2023-11-24T06:12:09.015 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T06:12:09.015 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560 --name rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} --verbose -- /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/orig.config.yaml 2023-11-24T06:12:09.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T06:12:09.140 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} email: null first_in_suite: false job_id: '7465560' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3305 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK571X5v8ybfW5xaL+9/jOldn0g12dbfgwdijBi196/sFnv87ZXK97WAtjgWmgzjyeqIfimHl2sjI2RS/LUwCEw= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN9RtF/LioMP8wF1Nn2EjNcSH9NOw6hdoWdwoIe+zgllor3fduKAXMcHtderaomSnjMpfFLiTZIei5/RJwWCvk8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_05:41:33 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T06:12:09.140 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa; will attempt to use it 2023-11-24T06:12:09.141 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks 2023-11-24T06:12:09.141 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T06:12:09.142 INFO:teuthology.task.internal:Checking packages... 2023-11-24T06:12:09.164 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T06:12:09.164 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T06:12:09.164 INFO:teuthology.packaging:ref: None 2023-11-24T06:12:09.164 INFO:teuthology.packaging:tag: None 2023-11-24T06:12:09.164 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T06:12:09.164 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:12:09.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T06:12:09.384 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:12:09.385 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T06:12:09.391 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T06:12:09.391 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T06:12:09.507 INFO:teuthology.task.internal:Saving configuration 2023-11-24T06:12:09.523 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T06:12:09.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:12:09.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 06:06:24.045567', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIESPJKq3HPgNSGy0+Z2dZXIKJXorq8CzSTZIi/17th6i'} 2023-11-24T06:12:09.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 06:06:24.046853', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE7nQMdpzjKConqtYNrWtMDLtewTly+ybeOoChM3CQT5'} 2023-11-24T06:12:09.584 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T06:12:09.591 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T06:12:09.591 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T06:12:09.591 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T06:12:09.674 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49377820d0>, signals=[15]) 2023-11-24T06:12:09.674 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T06:12:09.681 INFO:teuthology.task.internal:Opening connections... 2023-11-24T06:12:09.681 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:12:09.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:12:09.759 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:12:09.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:12:09.832 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T06:12:09.839 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-11-24T06:12:09.844 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-11-24T06:12:09.845 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-24T06:12:09.895 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-24T06:12:09.895 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-24T06:12:09.896 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2023-11-24T06:12:09.897 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-24T06:12:09.915 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-11-24T06:12:09.920 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-11-24T06:12:09.920 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="22.04" 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=jammy 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-11-24T06:12:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-24T06:12:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-24T06:12:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-24T06:12:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-24T06:12:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=jammy 2023-11-24T06:12:09.969 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-11-24T06:12:09.989 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T06:12:09.999 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T06:12:10.042 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T06:12:10.042 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2023-11-24T06:12:10.044 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-11-24T06:12:10.049 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T06:12:10.067 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T06:12:10.067 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2023-11-24T06:12:10.093 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-11-24T06:12:10.109 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T06:12:10.163 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T06:12:10.178 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T06:12:10.178 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-24T06:12:10.179 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-24T06:12:10.179 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T06:12:10.179 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T06:12:10.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:12:10.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-24T06:12:10.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:12:10.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-24T06:12:10.406 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T06:12:10.407 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T06:12:10.407 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-11-24T06:12:10.412 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-56-generic 2023-11-24T06:12:10.412 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T06:12:10.413 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T06:12:10.413 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-24T06:12:10.413 DEBUG:teuthology.orchestra.run.smithi146:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-24T06:12:10.417 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T06:12:10.417 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T06:12:10.418 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2023-11-24T06:12:10.423 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-56-generic 2023-11-24T06:12:10.423 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T06:12:10.423 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T06:12:10.424 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-24T06:12:10.424 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-24T06:12:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-24T06:12:10.486 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git config --global init.defaultBranch 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-11-24T06:12:10.599 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-24T06:12:10.600 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-24T06:12:10.600 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-11-24T06:12:10.600 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git branch -m 2023-11-24T06:12:10.601 INFO:teuthology.orchestra.run.smithi143.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-24T06:12:10.603 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-24T06:12:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-24T06:12:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-24T06:12:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: git config --global init.defaultBranch 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: 2023-11-24T06:12:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:hint: git branch -m 2023-11-24T06:12:10.623 INFO:teuthology.orchestra.run.smithi146.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-24T06:12:10.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-24T06:12:10.671 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-24T06:12:10.692 DEBUG:teuthology.orchestra.run.smithi146:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-24T06:12:10.728 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-24T06:12:10.749 DEBUG:teuthology.orchestra.run.smithi146:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-24T06:13:47.015 INFO:teuthology.orchestra.run.smithi143.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-24T06:13:47.015 INFO:teuthology.orchestra.run.smithi143.stderr: * [new branch] main -> origin/main 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190312 -> 20190312 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190416 -> 20190416 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190514 -> 20190514 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190618 -> 20190618 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190717 -> 20190717 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190815 -> 20190815 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190923 -> 20190923 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191022 -> 20191022 2023-11-24T06:13:47.046 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191215 -> 20191215 2023-11-24T06:13:47.048 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200122 -> 20200122 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200316 -> 20200316 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200421 -> 20200421 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200519 -> 20200519 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200619 -> 20200619 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200721 -> 20200721 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200817 -> 20200817 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200918 -> 20200918 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201022 -> 20201022 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201118 -> 20201118 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201218 -> 20201218 2023-11-24T06:13:47.049 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210208 -> 20210208 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210315 -> 20210315 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210511 -> 20210511 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210716 -> 20210716 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210818 -> 20210818 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210919 -> 20210919 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211027 -> 20211027 2023-11-24T06:13:47.050 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211216 -> 20211216 2023-11-24T06:13:47.052 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220209 -> 20220209 2023-11-24T06:13:47.052 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220310 -> 20220310 2023-11-24T06:13:47.052 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220411 -> 20220411 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220509 -> 20220509 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220610 -> 20220610 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220708 -> 20220708 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220815 -> 20220815 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220913 -> 20220913 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221012 -> 20221012 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221109 -> 20221109 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221214 -> 20221214 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230117 -> 20230117 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230210 -> 20230210 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230310 -> 20230310 2023-11-24T06:13:47.053 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230404 -> 20230404 2023-11-24T06:13:47.054 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230515 -> 20230515 2023-11-24T06:13:47.054 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230625 -> 20230625 2023-11-24T06:13:47.054 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230804 -> 20230804 2023-11-24T06:13:47.054 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230919 -> 20230919 2023-11-24T06:13:47.054 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231030 -> 20231030 2023-11-24T06:13:47.054 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231111 -> 20231111 2023-11-24T06:13:51.051 INFO:teuthology.orchestra.run.smithi143.stderr:Updating files: 51% (1665/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 64% (2109/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2648/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-24T06:13:51.055 INFO:teuthology.orchestra.run.smithi143.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-24T06:13:51.076 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T06:13:51.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T06:13:51.231 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-24T06:13:51.232 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-24T06:13:51.235 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi143.front.sepia.ceph.com to complete... 2023-11-24T06:13:52.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24 06:13:53 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-24T06:13:52.880 INFO:teuthology.orchestra.run.smithi143.stderr:FINISHED --2023-11-24 06:13:53-- 2023-11-24T06:13:52.880 INFO:teuthology.orchestra.run.smithi143.stderr:Total wall clock time: 1.6s 2023-11-24T06:13:52.881 INFO:teuthology.orchestra.run.smithi143.stderr:Downloaded: 1 files, 37M in 1.5s (25.0 MB/s) 2023-11-24T06:13:52.883 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T06:13:52.883 DEBUG:teuthology.orchestra.run.smithi143:> sudo dpkg -i /tmp/linux-image.deb 2023-11-24T06:13:53.111 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-24T06:13:55.153 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-24T06:13:55.157 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-24T06:13:55.315 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T06:13:58.801 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T06:13:58.903 INFO:teuthology.orchestra.run.smithi143.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T06:14:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-24T06:14:07.456 INFO:teuthology.orchestra.run.smithi146.stderr: * [new branch] main -> origin/main 2023-11-24T06:14:07.487 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190312 -> 20190312 2023-11-24T06:14:07.487 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190416 -> 20190416 2023-11-24T06:14:07.488 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190514 -> 20190514 2023-11-24T06:14:07.488 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190618 -> 20190618 2023-11-24T06:14:07.489 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190717 -> 20190717 2023-11-24T06:14:07.489 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190815 -> 20190815 2023-11-24T06:14:07.489 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190923 -> 20190923 2023-11-24T06:14:07.489 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20191022 -> 20191022 2023-11-24T06:14:07.489 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20191215 -> 20191215 2023-11-24T06:14:07.490 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200122 -> 20200122 2023-11-24T06:14:07.490 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200316 -> 20200316 2023-11-24T06:14:07.490 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200421 -> 20200421 2023-11-24T06:14:07.490 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200519 -> 20200519 2023-11-24T06:14:07.491 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200619 -> 20200619 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200721 -> 20200721 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200817 -> 20200817 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200918 -> 20200918 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20201022 -> 20201022 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20201118 -> 20201118 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20201218 -> 20201218 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20210208 -> 20210208 2023-11-24T06:14:07.492 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20210315 -> 20210315 2023-11-24T06:14:07.493 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20210511 -> 20210511 2023-11-24T06:14:07.493 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20210716 -> 20210716 2023-11-24T06:14:07.493 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20210818 -> 20210818 2023-11-24T06:14:07.493 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20210919 -> 20210919 2023-11-24T06:14:07.495 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20211027 -> 20211027 2023-11-24T06:14:07.495 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20211216 -> 20211216 2023-11-24T06:14:07.495 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220209 -> 20220209 2023-11-24T06:14:07.495 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220310 -> 20220310 2023-11-24T06:14:07.495 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220411 -> 20220411 2023-11-24T06:14:07.495 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220509 -> 20220509 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220610 -> 20220610 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220708 -> 20220708 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220815 -> 20220815 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20220913 -> 20220913 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20221012 -> 20221012 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20221109 -> 20221109 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20221214 -> 20221214 2023-11-24T06:14:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230117 -> 20230117 2023-11-24T06:14:07.497 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230210 -> 20230210 2023-11-24T06:14:07.497 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230310 -> 20230310 2023-11-24T06:14:07.497 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230404 -> 20230404 2023-11-24T06:14:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230515 -> 20230515 2023-11-24T06:14:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230625 -> 20230625 2023-11-24T06:14:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230804 -> 20230804 2023-11-24T06:14:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20230919 -> 20230919 2023-11-24T06:14:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20231030 -> 20231030 2023-11-24T06:14:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20231111 -> 20231111 2023-11-24T06:14:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:Updating files: 51% (1668/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2648/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-24T06:14:11.480 INFO:teuthology.orchestra.run.smithi146.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-24T06:14:11.500 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T06:14:11.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T06:14:11.718 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-24T06:14:11.719 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-24T06:14:11.721 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2023-11-24T06:14:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24 06:14:13 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-24T06:14:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2023-11-24 06:14:13-- 2023-11-24T06:14:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 1.5s 2023-11-24T06:14:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2023-11-24T06:14:13.229 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T06:14:13.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo dpkg -i /tmp/linux-image.deb 2023-11-24T06:14:13.489 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-24T06:14:15.463 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-24T06:14:15.467 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-24T06:14:15.709 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T06:14:18.991 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T06:14:19.119 INFO:teuthology.orchestra.run.smithi146.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T06:14:20.185 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2023-11-24T06:14:20.200 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T06:14:20.224 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2023-11-24T06:14:20.546 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T06:14:20.564 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T06:14:20.826 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T06:14:21.046 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T06:14:21.046 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T06:14:21.047 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T06:14:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T06:14:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T06:14:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T06:14:21.121 INFO:teuthology.orchestra.run.smithi143.stderr:done 2023-11-24T06:14:21.320 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-deb -c /tmp/linux-image.deb 2023-11-24T06:14:21.328 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-24T06:14:21.328 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-24T06:14:21.329 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T06:14:21.341 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-24T06:14:21.341 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T06:14:21.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-24T06:14:21.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-24T06:14:21.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-24T06:14:21.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-24T06:14:21.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-24T06:14:21.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T06:14:21.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-24T06:14:21.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T06:14:21.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-24T06:14:21.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-24T06:14:21.367 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-24T06:14:21.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T06:14:21.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T06:14:21.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T06:14:21.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T06:14:21.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T06:14:21.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T06:14:21.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T06:14:21.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T06:14:21.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T06:14:21.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T06:14:21.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T06:14:21.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T06:14:21.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T06:14:21.397 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T06:14:21.398 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-24T06:14:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-24T06:14:21.401 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-24T06:14:21.402 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-24T06:14:21.403 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T06:14:21.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-24T06:14:21.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T06:14:21.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T06:14:21.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T06:14:21.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-24T06:14:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-24T06:14:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-24T06:14:21.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T06:14:21.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-24T06:14:21.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T06:14:21.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T06:14:21.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T06:14:21.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T06:14:21.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T06:14:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-24T06:14:21.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T06:14:21.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T06:14:21.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T06:14:21.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-24T06:14:21.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T06:14:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T06:14:21.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T06:14:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T06:14:21.467 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T06:14:21.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T06:14:21.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T06:14:21.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-24T06:14:21.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T06:14:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-24T06:14:21.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T06:14:21.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T06:14:21.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-24T06:14:21.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-24T06:14:21.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-24T06:14:21.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-24T06:14:21.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T06:14:21.480 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T06:14:21.481 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-24T06:14:21.482 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-24T06:14:21.483 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T06:14:21.484 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T06:14:21.485 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T06:14:21.486 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T06:14:21.487 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-24T06:14:21.488 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-24T06:14:21.489 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-24T06:14:21.490 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-24T06:14:21.491 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-24T06:14:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-24T06:14:21.493 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-24T06:14:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T06:14:21.495 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-24T06:14:21.496 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-24T06:14:21.497 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T06:14:21.498 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-24T06:14:21.499 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T06:14:21.499 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T06:14:21.499 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-24T06:14:21.499 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-24T06:14:21.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T06:14:21.556 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T06:14:21.557 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-24T06:14:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T06:14:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T06:14:21.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-24T06:14:21.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-24T06:14:21.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-24T06:14:21.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T06:14:21.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T06:14:21.565 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-24T06:14:21.566 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T06:14:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T06:14:21.568 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T06:14:21.569 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T06:14:21.570 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T06:14:21.571 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T06:14:21.572 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T06:14:21.573 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-24T06:14:21.574 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T06:14:21.575 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-24T06:14:21.576 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T06:14:21.577 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-24T06:14:21.578 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-24T06:14:21.579 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-24T06:14:21.580 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T06:14:21.581 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T06:14:21.582 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T06:14:21.583 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T06:14:21.584 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-24T06:14:21.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-24T06:14:21.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-24T06:14:21.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T06:14:21.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T06:14:21.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T06:14:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T06:14:21.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T06:14:21.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T06:14:21.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T06:14:21.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-24T06:14:21.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T06:14:21.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-24T06:14:21.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-24T06:14:21.614 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T06:14:21.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-24T06:14:21.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-24T06:14:21.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T06:14:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T06:14:21.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-24T06:14:21.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-24T06:14:21.621 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T06:14:21.660 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-24T06:14:21.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T06:14:21.660 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-24T06:14:21.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T06:14:21.661 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-24T06:14:21.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T06:14:21.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-24T06:14:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T06:14:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T06:14:21.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T06:14:21.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T06:14:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T06:14:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-24T06:14:21.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-24T06:14:21.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-24T06:14:21.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-24T06:14:21.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-24T06:14:21.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T06:14:21.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T06:14:21.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T06:14:21.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T06:14:21.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T06:14:21.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T06:14:21.680 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T06:14:21.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T06:14:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T06:14:21.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T06:14:21.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T06:14:21.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T06:14:21.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T06:14:21.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T06:14:21.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T06:14:21.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T06:14:21.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T06:14:21.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T06:14:21.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T06:14:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T06:14:21.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T06:14:21.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T06:14:21.696 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T06:14:21.697 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T06:14:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T06:14:21.699 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T06:14:21.700 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T06:14:21.701 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-24T06:14:21.702 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-24T06:14:21.703 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T06:14:21.704 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T06:14:21.705 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T06:14:21.706 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T06:14:21.707 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-24T06:14:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-24T06:14:21.709 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T06:14:21.710 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-24T06:14:21.711 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-24T06:14:21.712 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T06:14:21.712 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-24T06:14:21.712 DEBUG:teuthology.orchestra.run.smithi143:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-24T06:14:21.719 INFO:teuthology.orchestra.run.smithi143.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T06:14:21.719 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T06:14:21.719 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T06:14:21.720 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-24T06:14:21.720 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-24T06:14:21.720 DEBUG:teuthology.orchestra.run.smithi143:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-24T06:14:21.763 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi143.front.sepia.ceph.com to complete... 2023-11-24T06:14:22.152 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2023-11-24T06:14:22.153 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T06:14:22.173 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2023-11-24T06:14:22.423 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T06:14:22.429 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T06:14:22.664 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T06:14:22.669 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T06:14:22.711 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T06:14:22.718 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T06:14:22.850 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T06:14:22.850 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T06:14:22.851 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T06:14:22.860 INFO:teuthology.orchestra.run.smithi143.stderr:done 2023-11-24T06:14:40.020 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2023-11-24T06:14:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T06:14:40.056 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-11-24T06:14:40.368 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T06:14:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T06:14:40.658 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T06:14:40.668 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T06:14:40.734 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T06:14:40.739 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T06:14:40.884 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T06:14:40.884 INFO:teuthology.orchestra.run.smithi146.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T06:14:40.884 INFO:teuthology.orchestra.run.smithi146.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T06:14:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-11-24T06:14:41.095 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-deb -c /tmp/linux-image.deb 2023-11-24T06:14:41.103 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-24T06:14:41.103 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-24T06:14:41.103 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T06:14:41.113 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-24T06:14:41.113 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-24T06:14:41.133 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T06:14:41.134 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T06:14:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T06:14:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T06:14:41.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T06:14:41.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-24T06:14:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T06:14:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T06:14:41.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T06:14:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T06:14:41.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T06:14:41.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T06:14:41.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T06:14:41.212 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T06:14:41.213 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T06:14:41.214 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-24T06:14:41.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T06:14:41.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-24T06:14:41.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-24T06:14:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-24T06:14:41.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-24T06:14:41.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T06:14:41.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-24T06:14:41.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-24T06:14:41.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-24T06:14:41.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-24T06:14:41.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T06:14:41.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T06:14:41.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T06:14:41.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T06:14:41.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T06:14:41.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T06:14:41.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T06:14:41.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T06:14:41.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T06:14:41.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-24T06:14:41.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T06:14:41.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T06:14:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T06:14:41.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T06:14:41.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T06:14:41.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T06:14:41.241 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T06:14:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T06:14:41.243 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T06:14:41.244 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T06:14:41.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T06:14:41.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T06:14:41.247 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T06:14:41.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T06:14:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-24T06:14:41.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T06:14:41.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-24T06:14:41.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-24T06:14:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T06:14:41.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-24T06:14:41.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-24T06:14:41.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-24T06:14:41.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T06:14:41.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T06:14:41.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T06:14:41.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-24T06:14:41.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-24T06:14:41.262 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-24T06:14:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-24T06:14:41.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T06:14:41.265 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T06:14:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T06:14:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T06:14:41.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T06:14:41.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T06:14:41.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T06:14:41.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T06:14:41.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T06:14:41.273 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-24T06:14:41.274 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-24T06:14:41.274 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T06:14:41.341 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-24T06:14:41.341 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T06:14:41.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T06:14:41.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-24T06:14:41.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-24T06:14:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-24T06:14:41.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T06:14:41.348 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T06:14:41.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-24T06:14:41.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T06:14:41.352 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T06:14:41.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T06:14:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-24T06:14:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-24T06:14:41.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T06:14:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-24T06:14:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-24T06:14:41.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T06:14:41.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T06:14:41.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-24T06:14:41.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T06:14:41.367 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-24T06:14:41.368 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T06:14:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-24T06:14:41.370 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T06:14:41.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T06:14:41.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-24T06:14:41.373 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-24T06:14:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T06:14:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T06:14:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T06:14:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-24T06:14:41.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-24T06:14:41.379 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T06:14:41.380 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-24T06:14:41.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T06:14:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-24T06:14:41.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-24T06:14:41.384 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-24T06:14:41.385 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-24T06:14:41.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-24T06:14:41.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-24T06:14:41.388 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-24T06:14:41.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-24T06:14:41.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-24T06:14:41.391 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-24T06:14:41.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T06:14:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T06:14:41.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T06:14:41.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-24T06:14:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T06:14:41.398 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T06:14:41.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T06:14:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T06:14:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T06:14:41.402 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-24T06:14:41.403 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T06:14:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T06:14:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T06:14:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-24T06:14:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-24T06:14:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T06:14:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-24T06:14:41.405 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-24T06:14:41.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-24T06:14:41.407 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T06:14:41.408 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T06:14:41.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-24T06:14:41.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T06:14:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-24T06:14:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-24T06:14:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-24T06:14:41.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T06:14:41.415 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T06:14:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T06:14:41.417 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T06:14:41.418 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T06:14:41.419 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T06:14:41.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T06:14:41.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T06:14:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T06:14:41.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T06:14:41.424 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T06:14:41.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-24T06:14:41.426 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T06:14:41.427 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-24T06:14:41.428 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T06:14:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T06:14:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-24T06:14:41.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T06:14:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T06:14:41.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T06:14:41.464 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T06:14:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T06:14:41.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T06:14:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T06:14:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-24T06:14:41.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T06:14:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T06:14:41.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T06:14:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-24T06:14:41.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T06:14:41.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T06:14:41.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T06:14:41.476 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-24T06:14:41.477 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T06:14:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T06:14:41.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T06:14:41.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T06:14:41.481 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T06:14:41.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T06:14:41.483 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T06:14:41.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T06:14:41.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T06:14:41.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T06:14:41.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T06:14:41.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T06:14:41.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T06:14:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T06:14:41.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-24T06:14:41.492 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T06:14:41.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T06:14:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T06:14:41.495 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T06:14:41.496 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-24T06:14:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T06:14:41.498 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T06:14:41.499 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-24T06:14:41.500 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-24T06:14:41.501 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T06:14:41.501 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-24T06:14:41.501 DEBUG:teuthology.orchestra.run.smithi146:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-24T06:14:41.508 INFO:teuthology.orchestra.run.smithi146.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T06:14:41.508 INFO:teuthology.orchestra.run.smithi146.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T06:14:41.508 INFO:teuthology.orchestra.run.smithi146.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T06:14:41.509 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-24T06:14:41.509 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-24T06:14:41.509 DEBUG:teuthology.orchestra.run.smithi146:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-24T06:14:41.553 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi146.front.sepia.ceph.com to complete... 2023-11-24T06:14:41.984 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2023-11-24T06:14:41.985 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T06:14:42.011 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-11-24T06:14:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T06:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T06:14:42.469 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T06:14:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T06:14:42.516 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T06:14:42.521 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T06:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T06:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T06:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T06:14:42.686 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-11-24T06:14:53.970 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-24T06:14:53.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-24T06:14:53.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:15:13.814 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-24T06:15:13.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-24T06:15:13.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:15:28.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-24T06:15:37.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-24T06:15:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:15:48.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-24T06:15:56.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-24T06:15:57.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-24T06:15:57.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:16:08.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-24T06:16:08.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:16:08.770 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-11-24T06:16:09.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-24T06:16:09.689 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-24T06:16:09.689 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2023-11-24T06:16:09.697 INFO:teuthology.orchestra.run.smithi143.stdout:6.6.0-g8247bbb5b470 2023-11-24T06:16:09.697 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T06:16:09.697 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T06:16:09.698 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-24T06:16:10.699 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:57.327 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T06:17:09.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-24T06:17:09.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:17:09.458 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-11-24T06:17:10.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-24T06:17:10.122 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-24T06:17:10.123 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-11-24T06:17:10.171 INFO:teuthology.orchestra.run.smithi146.stdout:6.6.0-g8247bbb5b470 2023-11-24T06:17:10.171 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T06:17:10.171 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T06:17:10.171 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-24T06:17:11.172 DEBUG:teuthology.parallel:result is None 2023-11-24T06:17:11.173 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T06:17:11.180 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T06:17:11.180 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T06:17:11.184 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T06:17:11.193 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T06:17:11.204 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T06:17:11.240 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T06:17:11.240 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T06:17:11.244 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T06:17:11.492 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T06:17:11.498 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T06:17:11.499 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T06:17:11.502 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T06:17:11.594 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:17:11.597 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:17:11.620 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:17:11.620 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:17:11.623 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T06:17:11.630 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T06:17:11.630 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T06:17:11.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T06:17:11.655 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T06:17:11.674 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T06:17:11.674 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T06:17:11.696 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T06:17:11.711 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:17:11.752 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:17:11.804 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:17:11.804 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T06:17:11.874 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:17:11.883 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:17:11.936 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:17:11.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T06:17:12.017 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2023-11-24T06:17:12.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-11-24T06:17:12.133 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T06:17:12.142 INFO:teuthology.task.internal:Starting timer... 2023-11-24T06:17:12.142 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T06:17:12.192 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T06:17:12.224 DEBUG:teuthology.task.selinux:Excluding smithi143: OS 'ubuntu' does not support SELinux 2023-11-24T06:17:12.224 DEBUG:teuthology.task.selinux:Excluding smithi146: OS 'ubuntu' does not support SELinux 2023-11-24T06:17:12.225 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T06:17:12.225 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-24T06:17:12.225 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T06:17:12.225 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T06:17:12.258 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-24T06:17:12.258 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T06:17:12.274 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T06:17:12.276 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi143.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T06:25:50.795 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi143.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2023-11-24T06:25:50.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-24T06:25:50.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:25:50.875 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-11-24T06:25:51.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-24T06:25:51.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-24T06:25:51.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:25:51.097 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-11-24T06:25:51.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-24T06:25:51.218 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T06:25:51.227 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T06:25:51.228 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:25:51.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:25:51.232 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:25:51.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:25:51.268 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-24T06:25:51.268 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Command line: ntpd -gq 2023-11-24T06:25:51.269 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: ---------------------------------------------------- 2023-11-24T06:25:51.269 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: ntp-4 is maintained by Network Time Foundation, 2023-11-24T06:25:51.269 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-24T06:25:51.269 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: corporation. Support and training for ntp-4 are 2023-11-24T06:25:51.269 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: available at https://www.nwtime.org/support 2023-11-24T06:25:51.269 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: ---------------------------------------------------- 2023-11-24T06:25:51.270 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: proto: precision = 0.045 usec (-24) 2023-11-24T06:25:51.270 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: basedate set to 2022-02-04 2023-11-24T06:25:51.270 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: gps base set to 2022-02-06 (week 2196) 2023-11-24T06:25:51.270 INFO:teuthology.orchestra.run.smithi143.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T06:25:51.271 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T06:25:51.271 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: restrict ::: KOD does nothing without LIMITED. 2023-11-24T06:25:51.272 INFO:teuthology.orchestra.run.smithi143.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listen and drop on 0 v6wildcard [::]:123 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listen normally on 2 lo 127.0.0.1:123 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listen normally on 3 enp3s0f1 172.21.15.143:123 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listen normally on 4 lo [::1]:123 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7783%5]:123 2023-11-24T06:25:51.273 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:51 ntpd[27989]: Listening on routing socket on fd #22 for interface updates 2023-11-24T06:25:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-24T06:25:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Command line: ntpd -gq 2023-11-24T06:25:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: ---------------------------------------------------- 2023-11-24T06:25:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: ntp-4 is maintained by Network Time Foundation, 2023-11-24T06:25:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-24T06:25:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: corporation. Support and training for ntp-4 are 2023-11-24T06:25:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: available at https://www.nwtime.org/support 2023-11-24T06:25:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: ---------------------------------------------------- 2023-11-24T06:25:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: proto: precision = 0.042 usec (-24) 2023-11-24T06:25:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: basedate set to 2022-02-04 2023-11-24T06:25:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: gps base set to 2022-02-06 (week 2196) 2023-11-24T06:25:51.299 INFO:teuthology.orchestra.run.smithi146.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T06:25:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T06:25:51.300 INFO:teuthology.orchestra.run.smithi146.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-24T06:25:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: restrict ::: KOD does nothing without LIMITED. 2023-11-24T06:25:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listen and drop on 0 v6wildcard [::]:123 2023-11-24T06:25:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-24T06:25:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listen normally on 2 lo 127.0.0.1:123 2023-11-24T06:25:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listen normally on 3 enp3s0f1 172.21.15.146:123 2023-11-24T06:25:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listen normally on 4 lo [::1]:123 2023-11-24T06:25:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:76fd%5]:123 2023-11-24T06:25:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:51 ntpd[28011]: Listening on routing socket on fd #22 for interface updates 2023-11-24T06:25:52.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:52 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:52.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:52 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:52.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:52 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:52.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:52 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:52.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:52 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:52.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:52 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:53.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:53.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:53.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:53.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:53 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:54.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:54.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:54 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:54 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:54 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:55.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:55 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:55 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:56 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:56 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:56 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:56 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:56 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:56 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:56 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:57.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:57 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:57.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:57 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:57.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:57 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:57.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:57 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:57.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:57 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:57.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:57 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:57.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:57.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:57.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:57.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:57.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:57.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:57 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:58.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:58.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:58.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:58.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:58.269 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:58.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:58.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:58.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:58.270 INFO:teuthology.orchestra.run.smithi143.stdout:24 Nov 06:25:58 ntpd[27989]: ntpd: time slew -0.002484 s 2023-11-24T06:25:58.270 INFO:teuthology.orchestra.run.smithi143.stdout:ntpd: time slew -0.002484s 2023-11-24T06:25:58.270 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-24T06:25:58.271 INFO:teuthology.orchestra.run.smithi143.stderr:24 Nov 06:25:58 ntpd[27989]: can't open /var/log/ntpstats/loopstats.20231124: Permission denied 2023-11-24T06:25:58.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:58 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:58.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:58 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:58.297 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:58 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:58 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:58 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:58 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:58.378 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T06:25:58.378 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2023-11-24T06:25:58.378 INFO:teuthology.orchestra.run.smithi143.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:58.378 INFO:teuthology.orchestra.run.smithi143.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:58.378 INFO:teuthology.orchestra.run.smithi143.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:58.378 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T06:25:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T06:25:59.299 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T06:25:59.299 INFO:teuthology.orchestra.run.smithi146.stdout:24 Nov 06:25:59 ntpd[28011]: ntpd: time slew +0.001567 s 2023-11-24T06:25:59.299 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time slew +0.001567s 2023-11-24T06:25:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-24T06:25:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:24 Nov 06:25:59 ntpd[28011]: can't open /var/log/ntpstats/loopstats.20231124: Permission denied 2023-11-24T06:25:59.391 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T06:25:59.391 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-11-24T06:25:59.391 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:59.392 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:59.392 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:59.392 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:25:59.393 INFO:teuthology.run_tasks:Running task install... 2023-11-24T06:25:59.401 DEBUG:teuthology.task.install:project ceph 2023-11-24T06:25:59.401 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T06:25:59.402 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T06:25:59.402 INFO:teuthology.task.install:Using flavor: default 2023-11-24T06:25:59.408 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T06:25:59.409 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T06:25:59.409 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-key list | grep Ceph 2023-11-24T06:25:59.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-key list | grep Ceph 2023-11-24T06:25:59.517 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-24T06:25:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-24T06:25:59.571 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-24T06:25:59.571 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph.com (release key) 2023-11-24T06:25:59.572 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-24T06:25:59.572 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-24T06:25:59.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:25:59.596 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-24T06:25:59.596 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph.com (release key) 2023-11-24T06:25:59.597 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-24T06:25:59.597 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-24T06:25:59.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:25:59.733 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default/ 2023-11-24T06:25:59.734 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:25:59.792 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default/ 2023-11-24T06:25:59.792 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:25:59.900 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:25:59.900 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-24T06:25:59.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-11-24T06:25:59.959 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:25:59.959 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-24T06:25:59.979 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2023-11-24T06:26:00.155 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy InRelease 2023-11-24T06:26:00.167 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-24T06:26:00.167 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-24T06:26:00.176 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-24T06:26:00.180 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-24T06:26:00.198 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-24T06:26:00.199 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-24T06:26:00.214 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy InRelease 2023-11-24T06:26:00.219 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-24T06:26:00.235 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-24T06:26:00.241 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-24T06:26:00.242 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-24T06:26:00.257 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-24T06:26:00.262 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-11-24T06:26:00.278 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-11-24T06:26:00.303 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-24T06:26:00.314 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-24T06:26:00.384 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-24T06:26:00.776 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 28.5 kB in 1s (49.6 kB/s) 2023-11-24T06:26:00.843 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 28.5 kB in 1s (40.5 kB/s) 2023-11-24T06:26:01.706 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-11-24T06:26:01.720 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-ga13ea5ff-1jammy cephadm=18.0.0-7484-ga13ea5ff-1jammy ceph-mds=18.0.0-7484-ga13ea5ff-1jammy ceph-mgr=18.0.0-7484-ga13ea5ff-1jammy ceph-common=18.0.0-7484-ga13ea5ff-1jammy ceph-fuse=18.0.0-7484-ga13ea5ff-1jammy ceph-test=18.0.0-7484-ga13ea5ff-1jammy ceph-volume=18.0.0-7484-ga13ea5ff-1jammy radosgw=18.0.0-7484-ga13ea5ff-1jammy python3-rados=18.0.0-7484-ga13ea5ff-1jammy python3-rgw=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy python3-rbd=18.0.0-7484-ga13ea5ff-1jammy libcephfs2=18.0.0-7484-ga13ea5ff-1jammy libcephfs-dev=18.0.0-7484-ga13ea5ff-1jammy librados2=18.0.0-7484-ga13ea5ff-1jammy librbd1=18.0.0-7484-ga13ea5ff-1jammy rbd-fuse=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy cephfs-shell=18.0.0-7484-ga13ea5ff-1jammy cephfs-top=18.0.0-7484-ga13ea5ff-1jammy cephfs-mirror=18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:26:01.779 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-11-24T06:26:01.794 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-ga13ea5ff-1jammy cephadm=18.0.0-7484-ga13ea5ff-1jammy ceph-mds=18.0.0-7484-ga13ea5ff-1jammy ceph-mgr=18.0.0-7484-ga13ea5ff-1jammy ceph-common=18.0.0-7484-ga13ea5ff-1jammy ceph-fuse=18.0.0-7484-ga13ea5ff-1jammy ceph-test=18.0.0-7484-ga13ea5ff-1jammy ceph-volume=18.0.0-7484-ga13ea5ff-1jammy radosgw=18.0.0-7484-ga13ea5ff-1jammy python3-rados=18.0.0-7484-ga13ea5ff-1jammy python3-rgw=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy python3-rbd=18.0.0-7484-ga13ea5ff-1jammy libcephfs2=18.0.0-7484-ga13ea5ff-1jammy libcephfs-dev=18.0.0-7484-ga13ea5ff-1jammy librados2=18.0.0-7484-ga13ea5ff-1jammy librbd1=18.0.0-7484-ga13ea5ff-1jammy rbd-fuse=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy cephfs-shell=18.0.0-7484-ga13ea5ff-1jammy cephfs-top=18.0.0-7484-ga13ea5ff-1jammy cephfs-mirror=18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:26:01.796 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-11-24T06:26:01.869 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-11-24T06:26:01.963 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2023-11-24T06:26:01.963 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2023-11-24T06:26:02.035 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-11-24T06:26:02.036 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-11-24T06:26:02.115 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T06:26:02.115 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T06:26:02.115 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T06:26:02.115 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T06:26:02.115 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T06:26:02.116 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T06:26:02.116 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T06:26:02.116 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2023-11-24T06:26:02.116 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-24T06:26:02.117 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-24T06:26:02.117 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-24T06:26:02.118 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T06:26:02.119 INFO:teuthology.orchestra.run.smithi143.stdout: socat xmlstarlet 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-24T06:26:02.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-watchdog 2023-11-24T06:26:02.121 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2023-11-24T06:26:02.121 INFO:teuthology.orchestra.run.smithi143.stdout: btrfs-tools 2023-11-24T06:26:02.188 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T06:26:02.189 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T06:26:02.189 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T06:26:02.189 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T06:26:02.189 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T06:26:02.189 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T06:26:02.189 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T06:26:02.190 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-11-24T06:26:02.190 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-24T06:26:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-24T06:26:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T06:26:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-24T06:26:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-24T06:26:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-24T06:26:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-24T06:26:02.192 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: socat xmlstarlet 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-24T06:26:02.193 INFO:teuthology.orchestra.run.smithi146.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-watchdog 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-11-24T06:26:02.194 INFO:teuthology.orchestra.run.smithi146.stdout: btrfs-tools 2023-11-24T06:26:02.266 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2023-11-24T06:26:02.267 INFO:teuthology.orchestra.run.smithi143.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-24T06:26:02.267 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-24T06:26:02.267 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-24T06:26:02.267 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-24T06:26:02.269 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T06:26:02.269 INFO:teuthology.orchestra.run.smithi143.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-24T06:26:02.269 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-24T06:26:02.269 INFO:teuthology.orchestra.run.smithi143.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-24T06:26:02.270 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-24T06:26:02.271 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T06:26:02.271 INFO:teuthology.orchestra.run.smithi143.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T06:26:02.271 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T06:26:02.271 INFO:teuthology.orchestra.run.smithi143.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T06:26:02.271 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T06:26:02.271 INFO:teuthology.orchestra.run.smithi143.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T06:26:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-24T06:26:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T06:26:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-24T06:26:02.406 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-24T06:26:02.406 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 186 MB of archives. 2023-11-24T06:26:02.406 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-24T06:26:02.406 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-24T06:26:02.415 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-24T06:26:02.416 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 186 MB of archives. 2023-11-24T06:26:02.416 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-24T06:26:02.416 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,458 kB] 2023-11-24T06:26:02.426 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-24T06:26:02.436 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-24T06:26:02.464 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-24T06:26:02.483 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,458 kB] 2023-11-24T06:26:02.496 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-24T06:26:02.510 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-24T06:26:02.512 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-24T06:26:02.526 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-24T06:26:02.546 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-24T06:26:02.571 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-24T06:26:02.573 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-24T06:26:02.582 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-24T06:26:02.585 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-24T06:26:02.585 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-24T06:26:02.592 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-24T06:26:02.592 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-24T06:26:02.593 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-24T06:26:02.593 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-24T06:26:02.594 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-24T06:26:02.597 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-24T06:26:02.615 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-24T06:26:02.615 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-24T06:26:02.616 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-24T06:26:02.616 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-24T06:26:02.616 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-24T06:26:02.618 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-24T06:26:02.619 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-24T06:26:02.619 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-24T06:26:02.620 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-24T06:26:02.633 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,112 kB] 2023-11-24T06:26:02.637 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-24T06:26:02.638 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-24T06:26:02.638 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-24T06:26:02.639 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-24T06:26:02.658 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-24T06:26:02.658 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-24T06:26:02.663 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-24T06:26:02.663 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-24T06:26:02.664 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-24T06:26:02.664 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-24T06:26:02.678 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-24T06:26:02.679 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-24T06:26:02.680 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-24T06:26:02.681 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-24T06:26:02.697 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-24T06:26:02.699 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-24T06:26:02.700 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-24T06:26:02.702 INFO:teuthology.orchestra.run.smithi146.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-24T06:26:02.738 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-ga13ea5ff-1jammy [690 kB] 2023-11-24T06:26:02.763 INFO:teuthology.orchestra.run.smithi146.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-24T06:26:02.765 INFO:teuthology.orchestra.run.smithi146.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-24T06:26:02.766 INFO:teuthology.orchestra.run.smithi146.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-24T06:26:02.766 INFO:teuthology.orchestra.run.smithi146.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-24T06:26:02.767 INFO:teuthology.orchestra.run.smithi146.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-24T06:26:02.767 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-ga13ea5ff-1jammy [356 kB] 2023-11-24T06:26:02.768 INFO:teuthology.orchestra.run.smithi146.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-24T06:26:02.779 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-ga13ea5ff-1jammy [32.8 kB] 2023-11-24T06:26:02.780 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-ga13ea5ff-1jammy [180 kB] 2023-11-24T06:26:02.786 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-ga13ea5ff-1jammy [63.5 kB] 2023-11-24T06:26:02.788 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-ga13ea5ff-1jammy [330 kB] 2023-11-24T06:26:02.794 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-24T06:26:02.795 INFO:teuthology.orchestra.run.smithi146.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-24T06:26:02.797 INFO:teuthology.orchestra.run.smithi146.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-24T06:26:02.797 INFO:teuthology.orchestra.run.smithi146.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-24T06:26:02.800 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-ga13ea5ff-1jammy [6,230 kB] 2023-11-24T06:26:02.825 INFO:teuthology.orchestra.run.smithi146.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-24T06:26:02.825 INFO:teuthology.orchestra.run.smithi146.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-24T06:26:02.825 INFO:teuthology.orchestra.run.smithi146.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-24T06:26:02.826 INFO:teuthology.orchestra.run.smithi146.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-24T06:26:02.826 INFO:teuthology.orchestra.run.smithi146.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-24T06:26:02.827 INFO:teuthology.orchestra.run.smithi146.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-24T06:26:02.842 INFO:teuthology.orchestra.run.smithi146.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-24T06:26:02.843 INFO:teuthology.orchestra.run.smithi146.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-24T06:26:02.846 INFO:teuthology.orchestra.run.smithi146.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-24T06:26:02.862 INFO:teuthology.orchestra.run.smithi146.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-24T06:26:02.865 INFO:teuthology.orchestra.run.smithi146.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-24T06:26:02.866 INFO:teuthology.orchestra.run.smithi146.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-24T06:26:02.868 INFO:teuthology.orchestra.run.smithi146.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-24T06:26:02.871 INFO:teuthology.orchestra.run.smithi146.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-24T06:26:02.871 INFO:teuthology.orchestra.run.smithi146.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-24T06:26:02.879 INFO:teuthology.orchestra.run.smithi146.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-24T06:26:02.887 INFO:teuthology.orchestra.run.smithi146.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-24T06:26:02.887 INFO:teuthology.orchestra.run.smithi146.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-24T06:26:02.888 INFO:teuthology.orchestra.run.smithi146.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-24T06:26:02.888 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-24T06:26:02.901 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-24T06:26:02.906 INFO:teuthology.orchestra.run.smithi146.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-24T06:26:02.908 INFO:teuthology.orchestra.run.smithi146.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-24T06:26:02.910 INFO:teuthology.orchestra.run.smithi146.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-24T06:26:02.918 INFO:teuthology.orchestra.run.smithi146.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-24T06:26:02.926 INFO:teuthology.orchestra.run.smithi146.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-24T06:26:02.926 INFO:teuthology.orchestra.run.smithi146.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-24T06:26:02.928 INFO:teuthology.orchestra.run.smithi146.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-24T06:26:02.929 INFO:teuthology.orchestra.run.smithi146.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-24T06:26:02.952 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-24T06:26:03.093 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-ga13ea5ff-1jammy [112 kB] 2023-11-24T06:26:03.093 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-ga13ea5ff-1jammy [439 kB] 2023-11-24T06:26:03.110 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-ga13ea5ff-1jammy [22.6 MB] 2023-11-24T06:26:03.126 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-24T06:26:03.136 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-24T06:26:03.163 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-24T06:26:03.171 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-24T06:26:03.335 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-24T06:26:03.409 INFO:teuthology.orchestra.run.smithi146.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,112 kB] 2023-11-24T06:26:03.909 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-ga13ea5ff-1jammy [6,900 kB] 2023-11-24T06:26:03.923 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-24T06:26:03.927 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-24T06:26:03.927 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-24T06:26:03.934 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-24T06:26:03.934 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-24T06:26:03.935 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-24T06:26:03.936 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-24T06:26:03.938 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-24T06:26:03.938 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-24T06:26:04.004 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-24T06:26:04.162 INFO:teuthology.orchestra.run.smithi146.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-ga13ea5ff-1jammy [690 kB] 2023-11-24T06:26:04.173 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-ga13ea5ff-1jammy [238 kB] 2023-11-24T06:26:04.179 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [124 kB] 2023-11-24T06:26:04.182 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-ga13ea5ff-1jammy [1,496 kB] 2023-11-24T06:26:04.187 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-24T06:26:04.241 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-ga13ea5ff-1jammy [9,955 kB] 2023-11-24T06:26:04.297 INFO:teuthology.orchestra.run.smithi146.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-ga13ea5ff-1jammy [356 kB] 2023-11-24T06:26:04.397 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-24T06:26:04.423 INFO:teuthology.orchestra.run.smithi146.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-ga13ea5ff-1jammy [32.8 kB] 2023-11-24T06:26:04.424 INFO:teuthology.orchestra.run.smithi146.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-ga13ea5ff-1jammy [180 kB] 2023-11-24T06:26:04.430 INFO:teuthology.orchestra.run.smithi146.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-ga13ea5ff-1jammy [63.5 kB] 2023-11-24T06:26:04.431 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-24T06:26:04.478 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-24T06:26:04.490 INFO:teuthology.orchestra.run.smithi146.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-ga13ea5ff-1jammy [330 kB] 2023-11-24T06:26:04.559 INFO:teuthology.orchestra.run.smithi146.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-ga13ea5ff-1jammy [6,230 kB] 2023-11-24T06:26:04.576 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-24T06:26:04.587 INFO:teuthology.orchestra.run.smithi143.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-24T06:26:04.593 INFO:teuthology.orchestra.run.smithi143.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-24T06:26:04.616 INFO:teuthology.orchestra.run.smithi143.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-ga13ea5ff-1jammy [31.8 MB] 2023-11-24T06:26:04.663 INFO:teuthology.orchestra.run.smithi143.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-24T06:26:04.685 INFO:teuthology.orchestra.run.smithi143.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-24T06:26:04.692 INFO:teuthology.orchestra.run.smithi143.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-24T06:26:04.810 INFO:teuthology.orchestra.run.smithi143.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-24T06:26:04.975 INFO:teuthology.orchestra.run.smithi143.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-24T06:26:05.172 INFO:teuthology.orchestra.run.smithi143.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-24T06:26:05.226 INFO:teuthology.orchestra.run.smithi143.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-24T06:26:05.385 INFO:teuthology.orchestra.run.smithi143.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-24T06:26:05.487 INFO:teuthology.orchestra.run.smithi143.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-24T06:26:05.506 INFO:teuthology.orchestra.run.smithi143.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-24T06:26:05.537 INFO:teuthology.orchestra.run.smithi143.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-24T06:26:05.551 INFO:teuthology.orchestra.run.smithi143.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-24T06:26:05.591 INFO:teuthology.orchestra.run.smithi143.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-24T06:26:05.599 INFO:teuthology.orchestra.run.smithi143.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-24T06:26:05.626 INFO:teuthology.orchestra.run.smithi143.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-24T06:26:05.835 INFO:teuthology.orchestra.run.smithi143.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [14.0 kB] 2023-11-24T06:26:05.835 INFO:teuthology.orchestra.run.smithi143.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [839 kB] 2023-11-24T06:26:05.861 INFO:teuthology.orchestra.run.smithi143.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-ga13ea5ff-1jammy [2,144 kB] 2023-11-24T06:26:05.945 INFO:teuthology.orchestra.run.smithi143.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-ga13ea5ff-1jammy [799 kB] 2023-11-24T06:26:05.969 INFO:teuthology.orchestra.run.smithi143.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-ga13ea5ff-1jammy [139 kB] 2023-11-24T06:26:05.980 INFO:teuthology.orchestra.run.smithi143.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-ga13ea5ff-1jammy [1,900 kB] 2023-11-24T06:26:06.018 INFO:teuthology.orchestra.run.smithi143.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-24T06:26:06.046 INFO:teuthology.orchestra.run.smithi146.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-ga13ea5ff-1jammy [112 kB] 2023-11-24T06:26:06.049 INFO:teuthology.orchestra.run.smithi146.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-ga13ea5ff-1jammy [439 kB] 2023-11-24T06:26:06.053 INFO:teuthology.orchestra.run.smithi143.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-ga13ea5ff-1jammy [8,625 kB] 2023-11-24T06:26:06.134 INFO:teuthology.orchestra.run.smithi146.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-ga13ea5ff-1jammy [22.6 MB] 2023-11-24T06:26:06.354 INFO:teuthology.orchestra.run.smithi143.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-24T06:26:06.383 INFO:teuthology.orchestra.run.smithi143.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-ga13ea5ff-1jammy [14.2 kB] 2023-11-24T06:26:06.384 INFO:teuthology.orchestra.run.smithi143.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-ga13ea5ff-1jammy [48.6 MB] 2023-11-24T06:26:06.441 INFO:teuthology.orchestra.run.smithi143.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-24T06:26:06.467 INFO:teuthology.orchestra.run.smithi143.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-24T06:26:06.479 INFO:teuthology.orchestra.run.smithi143.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-24T06:26:06.528 INFO:teuthology.orchestra.run.smithi143.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-24T06:26:06.777 INFO:teuthology.orchestra.run.smithi143.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-24T06:26:06.786 INFO:teuthology.orchestra.run.smithi143.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-24T06:26:06.787 INFO:teuthology.orchestra.run.smithi143.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-24T06:26:06.853 INFO:teuthology.orchestra.run.smithi143.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-24T06:26:06.853 INFO:teuthology.orchestra.run.smithi143.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-24T06:26:07.018 INFO:teuthology.orchestra.run.smithi143.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-24T06:26:07.225 INFO:teuthology.orchestra.run.smithi143.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-24T06:26:07.280 INFO:teuthology.orchestra.run.smithi143.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-24T06:26:07.368 INFO:teuthology.orchestra.run.smithi143.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-24T06:26:07.396 INFO:teuthology.orchestra.run.smithi143.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-24T06:26:07.427 INFO:teuthology.orchestra.run.smithi143.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-24T06:26:07.587 INFO:teuthology.orchestra.run.smithi143.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-24T06:26:07.624 INFO:teuthology.orchestra.run.smithi143.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-24T06:26:07.646 INFO:teuthology.orchestra.run.smithi143.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-24T06:26:07.655 INFO:teuthology.orchestra.run.smithi143.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-24T06:26:07.694 INFO:teuthology.orchestra.run.smithi143.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-24T06:26:07.881 INFO:teuthology.orchestra.run.smithi143.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-24T06:26:08.065 INFO:teuthology.orchestra.run.smithi143.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-24T06:26:08.270 INFO:teuthology.orchestra.run.smithi143.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-ga13ea5ff-1jammy [121 kB] 2023-11-24T06:26:08.271 INFO:teuthology.orchestra.run.smithi143.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-ga13ea5ff-1jammy [226 kB] 2023-11-24T06:26:08.273 INFO:teuthology.orchestra.run.smithi143.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-ga13ea5ff-1jammy [34.0 kB] 2023-11-24T06:26:08.273 INFO:teuthology.orchestra.run.smithi143.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-ga13ea5ff-1jammy [23.4 kB] 2023-11-24T06:26:08.274 INFO:teuthology.orchestra.run.smithi143.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-ga13ea5ff-1jammy [38.3 kB] 2023-11-24T06:26:08.274 INFO:teuthology.orchestra.run.smithi143.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-ga13ea5ff-1jammy [12.3 MB] 2023-11-24T06:26:08.475 INFO:teuthology.orchestra.run.smithi143.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-24T06:26:08.512 INFO:teuthology.orchestra.run.smithi143.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-24T06:26:08.512 INFO:teuthology.orchestra.run.smithi143.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-24T06:26:08.520 INFO:teuthology.orchestra.run.smithi143.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-24T06:26:08.523 INFO:teuthology.orchestra.run.smithi143.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-24T06:26:08.558 INFO:teuthology.orchestra.run.smithi143.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-24T06:26:08.565 INFO:teuthology.orchestra.run.smithi143.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-24T06:26:08.621 INFO:teuthology.orchestra.run.smithi143.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-24T06:26:08.622 INFO:teuthology.orchestra.run.smithi143.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-24T06:26:08.761 INFO:teuthology.orchestra.run.smithi143.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [91.3 kB] 2023-11-24T06:26:08.786 INFO:teuthology.orchestra.run.smithi143.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-24T06:26:09.242 INFO:teuthology.orchestra.run.smithi143.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-24T06:26:09.257 INFO:teuthology.orchestra.run.smithi143.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-24T06:26:09.430 INFO:teuthology.orchestra.run.smithi146.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-ga13ea5ff-1jammy [6,900 kB] 2023-11-24T06:26:09.864 INFO:teuthology.orchestra.run.smithi146.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-ga13ea5ff-1jammy [238 kB] 2023-11-24T06:26:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [124 kB] 2023-11-24T06:26:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-ga13ea5ff-1jammy [1,496 kB] 2023-11-24T06:26:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-ga13ea5ff-1jammy [9,955 kB] 2023-11-24T06:26:10.111 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 186 MB in 7s (25.6 MB/s) 2023-11-24T06:26:10.238 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-24T06:26:10.305 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-24T06:26:10.309 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-24T06:26:10.345 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-24T06:26:10.581 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-24T06:26:10.594 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-24T06:26:10.602 INFO:teuthology.orchestra.run.smithi146.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-ga13ea5ff-1jammy [31.8 MB] 2023-11-24T06:26:10.639 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T06:26:10.967 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cmd2. 2023-11-24T06:26:10.980 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-24T06:26:11.025 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-24T06:26:11.395 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-24T06:26:11.408 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-24T06:26:11.495 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T06:26:11.831 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-24T06:26:11.845 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-24T06:26:11.898 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T06:26:12.200 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-24T06:26:12.214 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-24T06:26:12.250 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T06:26:12.347 INFO:teuthology.orchestra.run.smithi146.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [14.0 kB] 2023-11-24T06:26:12.347 INFO:teuthology.orchestra.run.smithi146.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [839 kB] 2023-11-24T06:26:12.377 INFO:teuthology.orchestra.run.smithi146.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-ga13ea5ff-1jammy [2,144 kB] 2023-11-24T06:26:12.491 INFO:teuthology.orchestra.run.smithi146.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-ga13ea5ff-1jammy [799 kB] 2023-11-24T06:26:12.530 INFO:teuthology.orchestra.run.smithi146.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-ga13ea5ff-1jammy [139 kB] 2023-11-24T06:26:12.537 INFO:teuthology.orchestra.run.smithi146.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-ga13ea5ff-1jammy [1,900 kB] 2023-11-24T06:26:12.622 INFO:teuthology.orchestra.run.smithi146.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-ga13ea5ff-1jammy [8,625 kB] 2023-11-24T06:26:12.670 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-24T06:26:12.684 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T06:26:12.736 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:26:13.045 INFO:teuthology.orchestra.run.smithi146.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-ga13ea5ff-1jammy [14.2 kB] 2023-11-24T06:26:13.047 INFO:teuthology.orchestra.run.smithi146.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-ga13ea5ff-1jammy [48.6 MB] 2023-11-24T06:26:13.132 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-24T06:26:13.145 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T06:26:13.190 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:26:13.492 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-24T06:26:13.506 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T06:26:13.552 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:26:13.880 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-24T06:26:13.892 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-24T06:26:13.929 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T06:26:14.239 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librados2. 2023-11-24T06:26:14.253 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:14.306 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:14.742 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librbd1. 2023-11-24T06:26:14.757 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:14.801 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:15.194 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs2. 2023-11-24T06:26:15.208 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:15.215 INFO:teuthology.orchestra.run.smithi146.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-ga13ea5ff-1jammy [121 kB] 2023-11-24T06:26:15.216 INFO:teuthology.orchestra.run.smithi146.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-ga13ea5ff-1jammy [226 kB] 2023-11-24T06:26:15.218 INFO:teuthology.orchestra.run.smithi146.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-ga13ea5ff-1jammy [34.0 kB] 2023-11-24T06:26:15.218 INFO:teuthology.orchestra.run.smithi146.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-ga13ea5ff-1jammy [23.4 kB] 2023-11-24T06:26:15.219 INFO:teuthology.orchestra.run.smithi146.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-ga13ea5ff-1jammy [38.3 kB] 2023-11-24T06:26:15.219 INFO:teuthology.orchestra.run.smithi146.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-ga13ea5ff-1jammy [12.3 MB] 2023-11-24T06:26:15.278 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:15.547 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rados. 2023-11-24T06:26:15.560 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:15.588 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:15.711 INFO:teuthology.orchestra.run.smithi146.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [91.3 kB] 2023-11-24T06:26:15.899 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-24T06:26:15.913 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:15.958 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:16.243 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cephfs. 2023-11-24T06:26:16.257 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:16.282 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 186 MB in 13s (13.9 MB/s) 2023-11-24T06:26:16.302 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:16.423 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-24T06:26:16.490 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-24T06:26:16.493 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-24T06:26:16.546 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-24T06:26:16.604 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-24T06:26:16.617 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:16.654 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:16.966 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-24T06:26:16.979 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-24T06:26:17.007 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-prettytable. 2023-11-24T06:26:17.020 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-24T06:26:17.033 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T06:26:17.057 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-24T06:26:17.276 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rbd. 2023-11-24T06:26:17.289 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:17.326 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:17.410 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cmd2. 2023-11-24T06:26:17.425 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-24T06:26:17.477 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-24T06:26:17.670 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-24T06:26:17.684 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-24T06:26:17.720 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T06:26:17.913 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-24T06:26:17.928 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-24T06:26:18.014 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librgw2. 2023-11-24T06:26:18.028 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:18.030 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T06:26:18.064 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:18.417 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-24T06:26:18.432 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-24T06:26:18.475 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T06:26:18.517 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rgw. 2023-11-24T06:26:18.531 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:18.566 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:18.902 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-24T06:26:18.917 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-24T06:26:18.961 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T06:26:19.111 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-24T06:26:19.126 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-24T06:26:19.170 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T06:26:19.305 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libradosstriper1. 2023-11-24T06:26:19.320 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:19.363 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:19.606 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-24T06:26:19.621 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T06:26:19.674 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:26:19.809 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-common. 2023-11-24T06:26:19.824 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:19.867 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:20.018 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-24T06:26:20.033 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T06:26:20.068 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:26:20.387 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-24T06:26:20.402 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T06:26:20.437 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:26:20.807 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-24T06:26:20.822 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-24T06:26:20.865 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T06:26:20.939 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-base. 2023-11-24T06:26:20.954 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:21.006 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:21.185 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librados2. 2023-11-24T06:26:21.199 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:21.243 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:21.651 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-24T06:26:21.662 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librbd1. 2023-11-24T06:26:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-24T06:26:21.677 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:21.712 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:21.717 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-24T06:26:22.020 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cheroot. 2023-11-24T06:26:22.034 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-24T06:26:22.073 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2. 2023-11-24T06:26:22.078 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T06:26:22.088 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:22.140 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:22.417 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rados. 2023-11-24T06:26:22.431 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-24T06:26:22.432 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:22.445 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-24T06:26:22.476 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:22.489 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-24T06:26:22.758 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-24T06:26:22.772 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-24T06:26:22.808 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-24T06:26:22.828 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-24T06:26:22.843 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:22.886 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:23.119 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-24T06:26:23.130 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cephfs. 2023-11-24T06:26:23.133 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-24T06:26:23.145 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:23.178 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-24T06:26:23.180 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:23.425 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-24T06:26:23.439 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:23.463 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempora. 2023-11-24T06:26:23.477 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-24T06:26:23.483 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:23.538 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-24T06:26:23.819 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-prettytable. 2023-11-24T06:26:23.834 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-24T06:26:23.874 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-portend. 2023-11-24T06:26:23.877 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-24T06:26:23.888 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-24T06:26:23.933 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-24T06:26:24.202 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-24T06:26:24.216 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-24T06:26:24.259 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-24T06:26:24.271 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rbd. 2023-11-24T06:26:24.287 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:24.330 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:24.683 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-24T06:26:24.698 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-24T06:26:24.741 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T06:26:24.805 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-24T06:26:24.819 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-24T06:26:24.863 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-24T06:26:25.110 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2. 2023-11-24T06:26:25.125 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:25.177 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:25.200 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-natsort. 2023-11-24T06:26:25.213 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-24T06:26:25.249 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-24T06:26:25.552 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-logutils. 2023-11-24T06:26:25.566 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-24T06:26:25.611 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-24T06:26:25.687 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rgw. 2023-11-24T06:26:25.702 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:25.754 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:25.930 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-24T06:26:25.944 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-24T06:26:25.988 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-24T06:26:26.182 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-24T06:26:26.197 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-24T06:26:26.249 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T06:26:26.349 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-mako. 2023-11-24T06:26:26.363 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-24T06:26:26.407 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T06:26:26.568 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1. 2023-11-24T06:26:26.583 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:26.635 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:26.744 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-24T06:26:26.758 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-24T06:26:26.802 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-24T06:26:27.071 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-24T06:26:27.085 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-24T06:26:27.121 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-24T06:26:27.163 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common. 2023-11-24T06:26:27.177 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:27.229 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:27.457 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webob. 2023-11-24T06:26:27.472 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-24T06:26:27.516 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-24T06:26:27.868 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-waitress. 2023-11-24T06:26:27.883 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-24T06:26:27.929 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T06:26:28.262 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempita. 2023-11-24T06:26:28.277 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-24T06:26:28.312 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T06:26:28.443 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-base. 2023-11-24T06:26:28.458 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:28.527 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:28.573 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-paste. 2023-11-24T06:26:28.588 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-24T06:26:28.623 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T06:26:28.968 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-24T06:26:28.983 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-24T06:26:29.026 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T06:26:29.312 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-24T06:26:29.327 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-24T06:26:29.362 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-24T06:26:29.381 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-24T06:26:29.395 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-24T06:26:29.430 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-24T06:26:29.614 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webtest. 2023-11-24T06:26:29.630 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-24T06:26:29.706 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-24T06:26:29.758 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cheroot. 2023-11-24T06:26:29.773 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-24T06:26:29.817 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T06:26:30.034 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pecan. 2023-11-24T06:26:30.049 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-24T06:26:30.092 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T06:26:30.145 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-24T06:26:30.160 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-24T06:26:30.203 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-24T06:26:30.446 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-certifi. 2023-11-24T06:26:30.461 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-24T06:26:30.506 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-24T06:26:30.520 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-24T06:26:30.529 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-24T06:26:30.564 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-24T06:26:30.840 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-24T06:26:30.848 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-idna. 2023-11-24T06:26:30.855 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-24T06:26:30.863 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-24T06:26:30.894 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-24T06:26:30.907 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-24T06:26:31.196 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempora. 2023-11-24T06:26:31.211 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-24T06:26:31.218 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-urllib3. 2023-11-24T06:26:31.233 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-24T06:26:31.254 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-24T06:26:31.268 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T06:26:31.557 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-portend. 2023-11-24T06:26:31.572 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-24T06:26:31.615 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-24T06:26:31.620 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests. 2023-11-24T06:26:31.636 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-24T06:26:31.671 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T06:26:31.877 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-24T06:26:31.892 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-24T06:26:31.926 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-24T06:26:31.948 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-24T06:26:31.965 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-24T06:26:31.998 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T06:26:32.237 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-24T06:26:32.253 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-24T06:26:32.296 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-24T06:26:32.309 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-24T06:26:32.324 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:32.359 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:32.674 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-natsort. 2023-11-24T06:26:32.688 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-24T06:26:32.730 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-24T06:26:32.732 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-24T06:26:32.745 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:32.789 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:33.019 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-logutils. 2023-11-24T06:26:33.034 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-24T06:26:33.069 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-24T06:26:33.108 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-openssl. 2023-11-24T06:26:33.123 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-24T06:26:33.166 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-24T06:26:33.380 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-24T06:26:33.394 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-24T06:26:33.438 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-24T06:26:33.477 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr. 2023-11-24T06:26:33.493 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:33.527 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:33.741 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-mako. 2023-11-24T06:26:33.755 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-24T06:26:33.799 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T06:26:33.930 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mon. 2023-11-24T06:26:33.945 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:33.988 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-24T06:26:34.142 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-24T06:26:34.319 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-24T06:26:34.647 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-24T06:26:34.661 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-24T06:26:34.705 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-24T06:26:35.007 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webob. 2023-11-24T06:26:35.023 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-24T06:26:35.057 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-24T06:26:35.408 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-osd. 2023-11-24T06:26:35.423 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:35.466 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:35.961 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-waitress. 2023-11-24T06:26:35.975 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-24T06:26:36.013 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T06:26:36.288 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempita. 2023-11-24T06:26:36.303 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-24T06:26:36.346 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T06:26:36.649 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-paste. 2023-11-24T06:26:36.664 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-24T06:26:36.707 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T06:26:36.719 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph. 2023-11-24T06:26:36.735 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:36.778 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:37.011 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-24T06:26:37.025 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-24T06:26:37.069 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T06:26:37.122 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-fuse. 2023-11-24T06:26:37.137 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:37.180 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:37.405 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-24T06:26:37.420 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-24T06:26:37.471 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-24T06:26:37.491 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mds. 2023-11-24T06:26:37.506 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:37.541 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:37.841 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webtest. 2023-11-24T06:26:37.856 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-24T06:26:37.919 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephadm. 2023-11-24T06:26:37.925 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-24T06:26:37.934 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:37.977 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:38.288 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-24T06:26:38.304 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-24T06:26:38.319 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pecan. 2023-11-24T06:26:38.333 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-24T06:26:38.346 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-24T06:26:38.385 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T06:26:38.725 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-24T06:26:38.740 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T06:26:38.791 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T06:26:38.807 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-certifi. 2023-11-24T06:26:38.822 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-24T06:26:38.873 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-24T06:26:39.293 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-idna. 2023-11-24T06:26:39.308 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-24T06:26:39.351 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-24T06:26:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-urllib3. 2023-11-24T06:26:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-24T06:26:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T06:26:39.987 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-babel. 2023-11-24T06:26:40.001 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T06:26:40.045 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T06:26:40.090 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests. 2023-11-24T06:26:40.105 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-24T06:26:40.156 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T06:26:40.406 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jinja2. 2023-11-24T06:26:40.420 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-24T06:26:40.464 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-24T06:26:40.501 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-24T06:26:40.516 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-24T06:26:40.551 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T06:26:40.809 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-24T06:26:40.824 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:40.837 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-24T06:26:40.852 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:40.868 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:40.895 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:41.229 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-24T06:26:41.244 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-24T06:26:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-24T06:26:41.281 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:41.287 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-24T06:26:41.325 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:41.590 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-24T06:26:41.606 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-24T06:26:41.648 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-24T06:26:41.669 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-openssl. 2023-11-24T06:26:41.684 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-24T06:26:41.727 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-24T06:26:41.926 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-routes. 2023-11-24T06:26:41.941 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-24T06:26:41.976 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T06:26:42.030 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr. 2023-11-24T06:26:42.045 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:42.080 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:42.346 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-24T06:26:42.361 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:42.400 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon. 2023-11-24T06:26:42.403 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:42.415 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:42.458 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:42.873 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-24T06:26:42.888 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-24T06:26:42.940 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T06:26:43.328 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd. 2023-11-24T06:26:43.343 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:43.386 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:43.446 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-joblib. 2023-11-24T06:26:43.460 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-24T06:26:43.504 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T06:26:43.883 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-24T06:26:43.897 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-24T06:26:43.941 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-24T06:26:44.245 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn. 2023-11-24T06:26:44.259 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-24T06:26:44.303 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T06:26:44.723 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph. 2023-11-24T06:26:44.738 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:44.781 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:44.962 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-24T06:26:44.976 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:45.020 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:45.059 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse. 2023-11-24T06:26:45.074 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:45.109 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:45.470 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds. 2023-11-24T06:26:45.485 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:45.528 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:45.898 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephadm. 2023-11-24T06:26:45.913 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:45.956 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:46.016 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cachetools. 2023-11-24T06:26:46.031 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-24T06:26:46.074 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-24T06:26:46.267 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-24T06:26:46.283 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-24T06:26:46.334 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-24T06:26:46.402 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-24T06:26:46.418 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-24T06:26:46.460 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-24T06:26:46.678 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-24T06:26:46.694 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T06:26:46.737 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T06:26:46.780 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-24T06:26:46.796 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-24T06:26:46.839 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T06:26:47.133 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rsa. 2023-11-24T06:26:47.149 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-24T06:26:47.191 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-24T06:26:47.537 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-google-auth. 2023-11-24T06:26:47.553 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-24T06:26:47.587 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-24T06:26:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-babel. 2023-11-24T06:26:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T06:26:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T06:26:47.992 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-24T06:26:48.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-24T06:26:48.050 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T06:26:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jinja2. 2023-11-24T06:26:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-24T06:26:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-24T06:26:48.395 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-websocket. 2023-11-24T06:26:48.410 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-24T06:26:48.453 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-24T06:26:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-24T06:26:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:48.773 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-24T06:26:48.789 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-24T06:26:48.832 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T06:26:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-24T06:26:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-24T06:26:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-24T06:26:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-24T06:26:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-24T06:26:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-24T06:26:49.504 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-24T06:26:49.519 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:49.563 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-routes. 2023-11-24T06:26:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-24T06:26:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T06:26:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-24T06:26:49.905 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-24T06:26:49.949 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T06:26:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-24T06:26:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:50.261 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-24T06:26:50.275 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T06:26:50.319 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T06:26:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-24T06:26:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-24T06:26:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T06:26:50.605 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package jq. 2023-11-24T06:26:50.619 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T06:26:50.663 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-24T06:26:50.916 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package socat. 2023-11-24T06:26:50.930 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-24T06:26:50.975 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-24T06:26:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-joblib. 2023-11-24T06:26:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-24T06:26:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T06:26:51.287 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package xmlstarlet. 2023-11-24T06:26:51.301 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-24T06:26:51.345 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-24T06:26:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-24T06:26:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-24T06:26:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-24T06:26:51.733 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-test. 2023-11-24T06:26:51.746 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn. 2023-11-24T06:26:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-24T06:26:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T06:26:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-24T06:26:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:52.580 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:53.425 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cachetools. 2023-11-24T06:26:53.439 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-24T06:26:53.475 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-24T06:26:53.645 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-volume. 2023-11-24T06:26:53.661 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:53.703 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:53.795 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-24T06:26:53.810 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-24T06:26:53.852 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-24T06:26:54.083 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-24T06:26:54.098 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:54.141 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:54.181 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-24T06:26:54.196 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-24T06:26:54.230 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T06:26:54.470 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-colorama. 2023-11-24T06:26:54.485 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-24T06:26:54.525 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rsa. 2023-11-24T06:26:54.529 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-24T06:26:54.540 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-24T06:26:54.575 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-24T06:26:54.789 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-shell. 2023-11-24T06:26:54.804 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:54.847 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:55.304 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-google-auth. 2023-11-24T06:26:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-24T06:26:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-top. 2023-11-24T06:26:55.358 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:55.361 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-24T06:26:55.392 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:55.741 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-24T06:26:55.757 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-24T06:26:55.762 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-24T06:26:55.777 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:55.799 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T06:26:55.820 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:56.127 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-websocket. 2023-11-24T06:26:56.142 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-24T06:26:56.177 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-24T06:26:56.215 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package nvme-cli. 2023-11-24T06:26:56.231 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-24T06:26:56.273 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T06:26:56.447 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-24T06:26:56.463 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-24T06:26:56.497 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T06:26:56.578 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-24T06:26:56.593 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-24T06:26:56.637 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-24T06:26:57.048 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-24T06:26:57.062 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-24T06:26:57.102 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-24T06:26:57.106 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-24T06:26:57.116 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:26:57.186 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:57.410 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastescript. 2023-11-24T06:26:57.424 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-24T06:26:57.467 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-24T06:26:57.488 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-24T06:26:57.502 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-24T06:26:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T06:26:57.822 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pluggy. 2023-11-24T06:26:57.836 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-24T06:26:57.880 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-24T06:26:57.882 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-24T06:26:57.897 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T06:26:57.940 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T06:26:58.176 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package jq. 2023-11-24T06:26:58.182 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-psutil. 2023-11-24T06:26:58.192 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T06:26:58.198 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-24T06:26:58.235 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-24T06:26:58.241 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-24T06:26:58.504 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package socat. 2023-11-24T06:26:58.519 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-24T06:26:58.562 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-24T06:26:58.586 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-py. 2023-11-24T06:26:58.602 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-24T06:26:58.644 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-24T06:26:58.840 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package xmlstarlet. 2023-11-24T06:26:58.855 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-24T06:26:58.898 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-24T06:26:58.973 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pygments. 2023-11-24T06:26:58.988 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-24T06:26:59.030 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T06:26:59.253 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test. 2023-11-24T06:26:59.267 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:26:59.311 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:26:59.493 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-24T06:26:59.508 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-24T06:26:59.560 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-24T06:26:59.854 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-toml. 2023-11-24T06:26:59.869 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-24T06:26:59.912 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-24T06:27:00.216 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pytest. 2023-11-24T06:27:00.230 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-24T06:27:00.274 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T06:27:00.628 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplejson. 2023-11-24T06:27:00.642 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-24T06:27:00.686 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-24T06:27:00.980 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-24T06:27:00.995 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-24T06:27:01.038 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-24T06:27:01.148 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-volume. 2023-11-24T06:27:01.164 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:27:01.206 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:01.569 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-24T06:27:01.584 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:27:01.618 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:01.701 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package radosgw. 2023-11-24T06:27:01.715 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:27:01.759 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:01.921 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-colorama. 2023-11-24T06:27:01.938 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-24T06:27:01.980 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-24T06:27:02.266 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-shell. 2023-11-24T06:27:02.281 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:27:02.324 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:02.362 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package rbd-fuse. 2023-11-24T06:27:02.377 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:27:02.420 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:02.560 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-top. 2023-11-24T06:27:02.576 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T06:27:02.618 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:02.739 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-24T06:27:02.871 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-24T06:27:02.887 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:27:02.920 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:03.009 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T06:27:03.135 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T06:27:03.290 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package nvme-cli. 2023-11-24T06:27:03.306 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-24T06:27:03.348 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T06:27:03.403 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-24T06:27:03.695 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-24T06:27:03.710 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-24T06:27:03.753 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-24T06:27:03.770 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-24T06:27:04.198 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-24T06:27:04.212 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-24T06:27:04.256 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-24T06:27:04.356 INFO:teuthology.orchestra.run.smithi143.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-24T06:27:04.369 INFO:teuthology.orchestra.run.smithi143.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-24T06:27:04.421 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:04.594 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastescript. 2023-11-24T06:27:04.608 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-24T06:27:04.642 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-24T06:27:04.937 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pluggy. 2023-11-24T06:27:04.952 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-24T06:27:04.984 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user cephadm....done 2023-11-24T06:27:04.986 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-24T06:27:05.178 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T06:27:05.454 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-24T06:27:05.464 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-psutil. 2023-11-24T06:27:05.480 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-24T06:27:05.522 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-24T06:27:05.739 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-24T06:27:05.865 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-24T06:27:05.875 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-py. 2023-11-24T06:27:05.891 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-24T06:27:05.933 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-24T06:27:06.124 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-24T06:27:06.245 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pygments. 2023-11-24T06:27:06.261 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-24T06:27:06.303 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T06:27:06.375 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T06:27:06.501 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-24T06:27:06.790 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-24T06:27:06.805 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-24T06:27:06.812 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T06:27:06.848 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-24T06:27:07.151 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-toml. 2023-11-24T06:27:07.166 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-24T06:27:07.206 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-24T06:27:07.209 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-24T06:27:07.474 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-24T06:27:07.487 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pytest. 2023-11-24T06:27:07.503 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-24T06:27:07.537 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T06:27:07.741 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-24T06:27:07.832 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplejson. 2023-11-24T06:27:07.848 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-24T06:27:07.890 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-24T06:27:08.018 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-24T06:27:08.143 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-24T06:27:08.159 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-24T06:27:08.192 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-24T06:27:08.294 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-24T06:27:08.722 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-24T06:27:08.890 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw. 2023-11-24T06:27:08.905 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:27:08.940 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:08.988 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:09.264 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T06:27:09.407 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-24T06:27:09.560 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse. 2023-11-24T06:27:09.575 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T06:27:09.618 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:09.675 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-24T06:27:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-24T06:27:09.951 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T06:27:10.085 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-24T06:27:10.181 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T06:27:10.299 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T06:27:10.563 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-24T06:27:10.612 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T06:27:10.737 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-24T06:27:10.955 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-24T06:27:11.031 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T06:27:11.307 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-24T06:27:11.577 INFO:teuthology.orchestra.run.smithi146.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-24T06:27:11.590 INFO:teuthology.orchestra.run.smithi146.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-24T06:27:11.616 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T06:27:11.634 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:12.188 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user cephadm....done 2023-11-24T06:27:12.310 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T06:27:12.340 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T06:27:12.578 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T06:27:12.608 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-24T06:27:12.713 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-24T06:27:12.830 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T06:27:12.867 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-24T06:27:12.993 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-24T06:27:13.156 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-24T06:27:13.261 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-24T06:27:13.529 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T06:27:13.558 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-24T06:27:13.655 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-24T06:27:13.826 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T06:27:13.965 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T06:27:14.236 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T06:27:14.342 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-24T06:27:14.571 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-24T06:27:14.602 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-24T06:27:14.861 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-24T06:27:14.880 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T06:27:15.153 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-24T06:27:15.240 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-24T06:27:15.421 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-24T06:27:15.499 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-24T06:27:15.617 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:15.772 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-24T06:27:15.935 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-idna (3.3-1) ... 2023-11-24T06:27:16.023 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:16.308 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T06:27:16.311 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T06:27:16.425 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-24T06:27:16.684 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-24T06:27:16.944 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T06:27:17.070 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-24T06:27:17.455 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T06:27:17.534 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:27:17.580 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-24T06:27:17.702 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-24T06:27:17.848 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T06:27:17.978 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T06:27:18.099 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-24T06:27:18.104 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-24T06:27:18.230 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T06:27:18.392 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T06:27:18.532 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-24T06:27:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-24T06:27:19.051 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:27:19.077 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T06:27:19.177 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-24T06:27:19.345 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T06:27:19.479 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-24T06:27:19.487 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-24T06:27:19.605 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T06:27:19.755 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-24T06:27:19.923 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-24T06:27:20.023 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-24T06:27:20.282 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-24T06:27:20.307 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-24T06:27:20.525 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-24T06:27:20.742 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T06:27:20.801 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T06:27:20.936 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-24T06:27:21.135 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T06:27:21.245 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T06:27:21.363 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T06:27:21.436 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-24T06:27:21.664 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-24T06:27:21.771 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T06:27:21.966 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-24T06:27:22.130 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-24T06:27:22.233 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T06:27:22.365 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-24T06:27:22.466 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:22.676 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-24T06:27:22.759 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-idna (3.3-1) ... 2023-11-24T06:27:22.945 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T06:27:23.071 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T06:27:23.104 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T06:27:23.489 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-24T06:27:23.757 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-24T06:27:24.017 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:27:24.142 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-24T06:27:24.332 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:27:24.486 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T06:27:24.491 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-24T06:27:24.759 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T06:27:24.788 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T06:27:24.885 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-24T06:27:25.011 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T06:27:25.063 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-24T06:27:25.214 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-24T06:27:25.313 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-24T06:27:25.490 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-24T06:27:25.589 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-24T06:27:25.767 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T06:27:25.840 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:27:25.941 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-24T06:27:26.043 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-24T06:27:26.251 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-24T06:27:26.436 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-24T06:27:26.518 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-24T06:27:26.721 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T06:27:26.786 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-24T06:27:27.054 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-24T06:27:27.082 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T06:27:27.208 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:27.321 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-24T06:27:27.333 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:27.460 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:27.589 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T06:27:27.698 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-24T06:27:27.705 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:27.831 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:27.957 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-24T06:27:27.966 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T06:27:28.092 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T06:27:28.251 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:28.385 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-24T06:27:28.410 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:28.553 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:28.695 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-24T06:27:28.762 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T06:27:28.762 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T06:27:28.963 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T06:27:29.363 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-24T06:27:29.413 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:29.539 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:29.615 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T06:27:29.665 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:29.716 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T06:27:29.791 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T06:27:30.117 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-24T06:27:30.385 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-24T06:27:30.644 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T06:27:30.779 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-24T06:27:31.090 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:31.105 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T06:27:31.216 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:31.342 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:31.432 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T06:27:31.468 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:31.586 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:31.690 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-24T06:27:31.695 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:31.817 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-24T06:27:32.092 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-24T06:27:32.241 INFO:teuthology.orchestra.run.smithi143.stdout:Adding group ceph....done 2023-11-24T06:27:32.368 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T06:27:32.617 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user ceph....done 2023-11-24T06:27:32.645 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-24T06:27:32.845 INFO:teuthology.orchestra.run.smithi143.stdout:Setting system user ceph properties....done 2023-11-24T06:27:32.863 INFO:teuthology.orchestra.run.smithi143.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-24T06:27:33.005 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-24T06:27:33.046 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-24T06:27:33.331 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T06:27:33.399 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-24T06:27:33.666 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T06:27:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:33.951 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.132 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.280 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.323 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:27:34.323 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:27:34.381 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.491 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-24T06:27:34.792 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.890 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:34.944 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:35.016 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:35.084 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:35.306 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T06:27:35.306 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T06:27:35.562 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:27:35.563 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:27:35.938 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:36.064 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:36.127 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:36.189 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:36.291 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T06:27:36.493 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-24T06:27:37.163 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:37.417 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T06:27:37.417 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T06:27:37.578 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:37.704 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:37.805 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:37.906 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:38.015 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:38.032 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:38.142 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:38.244 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T06:27:38.244 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T06:27:38.712 INFO:teuthology.orchestra.run.smithi146.stdout:Adding group ceph....done 2023-11-24T06:27:38.866 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:39.087 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user ceph....done 2023-11-24T06:27:39.193 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T06:27:39.193 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T06:27:39.240 INFO:teuthology.orchestra.run.smithi146.stdout:Setting system user ceph properties....done 2023-11-24T06:27:39.262 INFO:teuthology.orchestra.run.smithi146.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-24T06:27:39.402 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-24T06:27:39.797 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-24T06:27:39.845 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:39.969 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:40.121 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:40.330 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T06:27:40.330 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T06:27:40.426 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:40.768 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:27:40.768 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:27:40.955 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:41.369 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:41.494 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:41.678 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:41.789 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:41.923 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:42.041 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:27:42.041 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:27:42.335 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T06:27:42.655 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:42.978 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-24T06:27:43.503 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T06:27:43.641 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:43.870 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T06:27:43.871 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T06:27:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T06:27:44.013 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-24T06:27:44.089 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-11-24T06:27:44.257 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2023-11-24T06:27:44.258 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T06:27:44.409 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-24T06:27:44.411 INFO:teuthology.orchestra.run.smithi143.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T06:27:44.412 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2023-11-24T06:27:44.412 INFO:teuthology.orchestra.run.smithi143.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-24T06:27:44.412 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-24T06:27:44.412 INFO:teuthology.orchestra.run.smithi143.stdout: libengine-pkcs11-openssl 2023-11-24T06:27:44.460 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2023-11-24T06:27:44.461 INFO:teuthology.orchestra.run.smithi143.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-24T06:27:44.462 INFO:teuthology.orchestra.run.smithi143.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-24T06:27:44.462 INFO:teuthology.orchestra.run.smithi143.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-24T06:27:44.462 INFO:teuthology.orchestra.run.smithi143.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-24T06:27:44.462 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-24T06:27:44.462 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-24T06:27:44.462 INFO:teuthology.orchestra.run.smithi143.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T06:27:44.463 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2023-11-24T06:27:44.463 INFO:teuthology.orchestra.run.smithi143.stdout: libssl3 2023-11-24T06:27:44.491 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:44.646 INFO:teuthology.orchestra.run.smithi143.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-24T06:27:44.647 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 54.6 MB of archives. 2023-11-24T06:27:44.647 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-24T06:27:44.647 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-24T06:27:44.705 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T06:27:44.705 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T06:27:45.144 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-24T06:27:45.309 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:45.401 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-24T06:27:45.435 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-24T06:27:45.437 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-24T06:27:45.442 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-24T06:27:45.445 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-24T06:27:45.446 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-24T06:27:45.450 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-24T06:27:45.452 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-24T06:27:45.617 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-24T06:27:45.617 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-24T06:27:45.673 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T06:27:45.673 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T06:27:45.879 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-24T06:27:46.707 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:46.833 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:46.892 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-24T06:27:46.894 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-24T06:27:46.894 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-24T06:27:46.897 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-24T06:27:46.898 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-24T06:27:46.924 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-24T06:27:46.926 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-24T06:27:46.933 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-24T06:27:46.984 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:47.097 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-24T06:27:47.198 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T06:27:47.198 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T06:27:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:47.838 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-24T06:27:47.838 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-24T06:27:47.864 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-24T06:27:47.943 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-24T06:27:47.951 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-24T06:27:47.951 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-24T06:27:47.952 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-24T06:27:47.953 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-24T06:27:47.982 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-24T06:27:47.985 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-24T06:27:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T06:27:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T06:27:48.610 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-24T06:27:48.691 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-24T06:27:48.692 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-24T06:27:48.692 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-24T06:27:48.787 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-24T06:27:48.804 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-24T06:27:49.247 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-24T06:27:49.251 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-24T06:27:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:Preconfiguring packages ... 2023-11-24T06:27:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T06:27:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2023-11-24T06:27:49.903 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package flex. 2023-11-24T06:27:49.976 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-24T06:27:49.980 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-24T06:27:50.044 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-24T06:27:50.191 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T06:27:50.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-24T06:27:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-11-24T06:27:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-11-24T06:27:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-11-24T06:27:50.582 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T06:27:50.591 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-11-24T06:27:50.592 INFO:teuthology.orchestra.run.smithi146.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-24T06:27:50.593 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-24T06:27:50.593 INFO:teuthology.orchestra.run.smithi146.stdout: libengine-pkcs11-openssl 2023-11-24T06:27:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-11-24T06:27:50.641 INFO:teuthology.orchestra.run.smithi146.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-24T06:27:50.641 INFO:teuthology.orchestra.run.smithi146.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-24T06:27:50.641 INFO:teuthology.orchestra.run.smithi146.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-24T06:27:50.641 INFO:teuthology.orchestra.run.smithi146.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-24T06:27:50.642 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-24T06:27:50.642 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-24T06:27:50.642 INFO:teuthology.orchestra.run.smithi146.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T06:27:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-11-24T06:27:50.643 INFO:teuthology.orchestra.run.smithi146.stdout: libssl3 2023-11-24T06:27:50.750 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-24T06:27:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-24T06:27:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 54.6 MB of archives. 2023-11-24T06:27:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-24T06:27:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-24T06:27:51.167 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T06:27:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-24T06:27:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-24T06:27:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-24T06:27:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-24T06:27:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-24T06:27:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-24T06:27:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-24T06:27:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-24T06:27:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-24T06:27:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-24T06:27:51.735 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package bison. 2023-11-24T06:27:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-24T06:27:51.808 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-24T06:27:51.812 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-24T06:27:51.863 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T06:27:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-24T06:27:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-24T06:27:52.303 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-24T06:27:52.347 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T06:27:52.675 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package dump. 2023-11-24T06:27:52.689 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-24T06:27:52.733 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking dump (0.4b47-3) ... 2023-11-24T06:27:53.037 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package indent. 2023-11-24T06:27:53.051 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:27:53.095 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T06:27:53.199 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-24T06:27:53.201 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-24T06:27:53.201 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-24T06:27:53.204 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-24T06:27:53.204 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-24T06:27:53.210 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-24T06:27:53.210 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-24T06:27:53.230 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-24T06:27:53.230 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-24T06:27:53.356 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-24T06:27:53.371 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-24T06:27:53.415 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T06:27:53.475 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-24T06:27:53.557 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-24T06:27:53.752 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-24T06:27:53.766 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-24T06:27:53.810 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T06:27:54.037 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-24T06:27:54.046 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-24T06:27:54.061 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-24T06:27:54.096 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T06:27:54.165 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-24T06:27:54.177 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-24T06:27:54.178 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-24T06:27:54.179 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-24T06:27:54.181 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-24T06:27:54.214 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-24T06:27:54.217 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-24T06:27:54.425 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-24T06:27:54.440 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-24T06:27:54.483 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T06:27:54.662 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-24T06:27:54.769 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-24T06:27:54.784 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-24T06:27:54.827 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-24T06:27:54.828 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T06:27:54.909 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-24T06:27:54.909 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-24T06:27:55.005 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-24T06:27:55.005 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-24T06:27:55.071 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjson-perl. 2023-11-24T06:27:55.088 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-24T06:27:55.121 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-24T06:27:55.433 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-24T06:27:55.449 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-24T06:27:55.468 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-24T06:27:55.469 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-24T06:27:55.491 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T06:27:55.857 INFO:teuthology.orchestra.run.smithi146.stdout:Preconfiguring packages ... 2023-11-24T06:27:56.023 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-11-24T06:27:56.166 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package flex. 2023-11-24T06:27:56.238 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-24T06:27:56.240 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-24T06:27:56.280 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-24T06:27:56.808 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T06:27:56.877 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-24T06:27:56.893 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T06:27:56.936 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:27:56.995 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-24T06:27:57.197 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-24T06:27:57.213 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T06:27:57.255 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:27:57.418 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T06:27:57.600 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-24T06:27:57.615 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T06:27:57.658 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:27:57.945 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package bison. 2023-11-24T06:27:57.969 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-24T06:27:57.986 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-24T06:27:58.018 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-24T06:27:58.021 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-24T06:27:58.027 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T06:27:58.072 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T06:27:58.372 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-24T06:27:58.388 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T06:27:58.431 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T06:27:58.506 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-24T06:27:58.521 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-24T06:27:58.564 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T06:27:58.750 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-24T06:27:58.765 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:27:58.808 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:27:58.901 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package dump. 2023-11-24T06:27:58.917 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-24T06:27:58.959 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking dump (0.4b47-3) ... 2023-11-24T06:27:59.153 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-24T06:27:59.168 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:27:59.204 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package indent. 2023-11-24T06:27:59.211 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:27:59.220 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:27:59.254 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T06:27:59.523 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-24T06:27:59.538 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:27:59.548 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-24T06:27:59.564 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-24T06:27:59.581 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:27:59.606 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T06:27:59.825 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-24T06:27:59.840 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T06:27:59.916 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T06:27:59.926 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-24T06:27:59.942 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-24T06:27:59.985 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T06:28:00.212 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-24T06:28:00.227 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-24T06:28:00.262 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T06:28:00.395 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-24T06:28:00.409 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-24T06:28:00.454 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T06:28:00.574 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-24T06:28:00.589 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-24T06:28:00.632 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T06:28:00.815 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package modemmanager. 2023-11-24T06:28:00.829 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T06:28:00.873 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:00.918 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-24T06:28:00.933 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-24T06:28:00.976 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T06:28:01.270 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjson-perl. 2023-11-24T06:28:01.286 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-24T06:28:01.320 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-24T06:28:01.488 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager. 2023-11-24T06:28:01.504 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T06:28:01.566 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-24T06:28:01.607 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-24T06:28:01.622 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-24T06:28:01.665 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T06:28:02.162 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ppp. 2023-11-24T06:28:02.178 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-24T06:28:02.533 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T06:28:02.867 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pptp-linux. 2023-11-24T06:28:02.881 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-24T06:28:02.925 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-24T06:28:03.018 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-24T06:28:03.034 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T06:28:03.075 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:28:03.187 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-24T06:28:03.201 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-24T06:28:03.261 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-24T06:28:03.345 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-24T06:28:03.360 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T06:28:03.403 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:28:03.532 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-24T06:28:03.546 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-24T06:28:03.581 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-common (238) ... 2023-11-24T06:28:03.706 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-24T06:28:03.722 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T06:28:03.755 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:03.885 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-24T06:28:03.900 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:03.944 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:04.075 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-24T06:28:04.091 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-24T06:28:04.133 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T06:28:04.494 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-24T06:28:04.510 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T06:28:04.532 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-common. 2023-11-24T06:28:04.547 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-24T06:28:04.555 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T06:28:04.608 INFO:teuthology.orchestra.run.smithi143.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-24T06:28:04.722 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-common (238) ... 2023-11-24T06:28:04.832 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-24T06:28:04.848 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:04.882 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:05.193 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-24T06:28:05.209 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:05.216 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-14. 2023-11-24T06:28:05.231 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:05.252 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:28:05.276 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:05.579 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-24T06:28:05.595 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:05.637 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:28:05.881 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-24T06:28:05.897 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T06:28:05.931 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T06:28:06.303 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql. 2023-11-24T06:28:06.317 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-24T06:28:06.361 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql (14+238) ... 2023-11-24T06:28:06.426 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-24T06:28:06.441 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-24T06:28:06.486 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T06:28:06.613 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client. 2023-11-24T06:28:06.628 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-24T06:28:06.672 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client (14+238) ... 2023-11-24T06:28:06.854 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package modemmanager. 2023-11-24T06:28:06.869 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T06:28:06.912 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:06.949 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-24T06:28:06.964 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-24T06:28:07.007 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-24T06:28:07.327 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl8.6. 2023-11-24T06:28:07.342 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-24T06:28:07.385 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T06:28:07.535 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package network-manager. 2023-11-24T06:28:07.551 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T06:28:07.601 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-24T06:28:07.705 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl. 2023-11-24T06:28:07.721 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-24T06:28:07.768 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-24T06:28:08.133 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package wpasupplicant. 2023-11-24T06:28:08.149 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-24T06:28:08.191 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T06:28:08.242 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ppp. 2023-11-24T06:28:08.258 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-24T06:28:08.554 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-24T06:28:08.563 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T06:28:08.570 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-24T06:28:08.612 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-24T06:28:08.879 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package pptp-linux. 2023-11-24T06:28:08.894 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-24T06:28:08.932 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-24T06:28:08.949 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-24T06:28:08.962 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-24T06:28:08.990 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T06:28:09.215 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-24T06:28:09.229 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-24T06:28:09.265 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-24T06:28:09.308 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-common (238) ... 2023-11-24T06:28:09.518 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-24T06:28:09.522 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-24T06:28:09.533 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-24T06:28:09.577 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client-common (238) ... 2023-11-24T06:28:09.640 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T06:28:09.766 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-24T06:28:09.892 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T06:28:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:10.040 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T06:28:10.169 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:10.535 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-common. 2023-11-24T06:28:10.551 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-24T06:28:10.613 INFO:teuthology.orchestra.run.smithi146.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-24T06:28:10.644 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-common (238) ... 2023-11-24T06:28:11.084 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-14. 2023-11-24T06:28:11.099 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T06:28:11.145 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:11.172 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-24T06:28:11.267 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T06:28:11.646 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T06:28:11.646 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T06:28:12.303 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql. 2023-11-24T06:28:12.318 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-24T06:28:12.361 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql (14+238) ... 2023-11-24T06:28:12.630 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client. 2023-11-24T06:28:12.645 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-24T06:28:12.688 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client (14+238) ... 2023-11-24T06:28:12.763 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T06:28:12.888 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T06:28:12.890 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-24T06:28:12.905 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-24T06:28:12.949 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-24T06:28:12.998 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-24T06:28:13.124 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T06:28:13.250 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T06:28:13.251 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package tcl8.6. 2023-11-24T06:28:13.266 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-24T06:28:13.309 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T06:28:13.376 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T06:28:13.502 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T06:28:13.596 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package tcl. 2023-11-24T06:28:13.611 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-24T06:28:13.658 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-24T06:28:13.982 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package wpasupplicant. 2023-11-24T06:28:13.998 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-24T06:28:14.040 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T06:28:14.182 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T06:28:14.310 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up dump (0.4b47-3) ... 2023-11-24T06:28:14.369 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-24T06:28:14.385 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-24T06:28:14.427 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-24T06:28:14.429 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-24T06:28:14.494 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:14.620 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T06:28:14.747 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-24T06:28:14.788 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-24T06:28:14.804 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-24T06:28:14.847 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T06:28:14.939 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-24T06:28:15.065 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T06:28:15.122 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client-common (238) ... 2023-11-24T06:28:15.154 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-24T06:28:15.225 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T06:28:15.294 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-24T06:28:15.376 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T06:28:15.412 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T06:28:15.538 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:15.552 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T06:28:15.672 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T06:28:15.678 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:28:15.798 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T06:28:15.805 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-24T06:28:15.924 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:15.956 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client (14+238) ... 2023-11-24T06:28:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-24T06:28:16.681 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:16.681 INFO:teuthology.orchestra.run.smithi143.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-24T06:28:16.681 INFO:teuthology.orchestra.run.smithi143.stdout:which means they are currently configured by ifupdown: 2023-11-24T06:28:16.681 INFO:teuthology.orchestra.run.smithi143.stdout:- enp3s0f1 2023-11-24T06:28:16.681 INFO:teuthology.orchestra.run.smithi143.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-24T06:28:16.682 INFO:teuthology.orchestra.run.smithi143.stdout:remove their configuration from /etc/network/interfaces. 2023-11-24T06:28:16.682 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:16.815 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-24T06:28:16.932 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-24T06:28:17.022 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T06:28:17.218 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-24T06:28:17.408 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T06:28:17.408 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T06:28:17.629 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-24T06:28:18.100 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T06:28:18.209 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T06:28:18.327 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-24T06:28:18.352 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:28:18.453 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T06:28:18.487 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T06:28:18.578 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T06:28:18.604 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-24T06:28:18.704 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T06:28:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-common (238) ... 2023-11-24T06:28:18.832 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T06:28:19.594 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T06:28:19.684 INFO:teuthology.orchestra.run.smithi143.stdout:Adding user postgres to group ssl-cert 2023-11-24T06:28:19.712 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up dump (0.4b47-3) ... 2023-11-24T06:28:19.807 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-24T06:28:19.888 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:19.955 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:19.956 INFO:teuthology.orchestra.run.smithi143.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-24T06:28:20.023 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T06:28:20.149 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-24T06:28:20.205 INFO:teuthology.orchestra.run.smithi143.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-24T06:28:20.205 INFO:teuthology.orchestra.run.smithi143.stdout:Removing obsolete dictionary files: 2023-11-24T06:28:20.275 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-24T06:28:20.393 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T06:28:20.465 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-24T06:28:20.527 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T06:28:20.636 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T06:28:20.838 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T06:28:20.876 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-24T06:28:20.964 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:28:21.099 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-24T06:28:21.266 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client (14+238) ... 2023-11-24T06:28:21.358 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:21.392 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-24T06:28:21.698 INFO:teuthology.orchestra.run.smithi143.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-24T06:28:21.721 INFO:teuthology.orchestra.run.smithi143.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-24T06:28:21.778 INFO:teuthology.orchestra.run.smithi143.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-24T06:28:21.778 INFO:teuthology.orchestra.run.smithi143.stdout:This user must also own the server process. 2023-11-24T06:28:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:21.779 INFO:teuthology.orchestra.run.smithi143.stdout:The database cluster will be initialized with locale "en_US". 2023-11-24T06:28:21.779 INFO:teuthology.orchestra.run.smithi143.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-24T06:28:21.779 INFO:teuthology.orchestra.run.smithi143.stdout:The default text search configuration will be set to "english". 2023-11-24T06:28:21.779 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:21.779 INFO:teuthology.orchestra.run.smithi143.stdout:Data page checksums are disabled. 2023-11-24T06:28:21.780 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:21.780 INFO:teuthology.orchestra.run.smithi143.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-24T06:28:21.781 INFO:teuthology.orchestra.run.smithi143.stdout:creating subdirectories ... ok 2023-11-24T06:28:21.781 INFO:teuthology.orchestra.run.smithi143.stdout:selecting dynamic shared memory implementation ... posix 2023-11-24T06:28:21.804 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default max_connections ... 100 2023-11-24T06:28:21.839 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default shared_buffers ... 128MB 2023-11-24T06:28:21.852 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default time zone ... Etc/UTC 2023-11-24T06:28:21.853 INFO:teuthology.orchestra.run.smithi143.stdout:creating configuration files ... ok 2023-11-24T06:28:22.021 INFO:teuthology.orchestra.run.smithi143.stdout:running bootstrap script ... ok 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout:which means they are currently configured by ifupdown: 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout:- enp3s0f1 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout:remove their configuration from /etc/network/interfaces. 2023-11-24T06:28:22.180 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:22.321 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-24T06:28:22.649 INFO:teuthology.orchestra.run.smithi143.stdout:performing post-bootstrap initialization ... ok 2023-11-24T06:28:22.729 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-24T06:28:23.139 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-24T06:28:23.184 INFO:teuthology.orchestra.run.smithi143.stdout:syncing data to disk ... ok 2023-11-24T06:28:23.703 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-24T06:28:23.844 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T06:28:23.990 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T06:28:24.122 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-24T06:28:24.240 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-common (238) ... 2023-11-24T06:28:25.150 INFO:teuthology.orchestra.run.smithi146.stdout:Adding user postgres to group ssl-cert 2023-11-24T06:28:25.406 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:25.407 INFO:teuthology.orchestra.run.smithi146.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-24T06:28:25.670 INFO:teuthology.orchestra.run.smithi146.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-24T06:28:25.671 INFO:teuthology.orchestra.run.smithi146.stdout:Removing obsolete dictionary files: 2023-11-24T06:28:26.377 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-24T06:28:26.643 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:28:26.768 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-24T06:28:26.894 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql (14+238) ... 2023-11-24T06:28:26.991 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T06:28:27.020 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:28:27.172 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:27.329 INFO:teuthology.orchestra.run.smithi146.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-24T06:28:27.353 INFO:teuthology.orchestra.run.smithi146.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-24T06:28:27.408 INFO:teuthology.orchestra.run.smithi146.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-24T06:28:27.408 INFO:teuthology.orchestra.run.smithi146.stdout:This user must also own the server process. 2023-11-24T06:28:27.408 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout:The database cluster will be initialized with locale "en_US". 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout:The default text search configuration will be set to "english". 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout:Data page checksums are disabled. 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:27.409 INFO:teuthology.orchestra.run.smithi146.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-24T06:28:27.410 INFO:teuthology.orchestra.run.smithi146.stdout:creating subdirectories ... ok 2023-11-24T06:28:27.410 INFO:teuthology.orchestra.run.smithi146.stdout:selecting dynamic shared memory implementation ... posix 2023-11-24T06:28:27.434 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default max_connections ... 100 2023-11-24T06:28:27.441 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T06:28:27.441 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T06:28:27.470 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default shared_buffers ... 128MB 2023-11-24T06:28:27.483 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default time zone ... Etc/UTC 2023-11-24T06:28:27.484 INFO:teuthology.orchestra.run.smithi146.stdout:creating configuration files ... ok 2023-11-24T06:28:27.653 INFO:teuthology.orchestra.run.smithi146.stdout:running bootstrap script ... ok 2023-11-24T06:28:28.182 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-24T06:28:28.297 INFO:teuthology.orchestra.run.smithi146.stdout:performing post-bootstrap initialization ... ok 2023-11-24T06:28:28.492 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T06:28:28.643 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T06:28:28.808 INFO:teuthology.orchestra.run.smithi146.stdout:syncing data to disk ... ok 2023-11-24T06:28:29.333 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-24T06:28:30.079 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-24T06:28:30.179 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-24T06:28:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T06:28:30.884 DEBUG:teuthology.parallel:result is None 2023-11-24T06:28:32.290 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:28:32.416 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-24T06:28:32.542 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql (14+238) ... 2023-11-24T06:28:32.693 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T06:28:32.819 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T06:28:33.080 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T06:28:33.080 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T06:28:33.838 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-24T06:28:34.156 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T06:28:34.291 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T06:28:35.677 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-24T06:28:35.769 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-24T06:28:36.445 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T06:28:36.449 DEBUG:teuthology.parallel:result is None 2023-11-24T06:28:36.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:28:36.670 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-query -W -f '${Version}' ceph 2023-11-24T06:28:36.694 INFO:teuthology.orchestra.run.smithi143.stdout:18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:28:36.695 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:28:36.695 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-ga13ea5ff-1jammy is installed. 2023-11-24T06:28:36.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:28:36.915 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-query -W -f '${Version}' ceph 2023-11-24T06:28:36.938 INFO:teuthology.orchestra.run.smithi146.stdout:18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:28:36.938 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T06:28:36.938 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-ga13ea5ff-1jammy is installed. 2023-11-24T06:28:36.939 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T06:28:36.939 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:36.939 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:28:36.962 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:36.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:28:37.004 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T06:28:37.005 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:37.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:28:37.027 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:28:37.095 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:37.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:28:37.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:28:37.175 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T06:28:37.175 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:37.175 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:28:37.197 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:28:37.259 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:37.259 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:28:37.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:28:37.342 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T06:28:37.343 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:37.344 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:28:37.366 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:28:37.427 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:37.427 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:28:37.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:28:37.511 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T06:28:37.600 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T06:28:37.600 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2023-11-24T06:28:37.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-11-24T06:28:37.625 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T06:28:37.625 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:28:37.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:28:37.694 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T06:28:37.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:28:37.738 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:28:37.765 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T06:28:37.765 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T06:28:37.765 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T06:28:37.766 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:37.766 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:28:37.807 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:28:37.900 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:37.900 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:28:37.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:28:38.005 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T06:28:38.005 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T06:28:38.006 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}', 'email': None, 'first_in_suite': False, 'job_id': '7465560', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3305, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK571X5v8ybfW5xaL+9/jOldn0g12dbfgwdijBi196/sFnv87ZXK97WAtjgWmgzjyeqIfimHl2sjI2RS/LUwCEw=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN9RtF/LioMP8wF1Nn2EjNcSH9NOw6hdoWdwoIe+zgllor3fduKAXMcHtderaomSnjMpfFLiTZIei5/RJwWCvk8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_05:41:33', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T06:28:38.006 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:28:38.011 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:28:38.023 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:28:38.061 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:28:38.083 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:38.083 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:28:38.131 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:28:38.131 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2023-11-24T06:28:38.187 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:28:38.187 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:38.187 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-11-24T06:28:38.187 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:38.188 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-11-24 06:22:13.368342892 +0000 2023-11-24T06:28:38.188 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-11-24 06:22:12.928346822 +0000 2023-11-24T06:28:38.188 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-11-24 06:22:12.928346822 +0000 2023-11-24T06:28:38.188 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-11-24 06:22:12.928346822 +0000 2023-11-24T06:28:38.188 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:28:38.250 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-11-24T06:28:38.250 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-11-24T06:28:38.250 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000396395 s, 1.3 MB/s 2023-11-24T06:28:38.252 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:28:38.305 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-11-24 06:22:14.012337143 +0000 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-11-24 06:22:13.612340715 +0000 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-11-24 06:22:13.612340715 +0000 2023-11-24T06:28:38.355 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-11-24 06:22:13.612340715 +0000 2023-11-24T06:28:38.356 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:28:38.421 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-11-24T06:28:38.422 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-11-24T06:28:38.422 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000388225 s, 1.3 MB/s 2023-11-24T06:28:38.423 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:28:38.477 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-11-24 06:22:14.696331034 +0000 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-11-24 06:22:14.308334497 +0000 2023-11-24T06:28:38.527 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-11-24 06:22:14.308334497 +0000 2023-11-24T06:28:38.528 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-11-24 06:22:14.308334497 +0000 2023-11-24T06:28:38.528 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:28:38.590 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-11-24T06:28:38.590 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-11-24T06:28:38.590 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000385066 s, 1.3 MB/s 2023-11-24T06:28:38.592 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:28:38.645 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2023-11-24T06:28:38.695 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:28:38.695 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:38.695 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 949 Links: 1 2023-11-24T06:28:38.695 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:38.695 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-11-24 06:22:15.380324924 +0000 2023-11-24T06:28:38.695 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-11-24 06:22:14.980328498 +0000 2023-11-24T06:28:38.696 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-11-24 06:22:14.980328498 +0000 2023-11-24T06:28:38.696 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-11-24 06:22:14.980328498 +0000 2023-11-24T06:28:38.696 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:28:38.757 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-11-24T06:28:38.758 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-11-24T06:28:38.758 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00040207 s, 1.3 MB/s 2023-11-24T06:28:38.759 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:28:38.813 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:38.814 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:38.814 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:28:38.824 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:28:38.824 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2023-11-24T06:28:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-11-24 06:22:13.569578387 +0000 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-11-24 06:22:13.193581746 +0000 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-11-24 06:22:13.193581746 +0000 2023-11-24T06:28:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-11-24 06:22:13.193581746 +0000 2023-11-24T06:28:38.882 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:28:38.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-11-24T06:28:38.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-11-24T06:28:38.947 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000384385 s, 1.3 MB/s 2023-11-24T06:28:38.949 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:28:39.002 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2023-11-24T06:28:39.052 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:28:39.052 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:39.053 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 915 Links: 1 2023-11-24T06:28:39.053 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:39.053 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-11-24 06:22:14.213572635 +0000 2023-11-24T06:28:39.053 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-11-24 06:22:13.817576172 +0000 2023-11-24T06:28:39.053 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-11-24 06:22:13.817576172 +0000 2023-11-24T06:28:39.053 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-11-24 06:22:13.817576172 +0000 2023-11-24T06:28:39.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:28:39.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-11-24T06:28:39.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-11-24T06:28:39.115 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000382047 s, 1.3 MB/s 2023-11-24T06:28:39.117 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:28:39.174 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2023-11-24T06:28:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:28:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:39.225 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-24T06:28:39.225 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:39.225 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-11-24 06:22:14.861566847 +0000 2023-11-24T06:28:39.225 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-11-24 06:22:14.465570384 +0000 2023-11-24T06:28:39.225 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-11-24 06:22:14.465570384 +0000 2023-11-24T06:28:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-11-24 06:22:14.465570384 +0000 2023-11-24T06:28:39.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:28:39.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-11-24T06:28:39.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-11-24T06:28:39.291 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000384304 s, 1.3 MB/s 2023-11-24T06:28:39.292 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:28:39.346 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 949 Links: 1 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-11-24 06:22:15.121564525 +0000 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-11-24 06:22:15.117564559 +0000 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-11-24 06:22:15.117564559 +0000 2023-11-24T06:28:39.396 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-11-24 06:22:15.117564559 +0000 2023-11-24T06:28:39.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:28:39.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-11-24T06:28:39.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-11-24T06:28:39.463 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000400725 s, 1.3 MB/s 2023-11-24T06:28:39.464 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:28:39.523 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:39.523 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:28:39.523 INFO:tasks.ceph:Generating config... 2023-11-24T06:28:39.525 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T06:28:39.526 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T06:28:39.526 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T06:28:39.526 INFO:tasks.ceph:[client] pid file = 2023-11-24T06:28:39.526 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T06:28:39.526 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T06:28:39.527 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-24T06:28:39.527 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T06:28:39.527 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T06:28:39.527 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T06:28:39.527 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T06:28:39.527 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T06:28:39.528 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T06:28:39.528 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T06:28:39.528 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T06:28:39.528 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T06:28:39.528 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T06:28:39.528 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T06:28:39.529 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T06:28:39.530 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T06:28:39.530 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T06:28:39.530 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T06:28:39.530 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T06:28:39.530 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T06:28:39.530 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T06:28:39.531 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T06:28:39.531 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T06:28:39.533 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T06:28:39.533 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T06:28:39.534 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T06:28:39.581 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T06:28:39.611 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T06:28:39.705 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:28:39.726 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.143'), ('mon.b', '172.21.15.146'), ('mon.c', '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]')] 2023-11-24T06:28:39.727 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.143,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T06:28:39.728 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:39.728 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:28:39.782 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.143 --add b 172.21.15.146 --addv c '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:39.873 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: generated fsid 039ed6d4-b5c2-4e8e-a15f-05a601a78248 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:setting min_mon_release = pacific 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:epoch 0 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:fsid 039ed6d4-b5c2-4e8e-a15f-05a601a78248 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:last_changed 2023-11-24T06:28:39.875329+0000 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:created 2023-11-24T06:28:39.875329+0000 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:min_mon_release 16 (pacific) 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:election_strategy: 1 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2023-11-24T06:28:39.874 INFO:teuthology.orchestra.run.smithi143.stdout:2: [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] mon.c 2023-11-24T06:28:39.875 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T06:28:39.877 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:28:39.886 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 039ed6d4-b5c2-4e8e-a15f-05a601a78248... 2023-11-24T06:28:39.887 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:28:39.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:28:39.970 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2023-11-24T06:28:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2023-11-24T06:28:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:28:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2023-11-24T06:28:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:28:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2023-11-24T06:28:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.143,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 039ed6d4-b5c2-4e8e-a15f-05a601a78248 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2023-11-24T06:28:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2023-11-24T06:28:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: bdev async discard = True 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: bdev enable discard = True 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore allocator = bitmap 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 1/20 2023-11-24T06:28:39.976 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 1/20 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 4/10 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-11-24T06:28:39.977 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug finisher = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2023-11-24T06:28:39.978 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.979 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2023-11-24T06:28:39.980 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2023-11-24T06:28:39.981 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2023-11-24T06:28:39.982 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2023-11-24T06:28:39.982 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2023-11-24T06:28:39.982 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2023-11-24T06:28:39.983 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2023-11-24T06:28:39.983 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2023-11-24T06:28:39.983 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = True 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2023-11-24T06:28:39.984 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.986 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:28:39.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-11-24T06:28:39.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.988 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:28:39.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.988 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-11-24T06:28:39.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.988 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.143,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 039ed6d4-b5c2-4e8e-a15f-05a601a78248 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-11-24T06:28:39.989 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.990 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-11-24T06:28:39.991 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-11-24T06:28:39.992 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug finisher = 20 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-11-24T06:28:39.993 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:28:39.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-11-24T06:28:39.995 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-11-24T06:28:39.996 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-11-24T06:28:39.997 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-11-24T06:28:39.999 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T06:28:39.999 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T06:28:40.102 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T06:28:40.102 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:40.103 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T06:28:40.111 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:40.112 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T06:28:40.162 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:28:40.162 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:40.162 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:28:40.162 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:28:40.243 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:28:40.243 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:40.295 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:28:40.295 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:40.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:28:40.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:28:40.332 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:28:40.332 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:40.383 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T06:28:40.383 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T06:28:40.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:28:40.439 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:28:40.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:28:40.503 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:28:40.521 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T06:28:40.521 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:28:40.578 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:28:40.582 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T06:28:40.603 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:28:40.701 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:28:40.706 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T06:28:40.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:28:40.786 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:28:40.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T06:28:40.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:28:40.912 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:28:40.916 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T06:28:40.936 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T06:28:40.937 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T06:28:40.980 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T06:28:40.997 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T06:28:41.080 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T06:28:41.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T06:28:41.140 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T06:28:41.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T06:28:41.242 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T06:28:41.259 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T06:28:41.259 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:28:41.259 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T06:28:41.280 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:41.280 INFO:tasks.ceph:role: osd.0 2023-11-24T06:28:41.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:28:41.281 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:28:41.350 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:41.350 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:41.350 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:41.351 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:41.351 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:41.352 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:41.352 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:41.352 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:41.352 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:41.352 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:41.805 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-11-24T06:28:41.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-11-24T06:28:41.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T06:28:41.919 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T06:28:41.936 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:41.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:41.938 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T06:28:42.002 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:42.002 INFO:tasks.ceph:role: osd.1 2023-11-24T06:28:42.003 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:28:42.003 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:42.080 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:42.581 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-11-24T06:28:42.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-11-24T06:28:42.584 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T06:28:42.734 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T06:28:42.752 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:42.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:42.753 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T06:28:42.819 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:42.820 INFO:tasks.ceph:role: osd.2 2023-11-24T06:28:42.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:28:42.820 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:42.891 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:42.892 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:42.892 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:42.892 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:43.371 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-11-24T06:28:43.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-11-24T06:28:43.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T06:28:43.498 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T06:28:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:43.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:43.518 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T06:28:43.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:43.584 INFO:tasks.ceph:role: osd.3 2023-11-24T06:28:43.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:28:43.584 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:28:43.656 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:43.656 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:43.656 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:43.657 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:44.108 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-11-24T06:28:44.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-11-24T06:28:44.111 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T06:28:44.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T06:28:44.243 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:44.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:44.244 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:44.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:44.369+0000 7f81d4aec640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T06:28:44.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:44.373+0000 7f81d4aec640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T06:28:44.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:44.373+0000 7f81d4aec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:28:44.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:44.373+0000 7f81d4aec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:28:44.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:44.373+0000 7f81d4aec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:28:44.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:44.377+0000 7f81d4aec640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T06:28:47.379 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T06:28:47.401 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:47.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:47.493+0000 7f29c3f3a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T06:28:47.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:47.497+0000 7f29c3f3a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T06:28:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:47.497+0000 7f29c3f3a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:28:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:47.497+0000 7f29c3f3a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:28:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:47.497+0000 7f29c3f3a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:28:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:47.497+0000 7f29c3f3a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T06:28:50.477 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T06:28:50.499 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:50.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:50.597+0000 7f8bfb1fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T06:28:50.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:50.597+0000 7f8bfb1fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T06:28:50.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:50.597+0000 7f8bfb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:28:50.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:50.597+0000 7f8bfb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:28:50.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:50.597+0000 7f8bfb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:28:50.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:50.597+0000 7f8bfb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T06:28:53.597 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T06:28:53.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:53.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:53.717+0000 7fd95447e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T06:28:53.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:53.717+0000 7fd95447e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T06:28:53.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:53.717+0000 7fd95447e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:28:53.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:53.717+0000 7fd95447e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:28:53.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:53.717+0000 7fd95447e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:28:53.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:28:53.721+0000 7fd95447e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T06:28:56.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T06:28:56.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T06:28:56.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:56.754 INFO:tasks.ceph:role: osd.4 2023-11-24T06:28:56.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:28:56.755 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:28:56.824 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:56.824 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:56.825 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:57.278 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-11-24T06:28:57.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-11-24T06:28:57.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T06:28:57.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T06:28:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:57.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:57.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T06:28:57.473 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:57.473 INFO:tasks.ceph:role: osd.5 2023-11-24T06:28:57.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:28:57.473 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:28:57.545 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:58.050 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-11-24T06:28:58.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-11-24T06:28:58.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T06:28:58.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T06:28:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:58.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:58.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T06:28:58.289 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:58.289 INFO:tasks.ceph:role: osd.6 2023-11-24T06:28:58.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:28:58.289 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:28:58.362 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:58.362 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:58.363 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:58.363 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:58.364 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:58.831 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-11-24T06:28:58.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-11-24T06:28:58.835 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T06:28:58.944 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T06:28:58.962 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:58.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:58.964 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T06:28:59.033 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:28:59.033 INFO:tasks.ceph:role: osd.7 2023-11-24T06:28:59.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:28:59.033 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:28:59.103 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:28:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:28:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:28:59.550 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-11-24T06:28:59.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-11-24T06:28:59.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T06:28:59.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T06:28:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T06:28:59.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:28:59.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:28:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:28:59.813+0000 7efda442b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T06:28:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:28:59.817+0000 7efda442b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T06:28:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:28:59.817+0000 7efda442b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:28:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:28:59.817+0000 7efda442b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:28:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:28:59.817+0000 7efda442b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:28:59.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:28:59.821+0000 7efda442b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T06:29:02.812 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T06:29:02.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:29:02.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:02.929+0000 7f6216436640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T06:29:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:02.929+0000 7f6216436640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T06:29:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:02.929+0000 7f6216436640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:29:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:02.929+0000 7f6216436640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:29:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:02.929+0000 7f6216436640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:29:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:02.933+0000 7f6216436640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T06:29:05.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T06:29:05.935 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:29:06.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:06.033+0000 7f841802b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T06:29:06.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:06.033+0000 7f841802b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T06:29:06.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:06.033+0000 7f841802b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:29:06.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:06.033+0000 7f841802b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:29:06.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:06.033+0000 7f841802b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:29:06.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:06.037+0000 7f841802b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T06:29:08.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:29:08.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:29:09.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T06:29:09.067 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:29:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:09.165+0000 7faa19bd8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T06:29:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:09.165+0000 7faa19bd8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T06:29:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:09.165+0000 7faa19bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:29:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:09.165+0000 7faa19bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:29:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:09.165+0000 7faa19bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:29:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:09.165+0000 7faa19bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T06:29:12.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T06:29:12.170 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T06:29:12.171 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.171 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T06:29:12.193 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T06:29:12.259 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.259 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T06:29:12.323 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.323 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T06:29:12.387 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T06:29:12.451 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.451 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T06:29:12.514 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.514 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T06:29:12.578 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.579 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T06:29:12.599 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T06:29:12.666 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T06:29:12.726 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T06:29:12.787 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T06:29:12.850 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T06:29:12.910 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:12.911 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T06:29:12.970 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.970 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T06:29:12.980 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:12.980 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T06:29:13.034 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:13.034 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T06:29:13.043 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:13.043 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T06:29:13.099 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T06:29:13.100 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:29:13.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:29:13.151 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2023-11-24T06:29:13.151 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw== 2023-11-24T06:29:13.151 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2023-11-24T06:29:13.151 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA== 2023-11-24T06:29:13.151 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg== 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg== 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg== 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA== 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw== 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2023-11-24T06:29:13.152 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA== 2023-11-24T06:29:13.153 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout:[client.2] 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw== 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w== 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout:[client.3] 2023-11-24T06:29:13.154 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw== 2023-11-24T06:29:13.164 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw== 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA== 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg== 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2023-11-24T06:29:13.165 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg== 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg== 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA== 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw== 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2023-11-24T06:29:13.166 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ== 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA== 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ== 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew== 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2023-11-24T06:29:13.167 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ== 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ== 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA== 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2023-11-24T06:29:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw== 2023-11-24T06:29:13.169 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2023-11-24T06:29:13.169 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w== 2023-11-24T06:29:13.169 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2023-11-24T06:29:13.169 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw== 2023-11-24T06:29:13.170 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:29:13.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:29:13.265 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.326 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.389 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.448 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.506 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.563 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.620 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:29:13.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:29:13.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.682 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.739 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:29:13.799 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.856 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.913 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.971 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:13.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:29:14.029 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.090 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.149 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.210 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:29:14.271 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T06:29:14.271 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T06:29:14.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:29:14.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T06:29:14.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T06:29:14.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:29:14.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T06:29:14.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T06:29:14.647 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:29:14.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T06:29:14.787 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:29:14.790 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:29:14.842 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T06:29:14.843 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T06:29:14.843 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T06:29:14.847 INFO:tasks.ceph.mon.a:Started 2023-11-24T06:29:14.848 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T06:29:14.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T06:29:14.890 INFO:tasks.ceph.mon.b:Started 2023-11-24T06:29:14.891 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T06:29:14.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T06:29:14.894 INFO:tasks.ceph.mon.c:Started 2023-11-24T06:29:14.894 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T06:29:14.894 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T06:29:14.895 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T06:29:14.898 INFO:tasks.ceph.mgr.y:Started 2023-11-24T06:29:14.898 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T06:29:14.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T06:29:14.902 INFO:tasks.ceph.mgr.x:Started 2023-11-24T06:29:14.902 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T06:29:14.902 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T06:29:15.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bca09a640 1 Processor -- start 2023-11-24T06:29:15.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bca09a640 1 -- start start 2023-11-24T06:29:15.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bca09a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 0x7f1bc4168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bca09a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40b0090 con 0x7f1bc40d39b0 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bca09a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40b0330 con 0x7f1bc415d7f0 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bca09a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc406b980 con 0x7f1bc406d3f0 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 0x7f1bc4168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 0x7f1bc4168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:49340/0 (socket says 172.21.15.143:49340) 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 -- 172.21.15.143:0/3938262513 learned_addr learned my addr 172.21.15.143:0/3938262513 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 -- 172.21.15.143:0/3938262513 >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 msgr2=0x7f1bc4168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 -- 172.21.15.143:0/3938262513 >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 msgr2=0x7f1bc4168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 --2- 172.21.15.143:0/3938262513 >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 0x7f1bc4168220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T06:29:15.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.041+0000 7f1bc3fff640 1 --2- 172.21.15.143:0/3938262513 >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 0x7f1bc4168220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T06:29:15.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705993880 0 0) 0x7f1bc40b0330 con 0x7f1bc415d7f0 2023-11-24T06:29:15.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac003530 con 0x7f1bc415d7f0 2023-11-24T06:29:15.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422821308 0 0) 0x7f1bc40b0090 con 0x7f1bc40d39b0 2023-11-24T06:29:15.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc40b0330 con 0x7f1bc40d39b0 2023-11-24T06:29:15.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821792095 0 0) 0x7f1bc40b0330 con 0x7f1bc40d39b0 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 msgr2=0x7f1bc4168220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 --2- 172.21.15.143:0/3938262513 >> v2:172.21.15.146:3300/0 conn(0x7f1bc406d3f0 0x7f1bc4168220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 >> v1:172.21.15.146:6789/0 conn(0x7f1bc415d7f0 legacy=0x7f1bc40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40b0610 con 0x7f1bc40d39b0 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f1bb8001600 con 0x7f1bc40d39b0 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 >> v1:172.21.15.143:6789/0 conn(0x7f1bc40d39b0 legacy=0x7f1bc406bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bac004bc0 0x7f1bac004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bac003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bac004200 0x7f1bac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc406b980 con 0x7f1bac003770 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac00c1b0 con 0x7f1bac004200 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac00c370 con 0x7f1bac004bc0 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bac003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bac004bc0 0x7f1bac004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc3fff640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bac004200 0x7f1bac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc2ffd640 1 -- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bac004bc0 msgr2=0x7f1bac004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bac004bc0 0x7f1bac004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc2ffd640 1 -- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bac004200 msgr2=0x7f1bac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bac004200 0x7f1bac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc2ffd640 1 -- 172.21.15.143:0/3938262513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40b0330 con 0x7f1bac003770 2023-11-24T06:29:15.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.217+0000 7f1bc3fff640 1 -- 172.21.15.143:0/3938262513 reap_dead start 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bac003bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8007e20 tx=0x7f1bb801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f923480315d734 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80a6620 con 0x7f1bac003770 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80a67a0 con 0x7f1bac003770 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bc27fc640 1 -- 172.21.15.143:0/3938262513 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80a6b50 con 0x7f1bac003770 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 -- 172.21.15.143:0/3938262513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 msgr2=0x7f1bac003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bac003bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8007e20 tx=0x7f1bb801c940 comp rx=0 tx=0).stop 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 -- 172.21.15.143:0/3938262513 shutdown_connections 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 --2- 172.21.15.143:0/3938262513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bac003bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 -- 172.21.15.143:0/3938262513 >> 172.21.15.143:0/3938262513 conn(0x7f1bc409c790 msgr2=0x7f1bc408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 -- 172.21.15.143:0/3938262513 shutdown_connections 2023-11-24T06:29:15.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.221+0000 7f1bca09a640 1 -- 172.21.15.143:0/3938262513 wait complete. 2023-11-24T06:29:15.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 Processor -- start 2023-11-24T06:29:15.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 -- start start 2023-11-24T06:29:15.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bc4153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc41f66f0 0x7f1bc40b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40b75b0 0x7f1bc415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4154070 con 0x7f1bac003770 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cf5e0 con 0x7f1bc41f66f0 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bca09a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cf8c0 con 0x7f1bc40b75b0 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bc37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bc4153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bc37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bc4153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51608/0 (socket says 172.21.15.143:51608) 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bc37fe640 1 -- 172.21.15.143:0/4202029301 learned_addr learned my addr 172.21.15.143:0/4202029301 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc41f66f0 0x7f1bc40b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.225+0000 7f1bc3fff640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40b75b0 0x7f1bc415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bc37fe640 1 -- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40b75b0 msgr2=0x7f1bc415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40b75b0 0x7f1bc415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bc37fe640 1 -- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc41f66f0 msgr2=0x7f1bc40b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc41f66f0 0x7f1bc40b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bc37fe640 1 -- 172.21.15.143:0/4202029301 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40cfba0 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bc4153b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400f7a0 tx=0x7f1bb400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40050d0 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4005230 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc40cfe80 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400d730 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc415ef90 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1bb400db90 con 0x7f1bac003770 2023-11-24T06:29:15.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1bb401d460 con 0x7f1bac003770 2023-11-24T06:29:15.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.229+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc415f180 con 0x7f1bac003770 2023-11-24T06:29:15.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.233+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1bb4003dd0 con 0x7f1bac003770 2023-11-24T06:29:15.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.297+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1bc404e8c0 con 0x7f1bac003770 2023-11-24T06:29:15.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.297+0000 7f1babfff640 1 -- 172.21.15.143:0/4202029301 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1bb4003600 con 0x7f1bac003770 2023-11-24T06:29:15.301 INFO:teuthology.orchestra.run.smithi143.stderr:adjusted tunables profile to default 2023-11-24T06:29:15.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 msgr2=0x7f1bc4153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bc4153b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400f7a0 tx=0x7f1bb400fc60 comp rx=0 tx=0).stop 2023-11-24T06:29:15.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 shutdown_connections 2023-11-24T06:29:15.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40b75b0 0x7f1bc415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc41f66f0 0x7f1bc40b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 --2- 172.21.15.143:0/4202029301 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bac003770 0x7f1bc4153b30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 >> 172.21.15.143:0/4202029301 conn(0x7f1bc409c790 msgr2=0x7f1bc415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:15.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 shutdown_connections 2023-11-24T06:29:15.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:15.301+0000 7f1bca09a640 1 -- 172.21.15.143:0/4202029301 wait complete. 2023-11-24T06:29:15.321 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T06:29:15.321 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T06:29:15.322 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:15.322 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T06:29:15.342 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:15.342 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T06:29:15.409 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:15.410 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T06:29:15.432 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:15.433+0000 7f4cfbee2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:29:15.443 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:15.441+0000 7f51129d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:29:15.464 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:15.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T06:29:15.529 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:15.529 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T06:29:15.551 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:15.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T06:29:15.611 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:15.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T06:29:15.675 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:29:15.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T06:29:15.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9 0 2023-11-24T06:29:15.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.917+0000 7fc679868640 1 Processor -- start 2023-11-24T06:29:15.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.917+0000 7fc679868640 1 -- start start 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.917+0000 7fc679868640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 0x7fc6740cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc679868640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6740cf4d0 0x7fc67406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc679868640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67406c620 con 0x7fc6740ce200 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc679868640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6740cbd80 con 0x7fc6740cf4d0 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc679868640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67406ba10 con 0x7fc67415d630 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 0x7fc6740cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 0x7fc6740cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:36820/0 (socket says 172.21.15.146:36820) 2023-11-24T06:29:15.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 -- 172.21.15.146:0/1217704315 learned_addr learned my addr 172.21.15.146:0/1217704315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:15.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc6737fe640 1 --2- 172.21.15.146:0/1217704315 >> v2:172.21.15.146:3300/0 conn(0x7fc6740cf4d0 0x7fc67406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 -- 172.21.15.146:0/1217704315 >> v2:172.21.15.146:3300/0 conn(0x7fc6740cf4d0 msgr2=0x7fc67406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:15.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 --2- 172.21.15.146:0/1217704315 >> v2:172.21.15.146:3300/0 conn(0x7fc6740cf4d0 0x7fc67406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 -- 172.21.15.146:0/1217704315 >> v1:172.21.15.143:6789/0 conn(0x7fc6740ce200 legacy=0x7fc6740cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.921+0000 7fc672ffd640 1 -- 172.21.15.146:0/1217704315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67406bcf0 con 0x7fc67415d630 2023-11-24T06:29:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc672ffd640 1 --2- 172.21.15.146:0/1217704315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 0x7fc6740cb840 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc664009870 tx=0x7fc66401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e830c80c149bc5e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc671ffb640 1 -- 172.21.15.146:0/1217704315 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640aa670 con 0x7fc67415d630 2023-11-24T06:29:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc671ffb640 1 -- 172.21.15.146:0/1217704315 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640aa7d0 con 0x7fc67415d630 2023-11-24T06:29:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc671ffb640 1 -- 172.21.15.146:0/1217704315 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640aab60 con 0x7fc67415d630 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 -- 172.21.15.146:0/1217704315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 msgr2=0x7fc6740cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 --2- 172.21.15.146:0/1217704315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 0x7fc6740cb840 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc664009870 tx=0x7fc66401c510 comp rx=0 tx=0).stop 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 -- 172.21.15.146:0/1217704315 shutdown_connections 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 --2- 172.21.15.146:0/1217704315 >> v2:172.21.15.146:3300/0 conn(0x7fc6740cf4d0 0x7fc67406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 --2- 172.21.15.146:0/1217704315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67415d630 0x7fc6740cb840 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 -- 172.21.15.146:0/1217704315 >> 172.21.15.146:0/1217704315 conn(0x7fc67406e860 msgr2=0x7fc67406ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 -- 172.21.15.146:0/1217704315 shutdown_connections 2023-11-24T06:29:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 -- 172.21.15.146:0/1217704315 wait complete. 2023-11-24T06:29:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 Processor -- start 2023-11-24T06:29:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.925+0000 7fc679868640 1 -- start start 2023-11-24T06:29:15.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 0x7fc674153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6740cf4d0 0x7fc674154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc67415d630 0x7fc6740b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc674154070 con 0x7fc67415d630 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc674154350 con 0x7fc6740ce200 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc674154630 con 0x7fc6740cf4d0 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 0x7fc674153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 0x7fc674153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39696/0 (socket says 172.21.15.146:39696) 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 -- 172.21.15.146:0/3688956033 learned_addr learned my addr 172.21.15.146:0/3688956033 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc6727fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6740cf4d0 0x7fc674154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc6737fe640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc67415d630 0x7fc6740b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 -- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6740cf4d0 msgr2=0x7fc674154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6740cf4d0 0x7fc674154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 -- 172.21.15.146:0/3688956033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc67415d630 msgr2=0x7fc6740b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc67415d630 0x7fc6740b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 -- 172.21.15.146:0/3688956033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640094d0 con 0x7fc6740ce200 2023-11-24T06:29:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc672ffd640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 0x7fc674153910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6640ac040 tx=0x7fc6640192b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640b4810 con 0x7fc6740ce200 2023-11-24T06:29:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640b49b0 con 0x7fc6740ce200 2023-11-24T06:29:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc674154910 con 0x7fc6740ce200 2023-11-24T06:29:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640b4d60 con 0x7fc6740ce200 2023-11-24T06:29:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6740b6930 con 0x7fc6740ce200 2023-11-24T06:29:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc6640be710 con 0x7fc6740ce200 2023-11-24T06:29:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc6640b3390 con 0x7fc6740ce200 2023-11-24T06:29:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.929+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6740c7e70 con 0x7fc6740ce200 2023-11-24T06:29:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:15.933+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc6640b3550 con 0x7fc6740ce200 2023-11-24T06:29:15.995 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:15.993+0000 7f51129d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:29:15.997 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:15.997+0000 7f4cfbee2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:29:15.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.001+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9", "id": 0} v 0) v1 -- 0x7fc6741541b0 con 0x7fc6740ce200 2023-11-24T06:29:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc65bfff640 1 -- 172.21.15.146:0/3688956033 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6741541b0 con 0x7fc6740ce200 2023-11-24T06:29:16.004 INFO:teuthology.orchestra.run.smithi146.stdout:0 2023-11-24T06:29:16.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 msgr2=0x7fc674153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 0x7fc674153910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6640ac040 tx=0x7fc6640192b0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 shutdown_connections 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc67415d630 0x7fc6740b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6740cf4d0 0x7fc674154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 --2- 172.21.15.146:0/3688956033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6740ce200 0x7fc674153910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 >> 172.21.15.146:0/3688956033 conn(0x7fc67406e860 msgr2=0x7fc6740d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 shutdown_connections 2023-11-24T06:29:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.005+0000 7fc679868640 1 -- 172.21.15.146:0/3688956033 wait complete. 2023-11-24T06:29:16.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 40ba0a51-0cdd-49d8-927d-8d3e2ca80308 1 2023-11-24T06:29:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.161+0000 7f56b1565640 1 Processor -- start 2023-11-24T06:29:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.161+0000 7f56b1565640 1 -- start start 2023-11-24T06:29:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56b1565640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56ac15d7f0 0x7f56ac0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56b1565640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac0d3c60 con 0x7f56ac06cce0 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56b1565640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac0b0090 con 0x7f56ac0d37e0 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56b1565640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac06b980 con 0x7f56ac15d7f0 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56aaffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56ac15d7f0 0x7f56ac0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56a3fff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f56ac0d37e0 0x7f56ac0b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34886/0 (socket says 172.21.15.146:34886) 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56a3fff640 1 -- 172.21.15.146:0/2769583541 learned_addr learned my addr 172.21.15.146:0/2769583541 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56aaffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56ac15d7f0 0x7f56ac0d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39712/0 (socket says 172.21.15.146:39712) 2023-11-24T06:29:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56aaffd640 1 -- 172.21.15.146:0/2769583541 >> v1:172.21.15.146:6789/0 conn(0x7f56ac0d37e0 legacy=0x7f56ac0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56aaffd640 1 -- 172.21.15.146:0/2769583541 >> v1:172.21.15.143:6789/0 conn(0x7f56ac06cce0 legacy=0x7f56ac06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.165+0000 7f56aaffd640 1 -- 172.21.15.146:0/2769583541 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac0b0330 con 0x7f56ac15d7f0 2023-11-24T06:29:16.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56aaffd640 1 --2- 172.21.15.146:0/2769583541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0d32a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f569c0097c0 tx=0x7f569c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a40142b80d9cc4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56aa7fc640 1 -- 172.21.15.146:0/2769583541 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0ab600 con 0x7f56ac15d7f0 2023-11-24T06:29:16.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56aa7fc640 1 -- 172.21.15.146:0/2769583541 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0a7050 con 0x7f56ac15d7f0 2023-11-24T06:29:16.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56aa7fc640 1 -- 172.21.15.146:0/2769583541 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0ab980 con 0x7f56ac15d7f0 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 -- 172.21.15.146:0/2769583541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 msgr2=0x7f56ac0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 --2- 172.21.15.146:0/2769583541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0d32a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f569c0097c0 tx=0x7f569c01c480 comp rx=0 tx=0).stop 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 -- 172.21.15.146:0/2769583541 shutdown_connections 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 --2- 172.21.15.146:0/2769583541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0d32a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 -- 172.21.15.146:0/2769583541 >> 172.21.15.146:0/2769583541 conn(0x7f56ac09c790 msgr2=0x7f56ac08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 -- 172.21.15.146:0/2769583541 shutdown_connections 2023-11-24T06:29:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 -- 172.21.15.146:0/2769583541 wait complete. 2023-11-24T06:29:16.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 Processor -- start 2023-11-24T06:29:16.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.169+0000 7f56b1565640 1 -- start start 2023-11-24T06:29:16.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56ac06cce0 0x7f56ac1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56ac0d37e0 0x7f56ac0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1548e0 con 0x7f56ac06cce0 2023-11-24T06:29:16.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0b7da0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0ca220 con 0x7f56ac0d37e0 2023-11-24T06:29:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39722/0 (socket says 172.21.15.146:39722) 2023-11-24T06:29:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 -- 172.21.15.146:0/3241167411 learned_addr learned my addr 172.21.15.146:0/3241167411 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56a3fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56ac0d37e0 0x7f56ac0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56aaffd640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56ac06cce0 0x7f56ac1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 -- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56ac0d37e0 msgr2=0x7f56ac0b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56ac0d37e0 0x7f56ac0b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 -- 172.21.15.146:0/3241167411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56ac06cce0 msgr2=0x7f56ac1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56ac06cce0 0x7f56ac1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 -- 172.21.15.146:0/3241167411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009420 con 0x7f56ac15d7f0 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56aaffd640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56ac06cce0 0x7f56ac1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56ab7fe640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0c9ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c6c0 tx=0x7f56a400cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4003b80 con 0x7f56ac15d7f0 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4003ce0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a40052f0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac154b80 con 0x7f56ac15d7f0 2023-11-24T06:29:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac0b63a0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f56a400a640 con 0x7f56ac15d7f0 2023-11-24T06:29:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f56a40124f0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.173+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac04e8c0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.177+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f56a4003e50 con 0x7f56ac15d7f0 2023-11-24T06:29:16.202 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:16.201+0000 7f51129d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:29:16.208 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:16.209+0000 7f4cfbee2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:29:16.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.245+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40ba0a51-0cdd-49d8-927d-8d3e2ca80308", "id": 1} v 0) v1 -- 0x7f56ac15af10 con 0x7f56ac15d7f0 2023-11-24T06:29:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56a37fe640 1 -- 172.21.15.146:0/3241167411 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40ba0a51-0cdd-49d8-927d-8d3e2ca80308", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f56a400aad0 con 0x7f56ac15d7f0 2023-11-24T06:29:16.253 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:29:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 msgr2=0x7f56ac0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0c9ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c6c0 tx=0x7f56a400cb80 comp rx=0 tx=0).stop 2023-11-24T06:29:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 shutdown_connections 2023-11-24T06:29:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ac15d7f0 0x7f56ac0c9ce0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56ac0d37e0 0x7f56ac0b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 --2- 172.21.15.146:0/3241167411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56ac06cce0 0x7f56ac1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 >> 172.21.15.146:0/3241167411 conn(0x7f56ac09c790 msgr2=0x7f56ac0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 shutdown_connections 2023-11-24T06:29:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.253+0000 7f56b1565640 1 -- 172.21.15.146:0/3241167411 wait complete. 2023-11-24T06:29:16.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 95c33c83-6f16-4318-9c3a-d34703a027b1 2 2023-11-24T06:29:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f412e5b8640 1 Processor -- start 2023-11-24T06:29:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f412e5b8640 1 -- start start 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f412e5b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f41280d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f412e5b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280d3c60 con 0x7f412806cce0 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f412e5b8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280b0090 con 0x7f41280d37e0 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f412e5b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412806b980 con 0x7f412815d7f0 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f41277fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f41280d37e0 0x7f41280b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34892/0 (socket says 172.21.15.146:34892) 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f41277fe640 1 -- 172.21.15.146:0/1975860305 learned_addr learned my addr 172.21.15.146:0/1975860305 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4127fff640 1 --2- 172.21.15.146:0/1975860305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f41280d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4126ffd640 1 -- 172.21.15.146:0/1975860305 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248001667 0 0) 0x7f41280b0090 con 0x7f41280d37e0 2023-11-24T06:29:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4126ffd640 1 -- 172.21.15.146:0/1975860305 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4110003530 con 0x7f41280d37e0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4127fff640 1 -- 172.21.15.146:0/1975860305 >> v1:172.21.15.146:6789/0 conn(0x7f41280d37e0 legacy=0x7f41280b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4127fff640 1 -- 172.21.15.146:0/1975860305 >> v1:172.21.15.143:6789/0 conn(0x7f412806cce0 legacy=0x7f41280b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4126ffd640 1 -- 172.21.15.146:0/1975860305 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389011806 0 0) 0x7f41280d3c60 con 0x7f412806cce0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.409+0000 7f4127fff640 1 -- 172.21.15.146:0/1975860305 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280b0330 con 0x7f412815d7f0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f4127fff640 1 --2- 172.21.15.146:0/1975860305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f41280d32a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f41180097f0 tx=0x7f411801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc60f78012d9e13 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f4126ffd640 1 -- 172.21.15.146:0/1975860305 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180ac410 con 0x7f412815d7f0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f4126ffd640 1 -- 172.21.15.146:0/1975860305 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41180ac570 con 0x7f412815d7f0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f4126ffd640 1 -- 172.21.15.146:0/1975860305 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180ac900 con 0x7f412815d7f0 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 -- 172.21.15.146:0/1975860305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 msgr2=0x7f41280d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 --2- 172.21.15.146:0/1975860305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f41280d32a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f41180097f0 tx=0x7f411801c4c0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 -- 172.21.15.146:0/1975860305 shutdown_connections 2023-11-24T06:29:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 --2- 172.21.15.146:0/1975860305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f41280d32a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 -- 172.21.15.146:0/1975860305 >> 172.21.15.146:0/1975860305 conn(0x7f412809c790 msgr2=0x7f412808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 -- 172.21.15.146:0/1975860305 shutdown_connections 2023-11-24T06:29:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.413+0000 7f412e5b8640 1 -- 172.21.15.146:0/1975860305 wait complete. 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 Processor -- start 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 -- start start 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f412806cce0 0x7f4128154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 0x7f41280b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f4128151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280b35f0 con 0x7f412806cce0 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280b8250 con 0x7f41280d37e0 2023-11-24T06:29:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280b7710 con 0x7f412815d7f0 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 0x7f41280b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 0x7f41280b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39730/0 (socket says 172.21.15.146:39730) 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 -- 172.21.15.146:0/1752021103 learned_addr learned my addr 172.21.15.146:0/1752021103 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4127fff640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f412806cce0 0x7f4128154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412cb55640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f4128151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 -- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 msgr2=0x7f4128151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f4128151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 -- 172.21.15.146:0/1752021103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f412806cce0 msgr2=0x7f4128154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f412806cce0 0x7f4128154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 -- 172.21.15.146:0/1752021103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118009420 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4127fff640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f412806cce0 0x7f4128154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f41277fe640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 0x7f41280b71d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f411c00c480 tx=0x7f411c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c005cf0 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c005e50 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c007290 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41280b79b0 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41280b7f70 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f411c01c440 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.417+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f411c012820 con 0x7f41280d37e0 2023-11-24T06:29:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.421+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41280b3350 con 0x7f41280d37e0 2023-11-24T06:29:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.421+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f41280b3350 con 0x7f41280d37e0 2023-11-24T06:29:16.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.489+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "95c33c83-6f16-4318-9c3a-d34703a027b1", "id": 2} v 0) v1 -- 0x7f412804e8c0 con 0x7f41280d37e0 2023-11-24T06:29:16.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f4124ff9640 1 -- 172.21.15.146:0/1752021103 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95c33c83-6f16-4318-9c3a-d34703a027b1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f411c017070 con 0x7f41280d37e0 2023-11-24T06:29:16.496 INFO:teuthology.orchestra.run.smithi146.stdout:2 2023-11-24T06:29:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 msgr2=0x7f41280b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 0x7f41280b71d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f411c00c480 tx=0x7f411c00c940 comp rx=0 tx=0).stop 2023-11-24T06:29:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 shutdown_connections 2023-11-24T06:29:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f412815d7f0 0x7f4128151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41280d37e0 0x7f41280b71d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 --2- 172.21.15.146:0/1752021103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f412806cce0 0x7f4128154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 >> 172.21.15.146:0/1752021103 conn(0x7f412809c790 msgr2=0x7f41280cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 shutdown_connections 2023-11-24T06:29:16.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.497+0000 7f412e5b8640 1 -- 172.21.15.146:0/1752021103 wait complete. 2023-11-24T06:29:16.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 0688ff1a-fa2e-4024-b587-bfab84e913bb 3 2023-11-24T06:29:16.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc861157640 1 Processor -- start 2023-11-24T06:29:16.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc861157640 1 -- start start 2023-11-24T06:29:16.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc861157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0d39b0 0x7fc85c06bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc861157640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0b0090 con 0x7fc85c0b2100 2023-11-24T06:29:16.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc861157640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0b0330 con 0x7fc85c15d7f0 2023-11-24T06:29:16.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc861157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c06b980 con 0x7fc85c0d39b0 2023-11-24T06:29:16.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc85ad9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc85c15d7f0 0x7fc85c0d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34898/0 (socket says 172.21.15.146:34898) 2023-11-24T06:29:16.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc85ad9d640 1 -- 172.21.15.146:0/1913219732 learned_addr learned my addr 172.21.15.146:0/1913219732 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-11-24T06:29:16.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc85a59c640 1 --2- 172.21.15.146:0/1913219732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0d39b0 0x7fc85c06bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc85a59c640 1 -- 172.21.15.146:0/1913219732 >> v1:172.21.15.146:6789/0 conn(0x7fc85c15d7f0 legacy=0x7fc85c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc859d9b640 1 -- 172.21.15.146:0/1913219732 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972785219 0 0) 0x7fc85c0b0330 con 0x7fc85c15d7f0 2023-11-24T06:29:16.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc85a59c640 1 -- 172.21.15.146:0/1913219732 >> v1:172.21.15.143:6789/0 conn(0x7fc85c0b2100 legacy=0x7fc85c06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.653+0000 7fc85a59c640 1 -- 172.21.15.146:0/1913219732 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0b0610 con 0x7fc85c0d39b0 2023-11-24T06:29:16.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc85a59c640 1 --2- 172.21.15.146:0/1913219732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0d39b0 0x7fc85c06bcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc8500097f0 tx=0x7fc85001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f5b52660bc287a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc859d9b640 1 -- 172.21.15.146:0/1913219732 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500ac410 con 0x7fc85c0d39b0 2023-11-24T06:29:16.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc859d9b640 1 -- 172.21.15.146:0/1913219732 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500ac570 con 0x7fc85c0d39b0 2023-11-24T06:29:16.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc859d9b640 1 -- 172.21.15.146:0/1913219732 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500ac900 con 0x7fc85c0d39b0 2023-11-24T06:29:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 -- 172.21.15.146:0/1913219732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0d39b0 msgr2=0x7fc85c06bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 --2- 172.21.15.146:0/1913219732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0d39b0 0x7fc85c06bcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc8500097f0 tx=0x7fc85001c4c0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 -- 172.21.15.146:0/1913219732 shutdown_connections 2023-11-24T06:29:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 --2- 172.21.15.146:0/1913219732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0d39b0 0x7fc85c06bcd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 -- 172.21.15.146:0/1913219732 >> 172.21.15.146:0/1913219732 conn(0x7fc85c09c790 msgr2=0x7fc85c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 -- 172.21.15.146:0/1913219732 shutdown_connections 2023-11-24T06:29:16.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.657+0000 7fc861157640 1 -- 172.21.15.146:0/1913219732 wait complete. 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 Processor -- start 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 -- start start 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 0x7fc85c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc85c0d39b0 0x7fc85c0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc85c15d7f0 0x7fc85c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0ce180 con 0x7fc85c15d7f0 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0ce460 con 0x7fc85c0d39b0 2023-11-24T06:29:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0ce740 con 0x7fc85c0b2100 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 0x7fc85c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc85c0d39b0 0x7fc85c0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 0x7fc85c14b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:36864/0 (socket says 172.21.15.146:36864) 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 -- 172.21.15.146:0/1061121483 learned_addr learned my addr 172.21.15.146:0/1061121483 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85b59e640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc85c15d7f0 0x7fc85c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 -- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc85c0d39b0 msgr2=0x7fc85c0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc85c0d39b0 0x7fc85c0b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 -- 172.21.15.146:0/1061121483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc85c15d7f0 msgr2=0x7fc85c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc85c15d7f0 0x7fc85c0b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 -- 172.21.15.146:0/1061121483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850009420 con 0x7fc85c0b2100 2023-11-24T06:29:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85a59c640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc85c0d39b0 0x7fc85c0b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:16.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85b59e640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc85c15d7f0 0x7fc85c0b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:16.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc85ad9d640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 0x7fc85c14b140 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c410 tx=0x7fc84c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0074e0 con 0x7fc85c0b2100 2023-11-24T06:29:16.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c007640 con 0x7fc85c0b2100 2023-11-24T06:29:16.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c004a30 con 0x7fc85c0b2100 2023-11-24T06:29:16.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0cea20 con 0x7fc85c0b2100 2023-11-24T06:29:16.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c14b680 con 0x7fc85c0b2100 2023-11-24T06:29:16.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc84c0133c0 con 0x7fc85c0b2100 2023-11-24T06:29:16.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.661+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc84c013b00 con 0x7fc85c0b2100 2023-11-24T06:29:16.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.665+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c04e8c0 con 0x7fc85c0b2100 2023-11-24T06:29:16.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.673+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc84c013cc0 con 0x7fc85c0b2100 2023-11-24T06:29:16.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.741+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0688ff1a-fa2e-4024-b587-bfab84e913bb", "id": 3} v 0) v1 -- 0x7fc85c169010 con 0x7fc85c0b2100 2023-11-24T06:29:16.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.745+0000 7fc8437fe640 1 -- 172.21.15.146:0/1061121483 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0688ff1a-fa2e-4024-b587-bfab84e913bb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc84c013670 con 0x7fc85c0b2100 2023-11-24T06:29:16.747 INFO:teuthology.orchestra.run.smithi146.stdout:3 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 msgr2=0x7fc85c14b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 0x7fc85c14b140 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c410 tx=0x7fc84c00c8d0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 shutdown_connections 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc85c15d7f0 0x7fc85c0b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc85c0d39b0 0x7fc85c0b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 --2- 172.21.15.146:0/1061121483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc85c0b2100 0x7fc85c14b140 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 >> 172.21.15.146:0/1061121483 conn(0x7fc85c09c790 msgr2=0x7fc85c15b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 shutdown_connections 2023-11-24T06:29:16.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.749+0000 7fc861157640 1 -- 172.21.15.146:0/1061121483 wait complete. 2023-11-24T06:29:16.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 08e4abf5-8b68-45b5-b039-e330f961ee76 4 2023-11-24T06:29:16.826 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:16.825+0000 7f51129d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:29:16.861 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:16.861+0000 7f4cfbee2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:29:16.888 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:16.885+0000 7f51129d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:29:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa57da9c640 1 Processor -- start 2023-11-24T06:29:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa57da9c640 1 -- start start 2023-11-24T06:29:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa57da9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa57815d7f0 0x7fa5780d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa57da9c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5780d3c60 con 0x7fa5780d37e0 2023-11-24T06:29:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa57da9c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5780b0090 con 0x7fa57806cce0 2023-11-24T06:29:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa57da9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57806b980 con 0x7fa57815d7f0 2023-11-24T06:29:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa577fff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa57806cce0 0x7fa57806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34904/0 (socket says 172.21.15.146:34904) 2023-11-24T06:29:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa577fff640 1 -- 172.21.15.146:0/3179980351 learned_addr learned my addr 172.21.15.146:0/3179980351 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-11-24T06:29:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5777fe640 1 --2- 172.21.15.146:0/3179980351 >> v2:172.21.15.143:3300/0 conn(0x7fa57815d7f0 0x7fa5780d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728457549 0 0) 0x7fa5780b0090 con 0x7fa57806cce0 2023-11-24T06:29:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa560003530 con 0x7fa57806cce0 2023-11-24T06:29:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099866557 0 0) 0x7fa5780d3c60 con 0x7fa5780d37e0 2023-11-24T06:29:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5780b0090 con 0x7fa5780d37e0 2023-11-24T06:29:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5777fe640 1 -- 172.21.15.146:0/3179980351 >> v1:172.21.15.146:6789/0 conn(0x7fa57806cce0 legacy=0x7fa57806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5777fe640 1 -- 172.21.15.146:0/3179980351 >> v1:172.21.15.143:6789/0 conn(0x7fa5780d37e0 legacy=0x7fa5780b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.905+0000 7fa5777fe640 1 -- 172.21.15.146:0/3179980351 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780b0330 con 0x7fa57815d7f0 2023-11-24T06:29:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa5777fe640 1 --2- 172.21.15.146:0/3179980351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57815d7f0 0x7fa5780d32a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa5680097c0 tx=0x7fa56801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b71e7a738780ab9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5680ab600 con 0x7fa57815d7f0 2023-11-24T06:29:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5680a7050 con 0x7fa57815d7f0 2023-11-24T06:29:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa5767fc640 1 -- 172.21.15.146:0/3179980351 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5680ab960 con 0x7fa57815d7f0 2023-11-24T06:29:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa57da9c640 1 -- 172.21.15.146:0/3179980351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57815d7f0 msgr2=0x7fa5780d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa57da9c640 1 --2- 172.21.15.146:0/3179980351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57815d7f0 0x7fa5780d32a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa5680097c0 tx=0x7fa56801c480 comp rx=0 tx=0).stop 2023-11-24T06:29:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa57da9c640 1 -- 172.21.15.146:0/3179980351 shutdown_connections 2023-11-24T06:29:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa57da9c640 1 --2- 172.21.15.146:0/3179980351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57815d7f0 0x7fa5780d32a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.909+0000 7fa57da9c640 1 -- 172.21.15.146:0/3179980351 >> 172.21.15.146:0/3179980351 conn(0x7fa57809c790 msgr2=0x7fa57808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 -- 172.21.15.146:0/3179980351 shutdown_connections 2023-11-24T06:29:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 -- 172.21.15.146:0/3179980351 wait complete. 2023-11-24T06:29:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 Processor -- start 2023-11-24T06:29:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 -- start start 2023-11-24T06:29:16.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57806cce0 0x7fa5780b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 0x7fa5780b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57815d7f0 0x7fa578153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5781569e0 con 0x7fa57806cce0 2023-11-24T06:29:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780a1150 con 0x7fa57815d7f0 2023-11-24T06:29:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa57da9c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780b5d00 con 0x7fa5780d37e0 2023-11-24T06:29:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 0x7fa5780b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 0x7fa5780b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:36878/0 (socket says 172.21.15.146:36878) 2023-11-24T06:29:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 -- 172.21.15.146:0/3439291051 learned_addr learned my addr 172.21.15.146:0/3439291051 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa5777fe640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57806cce0 0x7fa5780b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa577fff640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57815d7f0 0x7fa578153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:16.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 -- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57815d7f0 msgr2=0x7fa578153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57815d7f0 0x7fa578153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 -- 172.21.15.146:0/3439291051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57806cce0 msgr2=0x7fa5780b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57806cce0 0x7fa5780b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa576ffd640 1 -- 172.21.15.146:0/3439291051 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568009420 con 0x7fa5780d37e0 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.913+0000 7fa5777fe640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57806cce0 0x7fa5780b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa576ffd640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 0x7fa5780b8450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00c500 tx=0x7fa56c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0052d0 con 0x7fa5780d37e0 2023-11-24T06:29:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c005450 con 0x7fa5780d37e0 2023-11-24T06:29:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c012870 con 0x7fa5780d37e0 2023-11-24T06:29:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5780a0b90 con 0x7fa5780d37e0 2023-11-24T06:29:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57809d1a0 con 0x7fa5780d37e0 2023-11-24T06:29:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa56c012cd0 con 0x7fa5780d37e0 2023-11-24T06:29:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa56c003b10 con 0x7fa5780d37e0 2023-11-24T06:29:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57804e8c0 con 0x7fa5780d37e0 2023-11-24T06:29:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.917+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa56c003600 con 0x7fa5780d37e0 2023-11-24T06:29:16.928 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:16.929+0000 7f4cfbee2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:29:16.949 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:16.945+0000 7f51129d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:29:16.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.985+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "08e4abf5-8b68-45b5-b039-e330f961ee76", "id": 4} v 0) v1 -- 0x7fa5780d0b70 con 0x7fa5780d37e0 2023-11-24T06:29:16.989 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:16.989+0000 7f4cfbee2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:29:16.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa55ffff640 1 -- 172.21.15.146:0/3439291051 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08e4abf5-8b68-45b5-b039-e330f961ee76", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa56c003870 con 0x7fa5780d37e0 2023-11-24T06:29:16.992 INFO:teuthology.orchestra.run.smithi146.stdout:4 2023-11-24T06:29:16.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 msgr2=0x7fa5780b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:16.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 0x7fa5780b8450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00c500 tx=0x7fa56c00c9c0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 shutdown_connections 2023-11-24T06:29:16.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57815d7f0 0x7fa578153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5780d37e0 0x7fa5780b8450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 --2- 172.21.15.146:0/3439291051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa57806cce0 0x7fa5780b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:16.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 >> 172.21.15.146:0/3439291051 conn(0x7fa57809c790 msgr2=0x7fa5780cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:16.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 shutdown_connections 2023-11-24T06:29:16.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:16.993+0000 7fa57da9c640 1 -- 172.21.15.146:0/3439291051 wait complete. 2023-11-24T06:29:17.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 76811fdd-ba5b-434d-a7e8-7367cc8470c9 5 2023-11-24T06:29:17.037 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:17.033+0000 7f51129d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:29:17.082 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:17.081+0000 7f4cfbee2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:29:17.096 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:17.093+0000 7f51129d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:29:17.143 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:17.145+0000 7f4cfbee2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:29:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 Processor -- start 2023-11-24T06:29:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 -- start start 2023-11-24T06:29:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05740d0530 0x7f05740ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 0x7f057406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057415daf0 con 0x7f057415d710 2023-11-24T06:29:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05740cf3f0 con 0x7f05740d0530 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f057a646640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740ce560 con 0x7f057415e690 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 0x7f057406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 0x7f057406c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:36880/0 (socket says 172.21.15.146:36880) 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 -- 172.21.15.146:0/3970628315 learned_addr learned my addr 172.21.15.146:0/3970628315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f05737fe640 1 --2- 172.21.15.146:0/3970628315 >> v2:172.21.15.143:3300/0 conn(0x7f05740d0530 0x7f05740ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 -- 172.21.15.146:0/3970628315 >> v2:172.21.15.143:3300/0 conn(0x7f05740d0530 msgr2=0x7f05740ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 --2- 172.21.15.146:0/3970628315 >> v2:172.21.15.143:3300/0 conn(0x7f05740d0530 0x7f05740ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 -- 172.21.15.146:0/3970628315 >> v1:172.21.15.143:6789/0 conn(0x7f057415d710 legacy=0x7f05740cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0578be3640 1 -- 172.21.15.146:0/3970628315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740ce770 con 0x7f057415e690 2023-11-24T06:29:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.149+0000 7f0572ffd640 1 -- 172.21.15.146:0/3970628315 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73693650 0 0) 0x7f057415daf0 con 0x7f057415d710 2023-11-24T06:29:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f0578be3640 1 --2- 172.21.15.146:0/3970628315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 0x7f057406c9b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f056c009e50 tx=0x7f056c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fbeaf87e0f20996 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f0572ffd640 1 -- 172.21.15.146:0/3970628315 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0a58a0 con 0x7f057415e690 2023-11-24T06:29:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f0572ffd640 1 -- 172.21.15.146:0/3970628315 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c0a5a00 con 0x7f057415e690 2023-11-24T06:29:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f0572ffd640 1 -- 172.21.15.146:0/3970628315 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0a5d90 con 0x7f057415e690 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 -- 172.21.15.146:0/3970628315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 msgr2=0x7f057406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 --2- 172.21.15.146:0/3970628315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 0x7f057406c9b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f056c009e50 tx=0x7f056c01c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 -- 172.21.15.146:0/3970628315 shutdown_connections 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 --2- 172.21.15.146:0/3970628315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415e690 0x7f057406c9b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 --2- 172.21.15.146:0/3970628315 >> v2:172.21.15.143:3300/0 conn(0x7f05740d0530 0x7f05740ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 -- 172.21.15.146:0/3970628315 >> 172.21.15.146:0/3970628315 conn(0x7f057408af70 msgr2=0x7f05740d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 -- 172.21.15.146:0/3970628315 shutdown_connections 2023-11-24T06:29:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.153+0000 7f057a646640 1 -- 172.21.15.146:0/3970628315 wait complete. 2023-11-24T06:29:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 Processor -- start 2023-11-24T06:29:17.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 -- start start 2023-11-24T06:29:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05740d0530 0x7f057414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415d710 0x7f05740b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f057415e690 0x7f05741573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057414bfb0 con 0x7f057415e690 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740b1400 con 0x7f05740d0530 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740b16e0 con 0x7f057415d710 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f05737fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415d710 0x7f05740b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0573fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05740d0530 0x7f057414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f057415e690 0x7f05741573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f05737fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415d710 0x7f05740b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:36888/0 (socket says 172.21.15.146:36888) 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f05737fe640 1 -- 172.21.15.146:0/4258588127 learned_addr learned my addr 172.21.15.146:0/4258588127 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 -- 172.21.15.146:0/4258588127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415d710 msgr2=0x7f05740b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415d710 0x7f05740b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 -- 172.21.15.146:0/4258588127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05740d0530 msgr2=0x7f057414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05740d0530 0x7f057414b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 -- 172.21.15.146:0/4258588127 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c009b30 con 0x7f057415e690 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0578be3640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f057415e690 0x7f05741573e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f056c0ab000 tx=0x7f056c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c003ba0 con 0x7f057415e690 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c003d00 con 0x7f057415e690 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c004260 con 0x7f057415e690 2023-11-24T06:29:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740b19c0 con 0x7f057415e690 2023-11-24T06:29:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.157+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05740b1f80 con 0x7f057415e690 2023-11-24T06:29:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.161+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f056c0046c0 con 0x7f057415e690 2023-11-24T06:29:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.161+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f056c0b6410 con 0x7f057415e690 2023-11-24T06:29:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.161+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057404e8c0 con 0x7f057415e690 2023-11-24T06:29:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.177+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f056c0be070 con 0x7f057415e690 2023-11-24T06:29:17.184 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:17.181+0000 7f51129d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:29:17.238 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:17.237+0000 7f4cfbee2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:29:17.247 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:17.245+0000 7f51129d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:29:17.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.249+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "76811fdd-ba5b-434d-a7e8-7367cc8470c9", "id": 5} v 0) v1 -- 0x7f05740d0cd0 con 0x7f057415e690 2023-11-24T06:29:17.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f0570ff9640 1 -- 172.21.15.146:0/4258588127 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76811fdd-ba5b-434d-a7e8-7367cc8470c9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f056c0b8440 con 0x7f057415e690 2023-11-24T06:29:17.253 INFO:teuthology.orchestra.run.smithi146.stdout:5 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f057415e690 msgr2=0x7f05741573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f057415e690 0x7f05741573e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f056c0ab000 tx=0x7f056c019780 comp rx=0 tx=0).stop 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 shutdown_connections 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f057415e690 0x7f05741573e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f057415d710 0x7f05740b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 --2- 172.21.15.146:0/4258588127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05740d0530 0x7f057414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 >> 172.21.15.146:0/4258588127 conn(0x7f057408af70 msgr2=0x7f0574155260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:17.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 shutdown_connections 2023-11-24T06:29:17.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.253+0000 7f057a646640 1 -- 172.21.15.146:0/4258588127 wait complete. 2023-11-24T06:29:17.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 74dfc999-5da9-4d97-8fea-35ba4387f8ba 6 2023-11-24T06:29:17.303 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:17.301+0000 7f4cfbee2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:29:17.401 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:17.397+0000 7f51129d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.409+0000 7febaae54640 1 Processor -- start 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.409+0000 7febaae54640 1 -- start start 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7febaae54640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feba40d39b0 0x7feba406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7febaae54640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40b0090 con 0x7feba40b2100 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7febaae54640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40b0330 con 0x7feba415d7f0 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7febaae54640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba406b980 con 0x7feba40d39b0 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba8bf0640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feba415d7f0 0x7feba40d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34918/0 (socket says 172.21.15.146:34918) 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba8bf0640 1 -- 172.21.15.146:0/1367592268 learned_addr learned my addr 172.21.15.146:0/1367592268 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-11-24T06:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba3fff640 1 --2- 172.21.15.146:0/1367592268 >> v2:172.21.15.143:3300/0 conn(0x7feba40d39b0 0x7feba406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba37fe640 1 -- 172.21.15.146:0/1367592268 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889863472 0 0) 0x7feba40b0330 con 0x7feba415d7f0 2023-11-24T06:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba37fe640 1 -- 172.21.15.146:0/1367592268 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb94003530 con 0x7feba415d7f0 2023-11-24T06:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba37fe640 1 -- 172.21.15.146:0/1367592268 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743427308 0 0) 0x7feba40b0090 con 0x7feba40b2100 2023-11-24T06:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba3fff640 1 -- 172.21.15.146:0/1367592268 >> v1:172.21.15.146:6789/0 conn(0x7feba415d7f0 legacy=0x7feba40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba3fff640 1 -- 172.21.15.146:0/1367592268 >> v1:172.21.15.143:6789/0 conn(0x7feba40b2100 legacy=0x7feba406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.413+0000 7feba3fff640 1 -- 172.21.15.146:0/1367592268 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40b0610 con 0x7feba40d39b0 2023-11-24T06:29:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7feba3fff640 1 --2- 172.21.15.146:0/1367592268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba40d39b0 0x7feba406bcd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb900097c0 tx=0x7feb9001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33b309158f9e7b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7feba37fe640 1 -- 172.21.15.146:0/1367592268 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900ab600 con 0x7feba40d39b0 2023-11-24T06:29:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7feba37fe640 1 -- 172.21.15.146:0/1367592268 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900a7050 con 0x7feba40d39b0 2023-11-24T06:29:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7feba37fe640 1 -- 172.21.15.146:0/1367592268 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900ab980 con 0x7feba40d39b0 2023-11-24T06:29:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 -- 172.21.15.146:0/1367592268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba40d39b0 msgr2=0x7feba406bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 --2- 172.21.15.146:0/1367592268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba40d39b0 0x7feba406bcd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb900097c0 tx=0x7feb9001c480 comp rx=0 tx=0).stop 2023-11-24T06:29:17.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 -- 172.21.15.146:0/1367592268 shutdown_connections 2023-11-24T06:29:17.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 --2- 172.21.15.146:0/1367592268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba40d39b0 0x7feba406bcd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 -- 172.21.15.146:0/1367592268 >> 172.21.15.146:0/1367592268 conn(0x7feba409c790 msgr2=0x7feba408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:17.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 -- 172.21.15.146:0/1367592268 shutdown_connections 2023-11-24T06:29:17.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 -- 172.21.15.146:0/1367592268 wait complete. 2023-11-24T06:29:17.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 Processor -- start 2023-11-24T06:29:17.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.417+0000 7febaae54640 1 -- start start 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba40b2100 0x7feba41533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 0x7feba40c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba415d7f0 0x7feba414bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4152fc0 con 0x7feba415d7f0 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40b5180 con 0x7feba40b2100 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba4152340 con 0x7feba40d39b0 2023-11-24T06:29:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 0x7feba40c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba8bf0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba40b2100 0x7feba41533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 0x7feba40c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:36898/0 (socket says 172.21.15.146:36898) 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 -- 172.21.15.146:0/1680117313 learned_addr learned my addr 172.21.15.146:0/1680117313 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba93f1640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba415d7f0 0x7feba414bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 -- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba40b2100 msgr2=0x7feba41533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba40b2100 0x7feba41533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 -- 172.21.15.146:0/1680117313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba415d7f0 msgr2=0x7feba414bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba415d7f0 0x7feba414bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 -- 172.21.15.146:0/1680117313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009420 con 0x7feba40d39b0 2023-11-24T06:29:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba8bf0640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba40b2100 0x7feba41533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba3fff640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 0x7feba40c9c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb900097c0 tx=0x7feb90019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90004020 con 0x7feba40d39b0 2023-11-24T06:29:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90004180 con 0x7feba40d39b0 2023-11-24T06:29:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900044f0 con 0x7feba40d39b0 2023-11-24T06:29:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4152620 con 0x7feba40d39b0 2023-11-24T06:29:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4152be0 con 0x7feba40d39b0 2023-11-24T06:29:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feb900b2040 con 0x7feba40d39b0 2023-11-24T06:29:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7feb900b4c80 con 0x7feba40d39b0 2023-11-24T06:29:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.421+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba404e8c0 con 0x7feba40d39b0 2023-11-24T06:29:17.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.425+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7feb900c1060 con 0x7feba40d39b0 2023-11-24T06:29:17.466 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:17.465+0000 7f4cfbee2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:29:17.469 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:17.465+0000 7f51129d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:29:17.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.493+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74dfc999-5da9-4d97-8fea-35ba4387f8ba", "id": 6} v 0) v1 -- 0x7feba415ad30 con 0x7feba40d39b0 2023-11-24T06:29:17.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7feba17fa640 1 -- 172.21.15.146:0/1680117313 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74dfc999-5da9-4d97-8fea-35ba4387f8ba", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb900b0070 con 0x7feba40d39b0 2023-11-24T06:29:17.496 INFO:teuthology.orchestra.run.smithi146.stdout:6 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 msgr2=0x7feba40c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 0x7feba40c9c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb900097c0 tx=0x7feb90019220 comp rx=0 tx=0).stop 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 shutdown_connections 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feba415d7f0 0x7feba414bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feba40d39b0 0x7feba40c9c50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 --2- 172.21.15.146:0/1680117313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba40b2100 0x7feba41533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 >> 172.21.15.146:0/1680117313 conn(0x7feba409c790 msgr2=0x7feba414d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 shutdown_connections 2023-11-24T06:29:17.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.497+0000 7febaae54640 1 -- 172.21.15.146:0/1680117313 wait complete. 2023-11-24T06:29:17.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new cd65f1c5-f67f-43d8-aaff-2fa2e704308b 7 2023-11-24T06:29:17.537 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:17.537+0000 7f4cfbee2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:29:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 Processor -- start 2023-11-24T06:29:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 -- start start 2023-11-24T06:29:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb9a815d360 0x7fb9a80d1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9a80d3920 0x7fb9a80b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80b0290 con 0x7fb9a80d1da0 2023-11-24T06:29:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a80b0570 con 0x7fb9a815d360 2023-11-24T06:29:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9add85640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a80b0850 con 0x7fb9a80d3920 2023-11-24T06:29:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9ad584640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9a80d3920 0x7fb9a80b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9ad584640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9a80d3920 0x7fb9a80b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39762/0 (socket says 172.21.15.146:39762) 2023-11-24T06:29:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.673+0000 7fb9ad584640 1 -- 172.21.15.146:0/3700644301 learned_addr learned my addr 172.21.15.146:0/3700644301 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9acd83640 1 --2- 172.21.15.146:0/3700644301 >> v2:172.21.15.143:3300/0 conn(0x7fb9a815d360 0x7fb9a80d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9ad584640 1 -- 172.21.15.146:0/3700644301 >> v2:172.21.15.143:3300/0 conn(0x7fb9a815d360 msgr2=0x7fb9a80d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9ad584640 1 --2- 172.21.15.146:0/3700644301 >> v2:172.21.15.143:3300/0 conn(0x7fb9a815d360 0x7fb9a80d1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9ad584640 1 -- 172.21.15.146:0/3700644301 >> v1:172.21.15.146:6789/0 conn(0x7fb9a80d1da0 legacy=0x7fb9a80d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9ad584640 1 -- 172.21.15.146:0/3700644301 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80b0b30 con 0x7fb9a80d3920 2023-11-24T06:29:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9acd83640 1 --2- 172.21.15.146:0/3700644301 >> v2:172.21.15.143:3300/0 conn(0x7fb9a815d360 0x7fb9a80d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9ad584640 1 --2- 172.21.15.146:0/3700644301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a80d3920 0x7fb9a80b1330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb9a808bad0 tx=0x7fb9a001c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a83a66dc83874afd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9a77fe640 1 -- 172.21.15.146:0/3700644301 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00a57a0 con 0x7fb9a80d3920 2023-11-24T06:29:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9a77fe640 1 -- 172.21.15.146:0/3700644301 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a00a5900 con 0x7fb9a80d3920 2023-11-24T06:29:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.677+0000 7fb9a77fe640 1 -- 172.21.15.146:0/3700644301 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00a5c90 con 0x7fb9a80d3920 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- 172.21.15.146:0/3700644301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a80d3920 msgr2=0x7fb9a80b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 --2- 172.21.15.146:0/3700644301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a80d3920 0x7fb9a80b1330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb9a808bad0 tx=0x7fb9a001c9d0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- 172.21.15.146:0/3700644301 shutdown_connections 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 --2- 172.21.15.146:0/3700644301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a80d3920 0x7fb9a80b1330 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 --2- 172.21.15.146:0/3700644301 >> v2:172.21.15.143:3300/0 conn(0x7fb9a815d360 0x7fb9a80d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- 172.21.15.146:0/3700644301 >> 172.21.15.146:0/3700644301 conn(0x7fb9a808cca0 msgr2=0x7fb9a809c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- 172.21.15.146:0/3700644301 shutdown_connections 2023-11-24T06:29:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- 172.21.15.146:0/3700644301 wait complete. 2023-11-24T06:29:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 Processor -- start 2023-11-24T06:29:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- start start 2023-11-24T06:29:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a80d1da0 0x7fb9a8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9a80d3920 0x7fb9a814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 0x7fb9a80cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a814c1c0 con 0x7fb9a80d3920 2023-11-24T06:29:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a8155dd0 con 0x7fb9a815d360 2023-11-24T06:29:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9add85640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a815aee0 con 0x7fb9a80d1da0 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 0x7fb9a80cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9acd83640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a80d1da0 0x7fb9a8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 0x7fb9a80cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39778/0 (socket says 172.21.15.146:39778) 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 -- 172.21.15.146:0/2880797657 learned_addr learned my addr 172.21.15.146:0/2880797657 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9a7fff640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9a80d3920 0x7fb9a814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 -- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a80d1da0 msgr2=0x7fb9a8155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a80d1da0 0x7fb9a8155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 -- 172.21.15.146:0/2880797657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9a80d3920 msgr2=0x7fb9a814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9a80d3920 0x7fb9a814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9ad584640 1 -- 172.21.15.146:0/2880797657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009b30 con 0x7fb9a815d360 2023-11-24T06:29:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.681+0000 7fb9acd83640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a80d1da0 0x7fb9a8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9ad584640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 0x7fb9a80cf5d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00af040 tx=0x7fb9a0019770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00b8670 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a00b87d0 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a815a6d0 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00b8b80 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a815ac00 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb9a00c1410 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb9a00c1d20 con 0x7fb9a815d360 2023-11-24T06:29:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.685+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a804e850 con 0x7fb9a815d360 2023-11-24T06:29:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.689+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb9a00bc020 con 0x7fb9a815d360 2023-11-24T06:29:17.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.752+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd65f1c5-f67f-43d8-aaff-2fa2e704308b", "id": 7} v 0) v1 -- 0x7fb9a814bf60 con 0x7fb9a815d360 2023-11-24T06:29:17.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9a57fa640 1 -- 172.21.15.146:0/2880797657 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd65f1c5-f67f-43d8-aaff-2fa2e704308b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9a00c1790 con 0x7fb9a815d360 2023-11-24T06:29:17.757 INFO:teuthology.orchestra.run.smithi146.stdout:7 2023-11-24T06:29:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 msgr2=0x7fb9a80cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 0x7fb9a80cf5d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00af040 tx=0x7fb9a0019770 comp rx=0 tx=0).stop 2023-11-24T06:29:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 shutdown_connections 2023-11-24T06:29:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a815d360 0x7fb9a80cf5d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9a80d3920 0x7fb9a814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 --2- 172.21.15.146:0/2880797657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a80d1da0 0x7fb9a8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:17.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 >> 172.21.15.146:0/2880797657 conn(0x7fb9a808cca0 msgr2=0x7fb9a80b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:17.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 shutdown_connections 2023-11-24T06:29:17.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-11-24T06:29:17.756+0000 7fb9add85640 1 -- 172.21.15.146:0/2880797657 wait complete. 2023-11-24T06:29:17.776 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T06:29:17.776 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T06:29:17.786 INFO:tasks.ceph.osd.0:Started 2023-11-24T06:29:17.786 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T06:29:17.786 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T06:29:17.798 INFO:tasks.ceph.osd.1:Started 2023-11-24T06:29:17.798 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T06:29:17.798 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T06:29:17.807 INFO:tasks.ceph.osd.2:Started 2023-11-24T06:29:17.807 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T06:29:17.807 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T06:29:17.816 INFO:tasks.ceph.osd.3:Started 2023-11-24T06:29:17.817 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T06:29:17.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T06:29:17.820 INFO:tasks.ceph.osd.4:Started 2023-11-24T06:29:17.820 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T06:29:17.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T06:29:17.824 INFO:tasks.ceph.osd.5:Started 2023-11-24T06:29:17.825 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T06:29:17.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T06:29:17.828 INFO:tasks.ceph.osd.6:Started 2023-11-24T06:29:17.828 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T06:29:17.828 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T06:29:17.832 INFO:tasks.ceph.osd.7:Started 2023-11-24T06:29:17.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:17.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.993+0000 7fa2f033e640 1 Processor -- start 2023-11-24T06:29:17.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.993+0000 7fa2f033e640 1 -- start start 2023-11-24T06:29:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2f033e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2e815d570 0x7fa2e806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2f033e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa2e80ce8b0 0x7fa2e80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2f033e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e80d1cc0 con 0x7fa2e80d3020 2023-11-24T06:29:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2f033e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e80d1fa0 con 0x7fa2e80ce8b0 2023-11-24T06:29:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2f033e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e80ce0b0 con 0x7fa2e815d570 2023-11-24T06:29:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee8db640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa2e80ce8b0 0x7fa2e80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:18.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ed8d9640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa2e80d3020 0x7fa2e80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46610/0 (socket says 172.21.15.143:46610) 2023-11-24T06:29:18.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ed8d9640 1 -- 172.21.15.143:0/2111475721 learned_addr learned my addr 172.21.15.143:0/2111475721 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:18.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee0da640 1 --2- 172.21.15.143:0/2111475721 >> v2:172.21.15.146:3300/0 conn(0x7fa2e815d570 0x7fa2e806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:18.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee8db640 1 -- 172.21.15.143:0/2111475721 >> v2:172.21.15.146:3300/0 conn(0x7fa2e815d570 msgr2=0x7fa2e806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:18.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee8db640 1 --2- 172.21.15.143:0/2111475721 >> v2:172.21.15.146:3300/0 conn(0x7fa2e815d570 0x7fa2e806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee8db640 1 -- 172.21.15.143:0/2111475721 >> v1:172.21.15.143:6789/0 conn(0x7fa2e80d3020 legacy=0x7fa2e80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee8db640 1 -- 172.21.15.143:0/2111475721 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80ce390 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ee0da640 1 --2- 172.21.15.143:0/2111475721 >> v2:172.21.15.146:3300/0 conn(0x7fa2e815d570 0x7fa2e806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:17.997+0000 7fa2ed0d8640 1 -- 172.21.15.143:0/2111475721 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029332735 0 0) 0x7fa2e80d1cc0 con 0x7fa2e80d3020 2023-11-24T06:29:18.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2ee8db640 1 --2- 172.21.15.143:0/2111475721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e80ced60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80d0eb0 tx=0x7fa2e001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72143b37545356c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:18.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2ed0d8640 1 -- 172.21.15.143:0/2111475721 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00a59c0 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2ed0d8640 1 -- 172.21.15.143:0/2111475721 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e00a5b20 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2ed0d8640 1 -- 172.21.15.143:0/2111475721 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00ad440 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 -- 172.21.15.143:0/2111475721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 msgr2=0x7fa2e80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:18.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 --2- 172.21.15.143:0/2111475721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e80ced60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80d0eb0 tx=0x7fa2e001c8e0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 -- 172.21.15.143:0/2111475721 shutdown_connections 2023-11-24T06:29:18.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 --2- 172.21.15.143:0/2111475721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e80ced60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 --2- 172.21.15.143:0/2111475721 >> v2:172.21.15.146:3300/0 conn(0x7fa2e815d570 0x7fa2e806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 -- 172.21.15.143:0/2111475721 >> 172.21.15.143:0/2111475721 conn(0x7fa2e808ceb0 msgr2=0x7fa2e809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:18.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 -- 172.21.15.143:0/2111475721 shutdown_connections 2023-11-24T06:29:18.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 -- 172.21.15.143:0/2111475721 wait complete. 2023-11-24T06:29:18.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 Processor -- start 2023-11-24T06:29:18.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.001+0000 7fa2f033e640 1 -- start start 2023-11-24T06:29:18.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:18.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2e80d3020 0x7fa2e80c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:18.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2e815d570 0x7fa2e80c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:18.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8159a80 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8160a00 con 0x7fa2e80d3020 2023-11-24T06:29:18.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8159ea0 con 0x7fa2e815d570 2023-11-24T06:29:18.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:18.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e81568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38222/0 (socket says 172.21.15.143:38222) 2023-11-24T06:29:18.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 -- 172.21.15.143:0/1969547158 learned_addr learned my addr 172.21.15.143:0/1969547158 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:18.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ed8d9640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2e80d3020 0x7fa2e80c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:18.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee8db640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2e815d570 0x7fa2e80c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:18.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 -- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2e815d570 msgr2=0x7fa2e80c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:18.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2e815d570 0x7fa2e80c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 -- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2e80d3020 msgr2=0x7fa2e80c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:18.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2e80d3020 0x7fa2e80c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 -- 172.21.15.143:0/1969547158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0009a70 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2ee0da640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e81568c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400d830 tx=0x7fa2e400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40096c0 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4009820 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e8156e00 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4009bd0 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e81590e0 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2e4014710 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa2e401dda0 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.005+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e8067520 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.009+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa2e403cce0 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2e80b2640 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2deffd640 1 -- 172.21.15.143:0/1969547158 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa2e402b070 con 0x7fa2e80ce8b0 2023-11-24T06:29:18.068 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:18.068 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":10,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:17.756008+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:18.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 msgr2=0x7fa2e81568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e81568c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400d830 tx=0x7fa2e400dcf0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 shutdown_connections 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2e815d570 0x7fa2e80c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2e80d3020 0x7fa2e80c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 --2- 172.21.15.143:0/1969547158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2e80ce8b0 0x7fa2e81568c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 >> 172.21.15.143:0/1969547158 conn(0x7fa2e808ceb0 msgr2=0x7fa2e80b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:18.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 shutdown_connections 2023-11-24T06:29:18.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:18.065+0000 7fa2f033e640 1 -- 172.21.15.143:0/1969547158 wait complete. 2023-11-24T06:29:18.089 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T06:29:18.089 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T06:29:18.133 INFO:tasks.ceph.mgr.y.smithi143.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-24T06:29:18.133 INFO:tasks.ceph.mgr.y.smithi143.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-24T06:29:18.133 INFO:tasks.ceph.mgr.y.smithi143.stderr: from numpy import show_config as show_numpy_config 2023-11-24T06:29:18.214 INFO:tasks.ceph.mgr.x.smithi146.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-24T06:29:18.214 INFO:tasks.ceph.mgr.x.smithi146.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-24T06:29:18.214 INFO:tasks.ceph.mgr.x.smithi146.stderr: from numpy import show_config as show_numpy_config 2023-11-24T06:29:18.222 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:18.221+0000 7f51129d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:29:18.256 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:18.256+0000 7f4cfbee2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:29:18.358 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:18.357+0000 7f51129d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:29:18.391 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:18.388+0000 7f4cfbee2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:29:18.463 INFO:tasks.ceph.osd.0.smithi143.stderr:2023-11-24T06:29:18.461+0000 7fa356287640 -1 Falling back to public interface 2023-11-24T06:29:18.495 INFO:tasks.ceph.osd.1.smithi143.stderr:2023-11-24T06:29:18.493+0000 7f0aad42b640 -1 Falling back to public interface 2023-11-24T06:29:18.496 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-11-24T06:29:18.496+0000 7fa89a460640 -1 Falling back to public interface 2023-11-24T06:29:18.497 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-11-24T06:29:18.496+0000 7f60c877e640 -1 Falling back to public interface 2023-11-24T06:29:18.497 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-11-24T06:29:18.496+0000 7fa899421640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-24T06:29:18.500 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-11-24T06:29:18.500+0000 7fb3dd293640 -1 Falling back to public interface 2023-11-24T06:29:18.519 INFO:tasks.ceph.osd.3.smithi143.stderr:2023-11-24T06:29:18.517+0000 7ff193844640 -1 Falling back to public interface 2023-11-24T06:29:18.531 INFO:tasks.ceph.osd.2.smithi143.stderr:2023-11-24T06:29:18.529+0000 7fd7db02b640 -1 Falling back to public interface 2023-11-24T06:29:18.540 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:18.537+0000 7f51129d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:29:18.544 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-11-24T06:29:18.544+0000 7fefc3cb2640 -1 Falling back to public interface 2023-11-24T06:29:18.577 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:18.576+0000 7f4cfbee2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:29:18.613 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:18.609+0000 7f51129d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:29:18.650 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:18.648+0000 7f4cfbee2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:29:18.750 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:18.745+0000 7f51129d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:29:18.787 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:18.784+0000 7f4cfbee2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:29:18.895 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:19.023 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246f268640 1 Processor -- start 2023-11-24T06:29:19.023 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246f268640 1 -- start start 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246f268640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24680b73a0 0x7f24681680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246f268640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680b9390 con 0x7f24680b4e30 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246f268640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680b7a10 con 0x7f24680d24e0 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246f268640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680b7830 con 0x7f24680b73a0 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246d805640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24680b73a0 0x7f24681680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246d805640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24680b73a0 0x7f24681680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38224/0 (socket says 172.21.15.143:38224) 2023-11-24T06:29:19.025 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246d805640 1 -- 172.21.15.143:0/3318020920 learned_addr learned my addr 172.21.15.143:0/3318020920 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:19.026 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246d805640 1 -- 172.21.15.143:0/3318020920 >> v1:172.21.15.146:6789/0 conn(0x7f24680d24e0 legacy=0x7f24680b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:19.026 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246d805640 1 -- 172.21.15.143:0/3318020920 >> v1:172.21.15.143:6789/0 conn(0x7f24680b4e30 legacy=0x7f24680b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:19.026 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f246d805640 1 -- 172.21.15.143:0/3318020920 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680b7cf0 con 0x7f24680b73a0 2023-11-24T06:29:19.026 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.021+0000 7f245ffff640 1 -- 172.21.15.143:0/3318020920 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558388524 0 0) 0x7f24680b9390 con 0x7f24680b4e30 2023-11-24T06:29:19.028 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f246d805640 1 --2- 172.21.15.143:0/3318020920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b73a0 0x7f24681680c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f246001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34588521edb79ad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:19.028 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f245ffff640 1 -- 172.21.15.143:0/3318020920 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600af400 con 0x7f24680b73a0 2023-11-24T06:29:19.029 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f245ffff640 1 -- 172.21.15.143:0/3318020920 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24600ab050 con 0x7f24680b73a0 2023-11-24T06:29:19.029 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f245ffff640 1 -- 172.21.15.143:0/3318020920 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600af780 con 0x7f24680b73a0 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f246f268640 1 -- 172.21.15.143:0/3318020920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b73a0 msgr2=0x7f24681680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f246f268640 1 --2- 172.21.15.143:0/3318020920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b73a0 0x7f24681680c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f246001f1f0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f246f268640 1 -- 172.21.15.143:0/3318020920 shutdown_connections 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f246f268640 1 --2- 172.21.15.143:0/3318020920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b73a0 0x7f24681680c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.025+0000 7f246f268640 1 -- 172.21.15.143:0/3318020920 >> 172.21.15.143:0/3318020920 conn(0x7f2468072070 msgr2=0x7f2468072480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 -- 172.21.15.143:0/3318020920 shutdown_connections 2023-11-24T06:29:19.030 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 -- 172.21.15.143:0/3318020920 wait complete. 2023-11-24T06:29:19.031 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 Processor -- start 2023-11-24T06:29:19.031 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 -- start start 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 0x7f246814aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24680b73a0 0x7f24680ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24680d24e0 0x7f2468141560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cd300 con 0x7f24680b4e30 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cc930 con 0x7f24680d24e0 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246f268640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cbd20 con 0x7f24680b73a0 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d004640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 0x7f246814aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:19.033 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24680d24e0 0x7f2468141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:19.034 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d004640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 0x7f246814aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38236/0 (socket says 172.21.15.143:38236) 2023-11-24T06:29:19.034 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d004640 1 -- 172.21.15.143:0/4283804729 learned_addr learned my addr 172.21.15.143:0/4283804729 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:19.034 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246c803640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24680b73a0 0x7f24680ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:19.034 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 -- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24680b73a0 msgr2=0x7f24680ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:19.034 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24680b73a0 0x7f24680ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.035 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 -- 172.21.15.143:0/4283804729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 msgr2=0x7f246814aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:19.035 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 0x7f246814aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.035 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 -- 172.21.15.143:0/4283804729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009b30 con 0x7f24680d24e0 2023-11-24T06:29:19.035 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d004640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 0x7f246814aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:19.036 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.029+0000 7f246d805640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24680d24e0 0x7f2468141560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24680d3f00 tx=0x7f246001bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:19.037 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600c0070 con 0x7f24680d24e0 2023-11-24T06:29:19.037 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460009510 con 0x7f24680d24e0 2023-11-24T06:29:19.037 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600afe80 con 0x7f24680d24e0 2023-11-24T06:29:19.037 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24680cc000 con 0x7f24680d24e0 2023-11-24T06:29:19.037 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24680cc5c0 con 0x7f24680d24e0 2023-11-24T06:29:19.038 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24600b6040 con 0x7f24680d24e0 2023-11-24T06:29:19.038 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f24600c5ae0 con 0x7f24680d24e0 2023-11-24T06:29:19.038 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24680ccaa0 con 0x7f24680d24e0 2023-11-24T06:29:19.038 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.033+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f24600b4070 con 0x7f24680d24e0 2023-11-24T06:29:19.094 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24680749a0 con 0x7f24680d24e0 2023-11-24T06:29:19.095 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f245dffb640 1 -- 172.21.15.143:0/4283804729 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f24600c5470 con 0x7f24680d24e0 2023-11-24T06:29:19.095 INFO:teuthology.misc.health.smithi143.stdout: 2023-11-24T06:29:19.095 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":10,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:17.756008+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:19.097 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24680d24e0 msgr2=0x7f2468141560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:19.097 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24680d24e0 0x7f2468141560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24680d3f00 tx=0x7f246001bf90 comp rx=0 tx=0).stop 2023-11-24T06:29:19.097 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 shutdown_connections 2023-11-24T06:29:19.097 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24680d24e0 0x7f2468141560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.098 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24680b73a0 0x7f24680ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.098 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 --2- 172.21.15.143:0/4283804729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24680b4e30 0x7f246814aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:19.098 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 >> 172.21.15.143:0/4283804729 conn(0x7f2468072070 msgr2=0x7f24680d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:19.098 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 shutdown_connections 2023-11-24T06:29:19.098 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:19.093+0000 7f246f268640 1 -- 172.21.15.143:0/4283804729 wait complete. 2023-11-24T06:29:19.113 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:29:19.433 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:19.429+0000 7f51129d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:29:19.471 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:19.468+0000 7f4cfbee2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:29:19.519 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:19.517+0000 7f51129d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:29:19.557 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:19.556+0000 7f4cfbee2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:29:19.709 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:19.705+0000 7f51129d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:29:19.749 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:19.748+0000 7f4cfbee2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:29:19.794 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:19.793+0000 7f51129d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:29:19.832 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:19.832+0000 7f4cfbee2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:29:20.120 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:20.117+0000 7f51129d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:29:20.159 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:20.156+0000 7f4cfbee2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:29:20.188 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:20.185+0000 7f51129d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:29:20.230 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-11-24T06:29:20.228+0000 7f4cfbee2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:29:21.211 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:21.209+0000 7f50ba05f640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T06:29:21.212 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:29:21.209+0000 7f50ba05f640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T06:29:22.349 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-11-24T06:29:22.348+0000 7fb3dd293640 -1 osd.5 0 log_to_monitors true 2023-11-24T06:29:22.415 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-11-24T06:29:22.412+0000 7f60c877e640 -1 osd.7 0 log_to_monitors true 2023-11-24T06:29:22.463 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-11-24T06:29:22.460+0000 7fa89a460640 -1 osd.4 0 log_to_monitors true 2023-11-24T06:29:22.492 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-11-24T06:29:22.492+0000 7fefc3cb2640 -1 osd.6 0 log_to_monitors true 2023-11-24T06:29:22.500 INFO:tasks.ceph.osd.1.smithi143.stderr:2023-11-24T06:29:22.496+0000 7f0aad42b640 -1 osd.1 0 log_to_monitors true 2023-11-24T06:29:22.501 INFO:tasks.ceph.osd.2.smithi143.stderr:2023-11-24T06:29:22.496+0000 7fd7db02b640 -1 osd.2 0 log_to_monitors true 2023-11-24T06:29:22.626 INFO:tasks.ceph.osd.3.smithi143.stderr:2023-11-24T06:29:22.624+0000 7ff193844640 -1 osd.3 0 log_to_monitors true 2023-11-24T06:29:22.741 INFO:tasks.ceph.osd.0.smithi143.stderr:2023-11-24T06:29:22.736+0000 7fa356287640 -1 osd.0 0 log_to_monitors true 2023-11-24T06:29:25.920 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:26.140 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.136+0000 7fb1a5593640 1 Processor -- start 2023-11-24T06:29:26.141 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.136+0000 7fb1a5593640 1 -- start start 2023-11-24T06:29:26.143 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a5593640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a00b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:26.144 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a5593640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1a00b4720 0x7fb1a0143e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:26.144 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a5593640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a0070b20 con 0x7fb1a00cb870 2023-11-24T06:29:26.144 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a5593640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00cd3e0 con 0x7fb1a00b4720 2023-11-24T06:29:26.144 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a5593640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00b4b90 con 0x7fb1a015c370 2023-11-24T06:29:26.144 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb19f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a00b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:26.145 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1a00b4720 0x7fb1a0143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:26.145 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1a00b4720 0x7fb1a0143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:34318/0 (socket says 172.21.15.143:34318) 2023-11-24T06:29:26.145 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 -- 172.21.15.143:0/2792665097 learned_addr learned my addr 172.21.15.143:0/2792665097 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:26.146 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 -- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 msgr2=0x7fb1a00b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:26.146 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 --2- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a00b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.146 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 -- 172.21.15.143:0/2792665097 >> v1:172.21.15.146:6789/0 conn(0x7fb1a00cb870 legacy=0x7fb1a00cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:26.146 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb19effd640 1 -- 172.21.15.143:0/2792665097 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966801381 0 0) 0x7fb1a0070b20 con 0x7fb1a00cb870 2023-11-24T06:29:26.151 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.140+0000 7fb1a4d92640 1 -- 172.21.15.143:0/2792665097 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00cbc50 con 0x7fb1a00b4720 2023-11-24T06:29:26.151 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a4d92640 1 --2- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a0143e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb198009e80 tx=0x7fb19801c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31adf14e5efb483 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:26.152 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb19effd640 1 -- 172.21.15.143:0/2792665097 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980a58b0 con 0x7fb1a00b4720 2023-11-24T06:29:26.152 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb19effd640 1 -- 172.21.15.143:0/2792665097 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1980a5a10 con 0x7fb1a00b4720 2023-11-24T06:29:26.152 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb19effd640 1 -- 172.21.15.143:0/2792665097 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980a5da0 con 0x7fb1a00b4720 2023-11-24T06:29:26.153 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 -- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 msgr2=0x7fb1a0143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:26.153 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 --2- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a0143e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb198009e80 tx=0x7fb19801c9f0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.154 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 -- 172.21.15.143:0/2792665097 shutdown_connections 2023-11-24T06:29:26.154 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 --2- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a0143e70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.154 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 --2- 172.21.15.143:0/2792665097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a00b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.154 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 -- 172.21.15.143:0/2792665097 >> 172.21.15.143:0/2792665097 conn(0x7fb1a006c510 msgr2=0x7fb1a006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:26.154 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 -- 172.21.15.143:0/2792665097 shutdown_connections 2023-11-24T06:29:26.154 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.148+0000 7fb1a5593640 1 -- 172.21.15.143:0/2792665097 wait complete. 2023-11-24T06:29:26.156 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 Processor -- start 2023-11-24T06:29:26.156 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 -- start start 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a013b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a00cb870 0x7fb1a013b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a014db90 con 0x7fb1a00cb870 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a014de70 con 0x7fb1a00b4720 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb1a5593640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a014e150 con 0x7fb1a015c370 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.152+0000 7fb19ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a00cb870 0x7fb1a013b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb1a4d92640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a0153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:26.160 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb1a4d92640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a0153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:50134/0 (socket says 172.21.15.143:50134) 2023-11-24T06:29:26.161 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb1a4d92640 1 -- 172.21.15.143:0/3914936160 learned_addr learned my addr 172.21.15.143:0/3914936160 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:26.161 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19ffff640 1 -- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 msgr2=0x7fb1a0153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:26.161 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19ffff640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a0153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.161 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19ffff640 1 -- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a00cb870 msgr2=0x7fb1a013b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:26.161 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19ffff640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a00cb870 0x7fb1a013b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.161 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19ffff640 1 -- 172.21.15.143:0/3914936160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009b30 con 0x7fb1a00b4720 2023-11-24T06:29:26.162 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19ffff640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a013b630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb1900011f0 tx=0x7fb19000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:26.162 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900054e0 con 0x7fb1a00b4720 2023-11-24T06:29:26.162 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190003600 con 0x7fb1a00b4720 2023-11-24T06:29:26.162 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190003a30 con 0x7fb1a00b4720 2023-11-24T06:29:26.163 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a014e430 con 0x7fb1a00b4720 2023-11-24T06:29:26.163 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.156+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a013be60 con 0x7fb1a00b4720 2023-11-24T06:29:26.164 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.160+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a0068500 con 0x7fb1a00b4720 2023-11-24T06:29:26.165 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.160+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7fb190003b90 con 0x7fb1a00b4720 2023-11-24T06:29:26.168 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.164+0000 7fb19cff9640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb18c066410 0x7fb18c0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:26.168 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.164+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fb1900824a0 con 0x7fb1a00b4720 2023-11-24T06:29:26.168 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.164+0000 7fb19f7fe640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb18c066410 0x7fb18c0688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:26.168 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.164+0000 7fb19f7fe640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb18c066410 0x7fb18c0688d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1a013ea30 tx=0x7fb194008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:26.176 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.172+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb190050830 con 0x7fb1a00b4720 2023-11-24T06:29:26.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.460+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a014dfb0 con 0x7fb1a00b4720 2023-11-24T06:29:26.469 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.464+0000 7fb19cff9640 1 -- 172.21.15.143:0/3914936160 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb1a014dfb0 con 0x7fb1a00b4720 2023-11-24T06:29:26.472 INFO:teuthology.misc.health.smithi143.stdout: 2023-11-24T06:29:26.472 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":12,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:24.216028+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:26.472 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb18c066410 msgr2=0x7fb18c0688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb18c066410 0x7fb18c0688d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1a013ea30 tx=0x7fb194008040 comp rx=0 tx=0).stop 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 msgr2=0x7fb1a013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a013b630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb1900011f0 tx=0x7fb19000c8c0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 shutdown_connections 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb18c066410 0x7fb18c0688d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a015c370 0x7fb1a0153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a00cb870 0x7fb1a013b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 --2- 172.21.15.143:0/3914936160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00b4720 0x7fb1a013b630 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:26.473 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 >> 172.21.15.143:0/3914936160 conn(0x7fb1a006c510 msgr2=0x7fb1a0157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:26.474 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 shutdown_connections 2023-11-24T06:29:26.474 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:26.468+0000 7fb1a5593640 1 -- 172.21.15.143:0/3914936160 wait complete. 2023-11-24T06:29:26.508 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:29:26.645 INFO:tasks.ceph.osd.0.smithi143.stderr:2023-11-24T06:29:26.640+0000 7fa353244640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T06:29:26.657 INFO:tasks.ceph.osd.3.smithi143.stderr:2023-11-24T06:29:26.652+0000 7ff18efcb640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T06:29:26.668 INFO:tasks.ceph.osd.1.smithi143.stderr:2023-11-24T06:29:26.664+0000 7f0aa99c9640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T06:29:26.672 INFO:tasks.ceph.osd.0.smithi143.stderr:2023-11-24T06:29:26.668+0000 7fa34a05b640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.687 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-11-24T06:29:26.684+0000 7fefbf439640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T06:29:26.692 INFO:tasks.ceph.osd.3.smithi143.stderr:2023-11-24T06:29:26.688+0000 7ff187618640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.694 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-11-24T06:29:26.692+0000 7fa895be7640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T06:29:26.702 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-11-24T06:29:26.700+0000 7f60c3f05640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T06:29:26.703 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-11-24T06:29:26.700+0000 7fb3da250640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T06:29:26.712 INFO:tasks.ceph.osd.1.smithi143.stderr:2023-11-24T06:29:26.708+0000 7f0aa07e0640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.713 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-11-24T06:29:26.712+0000 7fefb7a86640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.737 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-11-24T06:29:26.736+0000 7fb3d1067640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.745 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-11-24T06:29:26.744+0000 7fa88e234640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.749 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-11-24T06:29:26.748+0000 7f60bc552640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:26.760 INFO:tasks.ceph.osd.2.smithi143.stderr:2023-11-24T06:29:26.756+0000 7fd7d5d75640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T06:29:26.780 INFO:tasks.ceph.osd.2.smithi143.stderr:2023-11-24T06:29:26.776+0000 7fd7ce3c2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:29:33.316 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:33.452 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 Processor -- start 2023-11-24T06:29:33.452 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 -- start start 2023-11-24T06:29:33.453 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0500d24e0 0x7fd0500b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.453 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 0x7fd0500b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.453 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0500b7a10 con 0x7fd0500b4e30 2023-11-24T06:29:33.453 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0500b7cf0 con 0x7fd0500d24e0 2023-11-24T06:29:33.453 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd0560bb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b7fd0 con 0x7fd0500b6390 2023-11-24T06:29:33.454 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd0500b4e30 0x7fd0500b5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:42294/0 (socket says 172.21.15.143:42294) 2023-11-24T06:29:33.454 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04f7fe640 1 -- 172.21.15.143:0/408438456 learned_addr learned my addr 172.21.15.143:0/408438456 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:33.455 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd047fff640 1 --2- 172.21.15.143:0/408438456 >> v2:172.21.15.146:3300/0 conn(0x7fd0500d24e0 0x7fd0500b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04ffff640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 0x7fd0500b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656948802 0 0) 0x7fd0500b7a10 con 0x7fd0500b4e30 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd03c003530 con 0x7fd0500b4e30 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 715275341 0 0) 0x7fd03c003530 con 0x7fd0500b4e30 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 msgr2=0x7fd0500b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 0x7fd0500b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 >> v2:172.21.15.146:3300/0 conn(0x7fd0500d24e0 msgr2=0x7fd0500b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 --2- 172.21.15.143:0/408438456 >> v2:172.21.15.146:3300/0 conn(0x7fd0500d24e0 0x7fd0500b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500b82b0 con 0x7fd0500b4e30 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fd040001680 con 0x7fd0500b4e30 2023-11-24T06:29:33.456 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 >> v1:172.21.15.143:6789/0 conn(0x7fd0500b4e30 legacy=0x7fd0500b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd03c003980 0x7fd03c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 0x7fd03c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c004d10 0x7fd03c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b7cf0 con 0x7fd03c003980 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b7fd0 con 0x7fd03c004d10 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c00b990 con 0x7fd0500b6390 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd03c003980 0x7fd03c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd04ffff640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c004d10 0x7fd03c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.451+0000 7fd047fff640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 0x7fd03c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04f7fe640 1 -- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 msgr2=0x7fd03c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0500b6390 0x7fd03c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.457 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04f7fe640 1 -- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c004d10 msgr2=0x7fd03c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.458 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c004d10 0x7fd03c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.458 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04f7fe640 1 -- 172.21.15.143:0/408438456 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c003530 con 0x7fd03c003980 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd03c003980 0x7fd03c003da0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c240 tx=0x7fd04001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ff3a12b880f53b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040005ae0 con 0x7fd03c003980 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400ab070 con 0x7fd03c003980 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04effd640 1 -- 172.21.15.143:0/408438456 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040005ea0 con 0x7fd03c003980 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd0560bb640 1 -- 172.21.15.143:0/408438456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd03c003980 msgr2=0x7fd03c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd0560bb640 1 --2- 172.21.15.143:0/408438456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd03c003980 0x7fd03c003da0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c240 tx=0x7fd04001f3d0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd04ffff640 1 -- 172.21.15.143:0/408438456 reap_dead start 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd0560bb640 1 -- 172.21.15.143:0/408438456 shutdown_connections 2023-11-24T06:29:33.459 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd0560bb640 1 -- 172.21.15.143:0/408438456 >> 172.21.15.143:0/408438456 conn(0x7fd050072070 msgr2=0x7fd050072480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:33.460 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd0560bb640 1 -- 172.21.15.143:0/408438456 shutdown_connections 2023-11-24T06:29:33.460 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.455+0000 7fd0560bb640 1 -- 172.21.15.143:0/408438456 wait complete. 2023-11-24T06:29:33.461 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 Processor -- start 2023-11-24T06:29:33.461 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 -- start start 2023-11-24T06:29:33.462 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd03c003980 0x7fd050155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.462 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd05015e670 0x7fd0500c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.462 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 0x7fd0500d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.462 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05015eaf0 con 0x7fd050156d00 2023-11-24T06:29:33.462 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd050155c60 con 0x7fd05015e670 2023-11-24T06:29:33.462 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd0560bb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd050155f40 con 0x7fd03c003980 2023-11-24T06:29:33.463 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 0x7fd0500d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.463 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 0x7fd0500d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32886/0 (socket says 172.21.15.143:32886) 2023-11-24T06:29:33.463 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 -- 172.21.15.143:0/3503643760 learned_addr learned my addr 172.21.15.143:0/3503643760 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:33.463 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd03c003980 0x7fd050155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.463 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd047fff640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd05015e670 0x7fd0500c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.465 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 -- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd03c003980 msgr2=0x7fd050155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.465 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd03c003980 0x7fd050155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.465 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 -- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd05015e670 msgr2=0x7fd0500c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.465 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd05015e670 0x7fd0500c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.465 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 -- 172.21.15.143:0/3503643760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050156220 con 0x7fd050156d00 2023-11-24T06:29:33.465 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.459+0000 7fd04ffff640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 0x7fd0500d13d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd0500d4450 tx=0x7fd04800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04800e040 con 0x7fd050156d00 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04800f040 con 0x7fd050156d00 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048015430 con 0x7fd050156d00 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd050156500 con 0x7fd050156d00 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0500c9330 con 0x7fd050156d00 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05015bb70 con 0x7fd050156d00 2023-11-24T06:29:33.466 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd048015590 con 0x7fd050156d00 2023-11-24T06:29:33.467 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04cff9640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd030066470 0x7fd030068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.467 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd048084200 con 0x7fd050156d00 2023-11-24T06:29:33.467 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd030066470 0x7fd030068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.467 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.463+0000 7fd04f7fe640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd030066470 0x7fd030068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0400ae000 tx=0x7fd0400b4040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:33.471 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.471+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd048051930 con 0x7fd050156d00 2023-11-24T06:29:33.620 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.619+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0500d2310 con 0x7fd050156d00 2023-11-24T06:29:33.621 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.619+0000 7fd04cff9640 1 -- 172.21.15.143:0/3503643760 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fd048054f50 con 0x7fd050156d00 2023-11-24T06:29:33.621 INFO:teuthology.misc.health.smithi143.stdout: 2023-11-24T06:29:33.621 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":16,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:30.691486+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:33.623 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.619+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd030066470 msgr2=0x7fd030068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.623 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.619+0000 7fd0560bb640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd030066470 0x7fd030068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0400ae000 tx=0x7fd0400b4040 comp rx=0 tx=0).stop 2023-11-24T06:29:33.623 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.619+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 msgr2=0x7fd0500d13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.623 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.619+0000 7fd0560bb640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 0x7fd0500d13d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd0500d4450 tx=0x7fd04800f1b0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 shutdown_connections 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd030066470 0x7fd030068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd050156d00 0x7fd0500d13d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd05015e670 0x7fd0500c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 --2- 172.21.15.143:0/3503643760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd03c003980 0x7fd050155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 >> 172.21.15.143:0/3503643760 conn(0x7fd050072070 msgr2=0x7fd0500ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 shutdown_connections 2023-11-24T06:29:33.624 INFO:teuthology.misc.health.smithi143.stderr:2023-11-24T06:29:33.623+0000 7fd0560bb640 1 -- 172.21.15.143:0/3503643760 wait complete. 2023-11-24T06:29:33.641 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T06:29:33.642 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T06:29:33.643 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:29:33.643 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:29:33.646 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:29:33.647 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:29:33.647 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:29:33.651 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:29:33.651 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:29:33.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:29:33.655 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:29:33.655 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:29:33.655 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:29:33.659 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:29:33.659 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T06:29:33.660 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:33.751 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:29:33.751 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:29:33.752 INFO:tasks.ceph.mds.a.smithi143.stderr:2023-11-24T06:29:33.751+0000 7f85943ab640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-24T06:29:33.761 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-11-24T06:29:33.761 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:29:33.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.803+0000 7f74f5535640 1 Processor -- start 2023-11-24T06:29:33.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.803+0000 7f74f5535640 1 -- start start 2023-11-24T06:29:33.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74f5535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00d3020 0x7f74f00d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74f5535640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f006c0e0 con 0x7f74f015d570 2023-11-24T06:29:33.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74f5535640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f00d39c0 con 0x7f74f00ce8b0 2023-11-24T06:29:33.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74f5535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f00d1cc0 con 0x7f74f00d3020 2023-11-24T06:29:33.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f74f015d570 0x7f74f006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:42320/0 (socket says 172.21.15.143:42320) 2023-11-24T06:29:33.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 -- 172.21.15.143:0/2901176117 learned_addr learned my addr 172.21.15.143:0/2901176117 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:33.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00d3020 0x7f74f00d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704839474 0 0) 0x7f74f006c0e0 con 0x7f74f015d570 2023-11-24T06:29:33.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d8003530 con 0x7f74f015d570 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365293904 0 0) 0x7f74f00d39c0 con 0x7f74f00ce8b0 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f006c0e0 con 0x7f74f00ce8b0 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290684129 0 0) 0x7f74d8003530 con 0x7f74f015d570 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00d3020 msgr2=0x7f74f00d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00d3020 0x7f74f00d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 >> v1:172.21.15.146:6789/0 conn(0x7f74f00ce8b0 legacy=0x7f74f00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f00d1fa0 con 0x7f74f015d570 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f74e0001680 con 0x7f74f015d570 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 >> v1:172.21.15.143:6789/0 conn(0x7f74f015d570 legacy=0x7f74f006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74d8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74d80047d0 0x7f74d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74d8005190 0x7f74d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f00d1cc0 con 0x7f74d8003b40 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800c000 con 0x7f74d80047d0 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800c1c0 con 0x7f74d8005190 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00d3020 0x7f74f00d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74d8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74ef7fe640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74d8005190 0x7f74d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74d80047d0 0x7f74d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 -- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74d8005190 msgr2=0x7f74d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74d8005190 0x7f74d800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 -- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74d80047d0 msgr2=0x7f74d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:33.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74d80047d0 0x7f74d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74eeffd640 1 -- 172.21.15.143:0/2901176117 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8003530 con 0x7f74d8003b40 2023-11-24T06:29:33.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.807+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74d80047d0 0x7f74d8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74d8003f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74e000c160 tx=0x7f74e001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b28d6cd1fbb588b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00058e0 con 0x7f74d8003b40 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e0005a60 con 0x7f74d8003b40 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74edffb640 1 -- 172.21.15.143:0/2901176117 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0005e10 con 0x7f74d8003b40 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 -- 172.21.15.143:0/2901176117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 msgr2=0x7f74d8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 --2- 172.21.15.143:0/2901176117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74d8003f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74e000c160 tx=0x7f74e001cb90 comp rx=0 tx=0).stop 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74ef7fe640 1 -- 172.21.15.143:0/2901176117 reap_dead start 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 -- 172.21.15.143:0/2901176117 shutdown_connections 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 -- 172.21.15.143:0/2901176117 >> 172.21.15.143:0/2901176117 conn(0x7f74f008ceb0 msgr2=0x7f74f009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:33.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 -- 172.21.15.143:0/2901176117 shutdown_connections 2023-11-24T06:29:33.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 -- 172.21.15.143:0/2901176117 wait complete. 2023-11-24T06:29:33.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.811+0000 7f74f5535640 1 Processor -- start 2023-11-24T06:29:33.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- start start 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74f014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f00c82c0 0x7f74f00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00b3440 0x7f74f00b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f00cc840 con 0x7f74d8003b40 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f00b3e00 con 0x7f74f00c82c0 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f00cb450 con 0x7f74f00b3440 2023-11-24T06:29:33.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74f014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74f014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32936/0 (socket says 172.21.15.143:32936) 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 -- 172.21.15.143:0/2306971236 learned_addr learned my addr 172.21.15.143:0/2306971236 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74ef7fe640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00b3440 0x7f74f00b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f00c82c0 0x7f74f00c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 -- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00b3440 msgr2=0x7f74f00b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00b3440 0x7f74f00b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 -- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f00c82c0 msgr2=0x7f74f00c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f00c82c0 0x7f74f00c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 -- 172.21.15.143:0/2306971236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f00ca840 con 0x7f74d8003b40 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f00c82c0 0x7f74f00c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74eeffd640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74f014c790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74e00ab040 tx=0x7f74d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:33.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00047f0 con 0x7f74d8003b40 2023-11-24T06:29:33.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e0004950 con 0x7f74d8003b40 2023-11-24T06:29:33.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0004cc0 con 0x7f74d8003b40 2023-11-24T06:29:33.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f00cab20 con 0x7f74d8003b40 2023-11-24T06:29:33.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f00cb0e0 con 0x7f74d8003b40 2023-11-24T06:29:33.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.815+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f0067520 con 0x7f74d8003b40 2023-11-24T06:29:33.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.819+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74e00a5780 con 0x7f74d8003b40 2023-11-24T06:29:33.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.819+0000 7f74d77fe640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f74dc066470 0x7f74dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:33.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.819+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74e011cf20 con 0x7f74d8003b40 2023-11-24T06:29:33.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.819+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f74dc066470 0x7f74dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:33.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.819+0000 7f74ee7fc640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f74dc066470 0x7f74dc068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74f01f9bf0 tx=0x7f74e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:33.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.823+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74e00ea6e0 con 0x7f74d8003b40 2023-11-24T06:29:33.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.971+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74f006b7b0 con 0x7f74d8003b40 2023-11-24T06:29:33.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.971+0000 7f74d77fe640 1 -- 172.21.15.143:0/2306971236 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f74e00bc090 con 0x7f74d8003b40 2023-11-24T06:29:33.975 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:33.976 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":16,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:30.691486+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:33.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f74dc066470 msgr2=0x7f74dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f74dc066470 0x7f74dc068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74f01f9bf0 tx=0x7f74e4008040 comp rx=0 tx=0).stop 2023-11-24T06:29:33.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 msgr2=0x7f74f014c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:33.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74f014c790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74e00ab040 tx=0x7f74d8005800 comp rx=0 tx=0).stop 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 shutdown_connections 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f74dc066470 0x7f74dc068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74f00b3440 0x7f74f00b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f00c82c0 0x7f74f00c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 --2- 172.21.15.143:0/2306971236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d8003b40 0x7f74f014c790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 >> 172.21.15.143:0/2306971236 conn(0x7f74f008ceb0 msgr2=0x7f74f00b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 shutdown_connections 2023-11-24T06:29:33.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:33.975+0000 7f74f5535640 1 -- 172.21.15.143:0/2306971236 wait complete. 2023-11-24T06:29:33.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:29:33.997 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:29:34.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.135+0000 7f3f473d1640 1 Processor -- start 2023-11-24T06:29:34.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f473d1640 1 -- start start 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f473d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 0x7f3f4006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f473d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4006c620 con 0x7f3f400ce200 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f473d1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4006ba10 con 0x7f3f4015d630 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f473d1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4006bcf0 con 0x7f3f400cf4d0 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3f400ce200 0x7f3f400cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:42328/0 (socket says 172.21.15.143:42328) 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 -- 172.21.15.143:0/620050999 learned_addr learned my addr 172.21.15.143:0/620050999 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4596e640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 0x7f3f4006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791047201 0 0) 0x7f3f4006c620 con 0x7f3f400ce200 2023-11-24T06:29:34.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f2c003530 con 0x7f3f400ce200 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465475975 0 0) 0x7f3f4006ba10 con 0x7f3f4015d630 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f4006c620 con 0x7f3f4015d630 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1584148486 0 0) 0x7f3f2c003530 con 0x7f3f400ce200 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 msgr2=0x7f3f4006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 0x7f3f4006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 >> v1:172.21.15.146:6789/0 conn(0x7f3f4015d630 legacy=0x7f3f400cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4006bfd0 con 0x7f3f400ce200 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f3f30001680 con 0x7f3f400ce200 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 >> v1:172.21.15.143:6789/0 conn(0x7f3f400ce200 legacy=0x7f3f400cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c003b40 0x7f3f2c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f2c0047d0 0x7f3f2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 0x7f3f2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4006bcf0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c00ba40 con 0x7f3f2c003b40 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c00bc00 con 0x7f3f400cf4d0 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f2c0047d0 0x7f3f2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4516d640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c003b40 0x7f3f2c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4596e640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 0x7f3f2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 -- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 msgr2=0x7f3f2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400cf4d0 0x7f3f2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 -- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c003b40 msgr2=0x7f3f2c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c003b40 0x7f3f2c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.139+0000 7f3f4496c640 1 -- 172.21.15.143:0/620050999 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c003530 con 0x7f3f2c0047d0 2023-11-24T06:29:34.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f4496c640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f2c0047d0 0x7f3f2c004c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f30001ec0 tx=0x7f3f3001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ab628aa0fab7cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300058e0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30005a60 con 0x7f3f2c0047d0 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f37fff640 1 -- 172.21.15.143:0/620050999 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30005e10 con 0x7f3f2c0047d0 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f473d1640 1 -- 172.21.15.143:0/620050999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f2c0047d0 msgr2=0x7f3f2c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f473d1640 1 --2- 172.21.15.143:0/620050999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f2c0047d0 0x7f3f2c004c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f30001ec0 tx=0x7f3f3001cb60 comp rx=0 tx=0).stop 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f4596e640 1 -- 172.21.15.143:0/620050999 reap_dead start 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f473d1640 1 -- 172.21.15.143:0/620050999 shutdown_connections 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f473d1640 1 -- 172.21.15.143:0/620050999 >> 172.21.15.143:0/620050999 conn(0x7f3f4006e860 msgr2=0x7f3f4006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f473d1640 1 -- 172.21.15.143:0/620050999 shutdown_connections 2023-11-24T06:29:34.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.143+0000 7f3f473d1640 1 -- 172.21.15.143:0/620050999 wait complete. 2023-11-24T06:29:34.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 Processor -- start 2023-11-24T06:29:34.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 -- start start 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c0047d0 0x7f3f4015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 0x7f3f4015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f401469b0 0x7f3f40146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400c89e0 con 0x7f3f40153730 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400c8440 con 0x7f3f2c0047d0 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400c8700 con 0x7f3f401469b0 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4496c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 0x7f3f4015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4496c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 0x7f3f4015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32946/0 (socket says 172.21.15.143:32946) 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4496c640 1 -- 172.21.15.143:0/3409151702 learned_addr learned my addr 172.21.15.143:0/3409151702 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c0047d0 0x7f3f4015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4596e640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f401469b0 0x7f3f40146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 -- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f401469b0 msgr2=0x7f3f40146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f401469b0 0x7f3f40146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 -- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 msgr2=0x7f3f4015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 0x7f3f4015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 -- 172.21.15.143:0/3409151702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f401447c0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4496c640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 0x7f3f4015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f4516d640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c0047d0 0x7f3f4015be50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c007fd0 tx=0x7f3f3c012c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0109c0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c010b40 con 0x7f3f2c0047d0 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40144aa0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c016480 con 0x7f3f2c0047d0 2023-11-24T06:29:34.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.147+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40147540 con 0x7f3f2c0047d0 2023-11-24T06:29:34.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.151+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40144600 con 0x7f3f2c0047d0 2023-11-24T06:29:34.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.151+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f3c0165e0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.151+0000 7f3f35ffb640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f240664a0 0x7f3f24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.151+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f3c087190 con 0x7f3f2c0047d0 2023-11-24T06:29:34.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.151+0000 7f3f4496c640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f240664a0 0x7f3f24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.151+0000 7f3f4496c640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f240664a0 0x7f3f24068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f3001cba0 tx=0x7f3f30001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:34.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.155+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f3c054a30 con 0x7f3f2c0047d0 2023-11-24T06:29:34.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.307+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f4004e8c0 con 0x7f3f2c0047d0 2023-11-24T06:29:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.307+0000 7f3f35ffb640 1 -- 172.21.15.143:0/3409151702 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f3c058050 con 0x7f3f2c0047d0 2023-11-24T06:29:34.310 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f240664a0 msgr2=0x7f3f24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f240664a0 0x7f3f24068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f3001cba0 tx=0x7f3f30001a00 comp rx=0 tx=0).stop 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c0047d0 msgr2=0x7f3f4015be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c0047d0 0x7f3f4015be50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c007fd0 tx=0x7f3f3c012c90 comp rx=0 tx=0).stop 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 shutdown_connections 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f240664a0 0x7f3f24068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f401469b0 0x7f3f40146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f40153730 0x7f3f4015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 --2- 172.21.15.143:0/3409151702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f2c0047d0 0x7f3f4015be50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 >> 172.21.15.143:0/3409151702 conn(0x7f3f4006e860 msgr2=0x7f3f4015dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 shutdown_connections 2023-11-24T06:29:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.311+0000 7f3f473d1640 1 -- 172.21.15.143:0/3409151702 wait complete. 2023-11-24T06:29:34.332 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:29:34.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 Processor -- start 2023-11-24T06:29:34.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 -- start start 2023-11-24T06:29:34.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c2415d570 0x7f9c2406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c240ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240d1cc0 con 0x7f9c240d3020 2023-11-24T06:29:34.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c240d1fa0 con 0x7f9c2415d570 2023-11-24T06:29:34.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c2ad94640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240ce0b0 con 0x7f9c240ce8b0 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c2415d570 0x7f9c2406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c29331640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c240ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c2415d570 0x7f9c2406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:53754/0 (socket says 172.21.15.143:53754) 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 -- 172.21.15.143:0/2360456886 learned_addr learned my addr 172.21.15.143:0/2360456886 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c1bfff640 1 --1- 172.21.15.143:0/2360456886 >> v1:172.21.15.146:6789/0 conn(0x7f9c240d3020 0x7f9c240d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:46076/0 (socket says 172.21.15.143:46076) 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 -- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 msgr2=0x7f9c240ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 --2- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c240ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 -- 172.21.15.143:0/2360456886 >> v1:172.21.15.146:6789/0 conn(0x7f9c240d3020 legacy=0x7f9c240d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.467+0000 7f9c28b30640 1 -- 172.21.15.143:0/2360456886 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240ce390 con 0x7f9c2415d570 2023-11-24T06:29:34.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c28b30640 1 --2- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c2406b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009870 tx=0x7f9c2001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ad8c1d1ce1268c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:34.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c1b7fe640 1 -- 172.21.15.143:0/2360456886 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200a95f0 con 0x7f9c2415d570 2023-11-24T06:29:34.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c1b7fe640 1 -- 172.21.15.143:0/2360456886 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c200a9750 con 0x7f9c2415d570 2023-11-24T06:29:34.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c1b7fe640 1 -- 172.21.15.143:0/2360456886 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200a9ae0 con 0x7f9c2415d570 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 -- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 msgr2=0x7f9c2406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c2406b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009870 tx=0x7f9c2001c510 comp rx=0 tx=0).stop 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 -- 172.21.15.143:0/2360456886 shutdown_connections 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c240ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/2360456886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c2406b9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 -- 172.21.15.143:0/2360456886 >> 172.21.15.143:0/2360456886 conn(0x7f9c2408ceb0 msgr2=0x7f9c2409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 -- 172.21.15.143:0/2360456886 shutdown_connections 2023-11-24T06:29:34.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.471+0000 7f9c2ad94640 1 -- 172.21.15.143:0/2360456886 wait complete. 2023-11-24T06:29:34.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 Processor -- start 2023-11-24T06:29:34.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 -- start start 2023-11-24T06:29:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c2415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 0x7f9c2415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c240c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240ca670 con 0x7f9c240d3020 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240ca950 con 0x7f9c2415d570 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240cac30 con 0x7f9c240ce8b0 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 0x7f9c2415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 0x7f9c2415ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32954/0 (socket says 172.21.15.143:32954) 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 -- 172.21.15.143:0/681743597 learned_addr learned my addr 172.21.15.143:0/681743597 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c28b30640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c2415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c29331640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c240c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 -- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 msgr2=0x7f9c2415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c2415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 -- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 msgr2=0x7f9c240c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c240c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 -- 172.21.15.143:0/681743597 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c200094d0 con 0x7f9c240d3020 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c1bfff640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 0x7f9c2415ab00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400c500 tx=0x7f9c1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14007500 con 0x7f9c240d3020 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14007660 con 0x7f9c240d3020 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c240caf10 con 0x7f9c240d3020 2023-11-24T06:29:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14004a10 con 0x7f9c240d3020 2023-11-24T06:29:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.475+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2414cab0 con 0x7f9c240d3020 2023-11-24T06:29:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.479+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2415b1f0 con 0x7f9c240d3020 2023-11-24T06:29:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.479+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c14004b70 con 0x7f9c240d3020 2023-11-24T06:29:34.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.479+0000 7f9c197fa640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c10066470 0x7f9c10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:34.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.479+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c14082fb0 con 0x7f9c240d3020 2023-11-24T06:29:34.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.479+0000 7f9c28b30640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c10066470 0x7f9c10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:34.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.479+0000 7f9c28b30640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c10066470 0x7f9c10068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ae000 tx=0x7f9c200b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.483+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c14050820 con 0x7f9c240d3020 2023-11-24T06:29:34.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.663+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c240cb3c0 con 0x7f9c240d3020 2023-11-24T06:29:34.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.663+0000 7f9c197fa640 1 -- 172.21.15.143:0/681743597 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f9c14018090 con 0x7f9c240d3020 2023-11-24T06:29:34.666 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:34.666 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T06:29:34.672 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 2 2023-11-24T06:29:34.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c10066470 msgr2=0x7f9c10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c10066470 0x7f9c10068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ae000 tx=0x7f9c200b3040 comp rx=0 tx=0).stop 2023-11-24T06:29:34.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 msgr2=0x7f9c2415ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:34.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 0x7f9c2415ab00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400c500 tx=0x7f9c1400c9c0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 shutdown_connections 2023-11-24T06:29:34.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c10066470 0x7f9c10068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2415d570 0x7f9c240c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c240d3020 0x7f9c2415ab00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 --2- 172.21.15.143:0/681743597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c240ce8b0 0x7f9c2415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:34.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 >> 172.21.15.143:0/681743597 conn(0x7f9c2408ceb0 msgr2=0x7f9c240b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:34.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 shutdown_connections 2023-11-24T06:29:34.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:34.667+0000 7f9c2ad94640 1 -- 172.21.15.143:0/681743597 wait complete. 2023-11-24T06:29:36.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:29:36.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 Processor -- start 2023-11-24T06:29:36.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 -- start start 2023-11-24T06:29:36.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23b815d570 0x7f23b806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23b80d3020 0x7f23b80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b80ce8b0 0x7f23b80ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80d39f0 con 0x7f23b815d570 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80d1cc0 con 0x7f23b80d3020 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23be5df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80d1fa0 con 0x7f23b80ce8b0 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23b815d570 0x7f23b806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23b815d570 0x7f23b806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32958/0 (socket says 172.21.15.143:32958) 2023-11-24T06:29:36.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 -- 172.21.15.143:0/4229818409 learned_addr learned my addr 172.21.15.143:0/4229818409 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:36.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 -- 172.21.15.143:0/4229818409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b80ce8b0 msgr2=0x7f23b80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:36.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b77fe640 1 --2- 172.21.15.143:0/4229818409 >> v2:172.21.15.146:3300/0 conn(0x7f23b80d3020 0x7f23b80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23bcb7c640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b80ce8b0 0x7f23b80ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b80ce8b0 0x7f23b80ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 -- 172.21.15.143:0/4229818409 >> v2:172.21.15.146:3300/0 conn(0x7f23b80d3020 msgr2=0x7f23b80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:36.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 --2- 172.21.15.143:0/4229818409 >> v2:172.21.15.146:3300/0 conn(0x7f23b80d3020 0x7f23b80d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b7fff640 1 -- 172.21.15.143:0/4229818409 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80ce0b0 con 0x7f23b815d570 2023-11-24T06:29:36.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23bcb7c640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b80ce8b0 0x7f23b80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:36.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.835+0000 7f23b77fe640 1 --2- 172.21.15.143:0/4229818409 >> v2:172.21.15.146:3300/0 conn(0x7f23b80d3020 0x7f23b80d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:36.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23b7fff640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b815d570 0x7f23b806b9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23b80b5f00 tx=0x7f23a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689408e6fb5a7b4a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:36.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23b6ffd640 1 -- 172.21.15.143:0/4229818409 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80aa610 con 0x7f23b815d570 2023-11-24T06:29:36.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23b6ffd640 1 -- 172.21.15.143:0/4229818409 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a80a6040 con 0x7f23b815d570 2023-11-24T06:29:36.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23b6ffd640 1 -- 172.21.15.143:0/4229818409 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80aa990 con 0x7f23b815d570 2023-11-24T06:29:36.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 -- 172.21.15.143:0/4229818409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b815d570 msgr2=0x7f23b806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:36.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b815d570 0x7f23b806b9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23b80b5f00 tx=0x7f23a801c4d0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 -- 172.21.15.143:0/4229818409 shutdown_connections 2023-11-24T06:29:36.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b80ce8b0 0x7f23b80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 --2- 172.21.15.143:0/4229818409 >> v2:172.21.15.146:3300/0 conn(0x7f23b80d3020 0x7f23b80d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 --2- 172.21.15.143:0/4229818409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b815d570 0x7f23b806b9d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 -- 172.21.15.143:0/4229818409 >> 172.21.15.143:0/4229818409 conn(0x7f23b808ceb0 msgr2=0x7f23b809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:36.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 -- 172.21.15.143:0/4229818409 shutdown_connections 2023-11-24T06:29:36.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.839+0000 7f23be5df640 1 -- 172.21.15.143:0/4229818409 wait complete. 2023-11-24T06:29:36.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 Processor -- start 2023-11-24T06:29:36.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 -- start start 2023-11-24T06:29:36.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 0x7f23b80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23b80d3020 0x7f23b80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b815d570 0x7f23b80cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b815cf50 con 0x7f23b80ce8b0 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80c6fd0 con 0x7f23b80d3020 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80c72b0 con 0x7f23b815d570 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 0x7f23b80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 0x7f23b80b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32964/0 (socket says 172.21.15.143:32964) 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 -- 172.21.15.143:0/831071761 learned_addr learned my addr 172.21.15.143:0/831071761 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23bcb7c640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b815d570 0x7f23b80cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b77fe640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23b80d3020 0x7f23b80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 -- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b815d570 msgr2=0x7f23b80cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:36.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b815d570 0x7f23b80cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 -- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23b80d3020 msgr2=0x7f23b80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23b80d3020 0x7f23b80cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 -- 172.21.15.143:0/831071761 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80094d0 con 0x7f23b80ce8b0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b7fff640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 0x7f23b80b1050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23a801ab80 tx=0x7f23a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80bd5f0 con 0x7f23b80ce8b0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a80bd770 con 0x7f23b80ce8b0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b80c7590 con 0x7f23b80ce8b0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80bdb20 con 0x7f23b80ce8b0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.843+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b80cbbe0 con 0x7f23b80ce8b0 2023-11-24T06:29:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.847+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8067520 con 0x7f23b80ce8b0 2023-11-24T06:29:36.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.847+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f23a80b33f0 con 0x7f23b80ce8b0 2023-11-24T06:29:36.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.847+0000 7f23b4ff9640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23a40664a0 0x7f23a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:36.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.847+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23a811e420 con 0x7f23b80ce8b0 2023-11-24T06:29:36.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.847+0000 7f23b77fe640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23a40664a0 0x7f23a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:36.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.847+0000 7f23b77fe640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23a40664a0 0x7f23a4068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23b80d0580 tx=0x7f23ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:36.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:36.851+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23a80ebb50 con 0x7f23b80ce8b0 2023-11-24T06:29:37.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23b806b7b0 con 0x7f23b80ce8b0 2023-11-24T06:29:37.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23b4ff9640 1 -- 172.21.15.143:0/831071761 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f23a80ef170 con 0x7f23b80ce8b0 2023-11-24T06:29:37.037 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:37.037 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T06:29:37.037 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 3 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23a40664a0 msgr2=0x7f23a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23a40664a0 0x7f23a4068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23b80d0580 tx=0x7f23ac008040 comp rx=0 tx=0).stop 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 msgr2=0x7f23b80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 0x7f23b80b1050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23a801ab80 tx=0x7f23a801ad10 comp rx=0 tx=0).stop 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 shutdown_connections 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23a40664a0 0x7f23a4068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23b815d570 0x7f23b80cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23b80d3020 0x7f23b80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 --2- 172.21.15.143:0/831071761 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23b80ce8b0 0x7f23b80b1050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 >> 172.21.15.143:0/831071761 conn(0x7f23b808ceb0 msgr2=0x7f23b80b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:37.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 shutdown_connections 2023-11-24T06:29:37.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.035+0000 7f23be5df640 1 -- 172.21.15.143:0/831071761 wait complete. 2023-11-24T06:29:37.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:37.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.191+0000 7ff6ad46b640 1 Processor -- start 2023-11-24T06:29:37.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.191+0000 7ff6ad46b640 1 -- start start 2023-11-24T06:29:37.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6ad46b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff6a80d01e0 0x7ff6a80b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6ad46b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6a80d0640 0x7ff6a80b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6ad46b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80cee60 con 0x7ff6a8147020 2023-11-24T06:29:37.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6ad46b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80cf140 con 0x7ff6a80d01e0 2023-11-24T06:29:37.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6ad46b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80cf420 con 0x7ff6a80d0640 2023-11-24T06:29:37.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6a6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff6a8147020 0x7ff6a80d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:42332/0 (socket says 172.21.15.143:42332) 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6a6ffd640 1 -- 172.21.15.143:0/4152462597 learned_addr learned my addr 172.21.15.143:0/4152462597 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff69e7fc640 1 --2- 172.21.15.143:0/4152462597 >> v2:172.21.15.143:3300/0 conn(0x7ff6a80d01e0 0x7ff6a80b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6a67fc640 1 -- 172.21.15.143:0/4152462597 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575244954 0 0) 0x7ff6a80cee60 con 0x7ff6a8147020 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6a67fc640 1 -- 172.21.15.143:0/4152462597 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694003530 con 0x7ff6a8147020 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6a77fe640 1 --2- 172.21.15.143:0/4152462597 >> v2:172.21.15.146:3300/0 conn(0x7ff6a80d0640 0x7ff6a80b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff69e7fc640 1 -- 172.21.15.143:0/4152462597 >> v2:172.21.15.146:3300/0 conn(0x7ff6a80d0640 msgr2=0x7ff6a80b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff69e7fc640 1 --2- 172.21.15.143:0/4152462597 >> v2:172.21.15.146:3300/0 conn(0x7ff6a80d0640 0x7ff6a80b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff69e7fc640 1 -- 172.21.15.143:0/4152462597 >> v1:172.21.15.143:6789/0 conn(0x7ff6a8147020 legacy=0x7ff6a80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff69e7fc640 1 -- 172.21.15.143:0/4152462597 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80cf700 con 0x7ff6a80d01e0 2023-11-24T06:29:37.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.195+0000 7ff6a77fe640 1 --2- 172.21.15.143:0/4152462597 >> v2:172.21.15.146:3300/0 conn(0x7ff6a80d0640 0x7ff6a80b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:37.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff69e7fc640 1 --2- 172.21.15.143:0/4152462597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a80d01e0 0x7ff6a80b2e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80c8270 tx=0x7ff69001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d046ef7e812c42b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6a67fc640 1 -- 172.21.15.143:0/4152462597 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900ab660 con 0x7ff6a80d01e0 2023-11-24T06:29:37.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6a67fc640 1 -- 172.21.15.143:0/4152462597 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6900ab7c0 con 0x7ff6a80d01e0 2023-11-24T06:29:37.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6a67fc640 1 -- 172.21.15.143:0/4152462597 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900abb50 con 0x7ff6a80d01e0 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 -- 172.21.15.143:0/4152462597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a80d01e0 msgr2=0x7ff6a80b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/4152462597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a80d01e0 0x7ff6a80b2e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80c8270 tx=0x7ff69001c460 comp rx=0 tx=0).stop 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 -- 172.21.15.143:0/4152462597 shutdown_connections 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/4152462597 >> v2:172.21.15.146:3300/0 conn(0x7ff6a80d0640 0x7ff6a80b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/4152462597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a80d01e0 0x7ff6a80b2e50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 -- 172.21.15.143:0/4152462597 >> 172.21.15.143:0/4152462597 conn(0x7ff6a8060fd0 msgr2=0x7ff6a80613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:37.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 -- 172.21.15.143:0/4152462597 shutdown_connections 2023-11-24T06:29:37.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 -- 172.21.15.143:0/4152462597 wait complete. 2023-11-24T06:29:37.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 Processor -- start 2023-11-24T06:29:37.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.199+0000 7ff6ad46b640 1 -- start start 2023-11-24T06:29:37.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6a80d01e0 0x7ff6a815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6a80d0640 0x7ff6a80b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 0x7ff6a80b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815de80 con 0x7ff6a8147020 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815d8b0 con 0x7ff6a80d0640 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815fd20 con 0x7ff6a80d01e0 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 0x7ff6a80b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 0x7ff6a80b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:32988/0 (socket says 172.21.15.143:32988) 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 -- 172.21.15.143:0/1863682772 learned_addr learned my addr 172.21.15.143:0/1863682772 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff69e7fc640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6a80d0640 0x7ff6a80b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a6ffd640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6a80d01e0 0x7ff6a815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 -- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6a80d01e0 msgr2=0x7ff6a815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6a80d01e0 0x7ff6a815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 -- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6a80d0640 msgr2=0x7ff6a80b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6a80d0640 0x7ff6a80b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 -- 172.21.15.143:0/1863682772 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690009420 con 0x7ff6a8147020 2023-11-24T06:29:37.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6a77fe640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 0x7ff6a80b63d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000ced0 tx=0x7ff6a000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0003ba0 con 0x7ff6a8147020 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0003d20 con 0x7ff6a8147020 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000d880 con 0x7ff6a8147020 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a815ffa0 con 0x7ff6a8147020 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a8160560 con 0x7ff6a8147020 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.203+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a8067520 con 0x7ff6a8147020 2023-11-24T06:29:37.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.207+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6a000d9e0 con 0x7ff6a8147020 2023-11-24T06:29:37.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.207+0000 7ff69ffff640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff688066470 0x7ff688068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.207+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6a0084350 con 0x7ff6a8147020 2023-11-24T06:29:37.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.207+0000 7ff6a6ffd640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff688066470 0x7ff688068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.207+0000 7ff6a6ffd640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff688066470 0x7ff688068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6980011f0 tx=0x7ff698007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.211+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6a0051bd0 con 0x7ff6a8147020 2023-11-24T06:29:37.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.363+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6a80ce6d0 con 0x7ff6a8147020 2023-11-24T06:29:37.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.363+0000 7ff69ffff640 1 -- 172.21.15.143:0/1863682772 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7ff6a00551f0 con 0x7ff6a8147020 2023-11-24T06:29:37.366 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:37.366 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":16,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:30.691486+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:37.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff688066470 msgr2=0x7ff688068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff688066470 0x7ff688068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6980011f0 tx=0x7ff698007d40 comp rx=0 tx=0).stop 2023-11-24T06:29:37.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 msgr2=0x7ff6a80b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 0x7ff6a80b63d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000ced0 tx=0x7ff6a000a710 comp rx=0 tx=0).stop 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 shutdown_connections 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff688066470 0x7ff688068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6a8147020 0x7ff6a80b63d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6a80d0640 0x7ff6a80b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 --2- 172.21.15.143:0/1863682772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6a80d01e0 0x7ff6a815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 >> 172.21.15.143:0/1863682772 conn(0x7ff6a8060fd0 msgr2=0x7ff6a80c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 shutdown_connections 2023-11-24T06:29:37.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.367+0000 7ff6ad46b640 1 -- 172.21.15.143:0/1863682772 wait complete. 2023-11-24T06:29:37.388 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:29:37.388 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:29:37.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 Processor -- start 2023-11-24T06:29:37.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 -- start start 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5bdc0ae4a0 0x7f5bdc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0cd850 0x7f5bdc0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0b3510 con 0x7f5bdc0ce250 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0ce6e0 con 0x7f5bdc0ae4a0 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5be1301640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0b37f0 con 0x7f5bdc0cd850 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5bdc0ae4a0 0x7f5bdc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5bdc0ae4a0 0x7f5bdc15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46200/0 (socket says 172.21.15.143:46200) 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdb7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5bdc0ce250 0x7f5bdc15eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48526/0 (socket says 172.21.15.143:48526) 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 -- 172.21.15.143:0/1668642148 learned_addr learned my addr 172.21.15.143:0/1668642148 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bd27fc640 1 --2- 172.21.15.143:0/1668642148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0cd850 0x7f5bdc0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 -- 172.21.15.143:0/1668642148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0cd850 msgr2=0x7f5bdc0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 --2- 172.21.15.143:0/1668642148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0cd850 0x7f5bdc0cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 -- 172.21.15.143:0/1668642148 >> v1:172.21.15.143:6789/0 conn(0x7f5bdc0ce250 legacy=0x7f5bdc15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.527+0000 7f5bdaffd640 1 -- 172.21.15.143:0/1668642148 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0b3ad0 con 0x7f5bdc0ae4a0 2023-11-24T06:29:37.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5bdaffd640 1 --2- 172.21.15.143:0/1668642148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ae4a0 0x7f5bdc15ba00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009e50 tx=0x7f5bcc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3262eaa72eac005 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5bda7fc640 1 -- 172.21.15.143:0/1668642148 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0a58a0 con 0x7f5bdc0ae4a0 2023-11-24T06:29:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5bda7fc640 1 -- 172.21.15.143:0/1668642148 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0a5a00 con 0x7f5bdc0ae4a0 2023-11-24T06:29:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5bda7fc640 1 -- 172.21.15.143:0/1668642148 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0a5d90 con 0x7f5bdc0ae4a0 2023-11-24T06:29:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 -- 172.21.15.143:0/1668642148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ae4a0 msgr2=0x7f5bdc15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 --2- 172.21.15.143:0/1668642148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ae4a0 0x7f5bdc15ba00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009e50 tx=0x7f5bcc01c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 -- 172.21.15.143:0/1668642148 shutdown_connections 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 --2- 172.21.15.143:0/1668642148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0cd850 0x7f5bdc0cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 --2- 172.21.15.143:0/1668642148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ae4a0 0x7f5bdc15ba00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 -- 172.21.15.143:0/1668642148 >> 172.21.15.143:0/1668642148 conn(0x7f5bdc0b0c80 msgr2=0x7f5bdc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 -- 172.21.15.143:0/1668642148 shutdown_connections 2023-11-24T06:29:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 -- 172.21.15.143:0/1668642148 wait complete. 2023-11-24T06:29:37.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.531+0000 7f5be1301640 1 Processor -- start 2023-11-24T06:29:37.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- start start 2023-11-24T06:29:37.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0ae4a0 0x7f5bdc165ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bdc0cd850 0x7f5bdc14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 0x7f5bdc141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc1417c0 con 0x7f5bdc0ce250 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc151410 con 0x7f5bdc0cd850 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc151660 con 0x7f5bdc0ae4a0 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 0x7f5bdc141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 0x7f5bdc141280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46208/0 (socket says 172.21.15.143:46208) 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 -- 172.21.15.143:0/2865001716 learned_addr learned my addr 172.21.15.143:0/2865001716 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bd27fc640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bdc0cd850 0x7f5bdc14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdaffd640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0ae4a0 0x7f5bdc165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 -- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0ae4a0 msgr2=0x7f5bdc165ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0ae4a0 0x7f5bdc165ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 -- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bdc0cd850 msgr2=0x7f5bdc14e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bdc0cd850 0x7f5bdc14e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 -- 172.21.15.143:0/2865001716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc009b30 con 0x7f5bdc0ce250 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bdb7fe640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 0x7f5bdc141280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c410 tx=0x7f5bd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40074e0 con 0x7f5bdc0ce250 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4007640 con 0x7f5bdc0ce250 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc151940 con 0x7f5bdc0ce250 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4004a10 con 0x7f5bdc0ce250 2023-11-24T06:29:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc151f00 con 0x7f5bdc0ce250 2023-11-24T06:29:37.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.535+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc152120 con 0x7f5bdc0ce250 2023-11-24T06:29:37.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.539+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bd4004b70 con 0x7f5bdc0ce250 2023-11-24T06:29:37.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.539+0000 7f5bd3fff640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bbc066470 0x7f5bbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.539+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5bd4083320 con 0x7f5bdc0ce250 2023-11-24T06:29:37.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.539+0000 7f5bdaffd640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bbc066470 0x7f5bbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.539+0000 7f5bdaffd640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bbc066470 0x7f5bbc068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0ae000 tx=0x7f5bcc0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.543+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bd4050c30 con 0x7f5bdc0ce250 2023-11-24T06:29:37.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.695+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bdc04e8c0 con 0x7f5bdc0ce250 2023-11-24T06:29:37.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.695+0000 7f5bd3fff640 1 -- 172.21.15.143:0/2865001716 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bd4054250 con 0x7f5bdc0ce250 2023-11-24T06:29:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bbc066470 msgr2=0x7f5bbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bbc066470 0x7f5bbc068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0ae000 tx=0x7f5bcc0a7070 comp rx=0 tx=0).stop 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 msgr2=0x7f5bdc141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 0x7f5bdc141280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c410 tx=0x7f5bd400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 shutdown_connections 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bbc066470 0x7f5bbc068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5bdc0ce250 0x7f5bdc141280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bdc0cd850 0x7f5bdc14e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 --2- 172.21.15.143:0/2865001716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bdc0ae4a0 0x7f5bdc165ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 >> 172.21.15.143:0/2865001716 conn(0x7f5bdc0b0c80 msgr2=0x7f5bdc0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 shutdown_connections 2023-11-24T06:29:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.699+0000 7f5be1301640 1 -- 172.21.15.143:0/2865001716 wait complete. 2023-11-24T06:29:37.719 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:29:37.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 Processor -- start 2023-11-24T06:29:37.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 -- start start 2023-11-24T06:29:37.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b9c0cfc10 0x7f5b9c0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9c0d21c0 con 0x7f5b9c15d500 2023-11-24T06:29:37.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c0d0600 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1a06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0cdcd0 con 0x7f5b9c0d3e80 2023-11-24T06:29:37.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b9c0cfc10 0x7f5b9c0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b9c0cfc10 0x7f5b9c0d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46216/0 (socket says 172.21.15.143:46216) 2023-11-24T06:29:37.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 -- 172.21.15.143:0/2597238024 learned_addr learned my addr 172.21.15.143:0/2597238024 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:37.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5b93fff640 1 --2- 172.21.15.143:0/2597238024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 -- 172.21.15.143:0/2597238024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 msgr2=0x7f5b9c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:37.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 --2- 172.21.15.143:0/2597238024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 -- 172.21.15.143:0/2597238024 >> v1:172.21.15.143:6789/0 conn(0x7f5b9c15d500 legacy=0x7f5b9c0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.855+0000 7f5ba1205640 1 -- 172.21.15.143:0/2597238024 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c0d1ef0 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1205640 1 --2- 172.21.15.143:0/2597238024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0d00c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009e50 tx=0x7f5b9401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5596ca8fe73f9c04 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5b937fe640 1 -- 172.21.15.143:0/2597238024 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940a58a0 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5b937fe640 1 -- 172.21.15.143:0/2597238024 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b940a5a00 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5b937fe640 1 -- 172.21.15.143:0/2597238024 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940a5d90 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 -- 172.21.15.143:0/2597238024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 msgr2=0x7f5b9c0d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/2597238024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0d00c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009e50 tx=0x7f5b9401c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 -- 172.21.15.143:0/2597238024 shutdown_connections 2023-11-24T06:29:37.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/2597238024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0d00c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/2597238024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 -- 172.21.15.143:0/2597238024 >> 172.21.15.143:0/2597238024 conn(0x7f5b9c09c540 msgr2=0x7f5b9c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:37.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 -- 172.21.15.143:0/2597238024 shutdown_connections 2023-11-24T06:29:37.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.859+0000 7f5ba1a06640 1 -- 172.21.15.143:0/2597238024 wait complete. 2023-11-24T06:29:37.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 Processor -- start 2023-11-24T06:29:37.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- start start 2023-11-24T06:29:37.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b9c15d500 0x7f5b9c14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c15a8b0 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1548f0 con 0x7f5b9c15d500 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c154bd0 con 0x7f5b9c0d3e80 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46226/0 (socket says 172.21.15.143:46226) 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 -- 172.21.15.143:0/828194723 learned_addr learned my addr 172.21.15.143:0/828194723 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 -- 172.21.15.143:0/828194723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 msgr2=0x7f5b9c0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 -- 172.21.15.143:0/828194723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b9c15d500 msgr2=0x7f5b9c14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:37.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b9c15d500 0x7f5b9c14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:37.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 -- 172.21.15.143:0/828194723 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009b30 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba0a04640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0b69a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c3c0 tx=0x7f5b9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980052d0 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98005430 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98003840 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c154eb0 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c0b5e20 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.863+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c15aa60 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.867+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b980039a0 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.867+0000 7f5b917fa640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b88066470 0x7f5b88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.867+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b98083150 con 0x7f5b9c0cfc10 2023-11-24T06:29:37.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.867+0000 7f5b93fff640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b88066470 0x7f5b88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.867+0000 7f5b93fff640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b88066470 0x7f5b88068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0b6600 tx=0x7f5b8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:37.871+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b98050880 con 0x7f5b9c0cfc10 2023-11-24T06:29:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.023+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b9c04e850 con 0x7f5b9c0cfc10 2023-11-24T06:29:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.023+0000 7f5b917fa640 1 -- 172.21.15.143:0/828194723 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5b98053ea0 con 0x7f5b9c0cfc10 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:29:38.026 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:29:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.023+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b88066470 msgr2=0x7f5b88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.023+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b88066470 0x7f5b88068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0b6600 tx=0x7f5b8c008040 comp rx=0 tx=0).stop 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.023+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 msgr2=0x7f5b9c0b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.023+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0b69a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c3c0 tx=0x7f5b9800c880 comp rx=0 tx=0).stop 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 shutdown_connections 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b88066470 0x7f5b88068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b9c15d500 0x7f5b9c14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b9c0d3e80 0x7f5b9c0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 --2- 172.21.15.143:0/828194723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b9c0cfc10 0x7f5b9c0b69a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 >> 172.21.15.143:0/828194723 conn(0x7f5b9c09c540 msgr2=0x7f5b9c15c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 shutdown_connections 2023-11-24T06:29:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.027+0000 7f5ba1a06640 1 -- 172.21.15.143:0/828194723 wait complete. 2023-11-24T06:29:38.047 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:29:38.047 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:29:38.115 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:29:38.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:29:38.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 Processor -- start 2023-11-24T06:29:38.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 -- start start 2023-11-24T06:29:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fceac06c650 0x7fceac09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac06d8b0 con 0x7fceac144030 2023-11-24T06:29:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac145020 con 0x7fceac06c650 2023-11-24T06:29:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceb0b80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac071390 con 0x7fceac0709c0 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fceac06c650 0x7fceac09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceaad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fceac06c650 0x7fceac09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42570/0 (socket says 172.21.15.143:42570) 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 -- 172.21.15.143:0/435503356 learned_addr learned my addr 172.21.15.143:0/435503356 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceaad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:57762/0 (socket says 172.21.15.143:57762) 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 -- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 msgr2=0x7fceac070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 --2- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 -- 172.21.15.143:0/435503356 >> v1:172.21.15.146:6789/0 conn(0x7fceac144030 legacy=0x7fceac06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fcea3fff640 1 -- 172.21.15.143:0/435503356 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac06cca0 con 0x7fceac06c650 2023-11-24T06:29:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.191+0000 7fceaad9d640 1 --2- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fcea3fff640 1 --2- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac06c650 0x7fceac09cc20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce94009870 tx=0x7fce9401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3d9b801a632b4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fcea9d9b640 1 -- 172.21.15.143:0/435503356 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940a7070 con 0x7fceac06c650 2023-11-24T06:29:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fcea9d9b640 1 -- 172.21.15.143:0/435503356 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce940ab430 con 0x7fceac06c650 2023-11-24T06:29:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fcea9d9b640 1 -- 172.21.15.143:0/435503356 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940ab7c0 con 0x7fceac06c650 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 -- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac06c650 msgr2=0x7fceac09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 --2- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac06c650 0x7fceac09cc20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce94009870 tx=0x7fce9401c540 comp rx=0 tx=0).stop 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 -- 172.21.15.143:0/435503356 shutdown_connections 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 --2- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 --2- 172.21.15.143:0/435503356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac06c650 0x7fceac09cc20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 -- 172.21.15.143:0/435503356 >> 172.21.15.143:0/435503356 conn(0x7fceac0b0bf0 msgr2=0x7fceac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 -- 172.21.15.143:0/435503356 shutdown_connections 2023-11-24T06:29:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.195+0000 7fceb0b80640 1 -- 172.21.15.143:0/435503356 wait complete. 2023-11-24T06:29:38.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 Processor -- start 2023-11-24T06:29:38.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 -- start start 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 0x7fceac141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac13a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac144030 0x7fceac13fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac13ab20 con 0x7fceac06c650 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1409d0 con 0x7fceac144030 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac140cb0 con 0x7fceac0709c0 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 0x7fceac141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 0x7fceac141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46232/0 (socket says 172.21.15.143:46232) 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 -- 172.21.15.143:0/139464715 learned_addr learned my addr 172.21.15.143:0/139464715 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:38.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaad9d640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac144030 0x7fceac13fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fcea3fff640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac13a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 -- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 msgr2=0x7fceac13a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac13a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 -- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac144030 msgr2=0x7fceac13fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac144030 0x7fceac13fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 -- 172.21.15.143:0/139464715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009a70 con 0x7fceac06c650 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceaa59c640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 0x7fceac141a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00c3c0 tx=0x7fce9c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0052d0 con 0x7fceac06c650 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c005430 con 0x7fceac06c650 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c003840 con 0x7fceac06c650 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce940094d0 con 0x7fceac06c650 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.199+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac141270 con 0x7fceac06c650 2023-11-24T06:29:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.203+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac067520 con 0x7fceac06c650 2023-11-24T06:29:38.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.203+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce9c0039a0 con 0x7fceac06c650 2023-11-24T06:29:38.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.203+0000 7fcea2ffd640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce8c066470 0x7fce8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:38.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.203+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce9c083240 con 0x7fceac06c650 2023-11-24T06:29:38.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.203+0000 7fcea3fff640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce8c066470 0x7fce8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:38.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.203+0000 7fcea3fff640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce8c066470 0x7fce8c068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce940af000 tx=0x7fce94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:38.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.207+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce9c0508e0 con 0x7fceac06c650 2023-11-24T06:29:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:38.359+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fceac0b23c0 con 0x7fceac06c650 2023-11-24T06:29:39.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.307+0000 7fcea2ffd640 1 -- 172.21.15.143:0/139464715 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fce9c053f00 con 0x7fceac06c650 2023-11-24T06:29:39.309 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2023-11-24T06:29:39.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.307+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce8c066470 msgr2=0x7fce8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:39.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.307+0000 7fceb0b80640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce8c066470 0x7fce8c068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce940af000 tx=0x7fce94008040 comp rx=0 tx=0).stop 2023-11-24T06:29:39.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.307+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 msgr2=0x7fceac141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:39.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.307+0000 7fceb0b80640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 0x7fceac141a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00c3c0 tx=0x7fce9c00c7c0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 shutdown_connections 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce8c066470 0x7fce8c068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceac144030 0x7fceac13fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fceac0709c0 0x7fceac13a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 --2- 172.21.15.143:0/139464715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fceac06c650 0x7fceac141a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 >> 172.21.15.143:0/139464715 conn(0x7fceac0b0bf0 msgr2=0x7fceac0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:39.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 shutdown_connections 2023-11-24T06:29:39.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.311+0000 7fceb0b80640 1 -- 172.21.15.143:0/139464715 wait complete. 2023-11-24T06:29:39.340 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:29:39.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 Processor -- start 2023-11-24T06:29:39.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 -- start start 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a5c15a4d0 0x7f3a5c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c0cad20 0x7f3a5c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3a5c06d740 0x7f3a5c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c06e0d0 con 0x7f3a5c06d740 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c15a8b0 con 0x7f3a5c15a4d0 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a61faa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0c9c30 con 0x7f3a5c0cad20 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3a5c06d740 0x7f3a5c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3a5c06d740 0x7f3a5c06db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46246/0 (socket says 172.21.15.143:46246) 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 -- 172.21.15.143:0/2128094456 learned_addr learned my addr 172.21.15.143:0/2128094456 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5b7fe640 1 --2- 172.21.15.143:0/2128094456 >> v2:172.21.15.146:3300/0 conn(0x7f3a5c15a4d0 0x7f3a5c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5affd640 1 --2- 172.21.15.143:0/2128094456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c0cad20 0x7f3a5c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 -- 172.21.15.143:0/2128094456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c0cad20 msgr2=0x7f3a5c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 --2- 172.21.15.143:0/2128094456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c0cad20 0x7f3a5c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 -- 172.21.15.143:0/2128094456 >> v2:172.21.15.146:3300/0 conn(0x7f3a5c15a4d0 msgr2=0x7f3a5c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 --2- 172.21.15.143:0/2128094456 >> v2:172.21.15.146:3300/0 conn(0x7f3a5c15a4d0 0x7f3a5c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.527+0000 7f3a5bfff640 1 -- 172.21.15.143:0/2128094456 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c15ee80 con 0x7f3a5c06d740 2023-11-24T06:29:39.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a5bfff640 1 --2- 172.21.15.143:0/2128094456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c06d740 0x7f3a5c06db90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c06e7d0 tx=0x7f3a5401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd9714dbbd61a34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:39.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a5a7fc640 1 -- 172.21.15.143:0/2128094456 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540a5790 con 0x7f3a5c06d740 2023-11-24T06:29:39.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a5a7fc640 1 -- 172.21.15.143:0/2128094456 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540a58f0 con 0x7f3a5c06d740 2023-11-24T06:29:39.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a5a7fc640 1 -- 172.21.15.143:0/2128094456 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540a5c80 con 0x7f3a5c06d740 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 -- 172.21.15.143:0/2128094456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c06d740 msgr2=0x7f3a5c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 --2- 172.21.15.143:0/2128094456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c06d740 0x7f3a5c06db90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c06e7d0 tx=0x7f3a5401c910 comp rx=0 tx=0).stop 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 -- 172.21.15.143:0/2128094456 shutdown_connections 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 --2- 172.21.15.143:0/2128094456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c06d740 0x7f3a5c06db90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 --2- 172.21.15.143:0/2128094456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c0cad20 0x7f3a5c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 --2- 172.21.15.143:0/2128094456 >> v2:172.21.15.146:3300/0 conn(0x7f3a5c15a4d0 0x7f3a5c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 -- 172.21.15.143:0/2128094456 >> 172.21.15.143:0/2128094456 conn(0x7f3a5c0b0bf0 msgr2=0x7f3a5c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 -- 172.21.15.143:0/2128094456 shutdown_connections 2023-11-24T06:29:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.531+0000 7f3a61faa640 1 -- 172.21.15.143:0/2128094456 wait complete. 2023-11-24T06:29:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 Processor -- start 2023-11-24T06:29:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 -- start start 2023-11-24T06:29:39.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c06d740 0x7f3a5c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 0x7f3a5c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c15a4d0 0x7f3a5c09c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0abed0 con 0x7f3a5c0cad20 2023-11-24T06:29:39.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c09c960 con 0x7f3a5c15a4d0 2023-11-24T06:29:39.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0c39c0 con 0x7f3a5c06d740 2023-11-24T06:29:39.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 0x7f3a5c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 0x7f3a5c09bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46258/0 (socket says 172.21.15.143:46258) 2023-11-24T06:29:39.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 -- 172.21.15.143:0/1713921103 learned_addr learned my addr 172.21.15.143:0/1713921103 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5b7fe640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c06d740 0x7f3a5c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5bfff640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c15a4d0 0x7f3a5c09c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 -- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c06d740 msgr2=0x7f3a5c157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c06d740 0x7f3a5c157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 -- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c15a4d0 msgr2=0x7f3a5c09c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c15a4d0 0x7f3a5c09c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:39.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 -- 172.21.15.143:0/1713921103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a54009b30 con 0x7f3a5c0cad20 2023-11-24T06:29:39.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a5affd640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 0x7f3a5c09bee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000d800 tx=0x7f3a5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:39.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500096a0 con 0x7f3a5c0cad20 2023-11-24T06:29:39.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a50009800 con 0x7f3a5c0cad20 2023-11-24T06:29:39.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c0c3ca0 con 0x7f3a5c0cad20 2023-11-24T06:29:39.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50009bb0 con 0x7f3a5c0cad20 2023-11-24T06:29:39.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.535+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c0ac400 con 0x7f3a5c0cad20 2023-11-24T06:29:39.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.539+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c09d250 con 0x7f3a5c0cad20 2023-11-24T06:29:39.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.539+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a50009d10 con 0x7f3a5c0cad20 2023-11-24T06:29:39.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.539+0000 7f3a43fff640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a48066470 0x7f3a48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:39.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.539+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3a500841a0 con 0x7f3a5c0cad20 2023-11-24T06:29:39.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.539+0000 7f3a5b7fe640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a48066470 0x7f3a48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:39.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.539+0000 7f3a5b7fe640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a48066470 0x7f3a48068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0079c0 tx=0x7f3a4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:39.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.543+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a50051790 con 0x7f3a5c0cad20 2023-11-24T06:29:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:39.695+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3a5c09ce40 con 0x7f3a5c0cad20 2023-11-24T06:29:40.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.307+0000 7f3a43fff640 1 -- 172.21.15.143:0/1713921103 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3a50054db0 con 0x7f3a5c0cad20 2023-11-24T06:29:40.311 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2023-11-24T06:29:40.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a48066470 msgr2=0x7f3a48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a48066470 0x7f3a48068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0079c0 tx=0x7f3a4c008040 comp rx=0 tx=0).stop 2023-11-24T06:29:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 msgr2=0x7f3a5c09bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 0x7f3a5c09bee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000d800 tx=0x7f3a5000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 shutdown_connections 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a48066470 0x7f3a48068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c15a4d0 0x7f3a5c09c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a5c0cad20 0x7f3a5c09bee0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 --2- 172.21.15.143:0/1713921103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a5c06d740 0x7f3a5c157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.311+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 >> 172.21.15.143:0/1713921103 conn(0x7f3a5c0b0bf0 msgr2=0x7f3a5c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.315+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 shutdown_connections 2023-11-24T06:29:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.315+0000 7f3a61faa640 1 -- 172.21.15.143:0/1713921103 wait complete. 2023-11-24T06:29:40.355 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:29:40.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.491+0000 7fd7edd01640 1 Processor -- start 2023-11-24T06:29:40.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.491+0000 7fd7edd01640 1 -- start start 2023-11-24T06:29:40.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7edd01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7e815ec60 0x7fd7e80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:40.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7edd01640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8070f00 con 0x7fd7e80cc6b0 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7edd01640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8071170 con 0x7fd7e815a290 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7edd01640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80cb690 con 0x7fd7e815ec60 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e6ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7e815ec60 0x7fd7e80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e7fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd7e80cc6b0 0x7fd7e80b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48544/0 (socket says 172.21.15.143:48544) 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e6ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7e815ec60 0x7fd7e80cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46264/0 (socket says 172.21.15.143:46264) 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e7fff640 1 -- 172.21.15.143:0/2680972017 learned_addr learned my addr 172.21.15.143:0/2680972017 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/2680972017 >> v1:172.21.15.146:6789/0 conn(0x7fd7e815a290 legacy=0x7fd7e80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:40.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/2680972017 >> v1:172.21.15.143:6789/0 conn(0x7fd7e80cc6b0 legacy=0x7fd7e80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:40.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.495+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/2680972017 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80cb970 con 0x7fd7e815ec60 2023-11-24T06:29:40.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7e6ffd640 1 --2- 172.21.15.143:0/2680972017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815ec60 0x7fd7e80cc170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0097c0 tx=0x7fd7dc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a421fea35723b9aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:40.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7e67fc640 1 -- 172.21.15.143:0/2680972017 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0ac600 con 0x7fd7e815ec60 2023-11-24T06:29:40.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7e67fc640 1 -- 172.21.15.143:0/2680972017 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc0a8050 con 0x7fd7e815ec60 2023-11-24T06:29:40.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7e67fc640 1 -- 172.21.15.143:0/2680972017 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0ac980 con 0x7fd7e815ec60 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 -- 172.21.15.143:0/2680972017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815ec60 msgr2=0x7fd7e80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 --2- 172.21.15.143:0/2680972017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815ec60 0x7fd7e80cc170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0097c0 tx=0x7fd7dc01c380 comp rx=0 tx=0).stop 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 -- 172.21.15.143:0/2680972017 shutdown_connections 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 --2- 172.21.15.143:0/2680972017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815ec60 0x7fd7e80cc170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 -- 172.21.15.143:0/2680972017 >> 172.21.15.143:0/2680972017 conn(0x7fd7e80b0c80 msgr2=0x7fd7e80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 -- 172.21.15.143:0/2680972017 shutdown_connections 2023-11-24T06:29:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 -- 172.21.15.143:0/2680972017 wait complete. 2023-11-24T06:29:40.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 Processor -- start 2023-11-24T06:29:40.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.499+0000 7fd7edd01640 1 -- start start 2023-11-24T06:29:40.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e80cc6b0 0x7fd7e8150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:40.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 0x7fd7e81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:40.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e815ec60 0x7fd7e815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151eb0 con 0x7fd7e815a290 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151230 con 0x7fd7e80cc6b0 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151510 con 0x7fd7e815ec60 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 0x7fd7e81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 0x7fd7e81500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46280/0 (socket says 172.21.15.143:46280) 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/884582546 learned_addr learned my addr 172.21.15.143:0/884582546 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e77fe640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e80cc6b0 0x7fd7e8150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e7fff640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e815ec60 0x7fd7e815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e815ec60 msgr2=0x7fd7e815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e815ec60 0x7fd7e815b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e80cc6b0 msgr2=0x7fd7e8150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:40.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e80cc6b0 0x7fd7e8150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:40.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 -- 172.21.15.143:0/884582546 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009420 con 0x7fd7e815a290 2023-11-24T06:29:40.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e77fe640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e80cc6b0 0x7fd7e8150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:40.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7e6ffd640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 0x7fd7e81500b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc019fb0 tx=0x7fd7dc01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0b7620 con 0x7fd7e815a290 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc0b7780 con 0x7fd7e815a290 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0b7b30 con 0x7fd7e815a290 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e81517f0 con 0x7fd7e815a290 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e81505f0 con 0x7fd7e815a290 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8151ff0 con 0x7fd7e815a290 2023-11-24T06:29:40.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.503+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7dc0b3040 con 0x7fd7e815a290 2023-11-24T06:29:40.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.507+0000 7fd7cffff640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd7d4066470 0x7fd7d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:40.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.507+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd7dc11e6b0 con 0x7fd7e815a290 2023-11-24T06:29:40.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.507+0000 7fd7e77fe640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd7d4066470 0x7fd7d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:40.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.507+0000 7fd7e77fe640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd7d4066470 0x7fd7d4068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8003ec0 tx=0x7fd7d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.511+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7dc0ebc00 con 0x7fd7e815a290 2023-11-24T06:29:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:40.687+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd7e8151ff0 con 0x7fd7e815a290 2023-11-24T06:29:41.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.319+0000 7fd7cffff640 1 -- 172.21.15.143:0/884582546 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd7e8151ff0 con 0x7fd7e815a290 2023-11-24T06:29:41.324 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T06:29:41.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd7d4066470 msgr2=0x7fd7d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd7d4066470 0x7fd7d4068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8003ec0 tx=0x7fd7d8009040 comp rx=0 tx=0).stop 2023-11-24T06:29:41.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 msgr2=0x7fd7e81500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 0x7fd7e81500b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc019fb0 tx=0x7fd7dc01abc0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 shutdown_connections 2023-11-24T06:29:41.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd7d4066470 0x7fd7d4068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e815ec60 0x7fd7e815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7e815a290 0x7fd7e81500b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 --2- 172.21.15.143:0/884582546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e80cc6b0 0x7fd7e8150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 >> 172.21.15.143:0/884582546 conn(0x7fd7e80b0c80 msgr2=0x7fd7e80b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:41.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 shutdown_connections 2023-11-24T06:29:41.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.323+0000 7fd7edd01640 1 -- 172.21.15.143:0/884582546 wait complete. 2023-11-24T06:29:41.352 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:41.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 Processor -- start 2023-11-24T06:29:41.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 -- start start 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe11c0ce8b0 0x7fe11c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c06c0e0 con 0x7fe11c15d570 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0d39c0 con 0x7fe11c0ce8b0 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe1242c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0d1cc0 con 0x7fe11c0d3020 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe11c0ce8b0 0x7fe11c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe11c0ce8b0 0x7fe11c0ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46292/0 (socket says 172.21.15.143:46292) 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 -- 172.21.15.143:0/721591894 learned_addr learned my addr 172.21.15.143:0/721591894 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe121864640 1 --2- 172.21.15.143:0/721591894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 -- 172.21.15.143:0/721591894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 msgr2=0x7fe11c0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:41.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 --2- 172.21.15.143:0/721591894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 -- 172.21.15.143:0/721591894 >> v1:172.21.15.146:6789/0 conn(0x7fe11c15d570 legacy=0x7fe11c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.487+0000 7fe122866640 1 -- 172.21.15.143:0/721591894 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0d1fa0 con 0x7fe11c0ce8b0 2023-11-24T06:29:41.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe122866640 1 --2- 172.21.15.143:0/721591894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ced40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe114009e50 tx=0x7fe11401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaf63d9aaceee49 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:41.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe121063640 1 -- 172.21.15.143:0/721591894 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a58a0 con 0x7fe11c0ce8b0 2023-11-24T06:29:41.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe121063640 1 -- 172.21.15.143:0/721591894 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140a5a00 con 0x7fe11c0ce8b0 2023-11-24T06:29:41.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe121063640 1 -- 172.21.15.143:0/721591894 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5d90 con 0x7fe11c0ce8b0 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 -- 172.21.15.143:0/721591894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c0ce8b0 msgr2=0x7fe11c0ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 --2- 172.21.15.143:0/721591894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ced40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe114009e50 tx=0x7fe11401c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 -- 172.21.15.143:0/721591894 shutdown_connections 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 --2- 172.21.15.143:0/721591894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ced40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 --2- 172.21.15.143:0/721591894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 -- 172.21.15.143:0/721591894 >> 172.21.15.143:0/721591894 conn(0x7fe11c08ceb0 msgr2=0x7fe11c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 -- 172.21.15.143:0/721591894 shutdown_connections 2023-11-24T06:29:41.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.491+0000 7fe1242c9640 1 -- 172.21.15.143:0/721591894 wait complete. 2023-11-24T06:29:41.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 Processor -- start 2023-11-24T06:29:41.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 -- start start 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 0x7fe11c0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0b8120 con 0x7fe11c15d570 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0caee0 con 0x7fe11c0ce8b0 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0cb1c0 con 0x7fe11c0d3020 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 0x7fe11c0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 0x7fe11c0c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46304/0 (socket says 172.21.15.143:46304) 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 -- 172.21.15.143:0/2106079634 learned_addr learned my addr 172.21.15.143:0/2106079634 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:41.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 -- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 msgr2=0x7fe11c0b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe121864640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122065640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0b85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 -- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe11c0ce8b0 msgr2=0x7fe11c0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 -- 172.21.15.143:0/2106079634 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114009b30 con 0x7fe11c15d570 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe121864640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122065640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe122866640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 0x7fe11c0c6f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1140af040 tx=0x7fe114019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140b8670 con 0x7fe11c15d570 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140b87d0 con 0x7fe11c15d570 2023-11-24T06:29:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c0cb4a0 con 0x7fe11c15d570 2023-11-24T06:29:41.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140b8b60 con 0x7fe11c15d570 2023-11-24T06:29:41.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.495+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0b3d50 con 0x7fe11c15d570 2023-11-24T06:29:41.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.499+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c0b92c0 con 0x7fe11c15d570 2023-11-24T06:29:41.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.499+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1140b8cc0 con 0x7fe11c15d570 2023-11-24T06:29:41.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.499+0000 7fe112ffd640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe1000664a0 0x7fe100068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.499+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe11411f510 con 0x7fe11c15d570 2023-11-24T06:29:41.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.499+0000 7fe122065640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe1000664a0 0x7fe100068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.499+0000 7fe122065640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe1000664a0 0x7fe100068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe118000f70 tx=0x7fe118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:41.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.503+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1140ecaa0 con 0x7fe11c15d570 2023-11-24T06:29:41.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe11c067520 con 0x7fe11c15d570 2023-11-24T06:29:41.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe112ffd640 1 -- 172.21.15.143:0/2106079634 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16566 (secure 0 0 0) 0x7fe1140f00c0 con 0x7fe11c15d570 2023-11-24T06:29:41.658 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:41.658 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":19,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:40.691235+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:41.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe1000664a0 msgr2=0x7fe100068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe1000664a0 0x7fe100068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe118000f70 tx=0x7fe118009040 comp rx=0 tx=0).stop 2023-11-24T06:29:41.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 msgr2=0x7fe11c0c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 0x7fe11c0c6f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1140af040 tx=0x7fe114019780 comp rx=0 tx=0).stop 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 shutdown_connections 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe1000664a0 0x7fe100068960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11c15d570 0x7fe11c0c6f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe11c0d3020 0x7fe11c0b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 --2- 172.21.15.143:0/2106079634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe11c0ce8b0 0x7fe11c0ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 >> 172.21.15.143:0/2106079634 conn(0x7fe11c08ceb0 msgr2=0x7fe11c159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 shutdown_connections 2023-11-24T06:29:41.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.655+0000 7fe1242c9640 1 -- 172.21.15.143:0/2106079634 wait complete. 2023-11-24T06:29:41.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 Processor -- start 2023-11-24T06:29:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 -- start start 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0ec15d570 0x7fe0ec06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe0ec0ce8b0 0x7fe0ec0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0d39c0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0d1cc0 con 0x7fe0ec15d570 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0f0f65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0d1fa0 con 0x7fe0ec0d3020 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe0ec0ce8b0 0x7fe0ec0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe0ec0ce8b0 0x7fe0ec0ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46316/0 (socket says 172.21.15.143:46316) 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 -- 172.21.15.143:0/1792189467 learned_addr learned my addr 172.21.15.143:0/1792189467 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ea59c640 1 --2- 172.21.15.143:0/1792189467 >> v2:172.21.15.146:3300/0 conn(0x7fe0ec15d570 0x7fe0ec06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0e1d9b640 1 --2- 172.21.15.143:0/1792189467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 -- 172.21.15.143:0/1792189467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 msgr2=0x7fe0ec0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:41.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 --2- 172.21.15.143:0/1792189467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec0d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 -- 172.21.15.143:0/1792189467 >> v2:172.21.15.146:3300/0 conn(0x7fe0ec15d570 msgr2=0x7fe0ec06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:41.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 --2- 172.21.15.143:0/1792189467 >> v2:172.21.15.146:3300/0 conn(0x7fe0ec15d570 0x7fe0ec06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ead9d640 1 -- 172.21.15.143:0/1792189467 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0ce0b0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.815+0000 7fe0ea59c640 1 --2- 172.21.15.143:0/1792189467 >> v2:172.21.15.146:3300/0 conn(0x7fe0ec15d570 0x7fe0ec06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:41.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0ead9d640 1 --2- 172.21.15.143:0/1792189467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec0ced40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0d0eb0 tx=0x7fe0e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0db5cf60028a91 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0e9d9b640 1 -- 172.21.15.143:0/1792189467 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40aa610 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0e9d9b640 1 -- 172.21.15.143:0/1792189467 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e40a6040 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0e9d9b640 1 -- 172.21.15.143:0/1792189467 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40aa990 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 -- 172.21.15.143:0/1792189467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 msgr2=0x7fe0ec0ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/1792189467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec0ced40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0d0eb0 tx=0x7fe0e401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 -- 172.21.15.143:0/1792189467 shutdown_connections 2023-11-24T06:29:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/1792189467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec0ced40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/1792189467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec0d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/1792189467 >> v2:172.21.15.146:3300/0 conn(0x7fe0ec15d570 0x7fe0ec06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 -- 172.21.15.143:0/1792189467 >> 172.21.15.143:0/1792189467 conn(0x7fe0ec08ceb0 msgr2=0x7fe0ec09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:41.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 -- 172.21.15.143:0/1792189467 shutdown_connections 2023-11-24T06:29:41.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.819+0000 7fe0f0f65640 1 -- 172.21.15.143:0/1792189467 wait complete. 2023-11-24T06:29:41.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 Processor -- start 2023-11-24T06:29:41.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 -- start start 2023-11-24T06:29:41.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0ec15d570 0x7fe0ec0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec155e30 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec15ac40 con 0x7fe0ec15d570 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec15aec0 con 0x7fe0ec0d3020 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec15a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46318/0 (socket says 172.21.15.143:46318) 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 -- 172.21.15.143:0/2342961899 learned_addr learned my addr 172.21.15.143:0/2342961899 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ead9d640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0ec15d570 0x7fe0ec0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0e1d9b640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 -- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 msgr2=0x7fe0ec160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 -- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0ec15d570 msgr2=0x7fe0ec0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0ec15d570 0x7fe0ec0c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 -- 172.21.15.143:0/2342961899 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40094d0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0ea59c640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec15a700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00e810 tx=0x7fe0dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00c8d0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00ca30 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00cdc0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec15b1a0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.823+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec15b760 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.827+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec067520 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.827+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0dc013410 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.827+0000 7fe0e37fe640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe0cc066470 0x7fe0cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:41.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.827+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0dc083c50 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.827+0000 7fe0e1d9b640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe0cc066470 0x7fe0cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:41.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.827+0000 7fe0e1d9b640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe0cc066470 0x7fe0cc068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40039f0 tx=0x7fe0d4009790 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:41.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.831+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0dc051170 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.982+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0ec06b7b0 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0e37fe640 1 -- 172.21.15.143:0/2342961899 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16566 (secure 0 0 0) 0x7fe0dc009480 con 0x7fe0ec0ce8b0 2023-11-24T06:29:41.989 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:41.989 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":19,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:40.691235+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:41.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe0cc066470 msgr2=0x7fe0cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe0cc066470 0x7fe0cc068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40039f0 tx=0x7fe0d4009790 comp rx=0 tx=0).stop 2023-11-24T06:29:41.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 msgr2=0x7fe0ec15a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec15a700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00e810 tx=0x7fe0dc00ecd0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 shutdown_connections 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe0cc066470 0x7fe0cc068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0ec15d570 0x7fe0ec0c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0ec0d3020 0x7fe0ec160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 --2- 172.21.15.143:0/2342961899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0ec0ce8b0 0x7fe0ec15a700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 >> 172.21.15.143:0/2342961899 conn(0x7fe0ec08ceb0 msgr2=0x7fe0ec0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 shutdown_connections 2023-11-24T06:29:41.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:41.986+0000 7fe0f0f65640 1 -- 172.21.15.143:0/2342961899 wait complete. 2023-11-24T06:29:42.012 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:29:42.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.146+0000 7f5d95232640 1 Processor -- start 2023-11-24T06:29:42.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.146+0000 7f5d95232640 1 -- start start 2023-11-24T06:29:42.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d95232640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5d9015a290 0x7f5d900707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:42.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d95232640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d900b1f80 0x7f5d900b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:42.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d95232640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d90071170 con 0x7f5d9015ec60 2023-11-24T06:29:42.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d95232640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900cb690 con 0x7f5d9015a290 2023-11-24T06:29:42.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d95232640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900cb970 con 0x7f5d900b1f80 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5d9015a290 0x7f5d900707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d87fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5d9015ec60 0x7f5d900cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48550/0 (socket says 172.21.15.143:48550) 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d87fff640 1 -- 172.21.15.143:0/2800076591 learned_addr learned my addr 172.21.15.143:0/2800076591 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/2800076591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d900b1f80 msgr2=0x7f5d900b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8f59e640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d900b1f80 0x7f5d900b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8ed9d640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d900b1f80 0x7f5d900b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8e59c640 1 -- 172.21.15.143:0/2800076591 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099891421 0 0) 0x7f5d90071170 con 0x7f5d9015ec60 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/2800076591 >> v1:172.21.15.143:6789/0 conn(0x7f5d9015ec60 legacy=0x7f5d900cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/2800076591 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d900cbc50 con 0x7f5d9015a290 2023-11-24T06:29:42.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.150+0000 7f5d8f59e640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d900b1f80 0x7f5d900b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:42.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d8ed9d640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d9015a290 0x7f5d900707f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d800097c0 tx=0x7f5d8001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4f6b513ce130c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:42.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d8e59c640 1 -- 172.21.15.143:0/2800076591 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800ab600 con 0x7f5d9015a290 2023-11-24T06:29:42.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d8e59c640 1 -- 172.21.15.143:0/2800076591 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800a7050 con 0x7f5d9015a290 2023-11-24T06:29:42.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d8e59c640 1 -- 172.21.15.143:0/2800076591 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800ab980 con 0x7f5d9015a290 2023-11-24T06:29:42.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 -- 172.21.15.143:0/2800076591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d9015a290 msgr2=0x7f5d900707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:42.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d9015a290 0x7f5d900707f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d800097c0 tx=0x7f5d8001c3f0 comp rx=0 tx=0).stop 2023-11-24T06:29:42.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 -- 172.21.15.143:0/2800076591 shutdown_connections 2023-11-24T06:29:42.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d900b1f80 0x7f5d900b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:42.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 --2- 172.21.15.143:0/2800076591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d9015a290 0x7f5d900707f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:42.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 -- 172.21.15.143:0/2800076591 >> 172.21.15.143:0/2800076591 conn(0x7f5d900b0c80 msgr2=0x7f5d900b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:42.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 -- 172.21.15.143:0/2800076591 shutdown_connections 2023-11-24T06:29:42.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 -- 172.21.15.143:0/2800076591 wait complete. 2023-11-24T06:29:42.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 Processor -- start 2023-11-24T06:29:42.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.154+0000 7f5d95232640 1 -- start start 2023-11-24T06:29:42.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 0x7f5d90149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:42.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d9015a290 0x7f5d90149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:42.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d9015ec60 0x7f5d90153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9015d2f0 con 0x7f5d900b1f80 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9015d590 con 0x7f5d9015ec60 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900aec50 con 0x7f5d9015a290 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 0x7f5d90149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 0x7f5d90149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46344/0 (socket says 172.21.15.143:46344) 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/385888525 learned_addr learned my addr 172.21.15.143:0/385888525 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:42.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d87fff640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d9015a290 0x7f5d90149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8f59e640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d9015ec60 0x7f5d90153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d9015a290 msgr2=0x7f5d90149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d9015a290 0x7f5d90149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d9015ec60 msgr2=0x7f5d90153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d9015ec60 0x7f5d90153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 -- 172.21.15.143:0/385888525 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80009420 con 0x7f5d900b1f80 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d8ed9d640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 0x7f5d90149470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001a020 tx=0x7f5d8001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b7650 con 0x7f5d900b1f80 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800abe90 con 0x7f5d900b1f80 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d90070f40 con 0x7f5d900b1f80 2023-11-24T06:29:42.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b7a10 con 0x7f5d900b1f80 2023-11-24T06:29:42.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d900af210 con 0x7f5d900b1f80 2023-11-24T06:29:42.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.158+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9004e8c0 con 0x7f5d900b1f80 2023-11-24T06:29:42.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.162+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d800b7b70 con 0x7f5d900b1f80 2023-11-24T06:29:42.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.162+0000 7f5d877fe640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5d70066470 0x7f5d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:42.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.162+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d8011e7d0 con 0x7f5d900b1f80 2023-11-24T06:29:42.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.162+0000 7f5d87fff640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5d70066470 0x7f5d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:42.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.162+0000 7f5d87fff640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5d70066470 0x7f5d70068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d900b3dc0 tx=0x7f5d78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:42.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.166+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d800ebcd0 con 0x7f5d900b1f80 2023-11-24T06:29:42.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:42.350+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5d900b18e0 con 0x7f5d900b1f80 2023-11-24T06:29:43.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.338+0000 7f5d877fe640 1 -- 172.21.15.143:0/385888525 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5d800bb0b0 con 0x7f5d900b1f80 2023-11-24T06:29:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5d70066470 msgr2=0x7f5d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5d70066470 0x7f5d70068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d900b3dc0 tx=0x7f5d78009040 comp rx=0 tx=0).stop 2023-11-24T06:29:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 msgr2=0x7f5d90149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 0x7f5d90149470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001a020 tx=0x7f5d8001ac30 comp rx=0 tx=0).stop 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 shutdown_connections 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5d70066470 0x7f5d70068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d9015ec60 0x7f5d90153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d9015a290 0x7f5d90149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 --2- 172.21.15.143:0/385888525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900b1f80 0x7f5d90149470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 >> 172.21.15.143:0/385888525 conn(0x7f5d900b0c80 msgr2=0x7f5d900ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 shutdown_connections 2023-11-24T06:29:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.342+0000 7f5d95232640 1 -- 172.21.15.143:0/385888525 wait complete. 2023-11-24T06:29:43.364 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:29:43.364 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:29:43.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 Processor -- start 2023-11-24T06:29:43.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 -- start start 2023-11-24T06:29:43.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 0x7f4b2406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b240b1f80 0x7f4b24163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2415a050 con 0x7f4b240ccef0 2023-11-24T06:29:43.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240722e0 con 0x7f4b240b1f80 2023-11-24T06:29:43.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2c5f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24072860 con 0x7f4b240ce2e0 2023-11-24T06:29:43.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4b240ccef0 0x7f4b2406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48556/0 (socket says 172.21.15.143:48556) 2023-11-24T06:29:43.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 -- 172.21.15.143:0/1849736907 learned_addr learned my addr 172.21.15.143:0/1849736907 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2ab95640 1 --2- 172.21.15.143:0/1849736907 >> v2:172.21.15.146:3300/0 conn(0x7f4b240b1f80 0x7f4b24163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29b93640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 0x7f4b2406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107567573 0 0) 0x7f4b2415a050 con 0x7f4b240ccef0 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b10003530 con 0x7f4b240ccef0 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2986040203 0 0) 0x7f4b10003530 con 0x7f4b240ccef0 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 msgr2=0x7f4b2406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 0x7f4b2406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 >> v2:172.21.15.146:3300/0 conn(0x7f4b240b1f80 msgr2=0x7f4b24163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 --2- 172.21.15.143:0/1849736907 >> v2:172.21.15.146:3300/0 conn(0x7f4b240b1f80 0x7f4b24163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240705e0 con 0x7f4b240ccef0 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f4b20001680 con 0x7f4b240ccef0 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 >> v1:172.21.15.143:6789/0 conn(0x7f4b240ccef0 legacy=0x7f4b2406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100047d0 0x7f4b10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 0x7f4b10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240722e0 con 0x7f4b10003980 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24072860 con 0x7f4b100047d0 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1000b990 con 0x7f4b240ce2e0 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b29b93640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100047d0 0x7f4b10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2ab95640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 0x7f4b10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 -- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 msgr2=0x7f4b10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b240ce2e0 0x7f4b10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 -- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100047d0 msgr2=0x7f4b10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100047d0 0x7f4b10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.502+0000 7f4b2a394640 1 -- 172.21.15.143:0/1849736907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10003530 con 0x7f4b10003980 2023-11-24T06:29:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2a394640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b10003da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c240 tx=0x7f4b2001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af330fafc5e5fea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200058e0 con 0x7f4b10003980 2023-11-24T06:29:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20005a40 con 0x7f4b10003980 2023-11-24T06:29:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b29392640 1 -- 172.21.15.143:0/1849736907 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20005dd0 con 0x7f4b10003980 2023-11-24T06:29:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/1849736907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 msgr2=0x7f4b10003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/1849736907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b10003da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c240 tx=0x7f4b2001cc10 comp rx=0 tx=0).stop 2023-11-24T06:29:43.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2ab95640 1 -- 172.21.15.143:0/1849736907 reap_dead start 2023-11-24T06:29:43.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/1849736907 shutdown_connections 2023-11-24T06:29:43.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/1849736907 >> 172.21.15.143:0/1849736907 conn(0x7f4b240b0c80 msgr2=0x7f4b240b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:43.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/1849736907 shutdown_connections 2023-11-24T06:29:43.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.506+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/1849736907 wait complete. 2023-11-24T06:29:43.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 Processor -- start 2023-11-24T06:29:43.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 -- start start 2023-11-24T06:29:43.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b241478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b2415a200 0x7f4b240ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b241480d0 0x7f4b241668f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24147e20 con 0x7f4b10003980 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240ac350 con 0x7f4b2415a200 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240ac630 con 0x7f4b241480d0 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b241478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b241478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46356/0 (socket says 172.21.15.143:46356) 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 -- 172.21.15.143:0/24276671 learned_addr learned my addr 172.21.15.143:0/24276671 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2ab95640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b241480d0 0x7f4b241668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b29b93640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b2415a200 0x7f4b240ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 -- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b241480d0 msgr2=0x7f4b241668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:43.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b241480d0 0x7f4b241668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 -- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b2415a200 msgr2=0x7f4b240ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:43.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b2415a200 0x7f4b240ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:43.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 -- 172.21.15.143:0/24276671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240ac910 con 0x7f4b10003980 2023-11-24T06:29:43.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b29b93640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b2415a200 0x7f4b240ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:43.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2a394640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b241478e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c240 tx=0x7f4b10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200047f0 con 0x7f4b10003980 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20004950 con 0x7f4b10003980 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20004cc0 con 0x7f4b10003980 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b24150560 con 0x7f4b10003980 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.510+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b240adc10 con 0x7f4b10003980 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.514+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b241506f0 con 0x7f4b10003980 2023-11-24T06:29:43.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.514+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b20007070 con 0x7f4b10003980 2023-11-24T06:29:43.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.514+0000 7f4b1affd640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4b080664a0 0x7f4b08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:43.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.514+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b2011d0f0 con 0x7f4b10003980 2023-11-24T06:29:43.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.514+0000 7f4b29b93640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4b080664a0 0x7f4b08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:43.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.514+0000 7f4b29b93640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4b080664a0 0x7f4b08068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b2415a600 tx=0x7f4b14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:43.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.518+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b200ea580 con 0x7f4b10003980 2023-11-24T06:29:43.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:43.698+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4b240ac770 con 0x7f4b10003980 2023-11-24T06:29:44.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b1affd640 1 -- 172.21.15.143:0/24276671 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b240ac770 con 0x7f4b10003980 2023-11-24T06:29:44.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4b080664a0 msgr2=0x7f4b08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4b080664a0 0x7f4b08068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b2415a600 tx=0x7f4b14008040 comp rx=0 tx=0).stop 2023-11-24T06:29:44.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 msgr2=0x7f4b241478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b241478e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c240 tx=0x7f4b10005800 comp rx=0 tx=0).stop 2023-11-24T06:29:44.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 shutdown_connections 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4b080664a0 0x7f4b08068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b241480d0 0x7f4b241668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b2415a200 0x7f4b240ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 --2- 172.21.15.143:0/24276671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b10003980 0x7f4b241478e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 >> 172.21.15.143:0/24276671 conn(0x7f4b240b0c80 msgr2=0x7f4b240ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 shutdown_connections 2023-11-24T06:29:44.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.346+0000 7f4b2c5f8640 1 -- 172.21.15.143:0/24276671 wait complete. 2023-11-24T06:29:44.374 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:29:44.374 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:29:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 Processor -- start 2023-11-24T06:29:44.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 -- start start 2023-11-24T06:29:44.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe588144030 0x7fe58806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5880709c0 0x7fe588070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58806d8b0 con 0x7fe58809cc20 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe588145020 con 0x7fe5880709c0 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58f8e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58809d0a0 con 0x7fe588144030 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5880709c0 0x7fe588070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5880709c0 0x7fe588070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46360/0 (socket says 172.21.15.143:46360) 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 -- 172.21.15.143:0/3611015815 learned_addr learned my addr 172.21.15.143:0/3611015815 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58ce7e640 1 --1- 172.21.15.143:0/3611015815 >> v1:172.21.15.143:6789/0 conn(0x7fe58809cc20 0x7fe58806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48568/0 (socket says 172.21.15.143:48568) 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 -- 172.21.15.143:0/3611015815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe588144030 msgr2=0x7fe58806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58d67f640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe588144030 0x7fe58806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe588144030 0x7fe58806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 -- 172.21.15.143:0/3611015815 >> v1:172.21.15.143:6789/0 conn(0x7fe58809cc20 legacy=0x7fe58806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58de80640 1 -- 172.21.15.143:0/3611015815 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588071390 con 0x7fe5880709c0 2023-11-24T06:29:44.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe57ffff640 1 -- 172.21.15.143:0/3611015815 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747283835 0 0) 0x7fe58806d8b0 con 0x7fe58809cc20 2023-11-24T06:29:44.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.510+0000 7fe58d67f640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe588144030 0x7fe58806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:44.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58de80640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5880709c0 0x7fe588070e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe580009e50 tx=0x7fe58001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a1eee86c1d0e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:44.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe57ffff640 1 -- 172.21.15.143:0/3611015815 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800a58a0 con 0x7fe5880709c0 2023-11-24T06:29:44.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe57ffff640 1 -- 172.21.15.143:0/3611015815 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800a5a00 con 0x7fe5880709c0 2023-11-24T06:29:44.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe57ffff640 1 -- 172.21.15.143:0/3611015815 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800a5d90 con 0x7fe5880709c0 2023-11-24T06:29:44.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 -- 172.21.15.143:0/3611015815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5880709c0 msgr2=0x7fe588070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5880709c0 0x7fe588070e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe580009e50 tx=0x7fe58001c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 -- 172.21.15.143:0/3611015815 shutdown_connections 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5880709c0 0x7fe588070e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/3611015815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe588144030 0x7fe58806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 -- 172.21.15.143:0/3611015815 >> 172.21.15.143:0/3611015815 conn(0x7fe5880b0bf0 msgr2=0x7fe5880b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 -- 172.21.15.143:0/3611015815 shutdown_connections 2023-11-24T06:29:44.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.514+0000 7fe58f8e3640 1 -- 172.21.15.143:0/3611015815 wait complete. 2023-11-24T06:29:44.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 Processor -- start 2023-11-24T06:29:44.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 -- start start 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5880709c0 0x7fe58813cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe58809cc20 0x7fe5880abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 0x7fe5880ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880cc6d0 con 0x7fe588144030 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58809c7e0 con 0x7fe5880709c0 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58809bc60 con 0x7fe58809cc20 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 0x7fe5880ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 0x7fe5880ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46368/0 (socket says 172.21.15.143:46368) 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 -- 172.21.15.143:0/118537325 learned_addr learned my addr 172.21.15.143:0/118537325 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:44.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58d67f640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5880709c0 0x7fe58813cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58ce7e640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe58809cc20 0x7fe5880abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 -- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe58809cc20 msgr2=0x7fe5880abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe58809cc20 0x7fe5880abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 -- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5880709c0 msgr2=0x7fe58813cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5880709c0 0x7fe58813cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 -- 172.21.15.143:0/118537325 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009b30 con 0x7fe588144030 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58ce7e640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe58809cc20 0x7fe5880abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58d67f640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5880709c0 0x7fe58813cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:44.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58de80640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 0x7fe5880ac410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5800af040 tx=0x7fe580019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:44.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800b8880 con 0x7fe588144030 2023-11-24T06:29:44.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800b8a20 con 0x7fe588144030 2023-11-24T06:29:44.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800b8dd0 con 0x7fe588144030 2023-11-24T06:29:44.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.518+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58809bf40 con 0x7fe588144030 2023-11-24T06:29:44.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58809c500 con 0x7fe588144030 2023-11-24T06:29:44.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5880cc840 con 0x7fe588144030 2023-11-24T06:29:44.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5800c3460 con 0x7fe588144030 2023-11-24T06:29:44.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe57dffb640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe56c066470 0x7fe56c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe58011f700 con 0x7fe588144030 2023-11-24T06:29:44.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe58d67f640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe56c066470 0x7fe56c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.522+0000 7fe58d67f640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe56c066470 0x7fe56c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe58400a9b0 tx=0x7fe584008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:44.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.526+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5800ecc00 con 0x7fe588144030 2023-11-24T06:29:44.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.706+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe588067520 con 0x7fe588144030 2023-11-24T06:29:44.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.706+0000 7fe57dffb640 1 -- 172.21.15.143:0/118537325 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fe5800f0220 con 0x7fe588144030 2023-11-24T06:29:44.711 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:44.711 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:29:44.712 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe56c066470 msgr2=0x7fe56c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe56c066470 0x7fe56c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe58400a9b0 tx=0x7fe584008040 comp rx=0 tx=0).stop 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 msgr2=0x7fe5880ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 0x7fe5880ac410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5800af040 tx=0x7fe580019780 comp rx=0 tx=0).stop 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 shutdown_connections 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe56c066470 0x7fe56c068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe588144030 0x7fe5880ac410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe58809cc20 0x7fe5880abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 --2- 172.21.15.143:0/118537325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5880709c0 0x7fe58813cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 >> 172.21.15.143:0/118537325 conn(0x7fe5880b0bf0 msgr2=0x7fe5880af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:44.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 shutdown_connections 2023-11-24T06:29:44.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.710+0000 7fe58f8e3640 1 -- 172.21.15.143:0/118537325 wait complete. 2023-11-24T06:29:44.732 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:44.777 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-11-24T06:29:44.775+0000 7f8efd5f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:29:44.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 Processor -- start 2023-11-24T06:29:44.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 -- start start 2023-11-24T06:29:44.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f117015a320 0x7f11700b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11700b36c0 0x7f1170070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117015a700 con 0x7f1170070bd0 2023-11-24T06:29:44.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700b2430 con 0x7f117015a320 2023-11-24T06:29:44.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f1178416640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b2620 con 0x7f11700b36c0 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f11761b2640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f117015a320 0x7f11700b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f11759b1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11700b36c0 0x7f1170070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f11761b2640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f117015a320 0x7f11700b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42684/0 (socket says 172.21.15.143:42684) 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.866+0000 7f11761b2640 1 -- 172.21.15.143:0/3318826281 learned_addr learned my addr 172.21.15.143:0/3318826281 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11761b2640 1 -- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11700b36c0 msgr2=0x7f1170070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11761b2640 1 --2- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11700b36c0 0x7f1170070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11761b2640 1 -- 172.21.15.143:0/3318826281 >> v1:172.21.15.146:6789/0 conn(0x7f1170070bd0 legacy=0x7f11700ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11761b2640 1 -- 172.21.15.143:0/3318826281 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700b2900 con 0x7f117015a320 2023-11-24T06:29:44.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11759b1640 1 --2- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11700b36c0 0x7f1170070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:44.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11761b2640 1 --2- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f117015a320 0x7f11700b1ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f116c009870 tx=0x7f116c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11f9e36411c1012 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:44.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11751b0640 1 -- 172.21.15.143:0/3318826281 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0a9400 con 0x7f117015a320 2023-11-24T06:29:44.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11751b0640 1 -- 172.21.15.143:0/3318826281 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0a9560 con 0x7f117015a320 2023-11-24T06:29:44.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f11751b0640 1 -- 172.21.15.143:0/3318826281 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0a98f0 con 0x7f117015a320 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f1178416640 1 -- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f117015a320 msgr2=0x7f11700b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.870+0000 7f1178416640 1 --2- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f117015a320 0x7f11700b1ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f116c009870 tx=0x7f116c01c540 comp rx=0 tx=0).stop 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- 172.21.15.143:0/3318826281 shutdown_connections 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 --2- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11700b36c0 0x7f1170070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 --2- 172.21.15.143:0/3318826281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f117015a320 0x7f11700b1ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- 172.21.15.143:0/3318826281 >> 172.21.15.143:0/3318826281 conn(0x7f11700b0bf0 msgr2=0x7f11700b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- 172.21.15.143:0/3318826281 shutdown_connections 2023-11-24T06:29:44.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- 172.21.15.143:0/3318826281 wait complete. 2023-11-24T06:29:44.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 Processor -- start 2023-11-24T06:29:44.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- start start 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1170070bd0 0x7f1170156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 0x7f1170155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f117015a320 0x7f117009ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170158050 con 0x7f11700b36c0 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11701560e0 con 0x7f1170070bd0 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f1178416640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1170157440 con 0x7f117015a320 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 0x7f1170155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 0x7f1170155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46378/0 (socket says 172.21.15.143:46378) 2023-11-24T06:29:44.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 -- 172.21.15.143:0/2176626430 learned_addr learned my addr 172.21.15.143:0/2176626430 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:44.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11769b3640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f117015a320 0x7f117009ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11761b2640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1170070bd0 0x7f1170156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 -- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f117015a320 msgr2=0x7f117009ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f117015a320 0x7f117009ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 -- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1170070bd0 msgr2=0x7f1170156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1170070bd0 0x7f1170156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 -- 172.21.15.143:0/2176626430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009420 con 0x7f11700b36c0 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11769b3640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f117015a320 0x7f117009ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11761b2640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1170070bd0 0x7f1170156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.874+0000 7f11759b1640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 0x7f1170155140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f116000e9d0 tx=0x7f116000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000ca60 con 0x7f11700b36c0 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000cbc0 con 0x7f11700b36c0 2023-11-24T06:29:44.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160013470 con 0x7f11700b36c0 2023-11-24T06:29:44.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c0094d0 con 0x7f11700b36c0 2023-11-24T06:29:44.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170157a00 con 0x7f11700b36c0 2023-11-24T06:29:44.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170067520 con 0x7f11700b36c0 2023-11-24T06:29:44.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11600135d0 con 0x7f11700b36c0 2023-11-24T06:29:44.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1166ffd640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1154066470 0x7f1154068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:44.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1160084150 con 0x7f11700b36c0 2023-11-24T06:29:44.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f11761b2640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1154066470 0x7f1154068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:44.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.878+0000 7f11761b2640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1154066470 0x7f1154068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f116c0ae000 tx=0x7f116c0b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:44.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:44.882+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11600515d0 con 0x7f11700b36c0 2023-11-24T06:29:45.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.034+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f117009ca10 con 0x7f11700b36c0 2023-11-24T06:29:45.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1166ffd640 1 -- 172.21.15.143:0/2176626430 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f1160054bf0 con 0x7f11700b36c0 2023-11-24T06:29:45.041 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:45.041 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:45.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1154066470 msgr2=0x7f1154068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1154066470 0x7f1154068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f116c0ae000 tx=0x7f116c0b3040 comp rx=0 tx=0).stop 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 msgr2=0x7f1170155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 0x7f1170155140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f116000e9d0 tx=0x7f116000ee90 comp rx=0 tx=0).stop 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 shutdown_connections 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1154066470 0x7f1154068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f117015a320 0x7f117009ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11700b36c0 0x7f1170155140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 --2- 172.21.15.143:0/2176626430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1170070bd0 0x7f1170156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 >> 172.21.15.143:0/2176626430 conn(0x7f11700b0bf0 msgr2=0x7f1170164170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 shutdown_connections 2023-11-24T06:29:45.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.038+0000 7f1178416640 1 -- 172.21.15.143:0/2176626430 wait complete. 2023-11-24T06:29:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:29:45.063 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:29:45.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 Processor -- start 2023-11-24T06:29:45.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 -- start start 2023-11-24T06:29:45.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec380d3e80 0x7fec380ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380cfc10 0x7fec380d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380d21c0 con 0x7fec3815d500 2023-11-24T06:29:45.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec380d05c0 con 0x7fec380d3e80 2023-11-24T06:29:45.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3d4c8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380cdcd0 con 0x7fec380cfc10 2023-11-24T06:29:45.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec37fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fec3815d500 0x7fec380d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48574/0 (socket says 172.21.15.143:48574) 2023-11-24T06:29:45.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec37fff640 1 -- 172.21.15.143:0/277241852 learned_addr learned my addr 172.21.15.143:0/277241852 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:45.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3ccc7640 1 --2- 172.21.15.143:0/277241852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380cfc10 0x7fec380d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec377fe640 1 --2- 172.21.15.143:0/277241852 >> v2:172.21.15.146:3300/0 conn(0x7fec380d3e80 0x7fec380ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec36ffd640 1 -- 172.21.15.143:0/277241852 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367899211 0 0) 0x7fec380d21c0 con 0x7fec3815d500 2023-11-24T06:29:45.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec36ffd640 1 -- 172.21.15.143:0/277241852 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec20003530 con 0x7fec3815d500 2023-11-24T06:29:45.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3ccc7640 1 -- 172.21.15.143:0/277241852 >> v2:172.21.15.146:3300/0 conn(0x7fec380d3e80 msgr2=0x7fec380ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:45.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3ccc7640 1 --2- 172.21.15.143:0/277241852 >> v2:172.21.15.146:3300/0 conn(0x7fec380d3e80 0x7fec380ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3ccc7640 1 -- 172.21.15.143:0/277241852 >> v1:172.21.15.143:6789/0 conn(0x7fec3815d500 legacy=0x7fec380d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.198+0000 7fec3ccc7640 1 -- 172.21.15.143:0/277241852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380d1ef0 con 0x7fec380cfc10 2023-11-24T06:29:45.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3ccc7640 1 --2- 172.21.15.143:0/277241852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380cfc10 0x7fec380d0080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fec30009d90 tx=0x7fec3001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f2f5bd8dfcbf6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec36ffd640 1 -- 172.21.15.143:0/277241852 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300a59e0 con 0x7fec380cfc10 2023-11-24T06:29:45.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec36ffd640 1 -- 172.21.15.143:0/277241852 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec300a5b40 con 0x7fec380cfc10 2023-11-24T06:29:45.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec36ffd640 1 -- 172.21.15.143:0/277241852 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300ad440 con 0x7fec380cfc10 2023-11-24T06:29:45.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 -- 172.21.15.143:0/277241852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380cfc10 msgr2=0x7fec380d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/277241852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380cfc10 0x7fec380d0080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fec30009d90 tx=0x7fec3001c920 comp rx=0 tx=0).stop 2023-11-24T06:29:45.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 -- 172.21.15.143:0/277241852 shutdown_connections 2023-11-24T06:29:45.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/277241852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380cfc10 0x7fec380d0080 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/277241852 >> v2:172.21.15.146:3300/0 conn(0x7fec380d3e80 0x7fec380ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 -- 172.21.15.143:0/277241852 >> 172.21.15.143:0/277241852 conn(0x7fec3809c540 msgr2=0x7fec380d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:45.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 -- 172.21.15.143:0/277241852 shutdown_connections 2023-11-24T06:29:45.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.202+0000 7fec3d4c8640 1 -- 172.21.15.143:0/277241852 wait complete. 2023-11-24T06:29:45.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 Processor -- start 2023-11-24T06:29:45.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 -- start start 2023-11-24T06:29:45.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 0x7fec3815c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380d3e80 0x7fec3815da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815d500 0x7fec38154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3815f1a0 con 0x7fec380cfc10 2023-11-24T06:29:45.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3815e520 con 0x7fec3815d500 2023-11-24T06:29:45.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3815e800 con 0x7fec380d3e80 2023-11-24T06:29:45.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 0x7fec3815c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 0x7fec3815c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46382/0 (socket says 172.21.15.143:46382) 2023-11-24T06:29:45.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 -- 172.21.15.143:0/323845688 learned_addr learned my addr 172.21.15.143:0/323845688 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:45.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 -- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380d3e80 msgr2=0x7fec3815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380d3e80 0x7fec3815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3ccc7640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815d500 0x7fec38154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 -- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815d500 msgr2=0x7fec38154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815d500 0x7fec38154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 -- 172.21.15.143:0/323845688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30009a70 con 0x7fec380cfc10 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3ccc7640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815d500 0x7fec38154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec37fff640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 0x7fec3815c960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fec2800c420 tx=0x7fec2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28005cf0 con 0x7fec380cfc10 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28005e50 con 0x7fec380cfc10 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3815eae0 con 0x7fec380cfc10 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280072d0 con 0x7fec380cfc10 2023-11-24T06:29:45.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.206+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3815b8c0 con 0x7fec380cfc10 2023-11-24T06:29:45.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.210+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3804e850 con 0x7fec380cfc10 2023-11-24T06:29:45.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.210+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec28007430 con 0x7fec380cfc10 2023-11-24T06:29:45.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.210+0000 7fec34ff9640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fec24066470 0x7fec24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.210+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec280833c0 con 0x7fec380cfc10 2023-11-24T06:29:45.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.210+0000 7fec377fe640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fec24066470 0x7fec24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.210+0000 7fec377fe640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fec24066470 0x7fec24068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec2c006aa0 tx=0x7fec2c006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.214+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec28050850 con 0x7fec380cfc10 2023-11-24T06:29:45.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.362+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec3815d8e0 con 0x7fec24066470 2023-11-24T06:29:45.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.370+0000 7fec34ff9640 1 -- 172.21.15.143:0/323845688 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264754 (secure 0 0 0) 0x7fec2c00e860 con 0x7fec24066470 2023-11-24T06:29:45.376 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:45.378 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:29:45.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fec24066470 msgr2=0x7fec24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fec24066470 0x7fec24068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec2c006aa0 tx=0x7fec2c006a30 comp rx=0 tx=0).stop 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 msgr2=0x7fec3815c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 0x7fec3815c960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fec2800c420 tx=0x7fec2800c8e0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 shutdown_connections 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fec24066470 0x7fec24068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815d500 0x7fec38154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec380d3e80 0x7fec3815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 --2- 172.21.15.143:0/323845688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec380cfc10 0x7fec3815c960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 >> 172.21.15.143:0/323845688 conn(0x7fec3809c540 msgr2=0x7fec380c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 shutdown_connections 2023-11-24T06:29:45.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.374+0000 7fec3d4c8640 1 -- 172.21.15.143:0/323845688 wait complete. 2023-11-24T06:29:45.397 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T06:29:44.207460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2887680,"data_stored":1751867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.897700"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413188+0000","last_change":"2023-11-24T06:29:41.035477+0000","last_active":"2023-11-24T06:29:42.413188+0000","last_peered":"2023-11-24T06:29:42.413188+0000","last_clean":"2023-11-24T06:29:42.413188+0000","last_became_active":"2023-11-24T06:29:41.035174+0000","last_became_peered":"2023-11-24T06:29:41.035174+0000","last_unstale":"2023-11-24T06:29:42.413188+0000","last_undegraded":"2023-11-24T06:29:42.413188+0000","last_fullsized":"2023-11-24T06:29:42.413188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010247+0000","last_change":"2023-11-24T06:29:41.022068+0000","last_active":"2023-11-24T06:29:42.010247+0000","last_peered":"2023-11-24T06:29:42.010247+0000","last_clean":"2023-11-24T06:29:42.010247+0000","last_became_active":"2023-11-24T06:29:41.021715+0000","last_became_peered":"2023-11-24T06:29:41.021715+0000","last_unstale":"2023-11-24T06:29:42.010247+0000","last_undegraded":"2023-11-24T06:29:42.010247+0000","last_fullsized":"2023-11-24T06:29:42.010247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411078+0000","last_change":"2023-11-24T06:29:41.024602+0000","last_active":"2023-11-24T06:29:42.411078+0000","last_peered":"2023-11-24T06:29:42.411078+0000","last_clean":"2023-11-24T06:29:42.411078+0000","last_became_active":"2023-11-24T06:29:41.024285+0000","last_became_peered":"2023-11-24T06:29:41.024285+0000","last_unstale":"2023-11-24T06:29:42.411078+0000","last_undegraded":"2023-11-24T06:29:42.411078+0000","last_fullsized":"2023-11-24T06:29:42.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412375+0000","last_change":"2023-11-24T06:29:41.041359+0000","last_active":"2023-11-24T06:29:42.412375+0000","last_peered":"2023-11-24T06:29:42.412375+0000","last_clean":"2023-11-24T06:29:42.412375+0000","last_became_active":"2023-11-24T06:29:41.040996+0000","last_became_peered":"2023-11-24T06:29:41.040996+0000","last_unstale":"2023-11-24T06:29:42.412375+0000","last_undegraded":"2023-11-24T06:29:42.412375+0000","last_fullsized":"2023-11-24T06:29:42.412375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412762+0000","last_change":"2023-11-24T06:29:41.034177+0000","last_active":"2023-11-24T06:29:42.412762+0000","last_peered":"2023-11-24T06:29:42.412762+0000","last_clean":"2023-11-24T06:29:42.412762+0000","last_became_active":"2023-11-24T06:29:41.033446+0000","last_became_peered":"2023-11-24T06:29:41.033446+0000","last_unstale":"2023-11-24T06:29:42.412762+0000","last_undegraded":"2023-11-24T06:29:42.412762+0000","last_fullsized":"2023-11-24T06:29:42.412762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411687+0000","last_change":"2023-11-24T06:29:41.038649+0000","last_active":"2023-11-24T06:29:42.411687+0000","last_peered":"2023-11-24T06:29:42.411687+0000","last_clean":"2023-11-24T06:29:42.411687+0000","last_became_active":"2023-11-24T06:29:41.038301+0000","last_became_peered":"2023-11-24T06:29:41.038301+0000","last_unstale":"2023-11-24T06:29:42.411687+0000","last_undegraded":"2023-11-24T06:29:42.411687+0000","last_fullsized":"2023-11-24T06:29:42.411687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.023574+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.023253+0000","last_became_peered":"2023-11-24T06:29:41.023253+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008553+0000","last_change":"2023-11-24T06:29:41.047704+0000","last_active":"2023-11-24T06:29:42.008553+0000","last_peered":"2023-11-24T06:29:42.008553+0000","last_clean":"2023-11-24T06:29:42.008553+0000","last_became_active":"2023-11-24T06:29:41.047479+0000","last_became_peered":"2023-11-24T06:29:41.047479+0000","last_unstale":"2023-11-24T06:29:42.008553+0000","last_undegraded":"2023-11-24T06:29:42.008553+0000","last_fullsized":"2023-11-24T06:29:42.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413219+0000","last_change":"2023-11-24T06:29:41.038737+0000","last_active":"2023-11-24T06:29:42.413219+0000","last_peered":"2023-11-24T06:29:42.413219+0000","last_clean":"2023-11-24T06:29:42.413219+0000","last_became_active":"2023-11-24T06:29:41.038472+0000","last_became_peered":"2023-11-24T06:29:41.038472+0000","last_unstale":"2023-11-24T06:29:42.413219+0000","last_undegraded":"2023-11-24T06:29:42.413219+0000","last_fullsized":"2023-11-24T06:29:42.413219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402616+0000","last_change":"2023-11-24T06:29:41.045851+0000","last_active":"2023-11-24T06:29:42.402616+0000","last_peered":"2023-11-24T06:29:42.402616+0000","last_clean":"2023-11-24T06:29:42.402616+0000","last_became_active":"2023-11-24T06:29:41.044799+0000","last_became_peered":"2023-11-24T06:29:41.044799+0000","last_unstale":"2023-11-24T06:29:42.402616+0000","last_undegraded":"2023-11-24T06:29:42.402616+0000","last_fullsized":"2023-11-24T06:29:42.402616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402357+0000","last_change":"2023-11-24T06:29:41.045092+0000","last_active":"2023-11-24T06:29:42.402357+0000","last_peered":"2023-11-24T06:29:42.402357+0000","last_clean":"2023-11-24T06:29:42.402357+0000","last_became_active":"2023-11-24T06:29:41.044758+0000","last_became_peered":"2023-11-24T06:29:41.044758+0000","last_unstale":"2023-11-24T06:29:42.402357+0000","last_undegraded":"2023-11-24T06:29:42.402357+0000","last_fullsized":"2023-11-24T06:29:42.402357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411929+0000","last_change":"2023-11-24T06:29:41.029744+0000","last_active":"2023-11-24T06:29:42.411929+0000","last_peered":"2023-11-24T06:29:42.411929+0000","last_clean":"2023-11-24T06:29:42.411929+0000","last_became_active":"2023-11-24T06:29:41.029413+0000","last_became_peered":"2023-11-24T06:29:41.029413+0000","last_unstale":"2023-11-24T06:29:42.411929+0000","last_undegraded":"2023-11-24T06:29:42.411929+0000","last_fullsized":"2023-11-24T06:29:42.411929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:40.396297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009191+0000","last_change":"2023-11-24T06:29:41.032796+0000","last_active":"2023-11-24T06:29:42.009191+0000","last_peered":"2023-11-24T06:29:42.009191+0000","last_clean":"2023-11-24T06:29:42.009191+0000","last_became_active":"2023-11-24T06:29:41.032526+0000","last_became_peered":"2023-11-24T06:29:41.032526+0000","last_unstale":"2023-11-24T06:29:42.009191+0000","last_undegraded":"2023-11-24T06:29:42.009191+0000","last_fullsized":"2023-11-24T06:29:42.009191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410937+0000","last_change":"2023-11-24T06:29:41.022282+0000","last_active":"2023-11-24T06:29:42.410937+0000","last_peered":"2023-11-24T06:29:42.410937+0000","last_clean":"2023-11-24T06:29:42.410937+0000","last_became_active":"2023-11-24T06:29:41.021823+0000","last_became_peered":"2023-11-24T06:29:41.021823+0000","last_unstale":"2023-11-24T06:29:42.410937+0000","last_undegraded":"2023-11-24T06:29:42.410937+0000","last_fullsized":"2023-11-24T06:29:42.410937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:06.770793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010312+0000","last_change":"2023-11-24T06:29:41.013047+0000","last_active":"2023-11-24T06:29:42.010312+0000","last_peered":"2023-11-24T06:29:42.010312+0000","last_clean":"2023-11-24T06:29:42.010312+0000","last_became_active":"2023-11-24T06:29:41.012696+0000","last_became_peered":"2023-11-24T06:29:41.012696+0000","last_unstale":"2023-11-24T06:29:42.010312+0000","last_undegraded":"2023-11-24T06:29:42.010312+0000","last_fullsized":"2023-11-24T06:29:42.010312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041964+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.041680+0000","last_became_peered":"2023-11-24T06:29:41.041680+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412021+0000","last_change":"2023-11-24T06:29:41.041640+0000","last_active":"2023-11-24T06:29:42.412021+0000","last_peered":"2023-11-24T06:29:42.412021+0000","last_clean":"2023-11-24T06:29:42.412021+0000","last_became_active":"2023-11-24T06:29:41.040550+0000","last_became_peered":"2023-11-24T06:29:41.040550+0000","last_unstale":"2023-11-24T06:29:42.412021+0000","last_undegraded":"2023-11-24T06:29:42.412021+0000","last_fullsized":"2023-11-24T06:29:42.412021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009398+0000","last_change":"2023-11-24T06:29:41.033224+0000","last_active":"2023-11-24T06:29:42.009398+0000","last_peered":"2023-11-24T06:29:42.009398+0000","last_clean":"2023-11-24T06:29:42.009398+0000","last_became_active":"2023-11-24T06:29:41.032892+0000","last_became_peered":"2023-11-24T06:29:41.032892+0000","last_unstale":"2023-11-24T06:29:42.009398+0000","last_undegraded":"2023-11-24T06:29:42.009398+0000","last_fullsized":"2023-11-24T06:29:42.009398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413054+0000","last_change":"2023-11-24T06:29:41.026686+0000","last_active":"2023-11-24T06:29:42.413054+0000","last_peered":"2023-11-24T06:29:42.413054+0000","last_clean":"2023-11-24T06:29:42.413054+0000","last_became_active":"2023-11-24T06:29:41.026385+0000","last_became_peered":"2023-11-24T06:29:41.026385+0000","last_unstale":"2023-11-24T06:29:42.413054+0000","last_undegraded":"2023-11-24T06:29:42.413054+0000","last_fullsized":"2023-11-24T06:29:42.413054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402323+0000","last_change":"2023-11-24T06:29:41.036431+0000","last_active":"2023-11-24T06:29:42.402323+0000","last_peered":"2023-11-24T06:29:42.402323+0000","last_clean":"2023-11-24T06:29:42.402323+0000","last_became_active":"2023-11-24T06:29:41.035252+0000","last_became_peered":"2023-11-24T06:29:41.035252+0000","last_unstale":"2023-11-24T06:29:42.402323+0000","last_undegraded":"2023-11-24T06:29:42.402323+0000","last_fullsized":"2023-11-24T06:29:42.402323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411213+0000","last_change":"2023-11-24T06:29:41.035408+0000","last_active":"2023-11-24T06:29:42.411213+0000","last_peered":"2023-11-24T06:29:42.411213+0000","last_clean":"2023-11-24T06:29:42.411213+0000","last_became_active":"2023-11-24T06:29:41.035123+0000","last_became_peered":"2023-11-24T06:29:41.035123+0000","last_unstale":"2023-11-24T06:29:42.411213+0000","last_undegraded":"2023-11-24T06:29:42.411213+0000","last_fullsized":"2023-11-24T06:29:42.411213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411820+0000","last_change":"2023-11-24T06:29:41.038635+0000","last_active":"2023-11-24T06:29:42.411820+0000","last_peered":"2023-11-24T06:29:42.411820+0000","last_clean":"2023-11-24T06:29:42.411820+0000","last_became_active":"2023-11-24T06:29:41.038315+0000","last_became_peered":"2023-11-24T06:29:41.038315+0000","last_unstale":"2023-11-24T06:29:42.411820+0000","last_undegraded":"2023-11-24T06:29:42.411820+0000","last_fullsized":"2023-11-24T06:29:42.411820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009568+0000","last_change":"2023-11-24T06:29:41.032241+0000","last_active":"2023-11-24T06:29:42.009568+0000","last_peered":"2023-11-24T06:29:42.009568+0000","last_clean":"2023-11-24T06:29:42.009568+0000","last_became_active":"2023-11-24T06:29:41.031925+0000","last_became_peered":"2023-11-24T06:29:41.031925+0000","last_unstale":"2023-11-24T06:29:42.009568+0000","last_undegraded":"2023-11-24T06:29:42.009568+0000","last_fullsized":"2023-11-24T06:29:42.009568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041084+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.040726+0000","last_became_peered":"2023-11-24T06:29:41.040726+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009949+0000","last_change":"2023-11-24T06:29:41.032304+0000","last_active":"2023-11-24T06:29:42.009949+0000","last_peered":"2023-11-24T06:29:42.009949+0000","last_clean":"2023-11-24T06:29:42.009949+0000","last_became_active":"2023-11-24T06:29:41.031960+0000","last_became_peered":"2023-11-24T06:29:41.031960+0000","last_unstale":"2023-11-24T06:29:42.009949+0000","last_undegraded":"2023-11-24T06:29:42.009949+0000","last_fullsized":"2023-11-24T06:29:42.009949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402649+0000","last_change":"2023-11-24T06:29:41.034986+0000","last_active":"2023-11-24T06:29:42.402649+0000","last_peered":"2023-11-24T06:29:42.402649+0000","last_clean":"2023-11-24T06:29:42.402649+0000","last_became_active":"2023-11-24T06:29:41.034673+0000","last_became_peered":"2023-11-24T06:29:41.034673+0000","last_unstale":"2023-11-24T06:29:42.402649+0000","last_undegraded":"2023-11-24T06:29:42.402649+0000","last_fullsized":"2023-11-24T06:29:42.402649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009912+0000","last_change":"2023-11-24T06:29:41.027454+0000","last_active":"2023-11-24T06:29:42.009912+0000","last_peered":"2023-11-24T06:29:42.009912+0000","last_clean":"2023-11-24T06:29:42.009912+0000","last_became_active":"2023-11-24T06:29:41.027070+0000","last_became_peered":"2023-11-24T06:29:41.027070+0000","last_unstale":"2023-11-24T06:29:42.009912+0000","last_undegraded":"2023-11-24T06:29:42.009912+0000","last_fullsized":"2023-11-24T06:29:42.009912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010197+0000","last_change":"2023-11-24T06:29:41.031595+0000","last_active":"2023-11-24T06:29:42.010197+0000","last_peered":"2023-11-24T06:29:42.010197+0000","last_clean":"2023-11-24T06:29:42.010197+0000","last_became_active":"2023-11-24T06:29:41.031166+0000","last_became_peered":"2023-11-24T06:29:41.031166+0000","last_unstale":"2023-11-24T06:29:42.010197+0000","last_undegraded":"2023-11-24T06:29:42.010197+0000","last_fullsized":"2023-11-24T06:29:42.010197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411267+0000","last_change":"2023-11-24T06:29:41.021334+0000","last_active":"2023-11-24T06:29:42.411267+0000","last_peered":"2023-11-24T06:29:42.411267+0000","last_clean":"2023-11-24T06:29:42.411267+0000","last_became_active":"2023-11-24T06:29:41.021017+0000","last_became_peered":"2023-11-24T06:29:41.021017+0000","last_unstale":"2023-11-24T06:29:42.411267+0000","last_undegraded":"2023-11-24T06:29:42.411267+0000","last_fullsized":"2023-11-24T06:29:42.411267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411952+0000","last_change":"2023-11-24T06:29:41.043308+0000","last_active":"2023-11-24T06:29:42.411952+0000","last_peered":"2023-11-24T06:29:42.411952+0000","last_clean":"2023-11-24T06:29:42.411952+0000","last_became_active":"2023-11-24T06:29:41.043002+0000","last_became_peered":"2023-11-24T06:29:41.043002+0000","last_unstale":"2023-11-24T06:29:42.411952+0000","last_undegraded":"2023-11-24T06:29:42.411952+0000","last_fullsized":"2023-11-24T06:29:42.411952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009327+0000","last_change":"2023-11-24T06:29:41.042006+0000","last_active":"2023-11-24T06:29:42.009327+0000","last_peered":"2023-11-24T06:29:42.009327+0000","last_clean":"2023-11-24T06:29:42.009327+0000","last_became_active":"2023-11-24T06:29:41.041797+0000","last_became_peered":"2023-11-24T06:29:41.041797+0000","last_unstale":"2023-11-24T06:29:42.009327+0000","last_undegraded":"2023-11-24T06:29:42.009327+0000","last_fullsized":"2023-11-24T06:29:42.009327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402419+0000","last_change":"2023-11-24T06:29:41.029343+0000","last_active":"2023-11-24T06:29:42.402419+0000","last_peered":"2023-11-24T06:29:42.402419+0000","last_clean":"2023-11-24T06:29:42.402419+0000","last_became_active":"2023-11-24T06:29:41.028864+0000","last_became_peered":"2023-11-24T06:29:41.028864+0000","last_unstale":"2023-11-24T06:29:42.402419+0000","last_undegraded":"2023-11-24T06:29:42.402419+0000","last_fullsized":"2023-11-24T06:29:42.402419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411954+0000","last_change":"2023-11-24T06:29:41.011893+0000","last_active":"2023-11-24T06:29:42.411954+0000","last_peered":"2023-11-24T06:29:42.411954+0000","last_clean":"2023-11-24T06:29:42.411954+0000","last_became_active":"2023-11-24T06:29:41.011583+0000","last_became_peered":"2023-11-24T06:29:41.011583+0000","last_unstale":"2023-11-24T06:29:42.411954+0000","last_undegraded":"2023-11-24T06:29:42.411954+0000","last_fullsized":"2023-11-24T06:29:42.411954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:11.429086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009417+0000","last_change":"2023-11-24T06:29:40.343794+0000","last_active":"2023-11-24T06:29:42.009417+0000","last_peered":"2023-11-24T06:29:42.009417+0000","last_clean":"2023-11-24T06:29:42.009417+0000","last_became_active":"2023-11-24T06:29:40.343471+0000","last_became_peered":"2023-11-24T06:29:40.343471+0000","last_unstale":"2023-11-24T06:29:42.009417+0000","last_undegraded":"2023-11-24T06:29:42.009417+0000","last_fullsized":"2023-11-24T06:29:42.009417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411310+0000","last_change":"2023-11-24T06:29:41.026911+0000","last_active":"2023-11-24T06:29:42.411310+0000","last_peered":"2023-11-24T06:29:42.411310+0000","last_clean":"2023-11-24T06:29:42.411310+0000","last_became_active":"2023-11-24T06:29:41.026653+0000","last_became_peered":"2023-11-24T06:29:41.026653+0000","last_unstale":"2023-11-24T06:29:42.411310+0000","last_undegraded":"2023-11-24T06:29:42.411310+0000","last_fullsized":"2023-11-24T06:29:42.411310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402184+0000","last_change":"2023-11-24T06:29:40.341320+0000","last_active":"2023-11-24T06:29:42.402184+0000","last_peered":"2023-11-24T06:29:42.402184+0000","last_clean":"2023-11-24T06:29:42.402184+0000","last_became_active":"2023-11-24T06:29:40.340947+0000","last_became_peered":"2023-11-24T06:29:40.340947+0000","last_unstale":"2023-11-24T06:29:42.402184+0000","last_undegraded":"2023-11-24T06:29:42.402184+0000","last_fullsized":"2023-11-24T06:29:42.402184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008946+0000","last_change":"2023-11-24T06:29:40.332472+0000","last_active":"2023-11-24T06:29:42.008946+0000","last_peered":"2023-11-24T06:29:42.008946+0000","last_clean":"2023-11-24T06:29:42.008946+0000","last_became_active":"2023-11-24T06:29:40.331771+0000","last_became_peered":"2023-11-24T06:29:40.331771+0000","last_unstale":"2023-11-24T06:29:42.008946+0000","last_undegraded":"2023-11-24T06:29:42.008946+0000","last_fullsized":"2023-11-24T06:29:42.008946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009748+0000","last_change":"2023-11-24T06:29:41.029570+0000","last_active":"2023-11-24T06:29:42.009748+0000","last_peered":"2023-11-24T06:29:42.009748+0000","last_clean":"2023-11-24T06:29:42.009748+0000","last_became_active":"2023-11-24T06:29:41.029260+0000","last_became_peered":"2023-11-24T06:29:41.029260+0000","last_unstale":"2023-11-24T06:29:42.009748+0000","last_undegraded":"2023-11-24T06:29:42.009748+0000","last_fullsized":"2023-11-24T06:29:42.009748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411476+0000","last_change":"2023-11-24T06:29:40.336272+0000","last_active":"2023-11-24T06:29:42.411476+0000","last_peered":"2023-11-24T06:29:42.411476+0000","last_clean":"2023-11-24T06:29:42.411476+0000","last_became_active":"2023-11-24T06:29:40.335981+0000","last_became_peered":"2023-11-24T06:29:40.335981+0000","last_unstale":"2023-11-24T06:29:42.411476+0000","last_undegraded":"2023-11-24T06:29:42.411476+0000","last_fullsized":"2023-11-24T06:29:42.411476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010158+0000","last_change":"2023-11-24T06:29:41.027455+0000","last_active":"2023-11-24T06:29:42.010158+0000","last_peered":"2023-11-24T06:29:42.010158+0000","last_clean":"2023-11-24T06:29:42.010158+0000","last_became_active":"2023-11-24T06:29:41.027066+0000","last_became_peered":"2023-11-24T06:29:41.027066+0000","last_unstale":"2023-11-24T06:29:42.010158+0000","last_undegraded":"2023-11-24T06:29:42.010158+0000","last_fullsized":"2023-11-24T06:29:42.010158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402623+0000","last_change":"2023-11-24T06:29:40.349835+0000","last_active":"2023-11-24T06:29:42.402623+0000","last_peered":"2023-11-24T06:29:42.402623+0000","last_clean":"2023-11-24T06:29:42.402623+0000","last_became_active":"2023-11-24T06:29:40.349318+0000","last_became_peered":"2023-11-24T06:29:40.349318+0000","last_unstale":"2023-11-24T06:29:42.402623+0000","last_undegraded":"2023-11-24T06:29:42.402623+0000","last_fullsized":"2023-11-24T06:29:42.402623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:23.777269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412362+0000","last_change":"2023-11-24T06:29:41.035952+0000","last_active":"2023-11-24T06:29:42.412362+0000","last_peered":"2023-11-24T06:29:42.412362+0000","last_clean":"2023-11-24T06:29:42.412362+0000","last_became_active":"2023-11-24T06:29:41.035659+0000","last_became_peered":"2023-11-24T06:29:41.035659+0000","last_unstale":"2023-11-24T06:29:42.412362+0000","last_undegraded":"2023-11-24T06:29:42.412362+0000","last_fullsized":"2023-11-24T06:29:42.412362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412456+0000","last_change":"2023-11-24T06:29:40.346349+0000","last_active":"2023-11-24T06:29:42.412456+0000","last_peered":"2023-11-24T06:29:42.412456+0000","last_clean":"2023-11-24T06:29:42.412456+0000","last_became_active":"2023-11-24T06:29:40.345989+0000","last_became_peered":"2023-11-24T06:29:40.345989+0000","last_unstale":"2023-11-24T06:29:42.412456+0000","last_undegraded":"2023-11-24T06:29:42.412456+0000","last_fullsized":"2023-11-24T06:29:42.412456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:36.363583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411200+0000","last_change":"2023-11-24T06:29:41.038281+0000","last_active":"2023-11-24T06:29:42.411200+0000","last_peered":"2023-11-24T06:29:42.411200+0000","last_clean":"2023-11-24T06:29:42.411200+0000","last_became_active":"2023-11-24T06:29:41.038032+0000","last_became_peered":"2023-11-24T06:29:41.038032+0000","last_unstale":"2023-11-24T06:29:42.411200+0000","last_undegraded":"2023-11-24T06:29:42.411200+0000","last_fullsized":"2023-11-24T06:29:42.411200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009998+0000","last_change":"2023-11-24T06:29:40.346634+0000","last_active":"2023-11-24T06:29:42.009998+0000","last_peered":"2023-11-24T06:29:42.009998+0000","last_clean":"2023-11-24T06:29:42.009998+0000","last_became_active":"2023-11-24T06:29:40.346312+0000","last_became_peered":"2023-11-24T06:29:40.346312+0000","last_unstale":"2023-11-24T06:29:42.009998+0000","last_undegraded":"2023-11-24T06:29:42.009998+0000","last_fullsized":"2023-11-24T06:29:42.009998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412076+0000","last_change":"2023-11-24T06:29:41.021832+0000","last_active":"2023-11-24T06:29:42.412076+0000","last_peered":"2023-11-24T06:29:42.412076+0000","last_clean":"2023-11-24T06:29:42.412076+0000","last_became_active":"2023-11-24T06:29:41.021474+0000","last_became_peered":"2023-11-24T06:29:41.021474+0000","last_unstale":"2023-11-24T06:29:42.412076+0000","last_undegraded":"2023-11-24T06:29:42.412076+0000","last_fullsized":"2023-11-24T06:29:42.412076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:54.814389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402403+0000","last_change":"2023-11-24T06:29:40.341865+0000","last_active":"2023-11-24T06:29:42.402403+0000","last_peered":"2023-11-24T06:29:42.402403+0000","last_clean":"2023-11-24T06:29:42.402403+0000","last_became_active":"2023-11-24T06:29:40.341473+0000","last_became_peered":"2023-11-24T06:29:40.341473+0000","last_unstale":"2023-11-24T06:29:42.402403+0000","last_undegraded":"2023-11-24T06:29:42.402403+0000","last_fullsized":"2023-11-24T06:29:42.402403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412596+0000","last_change":"2023-11-24T06:29:41.032631+0000","last_active":"2023-11-24T06:29:42.412596+0000","last_peered":"2023-11-24T06:29:42.412596+0000","last_clean":"2023-11-24T06:29:42.412596+0000","last_became_active":"2023-11-24T06:29:41.032317+0000","last_became_peered":"2023-11-24T06:29:41.032317+0000","last_unstale":"2023-11-24T06:29:42.412596+0000","last_undegraded":"2023-11-24T06:29:42.412596+0000","last_fullsized":"2023-11-24T06:29:42.412596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411352+0000","last_change":"2023-11-24T06:29:40.346013+0000","last_active":"2023-11-24T06:29:42.411352+0000","last_peered":"2023-11-24T06:29:42.411352+0000","last_clean":"2023-11-24T06:29:42.411352+0000","last_became_active":"2023-11-24T06:29:40.345697+0000","last_became_peered":"2023-11-24T06:29:40.345697+0000","last_unstale":"2023-11-24T06:29:42.411352+0000","last_undegraded":"2023-11-24T06:29:42.411352+0000","last_fullsized":"2023-11-24T06:29:42.411352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410974+0000","last_change":"2023-11-24T06:29:41.022517+0000","last_active":"2023-11-24T06:29:42.410974+0000","last_peered":"2023-11-24T06:29:42.410974+0000","last_clean":"2023-11-24T06:29:42.410974+0000","last_became_active":"2023-11-24T06:29:41.022269+0000","last_became_peered":"2023-11-24T06:29:41.022269+0000","last_unstale":"2023-11-24T06:29:42.410974+0000","last_undegraded":"2023-11-24T06:29:42.410974+0000","last_fullsized":"2023-11-24T06:29:42.410974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412047+0000","last_change":"2023-11-24T06:29:40.333463+0000","last_active":"2023-11-24T06:29:42.412047+0000","last_peered":"2023-11-24T06:29:42.412047+0000","last_clean":"2023-11-24T06:29:42.412047+0000","last_became_active":"2023-11-24T06:29:40.333138+0000","last_became_peered":"2023-11-24T06:29:40.333138+0000","last_unstale":"2023-11-24T06:29:42.412047+0000","last_undegraded":"2023-11-24T06:29:42.412047+0000","last_fullsized":"2023-11-24T06:29:42.412047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412905+0000","last_change":"2023-11-24T06:29:41.034227+0000","last_active":"2023-11-24T06:29:42.412905+0000","last_peered":"2023-11-24T06:29:42.412905+0000","last_clean":"2023-11-24T06:29:42.412905+0000","last_became_active":"2023-11-24T06:29:41.033863+0000","last_became_peered":"2023-11-24T06:29:41.033863+0000","last_unstale":"2023-11-24T06:29:42.412905+0000","last_undegraded":"2023-11-24T06:29:42.412905+0000","last_fullsized":"2023-11-24T06:29:42.412905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402160+0000","last_change":"2023-11-24T06:29:40.339332+0000","last_active":"2023-11-24T06:29:42.402160+0000","last_peered":"2023-11-24T06:29:42.402160+0000","last_clean":"2023-11-24T06:29:42.402160+0000","last_became_active":"2023-11-24T06:29:40.338937+0000","last_became_peered":"2023-11-24T06:29:40.338937+0000","last_unstale":"2023-11-24T06:29:42.402160+0000","last_undegraded":"2023-11-24T06:29:42.402160+0000","last_fullsized":"2023-11-24T06:29:42.402160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402564+0000","last_change":"2023-11-24T06:29:41.022776+0000","last_active":"2023-11-24T06:29:42.402564+0000","last_peered":"2023-11-24T06:29:42.402564+0000","last_clean":"2023-11-24T06:29:42.402564+0000","last_became_active":"2023-11-24T06:29:41.022391+0000","last_became_peered":"2023-11-24T06:29:41.022391+0000","last_unstale":"2023-11-24T06:29:42.402564+0000","last_undegraded":"2023-11-24T06:29:42.402564+0000","last_fullsized":"2023-11-24T06:29:42.402564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009165+0000","last_change":"2023-11-24T06:29:40.330685+0000","last_active":"2023-11-24T06:29:42.009165+0000","last_peered":"2023-11-24T06:29:42.009165+0000","last_clean":"2023-11-24T06:29:42.009165+0000","last_became_active":"2023-11-24T06:29:40.330343+0000","last_became_peered":"2023-11-24T06:29:40.330343+0000","last_unstale":"2023-11-24T06:29:42.009165+0000","last_undegraded":"2023-11-24T06:29:42.009165+0000","last_fullsized":"2023-11-24T06:29:42.009165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412651+0000","last_change":"2023-11-24T06:29:41.033010+0000","last_active":"2023-11-24T06:29:42.412651+0000","last_peered":"2023-11-24T06:29:42.412651+0000","last_clean":"2023-11-24T06:29:42.412651+0000","last_became_active":"2023-11-24T06:29:41.032663+0000","last_became_peered":"2023-11-24T06:29:41.032663+0000","last_unstale":"2023-11-24T06:29:42.412651+0000","last_undegraded":"2023-11-24T06:29:42.412651+0000","last_fullsized":"2023-11-24T06:29:42.412651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412068+0000","last_change":"2023-11-24T06:29:40.344785+0000","last_active":"2023-11-24T06:29:42.412068+0000","last_peered":"2023-11-24T06:29:42.412068+0000","last_clean":"2023-11-24T06:29:42.412068+0000","last_became_active":"2023-11-24T06:29:40.344491+0000","last_became_peered":"2023-11-24T06:29:40.344491+0000","last_unstale":"2023-11-24T06:29:42.412068+0000","last_undegraded":"2023-11-24T06:29:42.412068+0000","last_fullsized":"2023-11-24T06:29:42.412068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:32.298231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413142+0000","last_change":"2023-11-24T06:29:41.030954+0000","last_active":"2023-11-24T06:29:42.413142+0000","last_peered":"2023-11-24T06:29:42.413142+0000","last_clean":"2023-11-24T06:29:42.413142+0000","last_became_active":"2023-11-24T06:29:41.030605+0000","last_became_peered":"2023-11-24T06:29:41.030605+0000","last_unstale":"2023-11-24T06:29:42.413142+0000","last_undegraded":"2023-11-24T06:29:42.413142+0000","last_fullsized":"2023-11-24T06:29:42.413142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009450+0000","last_change":"2023-11-24T06:29:40.330710+0000","last_active":"2023-11-24T06:29:42.009450+0000","last_peered":"2023-11-24T06:29:42.009450+0000","last_clean":"2023-11-24T06:29:42.009450+0000","last_became_active":"2023-11-24T06:29:40.330435+0000","last_became_peered":"2023-11-24T06:29:40.330435+0000","last_unstale":"2023-11-24T06:29:42.009450+0000","last_undegraded":"2023-11-24T06:29:42.009450+0000","last_fullsized":"2023-11-24T06:29:42.009450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:39.389505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413349+0000","last_change":"2023-11-24T06:29:41.032411+0000","last_active":"2023-11-24T06:29:42.413349+0000","last_peered":"2023-11-24T06:29:42.413349+0000","last_clean":"2023-11-24T06:29:42.413349+0000","last_became_active":"2023-11-24T06:29:41.032095+0000","last_became_peered":"2023-11-24T06:29:41.032095+0000","last_unstale":"2023-11-24T06:29:42.413349+0000","last_undegraded":"2023-11-24T06:29:42.413349+0000","last_fullsized":"2023-11-24T06:29:42.413349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:02.553538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010082+0000","last_change":"2023-11-24T06:29:40.337974+0000","last_active":"2023-11-24T06:29:42.010082+0000","last_peered":"2023-11-24T06:29:42.010082+0000","last_clean":"2023-11-24T06:29:42.010082+0000","last_became_active":"2023-11-24T06:29:40.337599+0000","last_became_peered":"2023-11-24T06:29:40.337599+0000","last_unstale":"2023-11-24T06:29:42.010082+0000","last_undegraded":"2023-11-24T06:29:42.010082+0000","last_fullsized":"2023-11-24T06:29:42.010082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412670+0000","last_change":"2023-11-24T06:29:41.040924+0000","last_active":"2023-11-24T06:29:42.412670+0000","last_peered":"2023-11-24T06:29:42.412670+0000","last_clean":"2023-11-24T06:29:42.412670+0000","last_became_active":"2023-11-24T06:29:41.040479+0000","last_became_peered":"2023-11-24T06:29:41.040479+0000","last_unstale":"2023-11-24T06:29:42.412670+0000","last_undegraded":"2023-11-24T06:29:42.412670+0000","last_fullsized":"2023-11-24T06:29:42.412670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009583+0000","last_change":"2023-11-24T06:29:40.336909+0000","last_active":"2023-11-24T06:29:42.009583+0000","last_peered":"2023-11-24T06:29:42.009583+0000","last_clean":"2023-11-24T06:29:42.009583+0000","last_became_active":"2023-11-24T06:29:40.336093+0000","last_became_peered":"2023-11-24T06:29:40.336093+0000","last_unstale":"2023-11-24T06:29:42.009583+0000","last_undegraded":"2023-11-24T06:29:42.009583+0000","last_fullsized":"2023-11-24T06:29:42.009583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:22.220406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412802+0000","last_change":"2023-11-24T06:29:41.044969+0000","last_active":"2023-11-24T06:29:42.412802+0000","last_peered":"2023-11-24T06:29:42.412802+0000","last_clean":"2023-11-24T06:29:42.412802+0000","last_became_active":"2023-11-24T06:29:41.044659+0000","last_became_peered":"2023-11-24T06:29:41.044659+0000","last_unstale":"2023-11-24T06:29:42.412802+0000","last_undegraded":"2023-11-24T06:29:42.412802+0000","last_fullsized":"2023-11-24T06:29:42.412802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:29:41.015301+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:29:41.015301+0000","last_peered":"2023-11-24T06:29:41.015301+0000","last_clean":"2023-11-24T06:29:41.015301+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:29:41.015301+0000","last_undegraded":"2023-11-24T06:29:41.015301+0000","last_fullsized":"2023-11-24T06:29:41.015301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411387+0000","last_change":"2023-11-24T06:29:40.333870+0000","last_active":"2023-11-24T06:29:42.411387+0000","last_peered":"2023-11-24T06:29:42.411387+0000","last_clean":"2023-11-24T06:29:42.411387+0000","last_became_active":"2023-11-24T06:29:40.330583+0000","last_became_peered":"2023-11-24T06:29:40.330583+0000","last_unstale":"2023-11-24T06:29:42.411387+0000","last_undegraded":"2023-11-24T06:29:42.411387+0000","last_fullsized":"2023-11-24T06:29:42.411387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008984+0000","last_change":"2023-11-24T06:29:41.044278+0000","last_active":"2023-11-24T06:29:42.008984+0000","last_peered":"2023-11-24T06:29:42.008984+0000","last_clean":"2023-11-24T06:29:42.008984+0000","last_became_active":"2023-11-24T06:29:41.044029+0000","last_became_peered":"2023-11-24T06:29:41.044029+0000","last_unstale":"2023-11-24T06:29:42.008984+0000","last_undegraded":"2023-11-24T06:29:42.008984+0000","last_fullsized":"2023-11-24T06:29:42.008984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411686+0000","last_change":"2023-11-24T06:29:40.351531+0000","last_active":"2023-11-24T06:29:42.411686+0000","last_peered":"2023-11-24T06:29:42.411686+0000","last_clean":"2023-11-24T06:29:42.411686+0000","last_became_active":"2023-11-24T06:29:40.351232+0000","last_became_peered":"2023-11-24T06:29:40.351232+0000","last_unstale":"2023-11-24T06:29:42.411686+0000","last_undegraded":"2023-11-24T06:29:42.411686+0000","last_fullsized":"2023-11-24T06:29:42.411686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410953+0000","last_change":"2023-11-24T06:29:41.027965+0000","last_active":"2023-11-24T06:29:42.410953+0000","last_peered":"2023-11-24T06:29:42.410953+0000","last_clean":"2023-11-24T06:29:42.410953+0000","last_became_active":"2023-11-24T06:29:41.027713+0000","last_became_peered":"2023-11-24T06:29:41.027713+0000","last_unstale":"2023-11-24T06:29:42.410953+0000","last_undegraded":"2023-11-24T06:29:42.410953+0000","last_fullsized":"2023-11-24T06:29:42.410953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009419+0000","last_change":"2023-11-24T06:29:40.328364+0000","last_active":"2023-11-24T06:29:42.009419+0000","last_peered":"2023-11-24T06:29:42.009419+0000","last_clean":"2023-11-24T06:29:42.009419+0000","last_became_active":"2023-11-24T06:29:40.328059+0000","last_became_peered":"2023-11-24T06:29:40.328059+0000","last_unstale":"2023-11-24T06:29:42.009419+0000","last_undegraded":"2023-11-24T06:29:42.009419+0000","last_fullsized":"2023-11-24T06:29:42.009419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010410+0000","last_change":"2023-11-24T06:29:41.018318+0000","last_active":"2023-11-24T06:29:42.010410+0000","last_peered":"2023-11-24T06:29:42.010410+0000","last_clean":"2023-11-24T06:29:42.010410+0000","last_became_active":"2023-11-24T06:29:41.018026+0000","last_became_peered":"2023-11-24T06:29:41.018026+0000","last_unstale":"2023-11-24T06:29:42.010410+0000","last_undegraded":"2023-11-24T06:29:42.010410+0000","last_fullsized":"2023-11-24T06:29:42.010410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412136+0000","last_change":"2023-11-24T06:29:40.347685+0000","last_active":"2023-11-24T06:29:42.412136+0000","last_peered":"2023-11-24T06:29:42.412136+0000","last_clean":"2023-11-24T06:29:42.412136+0000","last_became_active":"2023-11-24T06:29:40.345649+0000","last_became_peered":"2023-11-24T06:29:40.345649+0000","last_unstale":"2023-11-24T06:29:42.412136+0000","last_undegraded":"2023-11-24T06:29:42.412136+0000","last_fullsized":"2023-11-24T06:29:42.412136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:50.641651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412373+0000","last_change":"2023-11-24T06:29:41.021761+0000","last_active":"2023-11-24T06:29:42.412373+0000","last_peered":"2023-11-24T06:29:42.412373+0000","last_clean":"2023-11-24T06:29:42.412373+0000","last_became_active":"2023-11-24T06:29:41.021424+0000","last_became_peered":"2023-11-24T06:29:41.021424+0000","last_unstale":"2023-11-24T06:29:42.412373+0000","last_undegraded":"2023-11-24T06:29:42.412373+0000","last_fullsized":"2023-11-24T06:29:42.412373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010388+0000","last_change":"2023-11-24T06:29:40.347121+0000","last_active":"2023-11-24T06:29:42.010388+0000","last_peered":"2023-11-24T06:29:42.010388+0000","last_clean":"2023-11-24T06:29:42.010388+0000","last_became_active":"2023-11-24T06:29:40.346921+0000","last_became_peered":"2023-11-24T06:29:40.346921+0000","last_unstale":"2023-11-24T06:29:42.010388+0000","last_undegraded":"2023-11-24T06:29:42.010388+0000","last_fullsized":"2023-11-24T06:29:42.010388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412698+0000","last_change":"2023-11-24T06:29:41.043988+0000","last_active":"2023-11-24T06:29:42.412698+0000","last_peered":"2023-11-24T06:29:42.412698+0000","last_clean":"2023-11-24T06:29:42.412698+0000","last_became_active":"2023-11-24T06:29:41.042979+0000","last_became_peered":"2023-11-24T06:29:41.042979+0000","last_unstale":"2023-11-24T06:29:42.412698+0000","last_undegraded":"2023-11-24T06:29:42.412698+0000","last_fullsized":"2023-11-24T06:29:42.412698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412954+0000","last_change":"2023-11-24T06:29:40.354819+0000","last_active":"2023-11-24T06:29:42.412954+0000","last_peered":"2023-11-24T06:29:42.412954+0000","last_clean":"2023-11-24T06:29:42.412954+0000","last_became_active":"2023-11-24T06:29:40.354555+0000","last_became_peered":"2023-11-24T06:29:40.354555+0000","last_unstale":"2023-11-24T06:29:42.412954+0000","last_undegraded":"2023-11-24T06:29:42.412954+0000","last_fullsized":"2023-11-24T06:29:42.412954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010353+0000","last_change":"2023-11-24T06:29:41.026151+0000","last_active":"2023-11-24T06:29:42.010353+0000","last_peered":"2023-11-24T06:29:42.010353+0000","last_clean":"2023-11-24T06:29:42.010353+0000","last_became_active":"2023-11-24T06:29:41.025056+0000","last_became_peered":"2023-11-24T06:29:41.025056+0000","last_unstale":"2023-11-24T06:29:42.010353+0000","last_undegraded":"2023-11-24T06:29:42.010353+0000","last_fullsized":"2023-11-24T06:29:42.010353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010320+0000","last_change":"2023-11-24T06:29:40.339825+0000","last_active":"2023-11-24T06:29:42.010320+0000","last_peered":"2023-11-24T06:29:42.010320+0000","last_clean":"2023-11-24T06:29:42.010320+0000","last_became_active":"2023-11-24T06:29:40.339532+0000","last_became_peered":"2023-11-24T06:29:40.339532+0000","last_unstale":"2023-11-24T06:29:42.010320+0000","last_undegraded":"2023-11-24T06:29:42.010320+0000","last_fullsized":"2023-11-24T06:29:42.010320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010070+0000","last_change":"2023-11-24T06:29:41.034827+0000","last_active":"2023-11-24T06:29:42.010070+0000","last_peered":"2023-11-24T06:29:42.010070+0000","last_clean":"2023-11-24T06:29:42.010070+0000","last_became_active":"2023-11-24T06:29:41.034571+0000","last_became_peered":"2023-11-24T06:29:41.034571+0000","last_unstale":"2023-11-24T06:29:42.010070+0000","last_undegraded":"2023-11-24T06:29:42.010070+0000","last_fullsized":"2023-11-24T06:29:42.010070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402710+0000","last_change":"2023-11-24T06:29:40.349652+0000","last_active":"2023-11-24T06:29:42.402710+0000","last_peered":"2023-11-24T06:29:42.402710+0000","last_clean":"2023-11-24T06:29:42.402710+0000","last_became_active":"2023-11-24T06:29:40.348929+0000","last_became_peered":"2023-11-24T06:29:40.348929+0000","last_unstale":"2023-11-24T06:29:42.402710+0000","last_undegraded":"2023-11-24T06:29:42.402710+0000","last_fullsized":"2023-11-24T06:29:42.402710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411201+0000","last_change":"2023-11-24T06:29:41.020681+0000","last_active":"2023-11-24T06:29:42.411201+0000","last_peered":"2023-11-24T06:29:42.411201+0000","last_clean":"2023-11-24T06:29:42.411201+0000","last_became_active":"2023-11-24T06:29:41.020398+0000","last_became_peered":"2023-11-24T06:29:41.020398+0000","last_unstale":"2023-11-24T06:29:42.411201+0000","last_undegraded":"2023-11-24T06:29:42.411201+0000","last_fullsized":"2023-11-24T06:29:42.411201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411695+0000","last_change":"2023-11-24T06:29:40.350908+0000","last_active":"2023-11-24T06:29:42.411695+0000","last_peered":"2023-11-24T06:29:42.411695+0000","last_clean":"2023-11-24T06:29:42.411695+0000","last_became_active":"2023-11-24T06:29:40.350583+0000","last_became_peered":"2023-11-24T06:29:40.350583+0000","last_unstale":"2023-11-24T06:29:42.411695+0000","last_undegraded":"2023-11-24T06:29:42.411695+0000","last_fullsized":"2023-11-24T06:29:42.411695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412962+0000","last_change":"2023-11-24T06:29:41.023906+0000","last_active":"2023-11-24T06:29:42.412962+0000","last_peered":"2023-11-24T06:29:42.412962+0000","last_clean":"2023-11-24T06:29:42.412962+0000","last_became_active":"2023-11-24T06:29:41.023643+0000","last_became_peered":"2023-11-24T06:29:41.023643+0000","last_unstale":"2023-11-24T06:29:42.412962+0000","last_undegraded":"2023-11-24T06:29:42.412962+0000","last_fullsized":"2023-11-24T06:29:42.412962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010301+0000","last_change":"2023-11-24T06:29:40.351462+0000","last_active":"2023-11-24T06:29:42.010301+0000","last_peered":"2023-11-24T06:29:42.010301+0000","last_clean":"2023-11-24T06:29:42.010301+0000","last_became_active":"2023-11-24T06:29:40.351124+0000","last_became_peered":"2023-11-24T06:29:40.351124+0000","last_unstale":"2023-11-24T06:29:42.010301+0000","last_undegraded":"2023-11-24T06:29:42.010301+0000","last_fullsized":"2023-11-24T06:29:42.010301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010499+0000","last_change":"2023-11-24T06:29:41.020690+0000","last_active":"2023-11-24T06:29:42.010499+0000","last_peered":"2023-11-24T06:29:42.010499+0000","last_clean":"2023-11-24T06:29:42.010499+0000","last_became_active":"2023-11-24T06:29:41.020427+0000","last_became_peered":"2023-11-24T06:29:41.020427+0000","last_unstale":"2023-11-24T06:29:42.010499+0000","last_undegraded":"2023-11-24T06:29:42.010499+0000","last_fullsized":"2023-11-24T06:29:42.010499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010425+0000","last_change":"2023-11-24T06:29:40.328181+0000","last_active":"2023-11-24T06:29:42.010425+0000","last_peered":"2023-11-24T06:29:42.010425+0000","last_clean":"2023-11-24T06:29:42.010425+0000","last_became_active":"2023-11-24T06:29:40.327692+0000","last_became_peered":"2023-11-24T06:29:40.327692+0000","last_unstale":"2023-11-24T06:29:42.010425+0000","last_undegraded":"2023-11-24T06:29:42.010425+0000","last_fullsized":"2023-11-24T06:29:42.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009320+0000","last_change":"2023-11-24T06:29:41.022705+0000","last_active":"2023-11-24T06:29:42.009320+0000","last_peered":"2023-11-24T06:29:42.009320+0000","last_clean":"2023-11-24T06:29:42.009320+0000","last_became_active":"2023-11-24T06:29:41.022442+0000","last_became_peered":"2023-11-24T06:29:41.022442+0000","last_unstale":"2023-11-24T06:29:42.009320+0000","last_undegraded":"2023-11-24T06:29:42.009320+0000","last_fullsized":"2023-11-24T06:29:42.009320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412948+0000","last_change":"2023-11-24T06:29:40.351303+0000","last_active":"2023-11-24T06:29:42.412948+0000","last_peered":"2023-11-24T06:29:42.412948+0000","last_clean":"2023-11-24T06:29:42.412948+0000","last_became_active":"2023-11-24T06:29:40.350893+0000","last_became_peered":"2023-11-24T06:29:40.350893+0000","last_unstale":"2023-11-24T06:29:42.412948+0000","last_undegraded":"2023-11-24T06:29:42.412948+0000","last_fullsized":"2023-11-24T06:29:42.412948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:29.563013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402349+0000","last_change":"2023-11-24T06:29:41.030215+0000","last_active":"2023-11-24T06:29:42.402349+0000","last_peered":"2023-11-24T06:29:42.402349+0000","last_clean":"2023-11-24T06:29:42.402349+0000","last_became_active":"2023-11-24T06:29:41.029775+0000","last_became_peered":"2023-11-24T06:29:41.029775+0000","last_unstale":"2023-11-24T06:29:42.402349+0000","last_undegraded":"2023-11-24T06:29:42.402349+0000","last_fullsized":"2023-11-24T06:29:42.402349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.039473+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.039150+0000","last_became_peered":"2023-11-24T06:29:41.039150+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412823+0000","last_change":"2023-11-24T06:29:40.351147+0000","last_active":"2023-11-24T06:29:42.412823+0000","last_peered":"2023-11-24T06:29:42.412823+0000","last_clean":"2023-11-24T06:29:42.412823+0000","last_became_active":"2023-11-24T06:29:40.350837+0000","last_became_peered":"2023-11-24T06:29:40.350837+0000","last_unstale":"2023-11-24T06:29:42.412823+0000","last_undegraded":"2023-11-24T06:29:42.412823+0000","last_fullsized":"2023-11-24T06:29:42.412823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:00.101428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412531+0000","last_change":"2023-11-24T06:29:41.042212+0000","last_active":"2023-11-24T06:29:42.412531+0000","last_peered":"2023-11-24T06:29:42.412531+0000","last_clean":"2023-11-24T06:29:42.412531+0000","last_became_active":"2023-11-24T06:29:41.041751+0000","last_became_peered":"2023-11-24T06:29:41.041751+0000","last_unstale":"2023-11-24T06:29:42.412531+0000","last_undegraded":"2023-11-24T06:29:42.412531+0000","last_fullsized":"2023-11-24T06:29:42.412531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412849+0000","last_change":"2023-11-24T06:29:40.351090+0000","last_active":"2023-11-24T06:29:42.412849+0000","last_peered":"2023-11-24T06:29:42.412849+0000","last_clean":"2023-11-24T06:29:42.412849+0000","last_became_active":"2023-11-24T06:29:40.350722+0000","last_became_peered":"2023-11-24T06:29:40.350722+0000","last_unstale":"2023-11-24T06:29:42.412849+0000","last_undegraded":"2023-11-24T06:29:42.412849+0000","last_fullsized":"2023-11-24T06:29:42.412849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411181+0000","last_change":"2023-11-24T06:29:41.044968+0000","last_active":"2023-11-24T06:29:42.411181+0000","last_peered":"2023-11-24T06:29:42.411181+0000","last_clean":"2023-11-24T06:29:42.411181+0000","last_became_active":"2023-11-24T06:29:41.044679+0000","last_became_peered":"2023-11-24T06:29:41.044679+0000","last_unstale":"2023-11-24T06:29:42.411181+0000","last_undegraded":"2023-11-24T06:29:42.411181+0000","last_fullsized":"2023-11-24T06:29:42.411181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009975+0000","last_change":"2023-11-24T06:29:40.347084+0000","last_active":"2023-11-24T06:29:42.009975+0000","last_peered":"2023-11-24T06:29:42.009975+0000","last_clean":"2023-11-24T06:29:42.009975+0000","last_became_active":"2023-11-24T06:29:40.346829+0000","last_became_peered":"2023-11-24T06:29:40.346829+0000","last_unstale":"2023-11-24T06:29:42.009975+0000","last_undegraded":"2023-11-24T06:29:42.009975+0000","last_fullsized":"2023-11-24T06:29:42.009975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009898+0000","last_change":"2023-11-24T06:29:41.032848+0000","last_active":"2023-11-24T06:29:42.009898+0000","last_peered":"2023-11-24T06:29:42.009898+0000","last_clean":"2023-11-24T06:29:42.009898+0000","last_became_active":"2023-11-24T06:29:41.032572+0000","last_became_peered":"2023-11-24T06:29:41.032572+0000","last_unstale":"2023-11-24T06:29:42.009898+0000","last_undegraded":"2023-11-24T06:29:42.009898+0000","last_fullsized":"2023-11-24T06:29:42.009898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411279+0000","last_change":"2023-11-24T06:29:40.353473+0000","last_active":"2023-11-24T06:29:42.411279+0000","last_peered":"2023-11-24T06:29:42.411279+0000","last_clean":"2023-11-24T06:29:42.411279+0000","last_became_active":"2023-11-24T06:29:40.353135+0000","last_became_peered":"2023-11-24T06:29:40.353135+0000","last_unstale":"2023-11-24T06:29:42.411279+0000","last_undegraded":"2023-11-24T06:29:42.411279+0000","last_fullsized":"2023-11-24T06:29:42.411279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:29:45.402 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:29:45.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dd0a12640 1 Processor -- start 2023-11-24T06:29:45.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dd0a12640 1 -- start start 2023-11-24T06:29:45.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dd0a12640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dcc0d0320 0x7f9dcc0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dd0a12640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc0d21c0 con 0x7f9dcc0d3e80 2023-11-24T06:29:45.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dd0a12640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc0cdcd0 con 0x7f9dcc15d500 2023-11-24T06:29:45.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dd0a12640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc0d1ef0 con 0x7f9dcc0d0320 2023-11-24T06:29:45.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dca59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9dcc0d3e80 0x7f9dcc0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48580/0 (socket says 172.21.15.143:48580) 2023-11-24T06:29:45.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dca59c640 1 -- 172.21.15.143:0/770665139 learned_addr learned my addr 172.21.15.143:0/770665139 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:45.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/770665139 >> v2:172.21.15.146:3300/0 conn(0x7f9dcc0d0320 0x7f9dcc0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722455508 0 0) 0x7f9dcc0d21c0 con 0x7f9dcc0d3e80 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db4003530 con 0x7f9dcc0d3e80 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1632770500 0 0) 0x7f9db4003530 con 0x7f9dcc0d3e80 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 >> v2:172.21.15.146:3300/0 conn(0x7f9dcc0d0320 msgr2=0x7f9dcc0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 --2- 172.21.15.143:0/770665139 >> v2:172.21.15.146:3300/0 conn(0x7f9dcc0d0320 0x7f9dcc0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 >> v1:172.21.15.146:6789/0 conn(0x7f9dcc15d500 legacy=0x7f9dcc0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0cdf70 con 0x7f9dcc0d3e80 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f9dc0001680 con 0x7f9dcc0d3e80 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 >> v1:172.21.15.143:6789/0 conn(0x7f9dcc0d3e80 legacy=0x7f9dcc0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9db40039d0 0x7f9db4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db40047d0 0x7f9db4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9db400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0d1ef0 con 0x7f9db4005190 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db400c090 con 0x7f9db40047d0 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db400c250 con 0x7f9db40039d0 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9db400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dca59c640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db40047d0 0x7f9db4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcad9d640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9db40039d0 0x7f9db4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 -- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9db40039d0 msgr2=0x7f9db4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9db40039d0 0x7f9db4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 -- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db40047d0 msgr2=0x7f9db4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:45.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db40047d0 0x7f9db4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcb59e640 1 -- 172.21.15.143:0/770665139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4003530 con 0x7f9db4005190 2023-11-24T06:29:45.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.578+0000 7f9dcad9d640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9db40039d0 0x7f9db4003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:45.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dcb59e640 1 -- 172.21.15.143:0/770665139 reap_dead start 2023-11-24T06:29:45.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9db400b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009f90 tx=0x7f9dc401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3ff031e066bed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40a5c70 con 0x7f9db4005190 2023-11-24T06:29:45.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc400f040 con 0x7f9db4005190 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dc9d9b640 1 -- 172.21.15.143:0/770665139 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40ad440 con 0x7f9db4005190 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 -- 172.21.15.143:0/770665139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 msgr2=0x7f9db400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9db400b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009f90 tx=0x7f9dc401cc60 comp rx=0 tx=0).stop 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 -- 172.21.15.143:0/770665139 shutdown_connections 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/770665139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9db400b990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 -- 172.21.15.143:0/770665139 >> 172.21.15.143:0/770665139 conn(0x7f9dcc09c540 msgr2=0x7f9dcc0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 -- 172.21.15.143:0/770665139 shutdown_connections 2023-11-24T06:29:45.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.582+0000 7f9dd0a12640 1 -- 172.21.15.143:0/770665139 wait complete. 2023-11-24T06:29:45.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 Processor -- start 2023-11-24T06:29:45.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 -- start start 2023-11-24T06:29:45.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9dcc1f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dcc0cbc60 0x7f9dcc157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc15abc0 0x7f9dcc15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15b5b0 con 0x7f9db4005190 2023-11-24T06:29:45.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1f2e90 con 0x7f9dcc15abc0 2023-11-24T06:29:45.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1f3160 con 0x7f9dcc0cbc60 2023-11-24T06:29:45.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9dcc1f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9dcc1f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46402/0 (socket says 172.21.15.143:46402) 2023-11-24T06:29:45.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 -- 172.21.15.143:0/220163993 learned_addr learned my addr 172.21.15.143:0/220163993 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:45.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dca59c640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dcc0cbc60 0x7f9dcc157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 -- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dcc0cbc60 msgr2=0x7f9dcc157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc15abc0 0x7f9dcc15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dcc0cbc60 0x7f9dcc157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 -- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc15abc0 msgr2=0x7f9dcc15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc15abc0 0x7f9dcc15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 -- 172.21.15.143:0/220163993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0d2030 con 0x7f9db4005190 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dca59c640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dcc0cbc60 0x7f9dcc157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcb59e640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc15abc0 0x7f9dcc15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dcad9d640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9dcc1f4390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e440 tx=0x7f9dbc00e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0052e0 con 0x7f9db4005190 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc005440 con 0x7f9db4005190 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc003840 con 0x7f9db4005190 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc158840 con 0x7f9db4005190 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.586+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc158e00 con 0x7f9db4005190 2023-11-24T06:29:45.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.590+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc04e850 con 0x7f9db4005190 2023-11-24T06:29:45.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.590+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9dbc0039a0 con 0x7f9db4005190 2023-11-24T06:29:45.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.590+0000 7f9db37fe640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9db80664a0 0x7f9db8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.590+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dbc083580 con 0x7f9db4005190 2023-11-24T06:29:45.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.590+0000 7f9dca59c640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9db80664a0 0x7f9db8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.590+0000 7f9dca59c640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9db80664a0 0x7f9db8068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b8d30 tx=0x7f9dc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.594+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dbc050a10 con 0x7f9db4005190 2023-11-24T06:29:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.742+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9dcc0ce530 con 0x7f9db80664a0 2023-11-24T06:29:45.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.746+0000 7f9db37fe640 1 -- 172.21.15.143:0/220163993 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264754 (secure 0 0 0) 0x7f9dc0001560 con 0x7f9db80664a0 2023-11-24T06:29:45.753 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9db80664a0 msgr2=0x7f9db8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9db80664a0 0x7f9db8068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b8d30 tx=0x7f9dc0009040 comp rx=0 tx=0).stop 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 msgr2=0x7f9dcc1f4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9dcc1f4390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e440 tx=0x7f9dbc00e900 comp rx=0 tx=0).stop 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 shutdown_connections 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9db80664a0 0x7f9db8068960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc15abc0 0x7f9dcc15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dcc0cbc60 0x7f9dcc157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 --2- 172.21.15.143:0/220163993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db4005190 0x7f9dcc1f4390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 >> 172.21.15.143:0/220163993 conn(0x7f9dcc09c540 msgr2=0x7f9dcc15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:45.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 shutdown_connections 2023-11-24T06:29:45.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.750+0000 7f9dd0a12640 1 -- 172.21.15.143:0/220163993 wait complete. 2023-11-24T06:29:45.774 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T06:29:44.207460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2887680,"data_stored":1751867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.897700"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413188+0000","last_change":"2023-11-24T06:29:41.035477+0000","last_active":"2023-11-24T06:29:42.413188+0000","last_peered":"2023-11-24T06:29:42.413188+0000","last_clean":"2023-11-24T06:29:42.413188+0000","last_became_active":"2023-11-24T06:29:41.035174+0000","last_became_peered":"2023-11-24T06:29:41.035174+0000","last_unstale":"2023-11-24T06:29:42.413188+0000","last_undegraded":"2023-11-24T06:29:42.413188+0000","last_fullsized":"2023-11-24T06:29:42.413188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010247+0000","last_change":"2023-11-24T06:29:41.022068+0000","last_active":"2023-11-24T06:29:42.010247+0000","last_peered":"2023-11-24T06:29:42.010247+0000","last_clean":"2023-11-24T06:29:42.010247+0000","last_became_active":"2023-11-24T06:29:41.021715+0000","last_became_peered":"2023-11-24T06:29:41.021715+0000","last_unstale":"2023-11-24T06:29:42.010247+0000","last_undegraded":"2023-11-24T06:29:42.010247+0000","last_fullsized":"2023-11-24T06:29:42.010247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411078+0000","last_change":"2023-11-24T06:29:41.024602+0000","last_active":"2023-11-24T06:29:42.411078+0000","last_peered":"2023-11-24T06:29:42.411078+0000","last_clean":"2023-11-24T06:29:42.411078+0000","last_became_active":"2023-11-24T06:29:41.024285+0000","last_became_peered":"2023-11-24T06:29:41.024285+0000","last_unstale":"2023-11-24T06:29:42.411078+0000","last_undegraded":"2023-11-24T06:29:42.411078+0000","last_fullsized":"2023-11-24T06:29:42.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412375+0000","last_change":"2023-11-24T06:29:41.041359+0000","last_active":"2023-11-24T06:29:42.412375+0000","last_peered":"2023-11-24T06:29:42.412375+0000","last_clean":"2023-11-24T06:29:42.412375+0000","last_became_active":"2023-11-24T06:29:41.040996+0000","last_became_peered":"2023-11-24T06:29:41.040996+0000","last_unstale":"2023-11-24T06:29:42.412375+0000","last_undegraded":"2023-11-24T06:29:42.412375+0000","last_fullsized":"2023-11-24T06:29:42.412375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412762+0000","last_change":"2023-11-24T06:29:41.034177+0000","last_active":"2023-11-24T06:29:42.412762+0000","last_peered":"2023-11-24T06:29:42.412762+0000","last_clean":"2023-11-24T06:29:42.412762+0000","last_became_active":"2023-11-24T06:29:41.033446+0000","last_became_peered":"2023-11-24T06:29:41.033446+0000","last_unstale":"2023-11-24T06:29:42.412762+0000","last_undegraded":"2023-11-24T06:29:42.412762+0000","last_fullsized":"2023-11-24T06:29:42.412762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411687+0000","last_change":"2023-11-24T06:29:41.038649+0000","last_active":"2023-11-24T06:29:42.411687+0000","last_peered":"2023-11-24T06:29:42.411687+0000","last_clean":"2023-11-24T06:29:42.411687+0000","last_became_active":"2023-11-24T06:29:41.038301+0000","last_became_peered":"2023-11-24T06:29:41.038301+0000","last_unstale":"2023-11-24T06:29:42.411687+0000","last_undegraded":"2023-11-24T06:29:42.411687+0000","last_fullsized":"2023-11-24T06:29:42.411687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.023574+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.023253+0000","last_became_peered":"2023-11-24T06:29:41.023253+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008553+0000","last_change":"2023-11-24T06:29:41.047704+0000","last_active":"2023-11-24T06:29:42.008553+0000","last_peered":"2023-11-24T06:29:42.008553+0000","last_clean":"2023-11-24T06:29:42.008553+0000","last_became_active":"2023-11-24T06:29:41.047479+0000","last_became_peered":"2023-11-24T06:29:41.047479+0000","last_unstale":"2023-11-24T06:29:42.008553+0000","last_undegraded":"2023-11-24T06:29:42.008553+0000","last_fullsized":"2023-11-24T06:29:42.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413219+0000","last_change":"2023-11-24T06:29:41.038737+0000","last_active":"2023-11-24T06:29:42.413219+0000","last_peered":"2023-11-24T06:29:42.413219+0000","last_clean":"2023-11-24T06:29:42.413219+0000","last_became_active":"2023-11-24T06:29:41.038472+0000","last_became_peered":"2023-11-24T06:29:41.038472+0000","last_unstale":"2023-11-24T06:29:42.413219+0000","last_undegraded":"2023-11-24T06:29:42.413219+0000","last_fullsized":"2023-11-24T06:29:42.413219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402616+0000","last_change":"2023-11-24T06:29:41.045851+0000","last_active":"2023-11-24T06:29:42.402616+0000","last_peered":"2023-11-24T06:29:42.402616+0000","last_clean":"2023-11-24T06:29:42.402616+0000","last_became_active":"2023-11-24T06:29:41.044799+0000","last_became_peered":"2023-11-24T06:29:41.044799+0000","last_unstale":"2023-11-24T06:29:42.402616+0000","last_undegraded":"2023-11-24T06:29:42.402616+0000","last_fullsized":"2023-11-24T06:29:42.402616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402357+0000","last_change":"2023-11-24T06:29:41.045092+0000","last_active":"2023-11-24T06:29:42.402357+0000","last_peered":"2023-11-24T06:29:42.402357+0000","last_clean":"2023-11-24T06:29:42.402357+0000","last_became_active":"2023-11-24T06:29:41.044758+0000","last_became_peered":"2023-11-24T06:29:41.044758+0000","last_unstale":"2023-11-24T06:29:42.402357+0000","last_undegraded":"2023-11-24T06:29:42.402357+0000","last_fullsized":"2023-11-24T06:29:42.402357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411929+0000","last_change":"2023-11-24T06:29:41.029744+0000","last_active":"2023-11-24T06:29:42.411929+0000","last_peered":"2023-11-24T06:29:42.411929+0000","last_clean":"2023-11-24T06:29:42.411929+0000","last_became_active":"2023-11-24T06:29:41.029413+0000","last_became_peered":"2023-11-24T06:29:41.029413+0000","last_unstale":"2023-11-24T06:29:42.411929+0000","last_undegraded":"2023-11-24T06:29:42.411929+0000","last_fullsized":"2023-11-24T06:29:42.411929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:40.396297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009191+0000","last_change":"2023-11-24T06:29:41.032796+0000","last_active":"2023-11-24T06:29:42.009191+0000","last_peered":"2023-11-24T06:29:42.009191+0000","last_clean":"2023-11-24T06:29:42.009191+0000","last_became_active":"2023-11-24T06:29:41.032526+0000","last_became_peered":"2023-11-24T06:29:41.032526+0000","last_unstale":"2023-11-24T06:29:42.009191+0000","last_undegraded":"2023-11-24T06:29:42.009191+0000","last_fullsized":"2023-11-24T06:29:42.009191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410937+0000","last_change":"2023-11-24T06:29:41.022282+0000","last_active":"2023-11-24T06:29:42.410937+0000","last_peered":"2023-11-24T06:29:42.410937+0000","last_clean":"2023-11-24T06:29:42.410937+0000","last_became_active":"2023-11-24T06:29:41.021823+0000","last_became_peered":"2023-11-24T06:29:41.021823+0000","last_unstale":"2023-11-24T06:29:42.410937+0000","last_undegraded":"2023-11-24T06:29:42.410937+0000","last_fullsized":"2023-11-24T06:29:42.410937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:06.770793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010312+0000","last_change":"2023-11-24T06:29:41.013047+0000","last_active":"2023-11-24T06:29:42.010312+0000","last_peered":"2023-11-24T06:29:42.010312+0000","last_clean":"2023-11-24T06:29:42.010312+0000","last_became_active":"2023-11-24T06:29:41.012696+0000","last_became_peered":"2023-11-24T06:29:41.012696+0000","last_unstale":"2023-11-24T06:29:42.010312+0000","last_undegraded":"2023-11-24T06:29:42.010312+0000","last_fullsized":"2023-11-24T06:29:42.010312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041964+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.041680+0000","last_became_peered":"2023-11-24T06:29:41.041680+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412021+0000","last_change":"2023-11-24T06:29:41.041640+0000","last_active":"2023-11-24T06:29:42.412021+0000","last_peered":"2023-11-24T06:29:42.412021+0000","last_clean":"2023-11-24T06:29:42.412021+0000","last_became_active":"2023-11-24T06:29:41.040550+0000","last_became_peered":"2023-11-24T06:29:41.040550+0000","last_unstale":"2023-11-24T06:29:42.412021+0000","last_undegraded":"2023-11-24T06:29:42.412021+0000","last_fullsized":"2023-11-24T06:29:42.412021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009398+0000","last_change":"2023-11-24T06:29:41.033224+0000","last_active":"2023-11-24T06:29:42.009398+0000","last_peered":"2023-11-24T06:29:42.009398+0000","last_clean":"2023-11-24T06:29:42.009398+0000","last_became_active":"2023-11-24T06:29:41.032892+0000","last_became_peered":"2023-11-24T06:29:41.032892+0000","last_unstale":"2023-11-24T06:29:42.009398+0000","last_undegraded":"2023-11-24T06:29:42.009398+0000","last_fullsized":"2023-11-24T06:29:42.009398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413054+0000","last_change":"2023-11-24T06:29:41.026686+0000","last_active":"2023-11-24T06:29:42.413054+0000","last_peered":"2023-11-24T06:29:42.413054+0000","last_clean":"2023-11-24T06:29:42.413054+0000","last_became_active":"2023-11-24T06:29:41.026385+0000","last_became_peered":"2023-11-24T06:29:41.026385+0000","last_unstale":"2023-11-24T06:29:42.413054+0000","last_undegraded":"2023-11-24T06:29:42.413054+0000","last_fullsized":"2023-11-24T06:29:42.413054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402323+0000","last_change":"2023-11-24T06:29:41.036431+0000","last_active":"2023-11-24T06:29:42.402323+0000","last_peered":"2023-11-24T06:29:42.402323+0000","last_clean":"2023-11-24T06:29:42.402323+0000","last_became_active":"2023-11-24T06:29:41.035252+0000","last_became_peered":"2023-11-24T06:29:41.035252+0000","last_unstale":"2023-11-24T06:29:42.402323+0000","last_undegraded":"2023-11-24T06:29:42.402323+0000","last_fullsized":"2023-11-24T06:29:42.402323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411213+0000","last_change":"2023-11-24T06:29:41.035408+0000","last_active":"2023-11-24T06:29:42.411213+0000","last_peered":"2023-11-24T06:29:42.411213+0000","last_clean":"2023-11-24T06:29:42.411213+0000","last_became_active":"2023-11-24T06:29:41.035123+0000","last_became_peered":"2023-11-24T06:29:41.035123+0000","last_unstale":"2023-11-24T06:29:42.411213+0000","last_undegraded":"2023-11-24T06:29:42.411213+0000","last_fullsized":"2023-11-24T06:29:42.411213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411820+0000","last_change":"2023-11-24T06:29:41.038635+0000","last_active":"2023-11-24T06:29:42.411820+0000","last_peered":"2023-11-24T06:29:42.411820+0000","last_clean":"2023-11-24T06:29:42.411820+0000","last_became_active":"2023-11-24T06:29:41.038315+0000","last_became_peered":"2023-11-24T06:29:41.038315+0000","last_unstale":"2023-11-24T06:29:42.411820+0000","last_undegraded":"2023-11-24T06:29:42.411820+0000","last_fullsized":"2023-11-24T06:29:42.411820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009568+0000","last_change":"2023-11-24T06:29:41.032241+0000","last_active":"2023-11-24T06:29:42.009568+0000","last_peered":"2023-11-24T06:29:42.009568+0000","last_clean":"2023-11-24T06:29:42.009568+0000","last_became_active":"2023-11-24T06:29:41.031925+0000","last_became_peered":"2023-11-24T06:29:41.031925+0000","last_unstale":"2023-11-24T06:29:42.009568+0000","last_undegraded":"2023-11-24T06:29:42.009568+0000","last_fullsized":"2023-11-24T06:29:42.009568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041084+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.040726+0000","last_became_peered":"2023-11-24T06:29:41.040726+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009949+0000","last_change":"2023-11-24T06:29:41.032304+0000","last_active":"2023-11-24T06:29:42.009949+0000","last_peered":"2023-11-24T06:29:42.009949+0000","last_clean":"2023-11-24T06:29:42.009949+0000","last_became_active":"2023-11-24T06:29:41.031960+0000","last_became_peered":"2023-11-24T06:29:41.031960+0000","last_unstale":"2023-11-24T06:29:42.009949+0000","last_undegraded":"2023-11-24T06:29:42.009949+0000","last_fullsized":"2023-11-24T06:29:42.009949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402649+0000","last_change":"2023-11-24T06:29:41.034986+0000","last_active":"2023-11-24T06:29:42.402649+0000","last_peered":"2023-11-24T06:29:42.402649+0000","last_clean":"2023-11-24T06:29:42.402649+0000","last_became_active":"2023-11-24T06:29:41.034673+0000","last_became_peered":"2023-11-24T06:29:41.034673+0000","last_unstale":"2023-11-24T06:29:42.402649+0000","last_undegraded":"2023-11-24T06:29:42.402649+0000","last_fullsized":"2023-11-24T06:29:42.402649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009912+0000","last_change":"2023-11-24T06:29:41.027454+0000","last_active":"2023-11-24T06:29:42.009912+0000","last_peered":"2023-11-24T06:29:42.009912+0000","last_clean":"2023-11-24T06:29:42.009912+0000","last_became_active":"2023-11-24T06:29:41.027070+0000","last_became_peered":"2023-11-24T06:29:41.027070+0000","last_unstale":"2023-11-24T06:29:42.009912+0000","last_undegraded":"2023-11-24T06:29:42.009912+0000","last_fullsized":"2023-11-24T06:29:42.009912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010197+0000","last_change":"2023-11-24T06:29:41.031595+0000","last_active":"2023-11-24T06:29:42.010197+0000","last_peered":"2023-11-24T06:29:42.010197+0000","last_clean":"2023-11-24T06:29:42.010197+0000","last_became_active":"2023-11-24T06:29:41.031166+0000","last_became_peered":"2023-11-24T06:29:41.031166+0000","last_unstale":"2023-11-24T06:29:42.010197+0000","last_undegraded":"2023-11-24T06:29:42.010197+0000","last_fullsized":"2023-11-24T06:29:42.010197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411267+0000","last_change":"2023-11-24T06:29:41.021334+0000","last_active":"2023-11-24T06:29:42.411267+0000","last_peered":"2023-11-24T06:29:42.411267+0000","last_clean":"2023-11-24T06:29:42.411267+0000","last_became_active":"2023-11-24T06:29:41.021017+0000","last_became_peered":"2023-11-24T06:29:41.021017+0000","last_unstale":"2023-11-24T06:29:42.411267+0000","last_undegraded":"2023-11-24T06:29:42.411267+0000","last_fullsized":"2023-11-24T06:29:42.411267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411952+0000","last_change":"2023-11-24T06:29:41.043308+0000","last_active":"2023-11-24T06:29:42.411952+0000","last_peered":"2023-11-24T06:29:42.411952+0000","last_clean":"2023-11-24T06:29:42.411952+0000","last_became_active":"2023-11-24T06:29:41.043002+0000","last_became_peered":"2023-11-24T06:29:41.043002+0000","last_unstale":"2023-11-24T06:29:42.411952+0000","last_undegraded":"2023-11-24T06:29:42.411952+0000","last_fullsized":"2023-11-24T06:29:42.411952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009327+0000","last_change":"2023-11-24T06:29:41.042006+0000","last_active":"2023-11-24T06:29:42.009327+0000","last_peered":"2023-11-24T06:29:42.009327+0000","last_clean":"2023-11-24T06:29:42.009327+0000","last_became_active":"2023-11-24T06:29:41.041797+0000","last_became_peered":"2023-11-24T06:29:41.041797+0000","last_unstale":"2023-11-24T06:29:42.009327+0000","last_undegraded":"2023-11-24T06:29:42.009327+0000","last_fullsized":"2023-11-24T06:29:42.009327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402419+0000","last_change":"2023-11-24T06:29:41.029343+0000","last_active":"2023-11-24T06:29:42.402419+0000","last_peered":"2023-11-24T06:29:42.402419+0000","last_clean":"2023-11-24T06:29:42.402419+0000","last_became_active":"2023-11-24T06:29:41.028864+0000","last_became_peered":"2023-11-24T06:29:41.028864+0000","last_unstale":"2023-11-24T06:29:42.402419+0000","last_undegraded":"2023-11-24T06:29:42.402419+0000","last_fullsized":"2023-11-24T06:29:42.402419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411954+0000","last_change":"2023-11-24T06:29:41.011893+0000","last_active":"2023-11-24T06:29:42.411954+0000","last_peered":"2023-11-24T06:29:42.411954+0000","last_clean":"2023-11-24T06:29:42.411954+0000","last_became_active":"2023-11-24T06:29:41.011583+0000","last_became_peered":"2023-11-24T06:29:41.011583+0000","last_unstale":"2023-11-24T06:29:42.411954+0000","last_undegraded":"2023-11-24T06:29:42.411954+0000","last_fullsized":"2023-11-24T06:29:42.411954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:11.429086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009417+0000","last_change":"2023-11-24T06:29:40.343794+0000","last_active":"2023-11-24T06:29:42.009417+0000","last_peered":"2023-11-24T06:29:42.009417+0000","last_clean":"2023-11-24T06:29:42.009417+0000","last_became_active":"2023-11-24T06:29:40.343471+0000","last_became_peered":"2023-11-24T06:29:40.343471+0000","last_unstale":"2023-11-24T06:29:42.009417+0000","last_undegraded":"2023-11-24T06:29:42.009417+0000","last_fullsized":"2023-11-24T06:29:42.009417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411310+0000","last_change":"2023-11-24T06:29:41.026911+0000","last_active":"2023-11-24T06:29:42.411310+0000","last_peered":"2023-11-24T06:29:42.411310+0000","last_clean":"2023-11-24T06:29:42.411310+0000","last_became_active":"2023-11-24T06:29:41.026653+0000","last_became_peered":"2023-11-24T06:29:41.026653+0000","last_unstale":"2023-11-24T06:29:42.411310+0000","last_undegraded":"2023-11-24T06:29:42.411310+0000","last_fullsized":"2023-11-24T06:29:42.411310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402184+0000","last_change":"2023-11-24T06:29:40.341320+0000","last_active":"2023-11-24T06:29:42.402184+0000","last_peered":"2023-11-24T06:29:42.402184+0000","last_clean":"2023-11-24T06:29:42.402184+0000","last_became_active":"2023-11-24T06:29:40.340947+0000","last_became_peered":"2023-11-24T06:29:40.340947+0000","last_unstale":"2023-11-24T06:29:42.402184+0000","last_undegraded":"2023-11-24T06:29:42.402184+0000","last_fullsized":"2023-11-24T06:29:42.402184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008946+0000","last_change":"2023-11-24T06:29:40.332472+0000","last_active":"2023-11-24T06:29:42.008946+0000","last_peered":"2023-11-24T06:29:42.008946+0000","last_clean":"2023-11-24T06:29:42.008946+0000","last_became_active":"2023-11-24T06:29:40.331771+0000","last_became_peered":"2023-11-24T06:29:40.331771+0000","last_unstale":"2023-11-24T06:29:42.008946+0000","last_undegraded":"2023-11-24T06:29:42.008946+0000","last_fullsized":"2023-11-24T06:29:42.008946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009748+0000","last_change":"2023-11-24T06:29:41.029570+0000","last_active":"2023-11-24T06:29:42.009748+0000","last_peered":"2023-11-24T06:29:42.009748+0000","last_clean":"2023-11-24T06:29:42.009748+0000","last_became_active":"2023-11-24T06:29:41.029260+0000","last_became_peered":"2023-11-24T06:29:41.029260+0000","last_unstale":"2023-11-24T06:29:42.009748+0000","last_undegraded":"2023-11-24T06:29:42.009748+0000","last_fullsized":"2023-11-24T06:29:42.009748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411476+0000","last_change":"2023-11-24T06:29:40.336272+0000","last_active":"2023-11-24T06:29:42.411476+0000","last_peered":"2023-11-24T06:29:42.411476+0000","last_clean":"2023-11-24T06:29:42.411476+0000","last_became_active":"2023-11-24T06:29:40.335981+0000","last_became_peered":"2023-11-24T06:29:40.335981+0000","last_unstale":"2023-11-24T06:29:42.411476+0000","last_undegraded":"2023-11-24T06:29:42.411476+0000","last_fullsized":"2023-11-24T06:29:42.411476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010158+0000","last_change":"2023-11-24T06:29:41.027455+0000","last_active":"2023-11-24T06:29:42.010158+0000","last_peered":"2023-11-24T06:29:42.010158+0000","last_clean":"2023-11-24T06:29:42.010158+0000","last_became_active":"2023-11-24T06:29:41.027066+0000","last_became_peered":"2023-11-24T06:29:41.027066+0000","last_unstale":"2023-11-24T06:29:42.010158+0000","last_undegraded":"2023-11-24T06:29:42.010158+0000","last_fullsized":"2023-11-24T06:29:42.010158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402623+0000","last_change":"2023-11-24T06:29:40.349835+0000","last_active":"2023-11-24T06:29:42.402623+0000","last_peered":"2023-11-24T06:29:42.402623+0000","last_clean":"2023-11-24T06:29:42.402623+0000","last_became_active":"2023-11-24T06:29:40.349318+0000","last_became_peered":"2023-11-24T06:29:40.349318+0000","last_unstale":"2023-11-24T06:29:42.402623+0000","last_undegraded":"2023-11-24T06:29:42.402623+0000","last_fullsized":"2023-11-24T06:29:42.402623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:23.777269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412362+0000","last_change":"2023-11-24T06:29:41.035952+0000","last_active":"2023-11-24T06:29:42.412362+0000","last_peered":"2023-11-24T06:29:42.412362+0000","last_clean":"2023-11-24T06:29:42.412362+0000","last_became_active":"2023-11-24T06:29:41.035659+0000","last_became_peered":"2023-11-24T06:29:41.035659+0000","last_unstale":"2023-11-24T06:29:42.412362+0000","last_undegraded":"2023-11-24T06:29:42.412362+0000","last_fullsized":"2023-11-24T06:29:42.412362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412456+0000","last_change":"2023-11-24T06:29:40.346349+0000","last_active":"2023-11-24T06:29:42.412456+0000","last_peered":"2023-11-24T06:29:42.412456+0000","last_clean":"2023-11-24T06:29:42.412456+0000","last_became_active":"2023-11-24T06:29:40.345989+0000","last_became_peered":"2023-11-24T06:29:40.345989+0000","last_unstale":"2023-11-24T06:29:42.412456+0000","last_undegraded":"2023-11-24T06:29:42.412456+0000","last_fullsized":"2023-11-24T06:29:42.412456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:36.363583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411200+0000","last_change":"2023-11-24T06:29:41.038281+0000","last_active":"2023-11-24T06:29:42.411200+0000","last_peered":"2023-11-24T06:29:42.411200+0000","last_clean":"2023-11-24T06:29:42.411200+0000","last_became_active":"2023-11-24T06:29:41.038032+0000","last_became_peered":"2023-11-24T06:29:41.038032+0000","last_unstale":"2023-11-24T06:29:42.411200+0000","last_undegraded":"2023-11-24T06:29:42.411200+0000","last_fullsized":"2023-11-24T06:29:42.411200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009998+0000","last_change":"2023-11-24T06:29:40.346634+0000","last_active":"2023-11-24T06:29:42.009998+0000","last_peered":"2023-11-24T06:29:42.009998+0000","last_clean":"2023-11-24T06:29:42.009998+0000","last_became_active":"2023-11-24T06:29:40.346312+0000","last_became_peered":"2023-11-24T06:29:40.346312+0000","last_unstale":"2023-11-24T06:29:42.009998+0000","last_undegraded":"2023-11-24T06:29:42.009998+0000","last_fullsized":"2023-11-24T06:29:42.009998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412076+0000","last_change":"2023-11-24T06:29:41.021832+0000","last_active":"2023-11-24T06:29:42.412076+0000","last_peered":"2023-11-24T06:29:42.412076+0000","last_clean":"2023-11-24T06:29:42.412076+0000","last_became_active":"2023-11-24T06:29:41.021474+0000","last_became_peered":"2023-11-24T06:29:41.021474+0000","last_unstale":"2023-11-24T06:29:42.412076+0000","last_undegraded":"2023-11-24T06:29:42.412076+0000","last_fullsized":"2023-11-24T06:29:42.412076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:54.814389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402403+0000","last_change":"2023-11-24T06:29:40.341865+0000","last_active":"2023-11-24T06:29:42.402403+0000","last_peered":"2023-11-24T06:29:42.402403+0000","last_clean":"2023-11-24T06:29:42.402403+0000","last_became_active":"2023-11-24T06:29:40.341473+0000","last_became_peered":"2023-11-24T06:29:40.341473+0000","last_unstale":"2023-11-24T06:29:42.402403+0000","last_undegraded":"2023-11-24T06:29:42.402403+0000","last_fullsized":"2023-11-24T06:29:42.402403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412596+0000","last_change":"2023-11-24T06:29:41.032631+0000","last_active":"2023-11-24T06:29:42.412596+0000","last_peered":"2023-11-24T06:29:42.412596+0000","last_clean":"2023-11-24T06:29:42.412596+0000","last_became_active":"2023-11-24T06:29:41.032317+0000","last_became_peered":"2023-11-24T06:29:41.032317+0000","last_unstale":"2023-11-24T06:29:42.412596+0000","last_undegraded":"2023-11-24T06:29:42.412596+0000","last_fullsized":"2023-11-24T06:29:42.412596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411352+0000","last_change":"2023-11-24T06:29:40.346013+0000","last_active":"2023-11-24T06:29:42.411352+0000","last_peered":"2023-11-24T06:29:42.411352+0000","last_clean":"2023-11-24T06:29:42.411352+0000","last_became_active":"2023-11-24T06:29:40.345697+0000","last_became_peered":"2023-11-24T06:29:40.345697+0000","last_unstale":"2023-11-24T06:29:42.411352+0000","last_undegraded":"2023-11-24T06:29:42.411352+0000","last_fullsized":"2023-11-24T06:29:42.411352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410974+0000","last_change":"2023-11-24T06:29:41.022517+0000","last_active":"2023-11-24T06:29:42.410974+0000","last_peered":"2023-11-24T06:29:42.410974+0000","last_clean":"2023-11-24T06:29:42.410974+0000","last_became_active":"2023-11-24T06:29:41.022269+0000","last_became_peered":"2023-11-24T06:29:41.022269+0000","last_unstale":"2023-11-24T06:29:42.410974+0000","last_undegraded":"2023-11-24T06:29:42.410974+0000","last_fullsized":"2023-11-24T06:29:42.410974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412047+0000","last_change":"2023-11-24T06:29:40.333463+0000","last_active":"2023-11-24T06:29:42.412047+0000","last_peered":"2023-11-24T06:29:42.412047+0000","last_clean":"2023-11-24T06:29:42.412047+0000","last_became_active":"2023-11-24T06:29:40.333138+0000","last_became_peered":"2023-11-24T06:29:40.333138+0000","last_unstale":"2023-11-24T06:29:42.412047+0000","last_undegraded":"2023-11-24T06:29:42.412047+0000","last_fullsized":"2023-11-24T06:29:42.412047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412905+0000","last_change":"2023-11-24T06:29:41.034227+0000","last_active":"2023-11-24T06:29:42.412905+0000","last_peered":"2023-11-24T06:29:42.412905+0000","last_clean":"2023-11-24T06:29:42.412905+0000","last_became_active":"2023-11-24T06:29:41.033863+0000","last_became_peered":"2023-11-24T06:29:41.033863+0000","last_unstale":"2023-11-24T06:29:42.412905+0000","last_undegraded":"2023-11-24T06:29:42.412905+0000","last_fullsized":"2023-11-24T06:29:42.412905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402160+0000","last_change":"2023-11-24T06:29:40.339332+0000","last_active":"2023-11-24T06:29:42.402160+0000","last_peered":"2023-11-24T06:29:42.402160+0000","last_clean":"2023-11-24T06:29:42.402160+0000","last_became_active":"2023-11-24T06:29:40.338937+0000","last_became_peered":"2023-11-24T06:29:40.338937+0000","last_unstale":"2023-11-24T06:29:42.402160+0000","last_undegraded":"2023-11-24T06:29:42.402160+0000","last_fullsized":"2023-11-24T06:29:42.402160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402564+0000","last_change":"2023-11-24T06:29:41.022776+0000","last_active":"2023-11-24T06:29:42.402564+0000","last_peered":"2023-11-24T06:29:42.402564+0000","last_clean":"2023-11-24T06:29:42.402564+0000","last_became_active":"2023-11-24T06:29:41.022391+0000","last_became_peered":"2023-11-24T06:29:41.022391+0000","last_unstale":"2023-11-24T06:29:42.402564+0000","last_undegraded":"2023-11-24T06:29:42.402564+0000","last_fullsized":"2023-11-24T06:29:42.402564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009165+0000","last_change":"2023-11-24T06:29:40.330685+0000","last_active":"2023-11-24T06:29:42.009165+0000","last_peered":"2023-11-24T06:29:42.009165+0000","last_clean":"2023-11-24T06:29:42.009165+0000","last_became_active":"2023-11-24T06:29:40.330343+0000","last_became_peered":"2023-11-24T06:29:40.330343+0000","last_unstale":"2023-11-24T06:29:42.009165+0000","last_undegraded":"2023-11-24T06:29:42.009165+0000","last_fullsized":"2023-11-24T06:29:42.009165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412651+0000","last_change":"2023-11-24T06:29:41.033010+0000","last_active":"2023-11-24T06:29:42.412651+0000","last_peered":"2023-11-24T06:29:42.412651+0000","last_clean":"2023-11-24T06:29:42.412651+0000","last_became_active":"2023-11-24T06:29:41.032663+0000","last_became_peered":"2023-11-24T06:29:41.032663+0000","last_unstale":"2023-11-24T06:29:42.412651+0000","last_undegraded":"2023-11-24T06:29:42.412651+0000","last_fullsized":"2023-11-24T06:29:42.412651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412068+0000","last_change":"2023-11-24T06:29:40.344785+0000","last_active":"2023-11-24T06:29:42.412068+0000","last_peered":"2023-11-24T06:29:42.412068+0000","last_clean":"2023-11-24T06:29:42.412068+0000","last_became_active":"2023-11-24T06:29:40.344491+0000","last_became_peered":"2023-11-24T06:29:40.344491+0000","last_unstale":"2023-11-24T06:29:42.412068+0000","last_undegraded":"2023-11-24T06:29:42.412068+0000","last_fullsized":"2023-11-24T06:29:42.412068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:32.298231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413142+0000","last_change":"2023-11-24T06:29:41.030954+0000","last_active":"2023-11-24T06:29:42.413142+0000","last_peered":"2023-11-24T06:29:42.413142+0000","last_clean":"2023-11-24T06:29:42.413142+0000","last_became_active":"2023-11-24T06:29:41.030605+0000","last_became_peered":"2023-11-24T06:29:41.030605+0000","last_unstale":"2023-11-24T06:29:42.413142+0000","last_undegraded":"2023-11-24T06:29:42.413142+0000","last_fullsized":"2023-11-24T06:29:42.413142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009450+0000","last_change":"2023-11-24T06:29:40.330710+0000","last_active":"2023-11-24T06:29:42.009450+0000","last_peered":"2023-11-24T06:29:42.009450+0000","last_clean":"2023-11-24T06:29:42.009450+0000","last_became_active":"2023-11-24T06:29:40.330435+0000","last_became_peered":"2023-11-24T06:29:40.330435+0000","last_unstale":"2023-11-24T06:29:42.009450+0000","last_undegraded":"2023-11-24T06:29:42.009450+0000","last_fullsized":"2023-11-24T06:29:42.009450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:39.389505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413349+0000","last_change":"2023-11-24T06:29:41.032411+0000","last_active":"2023-11-24T06:29:42.413349+0000","last_peered":"2023-11-24T06:29:42.413349+0000","last_clean":"2023-11-24T06:29:42.413349+0000","last_became_active":"2023-11-24T06:29:41.032095+0000","last_became_peered":"2023-11-24T06:29:41.032095+0000","last_unstale":"2023-11-24T06:29:42.413349+0000","last_undegraded":"2023-11-24T06:29:42.413349+0000","last_fullsized":"2023-11-24T06:29:42.413349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:02.553538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010082+0000","last_change":"2023-11-24T06:29:40.337974+0000","last_active":"2023-11-24T06:29:42.010082+0000","last_peered":"2023-11-24T06:29:42.010082+0000","last_clean":"2023-11-24T06:29:42.010082+0000","last_became_active":"2023-11-24T06:29:40.337599+0000","last_became_peered":"2023-11-24T06:29:40.337599+0000","last_unstale":"2023-11-24T06:29:42.010082+0000","last_undegraded":"2023-11-24T06:29:42.010082+0000","last_fullsized":"2023-11-24T06:29:42.010082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412670+0000","last_change":"2023-11-24T06:29:41.040924+0000","last_active":"2023-11-24T06:29:42.412670+0000","last_peered":"2023-11-24T06:29:42.412670+0000","last_clean":"2023-11-24T06:29:42.412670+0000","last_became_active":"2023-11-24T06:29:41.040479+0000","last_became_peered":"2023-11-24T06:29:41.040479+0000","last_unstale":"2023-11-24T06:29:42.412670+0000","last_undegraded":"2023-11-24T06:29:42.412670+0000","last_fullsized":"2023-11-24T06:29:42.412670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009583+0000","last_change":"2023-11-24T06:29:40.336909+0000","last_active":"2023-11-24T06:29:42.009583+0000","last_peered":"2023-11-24T06:29:42.009583+0000","last_clean":"2023-11-24T06:29:42.009583+0000","last_became_active":"2023-11-24T06:29:40.336093+0000","last_became_peered":"2023-11-24T06:29:40.336093+0000","last_unstale":"2023-11-24T06:29:42.009583+0000","last_undegraded":"2023-11-24T06:29:42.009583+0000","last_fullsized":"2023-11-24T06:29:42.009583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:22.220406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412802+0000","last_change":"2023-11-24T06:29:41.044969+0000","last_active":"2023-11-24T06:29:42.412802+0000","last_peered":"2023-11-24T06:29:42.412802+0000","last_clean":"2023-11-24T06:29:42.412802+0000","last_became_active":"2023-11-24T06:29:41.044659+0000","last_became_peered":"2023-11-24T06:29:41.044659+0000","last_unstale":"2023-11-24T06:29:42.412802+0000","last_undegraded":"2023-11-24T06:29:42.412802+0000","last_fullsized":"2023-11-24T06:29:42.412802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:29:41.015301+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:29:41.015301+0000","last_peered":"2023-11-24T06:29:41.015301+0000","last_clean":"2023-11-24T06:29:41.015301+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:29:41.015301+0000","last_undegraded":"2023-11-24T06:29:41.015301+0000","last_fullsized":"2023-11-24T06:29:41.015301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411387+0000","last_change":"2023-11-24T06:29:40.333870+0000","last_active":"2023-11-24T06:29:42.411387+0000","last_peered":"2023-11-24T06:29:42.411387+0000","last_clean":"2023-11-24T06:29:42.411387+0000","last_became_active":"2023-11-24T06:29:40.330583+0000","last_became_peered":"2023-11-24T06:29:40.330583+0000","last_unstale":"2023-11-24T06:29:42.411387+0000","last_undegraded":"2023-11-24T06:29:42.411387+0000","last_fullsized":"2023-11-24T06:29:42.411387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008984+0000","last_change":"2023-11-24T06:29:41.044278+0000","last_active":"2023-11-24T06:29:42.008984+0000","last_peered":"2023-11-24T06:29:42.008984+0000","last_clean":"2023-11-24T06:29:42.008984+0000","last_became_active":"2023-11-24T06:29:41.044029+0000","last_became_peered":"2023-11-24T06:29:41.044029+0000","last_unstale":"2023-11-24T06:29:42.008984+0000","last_undegraded":"2023-11-24T06:29:42.008984+0000","last_fullsized":"2023-11-24T06:29:42.008984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411686+0000","last_change":"2023-11-24T06:29:40.351531+0000","last_active":"2023-11-24T06:29:42.411686+0000","last_peered":"2023-11-24T06:29:42.411686+0000","last_clean":"2023-11-24T06:29:42.411686+0000","last_became_active":"2023-11-24T06:29:40.351232+0000","last_became_peered":"2023-11-24T06:29:40.351232+0000","last_unstale":"2023-11-24T06:29:42.411686+0000","last_undegraded":"2023-11-24T06:29:42.411686+0000","last_fullsized":"2023-11-24T06:29:42.411686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410953+0000","last_change":"2023-11-24T06:29:41.027965+0000","last_active":"2023-11-24T06:29:42.410953+0000","last_peered":"2023-11-24T06:29:42.410953+0000","last_clean":"2023-11-24T06:29:42.410953+0000","last_became_active":"2023-11-24T06:29:41.027713+0000","last_became_peered":"2023-11-24T06:29:41.027713+0000","last_unstale":"2023-11-24T06:29:42.410953+0000","last_undegraded":"2023-11-24T06:29:42.410953+0000","last_fullsized":"2023-11-24T06:29:42.410953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009419+0000","last_change":"2023-11-24T06:29:40.328364+0000","last_active":"2023-11-24T06:29:42.009419+0000","last_peered":"2023-11-24T06:29:42.009419+0000","last_clean":"2023-11-24T06:29:42.009419+0000","last_became_active":"2023-11-24T06:29:40.328059+0000","last_became_peered":"2023-11-24T06:29:40.328059+0000","last_unstale":"2023-11-24T06:29:42.009419+0000","last_undegraded":"2023-11-24T06:29:42.009419+0000","last_fullsized":"2023-11-24T06:29:42.009419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010410+0000","last_change":"2023-11-24T06:29:41.018318+0000","last_active":"2023-11-24T06:29:42.010410+0000","last_peered":"2023-11-24T06:29:42.010410+0000","last_clean":"2023-11-24T06:29:42.010410+0000","last_became_active":"2023-11-24T06:29:41.018026+0000","last_became_peered":"2023-11-24T06:29:41.018026+0000","last_unstale":"2023-11-24T06:29:42.010410+0000","last_undegraded":"2023-11-24T06:29:42.010410+0000","last_fullsized":"2023-11-24T06:29:42.010410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412136+0000","last_change":"2023-11-24T06:29:40.347685+0000","last_active":"2023-11-24T06:29:42.412136+0000","last_peered":"2023-11-24T06:29:42.412136+0000","last_clean":"2023-11-24T06:29:42.412136+0000","last_became_active":"2023-11-24T06:29:40.345649+0000","last_became_peered":"2023-11-24T06:29:40.345649+0000","last_unstale":"2023-11-24T06:29:42.412136+0000","last_undegraded":"2023-11-24T06:29:42.412136+0000","last_fullsized":"2023-11-24T06:29:42.412136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:50.641651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412373+0000","last_change":"2023-11-24T06:29:41.021761+0000","last_active":"2023-11-24T06:29:42.412373+0000","last_peered":"2023-11-24T06:29:42.412373+0000","last_clean":"2023-11-24T06:29:42.412373+0000","last_became_active":"2023-11-24T06:29:41.021424+0000","last_became_peered":"2023-11-24T06:29:41.021424+0000","last_unstale":"2023-11-24T06:29:42.412373+0000","last_undegraded":"2023-11-24T06:29:42.412373+0000","last_fullsized":"2023-11-24T06:29:42.412373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010388+0000","last_change":"2023-11-24T06:29:40.347121+0000","last_active":"2023-11-24T06:29:42.010388+0000","last_peered":"2023-11-24T06:29:42.010388+0000","last_clean":"2023-11-24T06:29:42.010388+0000","last_became_active":"2023-11-24T06:29:40.346921+0000","last_became_peered":"2023-11-24T06:29:40.346921+0000","last_unstale":"2023-11-24T06:29:42.010388+0000","last_undegraded":"2023-11-24T06:29:42.010388+0000","last_fullsized":"2023-11-24T06:29:42.010388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412698+0000","last_change":"2023-11-24T06:29:41.043988+0000","last_active":"2023-11-24T06:29:42.412698+0000","last_peered":"2023-11-24T06:29:42.412698+0000","last_clean":"2023-11-24T06:29:42.412698+0000","last_became_active":"2023-11-24T06:29:41.042979+0000","last_became_peered":"2023-11-24T06:29:41.042979+0000","last_unstale":"2023-11-24T06:29:42.412698+0000","last_undegraded":"2023-11-24T06:29:42.412698+0000","last_fullsized":"2023-11-24T06:29:42.412698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412954+0000","last_change":"2023-11-24T06:29:40.354819+0000","last_active":"2023-11-24T06:29:42.412954+0000","last_peered":"2023-11-24T06:29:42.412954+0000","last_clean":"2023-11-24T06:29:42.412954+0000","last_became_active":"2023-11-24T06:29:40.354555+0000","last_became_peered":"2023-11-24T06:29:40.354555+0000","last_unstale":"2023-11-24T06:29:42.412954+0000","last_undegraded":"2023-11-24T06:29:42.412954+0000","last_fullsized":"2023-11-24T06:29:42.412954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010353+0000","last_change":"2023-11-24T06:29:41.026151+0000","last_active":"2023-11-24T06:29:42.010353+0000","last_peered":"2023-11-24T06:29:42.010353+0000","last_clean":"2023-11-24T06:29:42.010353+0000","last_became_active":"2023-11-24T06:29:41.025056+0000","last_became_peered":"2023-11-24T06:29:41.025056+0000","last_unstale":"2023-11-24T06:29:42.010353+0000","last_undegraded":"2023-11-24T06:29:42.010353+0000","last_fullsized":"2023-11-24T06:29:42.010353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010320+0000","last_change":"2023-11-24T06:29:40.339825+0000","last_active":"2023-11-24T06:29:42.010320+0000","last_peered":"2023-11-24T06:29:42.010320+0000","last_clean":"2023-11-24T06:29:42.010320+0000","last_became_active":"2023-11-24T06:29:40.339532+0000","last_became_peered":"2023-11-24T06:29:40.339532+0000","last_unstale":"2023-11-24T06:29:42.010320+0000","last_undegraded":"2023-11-24T06:29:42.010320+0000","last_fullsized":"2023-11-24T06:29:42.010320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010070+0000","last_change":"2023-11-24T06:29:41.034827+0000","last_active":"2023-11-24T06:29:42.010070+0000","last_peered":"2023-11-24T06:29:42.010070+0000","last_clean":"2023-11-24T06:29:42.010070+0000","last_became_active":"2023-11-24T06:29:41.034571+0000","last_became_peered":"2023-11-24T06:29:41.034571+0000","last_unstale":"2023-11-24T06:29:42.010070+0000","last_undegraded":"2023-11-24T06:29:42.010070+0000","last_fullsized":"2023-11-24T06:29:42.010070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402710+0000","last_change":"2023-11-24T06:29:40.349652+0000","last_active":"2023-11-24T06:29:42.402710+0000","last_peered":"2023-11-24T06:29:42.402710+0000","last_clean":"2023-11-24T06:29:42.402710+0000","last_became_active":"2023-11-24T06:29:40.348929+0000","last_became_peered":"2023-11-24T06:29:40.348929+0000","last_unstale":"2023-11-24T06:29:42.402710+0000","last_undegraded":"2023-11-24T06:29:42.402710+0000","last_fullsized":"2023-11-24T06:29:42.402710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411201+0000","last_change":"2023-11-24T06:29:41.020681+0000","last_active":"2023-11-24T06:29:42.411201+0000","last_peered":"2023-11-24T06:29:42.411201+0000","last_clean":"2023-11-24T06:29:42.411201+0000","last_became_active":"2023-11-24T06:29:41.020398+0000","last_became_peered":"2023-11-24T06:29:41.020398+0000","last_unstale":"2023-11-24T06:29:42.411201+0000","last_undegraded":"2023-11-24T06:29:42.411201+0000","last_fullsized":"2023-11-24T06:29:42.411201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411695+0000","last_change":"2023-11-24T06:29:40.350908+0000","last_active":"2023-11-24T06:29:42.411695+0000","last_peered":"2023-11-24T06:29:42.411695+0000","last_clean":"2023-11-24T06:29:42.411695+0000","last_became_active":"2023-11-24T06:29:40.350583+0000","last_became_peered":"2023-11-24T06:29:40.350583+0000","last_unstale":"2023-11-24T06:29:42.411695+0000","last_undegraded":"2023-11-24T06:29:42.411695+0000","last_fullsized":"2023-11-24T06:29:42.411695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412962+0000","last_change":"2023-11-24T06:29:41.023906+0000","last_active":"2023-11-24T06:29:42.412962+0000","last_peered":"2023-11-24T06:29:42.412962+0000","last_clean":"2023-11-24T06:29:42.412962+0000","last_became_active":"2023-11-24T06:29:41.023643+0000","last_became_peered":"2023-11-24T06:29:41.023643+0000","last_unstale":"2023-11-24T06:29:42.412962+0000","last_undegraded":"2023-11-24T06:29:42.412962+0000","last_fullsized":"2023-11-24T06:29:42.412962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010301+0000","last_change":"2023-11-24T06:29:40.351462+0000","last_active":"2023-11-24T06:29:42.010301+0000","last_peered":"2023-11-24T06:29:42.010301+0000","last_clean":"2023-11-24T06:29:42.010301+0000","last_became_active":"2023-11-24T06:29:40.351124+0000","last_became_peered":"2023-11-24T06:29:40.351124+0000","last_unstale":"2023-11-24T06:29:42.010301+0000","last_undegraded":"2023-11-24T06:29:42.010301+0000","last_fullsized":"2023-11-24T06:29:42.010301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010499+0000","last_change":"2023-11-24T06:29:41.020690+0000","last_active":"2023-11-24T06:29:42.010499+0000","last_peered":"2023-11-24T06:29:42.010499+0000","last_clean":"2023-11-24T06:29:42.010499+0000","last_became_active":"2023-11-24T06:29:41.020427+0000","last_became_peered":"2023-11-24T06:29:41.020427+0000","last_unstale":"2023-11-24T06:29:42.010499+0000","last_undegraded":"2023-11-24T06:29:42.010499+0000","last_fullsized":"2023-11-24T06:29:42.010499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010425+0000","last_change":"2023-11-24T06:29:40.328181+0000","last_active":"2023-11-24T06:29:42.010425+0000","last_peered":"2023-11-24T06:29:42.010425+0000","last_clean":"2023-11-24T06:29:42.010425+0000","last_became_active":"2023-11-24T06:29:40.327692+0000","last_became_peered":"2023-11-24T06:29:40.327692+0000","last_unstale":"2023-11-24T06:29:42.010425+0000","last_undegraded":"2023-11-24T06:29:42.010425+0000","last_fullsized":"2023-11-24T06:29:42.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009320+0000","last_change":"2023-11-24T06:29:41.022705+0000","last_active":"2023-11-24T06:29:42.009320+0000","last_peered":"2023-11-24T06:29:42.009320+0000","last_clean":"2023-11-24T06:29:42.009320+0000","last_became_active":"2023-11-24T06:29:41.022442+0000","last_became_peered":"2023-11-24T06:29:41.022442+0000","last_unstale":"2023-11-24T06:29:42.009320+0000","last_undegraded":"2023-11-24T06:29:42.009320+0000","last_fullsized":"2023-11-24T06:29:42.009320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412948+0000","last_change":"2023-11-24T06:29:40.351303+0000","last_active":"2023-11-24T06:29:42.412948+0000","last_peered":"2023-11-24T06:29:42.412948+0000","last_clean":"2023-11-24T06:29:42.412948+0000","last_became_active":"2023-11-24T06:29:40.350893+0000","last_became_peered":"2023-11-24T06:29:40.350893+0000","last_unstale":"2023-11-24T06:29:42.412948+0000","last_undegraded":"2023-11-24T06:29:42.412948+0000","last_fullsized":"2023-11-24T06:29:42.412948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:29.563013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402349+0000","last_change":"2023-11-24T06:29:41.030215+0000","last_active":"2023-11-24T06:29:42.402349+0000","last_peered":"2023-11-24T06:29:42.402349+0000","last_clean":"2023-11-24T06:29:42.402349+0000","last_became_active":"2023-11-24T06:29:41.029775+0000","last_became_peered":"2023-11-24T06:29:41.029775+0000","last_unstale":"2023-11-24T06:29:42.402349+0000","last_undegraded":"2023-11-24T06:29:42.402349+0000","last_fullsized":"2023-11-24T06:29:42.402349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.039473+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.039150+0000","last_became_peered":"2023-11-24T06:29:41.039150+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412823+0000","last_change":"2023-11-24T06:29:40.351147+0000","last_active":"2023-11-24T06:29:42.412823+0000","last_peered":"2023-11-24T06:29:42.412823+0000","last_clean":"2023-11-24T06:29:42.412823+0000","last_became_active":"2023-11-24T06:29:40.350837+0000","last_became_peered":"2023-11-24T06:29:40.350837+0000","last_unstale":"2023-11-24T06:29:42.412823+0000","last_undegraded":"2023-11-24T06:29:42.412823+0000","last_fullsized":"2023-11-24T06:29:42.412823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:00.101428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412531+0000","last_change":"2023-11-24T06:29:41.042212+0000","last_active":"2023-11-24T06:29:42.412531+0000","last_peered":"2023-11-24T06:29:42.412531+0000","last_clean":"2023-11-24T06:29:42.412531+0000","last_became_active":"2023-11-24T06:29:41.041751+0000","last_became_peered":"2023-11-24T06:29:41.041751+0000","last_unstale":"2023-11-24T06:29:42.412531+0000","last_undegraded":"2023-11-24T06:29:42.412531+0000","last_fullsized":"2023-11-24T06:29:42.412531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412849+0000","last_change":"2023-11-24T06:29:40.351090+0000","last_active":"2023-11-24T06:29:42.412849+0000","last_peered":"2023-11-24T06:29:42.412849+0000","last_clean":"2023-11-24T06:29:42.412849+0000","last_became_active":"2023-11-24T06:29:40.350722+0000","last_became_peered":"2023-11-24T06:29:40.350722+0000","last_unstale":"2023-11-24T06:29:42.412849+0000","last_undegraded":"2023-11-24T06:29:42.412849+0000","last_fullsized":"2023-11-24T06:29:42.412849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411181+0000","last_change":"2023-11-24T06:29:41.044968+0000","last_active":"2023-11-24T06:29:42.411181+0000","last_peered":"2023-11-24T06:29:42.411181+0000","last_clean":"2023-11-24T06:29:42.411181+0000","last_became_active":"2023-11-24T06:29:41.044679+0000","last_became_peered":"2023-11-24T06:29:41.044679+0000","last_unstale":"2023-11-24T06:29:42.411181+0000","last_undegraded":"2023-11-24T06:29:42.411181+0000","last_fullsized":"2023-11-24T06:29:42.411181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009975+0000","last_change":"2023-11-24T06:29:40.347084+0000","last_active":"2023-11-24T06:29:42.009975+0000","last_peered":"2023-11-24T06:29:42.009975+0000","last_clean":"2023-11-24T06:29:42.009975+0000","last_became_active":"2023-11-24T06:29:40.346829+0000","last_became_peered":"2023-11-24T06:29:40.346829+0000","last_unstale":"2023-11-24T06:29:42.009975+0000","last_undegraded":"2023-11-24T06:29:42.009975+0000","last_fullsized":"2023-11-24T06:29:42.009975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009898+0000","last_change":"2023-11-24T06:29:41.032848+0000","last_active":"2023-11-24T06:29:42.009898+0000","last_peered":"2023-11-24T06:29:42.009898+0000","last_clean":"2023-11-24T06:29:42.009898+0000","last_became_active":"2023-11-24T06:29:41.032572+0000","last_became_peered":"2023-11-24T06:29:41.032572+0000","last_unstale":"2023-11-24T06:29:42.009898+0000","last_undegraded":"2023-11-24T06:29:42.009898+0000","last_fullsized":"2023-11-24T06:29:42.009898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411279+0000","last_change":"2023-11-24T06:29:40.353473+0000","last_active":"2023-11-24T06:29:42.411279+0000","last_peered":"2023-11-24T06:29:42.411279+0000","last_clean":"2023-11-24T06:29:42.411279+0000","last_became_active":"2023-11-24T06:29:40.353135+0000","last_became_peered":"2023-11-24T06:29:40.353135+0000","last_unstale":"2023-11-24T06:29:42.411279+0000","last_undegraded":"2023-11-24T06:29:42.411279+0000","last_fullsized":"2023-11-24T06:29:42.411279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:29:45.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:29:45.781 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T06:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T06:29:45.781 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T06:29:45.781 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T06:29:45.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 Processor -- start 2023-11-24T06:29:45.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 -- start start 2023-11-24T06:29:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f002c15d570 0x7f002c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f002c0d3020 0x7f002c0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c0d39f0 con 0x7f002c0ce8b0 2023-11-24T06:29:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0d1cc0 con 0x7f002c0d3020 2023-11-24T06:29:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f003112a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0d1fa0 con 0x7f002c15d570 2023-11-24T06:29:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f002c0d3020 0x7f002c0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f002c0d3020 0x7f002c0d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46408/0 (socket says 172.21.15.143:46408) 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 -- 172.21.15.143:0/591273577 learned_addr learned my addr 172.21.15.143:0/591273577 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002ad9d640 1 --2- 172.21.15.143:0/591273577 >> v2:172.21.15.146:3300/0 conn(0x7f002c15d570 0x7f002c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 -- 172.21.15.143:0/591273577 >> v2:172.21.15.146:3300/0 conn(0x7f002c15d570 msgr2=0x7f002c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 --2- 172.21.15.143:0/591273577 >> v2:172.21.15.146:3300/0 conn(0x7f002c15d570 0x7f002c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 -- 172.21.15.143:0/591273577 >> v1:172.21.15.146:6789/0 conn(0x7f002c0ce8b0 legacy=0x7f002c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.954+0000 7f002a59c640 1 -- 172.21.15.143:0/591273577 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c0ce0b0 con 0x7f002c0d3020 2023-11-24T06:29:45.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f002a59c640 1 --2- 172.21.15.143:0/591273577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0d3020 0x7f002c0d34b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f002c0d0eb0 tx=0x7f002001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c91bec3b6c08426 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f0029d9b640 1 -- 172.21.15.143:0/591273577 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200aa650 con 0x7f002c0d3020 2023-11-24T06:29:45.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f0029d9b640 1 -- 172.21.15.143:0/591273577 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00200aa7b0 con 0x7f002c0d3020 2023-11-24T06:29:45.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f0029d9b640 1 -- 172.21.15.143:0/591273577 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200aab40 con 0x7f002c0d3020 2023-11-24T06:29:45.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 -- 172.21.15.143:0/591273577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0d3020 msgr2=0x7f002c0d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 --2- 172.21.15.143:0/591273577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0d3020 0x7f002c0d34b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f002c0d0eb0 tx=0x7f002001c4d0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 -- 172.21.15.143:0/591273577 shutdown_connections 2023-11-24T06:29:45.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 --2- 172.21.15.143:0/591273577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0d3020 0x7f002c0d34b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 --2- 172.21.15.143:0/591273577 >> v2:172.21.15.146:3300/0 conn(0x7f002c15d570 0x7f002c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 -- 172.21.15.143:0/591273577 >> 172.21.15.143:0/591273577 conn(0x7f002c08ceb0 msgr2=0x7f002c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:45.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 -- 172.21.15.143:0/591273577 shutdown_connections 2023-11-24T06:29:45.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.958+0000 7f003112a640 1 -- 172.21.15.143:0/591273577 wait complete. 2023-11-24T06:29:45.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 Processor -- start 2023-11-24T06:29:45.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- start start 2023-11-24T06:29:45.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 0x7f002c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f002c0d3020 0x7f002c15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f002c15d570 0x7f002c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0c8710 con 0x7f002c0ce8b0 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c15b670 con 0x7f002c15d570 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c1541e0 con 0x7f002c0d3020 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 0x7f002c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 0x7f002c0ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46416/0 (socket says 172.21.15.143:46416) 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 -- 172.21.15.143:0/259551005 learned_addr learned my addr 172.21.15.143:0/259551005 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002a59c640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f002c0d3020 0x7f002c15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002b59e640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f002c15d570 0x7f002c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 -- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f002c0d3020 msgr2=0x7f002c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f002c0d3020 0x7f002c15db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 -- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f002c15d570 msgr2=0x7f002c15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f002c15d570 0x7f002c15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 -- 172.21.15.143:0/259551005 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200094d0 con 0x7f002c0ce8b0 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002a59c640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f002c0d3020 0x7f002c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:45.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f002ad9d640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 0x7f002c0ccf50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e870 tx=0x7f001c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c009530 con 0x7f002c0ce8b0 2023-11-24T06:29:45.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c00c940 con 0x7f002c0ce8b0 2023-11-24T06:29:45.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c00ccd0 con 0x7f002c0ce8b0 2023-11-24T06:29:45.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c15b340 con 0x7f002c0ce8b0 2023-11-24T06:29:45.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c0c73b0 con 0x7f002c0ce8b0 2023-11-24T06:29:45.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.962+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c067520 con 0x7f002c0ce8b0 2023-11-24T06:29:45.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.966+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f001c013470 con 0x7f002c0ce8b0 2023-11-24T06:29:45.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.966+0000 7f00137fe640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0018066470 0x7f0018068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:45.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.966+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f001c0842e0 con 0x7f002c0ce8b0 2023-11-24T06:29:45.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.966+0000 7f002a59c640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0018066470 0x7f0018068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:45.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.966+0000 7f002a59c640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0018066470 0x7f0018068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00200ae000 tx=0x7f00200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:45.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:45.970+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f001c051800 con 0x7f002c0ce8b0 2023-11-24T06:29:46.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.158+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f002c06b7b0 con 0x7f002c0ce8b0 2023-11-24T06:29:46.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f00137fe640 1 -- 172.21.15.143:0/259551005 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164438 (secure 0 0 0) 0x7f001c054e20 con 0x7f002c0ce8b0 2023-11-24T06:29:46.166 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:46.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0018066470 msgr2=0x7f0018068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0018066470 0x7f0018068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00200ae000 tx=0x7f00200a7000 comp rx=0 tx=0).stop 2023-11-24T06:29:46.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 msgr2=0x7f002c0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 0x7f002c0ccf50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e870 tx=0x7f001c00ed30 comp rx=0 tx=0).stop 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 shutdown_connections 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0018066470 0x7f0018068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f002c15d570 0x7f002c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f002c0d3020 0x7f002c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 --2- 172.21.15.143:0/259551005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f002c0ce8b0 0x7f002c0ccf50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 >> 172.21.15.143:0/259551005 conn(0x7f002c08ceb0 msgr2=0x7f002c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 shutdown_connections 2023-11-24T06:29:46.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.162+0000 7f003112a640 1 -- 172.21.15.143:0/259551005 wait complete. 2023-11-24T06:29:46.186 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1816026817},{"type":"v1","addr":"172.21.15.143:6833","nonce":1816026817}]},"active_addr":"172.21.15.143:6833/1816026817","active_change":"2023-11-24T06:29:20.191650+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":3103976714}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":3415035958}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1259084678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":172510237}]}]} 2023-11-24T06:29:46.190 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T06:29:46.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T06:29:46.190 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:46.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.326+0000 7fce3ba32640 1 Processor -- start 2023-11-24T06:29:46.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.326+0000 7fce3ba32640 1 -- start start 2023-11-24T06:29:46.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce3ba32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce34144030 0x7fce3406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce3ba32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce3409cc20 0x7fce3406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce3ba32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce340709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce3ba32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce34145020 con 0x7fce3409cc20 2023-11-24T06:29:46.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce3ba32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3406d8b0 con 0x7fce34144030 2023-11-24T06:29:46.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce3ba32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3409d0a0 con 0x7fce3406e280 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce3409cc20 0x7fce3406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce3409cc20 0x7fce3406dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46426/0 (socket says 172.21.15.143:46426) 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 -- 172.21.15.143:0/2645626434 learned_addr learned my addr 172.21.15.143:0/2645626434 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce39fcf640 1 --2- 172.21.15.143:0/2645626434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce340709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce397ce640 1 --2- 172.21.15.143:0/2645626434 >> v2:172.21.15.146:3300/0 conn(0x7fce34144030 0x7fce3406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 -- 172.21.15.143:0/2645626434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 msgr2=0x7fce340709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 --2- 172.21.15.143:0/2645626434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce340709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 -- 172.21.15.143:0/2645626434 >> v2:172.21.15.146:3300/0 conn(0x7fce34144030 msgr2=0x7fce3406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:46.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 --2- 172.21.15.143:0/2645626434 >> v2:172.21.15.146:3300/0 conn(0x7fce34144030 0x7fce3406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.330+0000 7fce38fcd640 1 -- 172.21.15.143:0/2645626434 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3406cca0 con 0x7fce3409cc20 2023-11-24T06:29:46.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce38fcd640 1 --2- 172.21.15.143:0/2645626434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce3409cc20 0x7fce3406dd40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce3406c2f0 tx=0x7fce2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8ce0d7abcb5dae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:46.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce2bfff640 1 -- 172.21.15.143:0/2645626434 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce240aa5f0 con 0x7fce3409cc20 2023-11-24T06:29:46.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce2bfff640 1 -- 172.21.15.143:0/2645626434 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce240aa750 con 0x7fce3409cc20 2023-11-24T06:29:46.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce2bfff640 1 -- 172.21.15.143:0/2645626434 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce240aaae0 con 0x7fce3409cc20 2023-11-24T06:29:46.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 -- 172.21.15.143:0/2645626434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce3409cc20 msgr2=0x7fce3406dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 --2- 172.21.15.143:0/2645626434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce3409cc20 0x7fce3406dd40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce3406c2f0 tx=0x7fce2401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 -- 172.21.15.143:0/2645626434 shutdown_connections 2023-11-24T06:29:46.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 --2- 172.21.15.143:0/2645626434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce340709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 --2- 172.21.15.143:0/2645626434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce3409cc20 0x7fce3406dd40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 --2- 172.21.15.143:0/2645626434 >> v2:172.21.15.146:3300/0 conn(0x7fce34144030 0x7fce3406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 -- 172.21.15.143:0/2645626434 >> 172.21.15.143:0/2645626434 conn(0x7fce340b0bf0 msgr2=0x7fce340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:46.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 -- 172.21.15.143:0/2645626434 shutdown_connections 2023-11-24T06:29:46.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 -- 172.21.15.143:0/2645626434 wait complete. 2023-11-24T06:29:46.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 Processor -- start 2023-11-24T06:29:46.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.334+0000 7fce3ba32640 1 -- start start 2023-11-24T06:29:46.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce3413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce3409cc20 0x7fce340af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 0x7fce340af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3413f070 con 0x7fce34144030 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340ce980 con 0x7fce3409cc20 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340cec60 con 0x7fce3406e280 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 0x7fce340af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 0x7fce340af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46430/0 (socket says 172.21.15.143:46430) 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 -- 172.21.15.143:0/1677248205 learned_addr learned my addr 172.21.15.143:0/1677248205 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce38fcd640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce3409cc20 0x7fce340af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce397ce640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce3413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 -- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 msgr2=0x7fce3413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce3413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 -- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce3409cc20 msgr2=0x7fce340af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce3409cc20 0x7fce340af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 -- 172.21.15.143:0/1677248205 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce240094d0 con 0x7fce34144030 2023-11-24T06:29:46.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce39fcf640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 0x7fce340af750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00efc0 tx=0x7fce2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:46.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c014480 con 0x7fce34144030 2023-11-24T06:29:46.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c00f040 con 0x7fce34144030 2023-11-24T06:29:46.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c014820 con 0x7fce34144030 2023-11-24T06:29:46.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce340cef40 con 0x7fce34144030 2023-11-24T06:29:46.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce340cf500 con 0x7fce34144030 2023-11-24T06:29:46.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce340cf6f0 con 0x7fce34144030 2023-11-24T06:29:46.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.338+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce2c014980 con 0x7fce34144030 2023-11-24T06:29:46.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.342+0000 7fce29ffb640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce18066470 0x7fce18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.342+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce2c0848c0 con 0x7fce34144030 2023-11-24T06:29:46.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.342+0000 7fce397ce640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce18066470 0x7fce18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.342+0000 7fce397ce640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce18066470 0x7fce18068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce30009a40 tx=0x7fce30009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.346+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce2c051de0 con 0x7fce34144030 2023-11-24T06:29:46.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.498+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce34067520 con 0x7fce34144030 2023-11-24T06:29:46.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.498+0000 7fce29ffb640 1 -- 172.21.15.143:0/1677248205 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fce2c018090 con 0x7fce34144030 2023-11-24T06:29:46.503 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:46.503 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce18066470 msgr2=0x7fce18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce18066470 0x7fce18068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce30009a40 tx=0x7fce30009190 comp rx=0 tx=0).stop 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 msgr2=0x7fce340af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 0x7fce340af750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00efc0 tx=0x7fce2c00c490 comp rx=0 tx=0).stop 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 shutdown_connections 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce18066470 0x7fce18068930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce34144030 0x7fce340af750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce3409cc20 0x7fce340af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 --2- 172.21.15.143:0/1677248205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce3406e280 0x7fce3413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 >> 172.21.15.143:0/1677248205 conn(0x7fce340b0bf0 msgr2=0x7fce340b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 shutdown_connections 2023-11-24T06:29:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.502+0000 7fce3ba32640 1 -- 172.21.15.143:0/1677248205 wait complete. 2023-11-24T06:29:46.524 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T06:29:46.525 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:46.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 Processor -- start 2023-11-24T06:29:46.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 -- start start 2023-11-24T06:29:46.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ec415d570 0x7f8ec406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40d3020 0x7f8ec40d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec40d39c0 con 0x7f8ec40ce8b0 2023-11-24T06:29:46.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec40d1cc0 con 0x7f8ec415d570 2023-11-24T06:29:46.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec9a6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40d1fa0 con 0x7f8ec40d3020 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ec415d570 0x7f8ec406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec3fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8ec40ce8b0 0x7f8ec40ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48590/0 (socket says 172.21.15.143:48590) 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec3fff640 1 -- 172.21.15.143:0/3958718210 learned_addr learned my addr 172.21.15.143:0/3958718210 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec37fe640 1 -- 172.21.15.143:0/3958718210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40d3020 msgr2=0x7f8ec40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec37fe640 1 --2- 172.21.15.143:0/3958718210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40d3020 0x7f8ec40d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec37fe640 1 -- 172.21.15.143:0/3958718210 >> v1:172.21.15.143:6789/0 conn(0x7f8ec40ce8b0 legacy=0x7f8ec40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.658+0000 7f8ec37fe640 1 -- 172.21.15.143:0/3958718210 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40ce0b0 con 0x7f8ec415d570 2023-11-24T06:29:46.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec37fe640 1 --2- 172.21.15.143:0/3958718210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec415d570 0x7f8ec406b9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40097c0 tx=0x7f8eb401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa54803d9a4a51c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:46.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec2ffd640 1 -- 172.21.15.143:0/3958718210 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40ac640 con 0x7f8ec415d570 2023-11-24T06:29:46.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec2ffd640 1 -- 172.21.15.143:0/3958718210 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40ac7a0 con 0x7f8ec415d570 2023-11-24T06:29:46.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec2ffd640 1 -- 172.21.15.143:0/3958718210 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40acb30 con 0x7f8ec415d570 2023-11-24T06:29:46.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/3958718210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec415d570 msgr2=0x7f8ec406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/3958718210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec415d570 0x7f8ec406b9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40097c0 tx=0x7f8eb401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/3958718210 shutdown_connections 2023-11-24T06:29:46.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/3958718210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40d3020 0x7f8ec40d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/3958718210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec415d570 0x7f8ec406b9d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/3958718210 >> 172.21.15.143:0/3958718210 conn(0x7f8ec408ceb0 msgr2=0x7f8ec409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:46.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/3958718210 shutdown_connections 2023-11-24T06:29:46.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.662+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/3958718210 wait complete. 2023-11-24T06:29:46.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 Processor -- start 2023-11-24T06:29:46.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 -- start start 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40ce8b0 0x7f8ec414b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 0x7f8ec40c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec415d570 0x7f8ec414ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec415be50 con 0x7f8ec40d3020 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c70d0 con 0x7f8ec40ce8b0 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c73b0 con 0x7f8ec415d570 2023-11-24T06:29:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 0x7f8ec40c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 0x7f8ec40c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46440/0 (socket says 172.21.15.143:46440) 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 -- 172.21.15.143:0/552242505 learned_addr learned my addr 172.21.15.143:0/552242505 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec3fff640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec415d570 0x7f8ec414ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec37fe640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40ce8b0 0x7f8ec414b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 -- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec415d570 msgr2=0x7f8ec414ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec415d570 0x7f8ec414ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 -- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40ce8b0 msgr2=0x7f8ec414b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40ce8b0 0x7f8ec414b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 -- 172.21.15.143:0/552242505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4009420 con 0x7f8ec40d3020 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ebbfff640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 0x7f8ec40c9540 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00b550 tx=0x7f8eac00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac010870 con 0x7f8ec40d3020 2023-11-24T06:29:46.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0109f0 con 0x7f8ec40d3020 2023-11-24T06:29:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac010da0 con 0x7f8ec40d3020 2023-11-24T06:29:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec40c7690 con 0x7f8ec40d3020 2023-11-24T06:29:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.666+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec40b45e0 con 0x7f8ec40d3020 2023-11-24T06:29:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.670+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec415bf90 con 0x7f8ec40d3020 2023-11-24T06:29:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.670+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8eac00f3c0 con 0x7f8ec40d3020 2023-11-24T06:29:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.670+0000 7f8ec0ff9640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ea4066470 0x7f8ea4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.670+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8eac083f80 con 0x7f8ec40d3020 2023-11-24T06:29:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.670+0000 7f8ec37fe640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ea4066470 0x7f8ea4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.670+0000 7f8ec37fe640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ea4066470 0x7f8ea4068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40ae000 tx=0x7f8eb40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:46.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.674+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8eac051360 con 0x7f8ec40d3020 2023-11-24T06:29:46.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.822+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ec4067520 con 0x7f8ec40d3020 2023-11-24T06:29:46.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec0ff9640 1 -- 172.21.15.143:0/552242505 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f8eac054980 con 0x7f8ec40d3020 2023-11-24T06:29:46.829 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:46.829 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ea4066470 msgr2=0x7f8ea4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ea4066470 0x7f8ea4068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40ae000 tx=0x7f8eb40a7000 comp rx=0 tx=0).stop 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 msgr2=0x7f8ec40c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 0x7f8ec40c9540 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00b550 tx=0x7f8eac00ba10 comp rx=0 tx=0).stop 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 shutdown_connections 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ea4066470 0x7f8ea4068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec415d570 0x7f8ec414ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ec40d3020 0x7f8ec40c9540 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 --2- 172.21.15.143:0/552242505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40ce8b0 0x7f8ec414b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:46.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 >> 172.21.15.143:0/552242505 conn(0x7f8ec408ceb0 msgr2=0x7f8ec415a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:46.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 shutdown_connections 2023-11-24T06:29:46.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:46.826+0000 7f8ec9a6b640 1 -- 172.21.15.143:0/552242505 wait complete. 2023-11-24T06:29:46.851 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T06:29:46.851 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T06:29:46.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T06:29:46.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T06:29:46.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T06:29:46.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T06:29:46.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T06:29:46.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T06:29:47.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.086+0000 7f2c8a854640 1 Processor -- start 2023-11-24T06:29:47.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.086+0000 7f2c8a854640 1 -- start start 2023-11-24T06:29:47.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c8a854640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c8414b460 0x7f2c840b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c8a854640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c840b2b80 con 0x7f2c840b2720 2023-11-24T06:29:47.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c8a854640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c84161f90 con 0x7f2c84071a00 2023-11-24T06:29:47.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c8a854640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84161d90 con 0x7f2c8414b460 2023-11-24T06:29:47.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c837fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f2c840b2720 0x7f2c840712f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:48606/0 (socket says 172.21.15.143:48606) 2023-11-24T06:29:47.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c837fe640 1 -- 172.21.15.143:0/669620305 learned_addr learned my addr 172.21.15.143:0/669620305 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c83fff640 1 --2- 172.21.15.143:0/669620305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c8414b460 0x7f2c840b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c83fff640 1 -- 172.21.15.143:0/669620305 >> v1:172.21.15.146:6789/0 conn(0x7f2c84071a00 legacy=0x7f2c84163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c83fff640 1 -- 172.21.15.143:0/669620305 >> v1:172.21.15.143:6789/0 conn(0x7f2c840b2720 legacy=0x7f2c840712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f2c83fff640 1 -- 172.21.15.143:0/669620305 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c84162270 con 0x7f2c8414b460 2023-11-24T06:29:47.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f91e4a79640 1 Processor -- start 2023-11-24T06:29:47.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.090+0000 7f91e4a79640 1 -- start start 2023-11-24T06:29:47.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 Processor -- start 2023-11-24T06:29:47.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91e4a79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91e00d1c30 0x7f91e00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91e4a79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00cdc40 con 0x7f91e00cebf0 2023-11-24T06:29:47.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91e4a79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00cf040 con 0x7f91e00b25e0 2023-11-24T06:29:47.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91e4a79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e00cfab0 con 0x7f91e00d1c30 2023-11-24T06:29:47.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 -- start start 2023-11-24T06:29:47.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec159420 0x7f62ec06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62ec0b30f0 0x7f62ec15d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec15daf0 con 0x7f62ec15d0a0 2023-11-24T06:29:47.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec15e0b0 con 0x7f62ec0b30f0 2023-11-24T06:29:47.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f3f3e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec15ddd0 con 0x7f62ec159420 2023-11-24T06:29:47.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f24db640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62ec0b30f0 0x7f62ec15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91de59c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f91e00b25e0 0x7f91e00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45254/0 (socket says 172.21.15.143:45254) 2023-11-24T06:29:47.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91de59c640 1 -- 172.21.15.143:0/3318147709 learned_addr learned my addr 172.21.15.143:0/3318147709 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f91ddd9b640 1 --2- 172.21.15.143:0/3318147709 >> v2:172.21.15.143:3300/0 conn(0x7f91e00d1c30 0x7f91e00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f14d9640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f62ec15d0a0 0x7f62ec0b29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45260/0 (socket says 172.21.15.143:45260) 2023-11-24T06:29:47.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f14d9640 1 -- 172.21.15.143:0/1802633859 learned_addr learned my addr 172.21.15.143:0/1802633859 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.094+0000 7f62f1cda640 1 --2- 172.21.15.143:0/1802633859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec159420 0x7f62ec06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f91dd59a640 1 -- 172.21.15.143:0/3318147709 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887379411 0 0) 0x7f91e00cdc40 con 0x7f91e00cebf0 2023-11-24T06:29:47.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f62f1cda640 1 -- 172.21.15.143:0/1802633859 >> v2:172.21.15.143:3300/0 conn(0x7f62ec0b30f0 msgr2=0x7f62ec15d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f62f0cd8640 1 -- 172.21.15.143:0/1802633859 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753963732 0 0) 0x7f62ec15daf0 con 0x7f62ec15d0a0 2023-11-24T06:29:47.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f62f1cda640 1 --2- 172.21.15.143:0/1802633859 >> v2:172.21.15.143:3300/0 conn(0x7f62ec0b30f0 0x7f62ec15d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f62f1cda640 1 -- 172.21.15.143:0/1802633859 >> v1:172.21.15.146:6789/0 conn(0x7f62ec15d0a0 legacy=0x7f62ec0b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f62f1cda640 1 -- 172.21.15.143:0/1802633859 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec06da60 con 0x7f62ec159420 2023-11-24T06:29:47.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f91dd59a640 1 -- 172.21.15.143:0/3318147709 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c8003530 con 0x7f91e00cebf0 2023-11-24T06:29:47.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f91ddd9b640 1 -- 172.21.15.143:0/3318147709 >> v1:172.21.15.146:6789/0 conn(0x7f91e00b25e0 legacy=0x7f91e00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f91ddd9b640 1 -- 172.21.15.143:0/3318147709 >> v1:172.21.15.143:6789/0 conn(0x7f91e00cebf0 legacy=0x7f91e00b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f91dd59a640 1 -- 172.21.15.143:0/3318147709 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994134979 0 0) 0x7f91c8003530 con 0x7f91e00cebf0 2023-11-24T06:29:47.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f91ddd9b640 1 -- 172.21.15.143:0/3318147709 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00cde70 con 0x7f91e00d1c30 2023-11-24T06:29:47.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f2c83fff640 1 --2- 172.21.15.143:0/669620305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c8414b460 0x7f2c840b21e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097f0 tx=0x7f2c7801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8e1382a911320e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f2c82ffd640 1 -- 172.21.15.143:0/669620305 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780ab600 con 0x7f2c8414b460 2023-11-24T06:29:47.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f2c82ffd640 1 -- 172.21.15.143:0/669620305 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c780a7050 con 0x7f2c8414b460 2023-11-24T06:29:47.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.098+0000 7f2c82ffd640 1 -- 172.21.15.143:0/669620305 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780ab600 con 0x7f2c8414b460 2023-11-24T06:29:47.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 -- 172.21.15.143:0/669620305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c8414b460 msgr2=0x7f2c840b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 --2- 172.21.15.143:0/669620305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c8414b460 0x7f2c840b21e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097f0 tx=0x7f2c7801c430 comp rx=0 tx=0).stop 2023-11-24T06:29:47.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 -- 172.21.15.143:0/669620305 shutdown_connections 2023-11-24T06:29:47.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 --2- 172.21.15.143:0/669620305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c8414b460 0x7f2c840b21e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 -- 172.21.15.143:0/669620305 >> 172.21.15.143:0/669620305 conn(0x7f2c8406ae90 msgr2=0x7f2c840b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 -- 172.21.15.143:0/669620305 shutdown_connections 2023-11-24T06:29:47.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f2c8a854640 1 -- 172.21.15.143:0/669620305 wait complete. 2023-11-24T06:29:47.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f62f1cda640 1 --2- 172.21.15.143:0/1802633859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec159420 0x7f62ec06e260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62e80071d0 tx=0x7f62e801d480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4ebcc4fd5b97a6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f834e268640 1 Processor -- start 2023-11-24T06:29:47.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f91ddd9b640 1 --2- 172.21.15.143:0/3318147709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00d1c30 0x7f91e00cf420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91d40097c0 tx=0x7f91d401c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11c940af207811b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f834e268640 1 -- start start 2023-11-24T06:29:47.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f91dd59a640 1 -- 172.21.15.143:0/3318147709 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8001a00 con 0x7f91e00d1c30 2023-11-24T06:29:47.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f91dd59a640 1 -- 172.21.15.143:0/3318147709 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d40a7050 con 0x7f91e00d1c30 2023-11-24T06:29:47.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f91dd59a640 1 -- 172.21.15.143:0/3318147709 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d40ab600 con 0x7f91e00d1c30 2023-11-24T06:29:47.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f62f0cd8640 1 -- 172.21.15.143:0/1802633859 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8008be0 con 0x7f62ec159420 2023-11-24T06:29:47.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f62f0cd8640 1 -- 172.21.15.143:0/1802633859 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8008d40 con 0x7f62ec159420 2023-11-24T06:29:47.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f62f0cd8640 1 -- 172.21.15.143:0/1802633859 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800a2f0 con 0x7f62ec159420 2023-11-24T06:29:47.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f91e4a79640 1 -- 172.21.15.143:0/3318147709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00d1c30 msgr2=0x7f91e00cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f91e4a79640 1 --2- 172.21.15.143:0/3318147709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00d1c30 0x7f91e00cf420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91d40097c0 tx=0x7f91d401c2a0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f834e268640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83480b0bd0 0x7f83480c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f834e268640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83480b1060 con 0x7f83480c31e0 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f834e268640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83481629c0 con 0x7f8348165eb0 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f834e268640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8348163260 con 0x7f83480b0bd0 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f83477fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83480b0bd0 0x7f83480c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f83477fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83480b0bd0 0x7f83480c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42784/0 (socket says 172.21.15.143:42784) 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f83477fe640 1 -- 172.21.15.143:0/1381896809 learned_addr learned my addr 172.21.15.143:0/1381896809 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 Processor -- start 2023-11-24T06:29:47.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 -- start start 2023-11-24T06:29:47.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f91e4a79640 1 -- 172.21.15.143:0/3318147709 shutdown_connections 2023-11-24T06:29:47.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f91e4a79640 1 --2- 172.21.15.143:0/3318147709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00d1c30 0x7f91e00cf420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f91e4a79640 1 -- 172.21.15.143:0/3318147709 >> 172.21.15.143:0/3318147709 conn(0x7f91e008cd00 msgr2=0x7f91e009c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f91e4a79640 1 -- 172.21.15.143:0/3318147709 shutdown_connections 2023-11-24T06:29:47.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f62f3f3e640 1 -- 172.21.15.143:0/1802633859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec159420 msgr2=0x7f62ec06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.102+0000 7f62f3f3e640 1 --2- 172.21.15.143:0/1802633859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec159420 0x7f62ec06e260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62e80071d0 tx=0x7f62e801d480 comp rx=0 tx=0).stop 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f62f3f3e640 1 -- 172.21.15.143:0/1802633859 shutdown_connections 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f62f3f3e640 1 --2- 172.21.15.143:0/1802633859 >> v2:172.21.15.143:3300/0 conn(0x7f62ec0b30f0 0x7f62ec15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f62f3f3e640 1 --2- 172.21.15.143:0/1802633859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec159420 0x7f62ec06e260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f62f3f3e640 1 -- 172.21.15.143:0/1802633859 >> 172.21.15.143:0/1802633859 conn(0x7f62ec06ae90 msgr2=0x7f62ec0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f62f3f3e640 1 -- 172.21.15.143:0/1802633859 shutdown_connections 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f62f3f3e640 1 -- 172.21.15.143:0/1802633859 wait complete. 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f157e357640 1 Processor -- start 2023-11-24T06:29:47.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f8346ffd640 1 -- 172.21.15.143:0/1381896809 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086029953 0 0) 0x7f83480b1060 con 0x7f83480c31e0 2023-11-24T06:29:47.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f157e357640 1 -- start start 2023-11-24T06:29:47.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c84071a00 0x7f2c841401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f8346ffd640 1 -- 172.21.15.143:0/1381896809 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8330003530 con 0x7f83480c31e0 2023-11-24T06:29:47.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f83477fe640 1 -- 172.21.15.143:0/1381896809 >> v1:172.21.15.146:6789/0 conn(0x7f8348165eb0 legacy=0x7f83480ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f83477fe640 1 -- 172.21.15.143:0/1381896809 >> v1:172.21.15.143:6789/0 conn(0x7f83480c31e0 legacy=0x7f8348162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f83477fe640 1 -- 172.21.15.143:0/1381896809 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8348162ca0 con 0x7f83480b0bd0 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c840b2720 0x7f2c84160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c8414b460 0x7f2c8415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c841fa7e0 con 0x7f2c84071a00 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84156d80 con 0x7f2c8414b460 2023-11-24T06:29:47.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c8a854640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84157060 con 0x7f2c840b2720 2023-11-24T06:29:47.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f91e4a79640 1 -- 172.21.15.143:0/3318147709 wait complete. 2023-11-24T06:29:47.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c840b2720 0x7f2c84160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c840b2720 0x7f2c84160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:58040/0 (socket says 172.21.15.143:58040) 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 -- 172.21.15.143:0/1614495822 learned_addr learned my addr 172.21.15.143:0/1614495822 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c88df1640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c8414b460 0x7f2c8415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c83fff640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c84071a00 0x7f2c841401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 -- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c8414b460 msgr2=0x7f2c8415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c8414b460 0x7f2c8415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 -- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c84071a00 msgr2=0x7f2c841401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c84071a00 0x7f2c841401f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.106+0000 7f2c837fe640 1 -- 172.21.15.143:0/1614495822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78009420 con 0x7f2c840b2720 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c88df1640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c8414b460 0x7f2c8415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:47.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c837fe640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c840b2720 0x7f2c84160870 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00cba0 tx=0x7f2c7c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 Processor -- start 2023-11-24T06:29:47.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 -- start start 2023-11-24T06:29:47.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 Processor -- start 2023-11-24T06:29:47.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00ad40 con 0x7f2c840b2720 2023-11-24T06:29:47.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f157e357640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f157815d570 0x7f157806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c012400 con 0x7f2c840b2720 2023-11-24T06:29:47.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00aea0 con 0x7f2c840b2720 2023-11-24T06:29:47.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c84157340 con 0x7f2c840b2720 2023-11-24T06:29:47.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c84140730 con 0x7f2c840b2720 2023-11-24T06:29:47.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1577fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f157815d570 0x7f157806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1577fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f157815d570 0x7f157806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42802/0 (socket says 172.21.15.143:42802) 2023-11-24T06:29:47.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 -- start start 2023-11-24T06:29:47.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1577fff640 1 -- 172.21.15.143:0/3169392609 learned_addr learned my addr 172.21.15.143:0/3169392609 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f157e357640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15780ce8b0 0x7f15780ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c8404e850 con 0x7f2c840b2720 2023-11-24T06:29:47.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f157c8f4640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15780ce8b0 0x7f15780ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780d1cc0 con 0x7f15780d3020 2023-11-24T06:29:47.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f63b3a68640 1 Processor -- start 2023-11-24T06:29:47.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15780d1fa0 con 0x7f157815d570 2023-11-24T06:29:47.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec0b30f0 0x7f62ec0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15780ce0b0 con 0x7f15780ce8b0 2023-11-24T06:29:47.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62ec159420 0x7f62ec148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485440829 0 0) 0x7f15780d1cc0 con 0x7f15780d3020 2023-11-24T06:29:47.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f91e4a79640 1 Processor -- start 2023-11-24T06:29:47.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f91e4a79640 1 -- start start 2023-11-24T06:29:47.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f83477fe640 1 --2- 172.21.15.143:0/1381896809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480b0bd0 0x7f83480c35c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8340009e50 tx=0x7f834001c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5290b8efecadf10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1564003530 con 0x7f15780d3020 2023-11-24T06:29:47.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ec15d0a0 0x7f62ec1493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f1cda640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec0b30f0 0x7f62ec0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f674015d950 0x7f67400d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67400d1fb0 0x7f67400b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400cf100 con 0x7f674015d570 2023-11-24T06:29:47.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400d2440 con 0x7f674015d950 2023-11-24T06:29:47.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f67459aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400cf590 con 0x7f67400d1fb0 2023-11-24T06:29:47.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f63b3a68640 1 -- start start 2023-11-24T06:29:47.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f1cda640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec0b30f0 0x7f62ec0affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:58062/0 (socket says 172.21.15.143:58062) 2023-11-24T06:29:47.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f1cda640 1 -- 172.21.15.143:0/2782578669 learned_addr learned my addr 172.21.15.143:0/2782578669 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec14dd80 con 0x7f62ec159420 2023-11-24T06:29:47.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec151ce0 con 0x7f62ec15d0a0 2023-11-24T06:29:47.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f3f3e640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec14d6c0 con 0x7f62ec0b30f0 2023-11-24T06:29:47.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664354452 0 0) 0x7f1564003530 con 0x7f15780d3020 2023-11-24T06:29:47.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15780ce8b0 msgr2=0x7f15780ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f8346ffd640 1 -- 172.21.15.143:0/1381896809 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400a5860 con 0x7f83480b0bd0 2023-11-24T06:29:47.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15780ce8b0 0x7f15780ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 >> v2:172.21.15.146:3300/0 conn(0x7f157815d570 msgr2=0x7f157806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f8346ffd640 1 -- 172.21.15.143:0/1381896809 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83400a59c0 con 0x7f83480b0bd0 2023-11-24T06:29:47.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f1576ffd640 1 --2- 172.21.15.143:0/3169392609 >> v2:172.21.15.146:3300/0 conn(0x7f157815d570 0x7f157806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780ce390 con 0x7f15780d3020 2023-11-24T06:29:47.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c7c007070 con 0x7f2c840b2720 2023-11-24T06:29:47.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f14d9640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62ec159420 0x7f62ec148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.110+0000 7f62f24db640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ec15d0a0 0x7f62ec1493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f1cda640 1 -- 172.21.15.143:0/2782578669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ec15d0a0 msgr2=0x7f62ec1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f1cda640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ec15d0a0 0x7f62ec1493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f1cda640 1 -- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62ec159420 msgr2=0x7f62ec148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f1cda640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62ec159420 0x7f62ec148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f8346ffd640 1 -- 172.21.15.143:0/1381896809 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400a5860 con 0x7f83480b0bd0 2023-11-24T06:29:47.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f1cda640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e800ae50 con 0x7f62ec0b30f0 2023-11-24T06:29:47.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f1560001680 con 0x7f15780d3020 2023-11-24T06:29:47.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 >> v1:172.21.15.146:6789/0 conn(0x7f15780d3020 legacy=0x7f15780d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67400d1fb0 0x7f67400b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67400d1fb0 0x7f67400b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42818/0 (socket says 172.21.15.143:42818) 2023-11-24T06:29:47.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 -- 172.21.15.143:0/3473004884 learned_addr learned my addr 172.21.15.143:0/3473004884 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673e7fc640 1 --2- 172.21.15.143:0/3473004884 >> v2:172.21.15.143:3300/0 conn(0x7f674015d950 0x7f67400d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 -- 172.21.15.143:0/3473004884 >> v2:172.21.15.143:3300/0 conn(0x7f674015d950 msgr2=0x7f67400d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f1cda640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec0b30f0 0x7f62ec0affe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f62e801b0b0 tx=0x7f62e801a220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 -- 172.21.15.143:0/1381896809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480b0bd0 msgr2=0x7f83480c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 --2- 172.21.15.143:0/3473004884 >> v2:172.21.15.143:3300/0 conn(0x7f674015d950 0x7f67400d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 -- 172.21.15.143:0/3473004884 >> v1:172.21.15.143:6789/0 conn(0x7f674015d570 legacy=0x7f67400d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 --2- 172.21.15.143:0/1381896809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480b0bd0 0x7f83480c35c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8340009e50 tx=0x7f834001c9a0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800a2d0 con 0x7f62ec0b30f0 2023-11-24T06:29:47.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673f7fe640 1 -- 172.21.15.143:0/3473004884 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400ce4f0 con 0x7f67400d1fb0 2023-11-24T06:29:47.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f673e7fc640 1 --2- 172.21.15.143:0/3473004884 >> v2:172.21.15.143:3300/0 conn(0x7f674015d950 0x7f67400d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 -- 172.21.15.143:0/1381896809 shutdown_connections 2023-11-24T06:29:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 --2- 172.21.15.143:0/1381896809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480b0bd0 0x7f83480c35c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 -- 172.21.15.143:0/1381896809 >> 172.21.15.143:0/1381896809 conn(0x7f83480d0210 msgr2=0x7f83480d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e80be070 con 0x7f62ec0b30f0 2023-11-24T06:29:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800a690 con 0x7f62ec0b30f0 2023-11-24T06:29:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f3f3e640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec14d9a0 con 0x7f62ec0b30f0 2023-11-24T06:29:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f2c80ff9640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2c700664a0 0x7f2c70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 -- 172.21.15.143:0/1381896809 shutdown_connections 2023-11-24T06:29:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f834e268640 1 -- 172.21.15.143:0/1381896809 wait complete. 2023-11-24T06:29:47.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62f3f3e640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec149080 con 0x7f62ec0b30f0 2023-11-24T06:29:47.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f1564003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15640047d0 0x7f1564004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1564005190 0x7f156400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780d1fa0 con 0x7f15640047d0 2023-11-24T06:29:47.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780ce0b0 con 0x7f1564003a00 2023-11-24T06:29:47.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156400bed0 con 0x7f1564005190 2023-11-24T06:29:47.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62c8000fd0 con 0x7f62ec0b30f0 2023-11-24T06:29:47.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b3a68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f63ac15a4d0 0x7f63ac0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b3a68640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0c9c30 con 0x7f63ac0c9650 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b3a68640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0c9f60 con 0x7f63ac0cad20 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b3a68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac15a8e0 con 0x7f63ac15a4d0 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b1804640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f63ac0cad20 0x7f63ac15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45284/0 (socket says 172.21.15.143:45284) 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b1804640 1 -- 172.21.15.143:0/323728526 learned_addr learned my addr 172.21.15.143:0/323728526 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f157c8f4640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15780ce8b0 0x7f15780ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:47.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102822903 0 0) 0x7f63ac0c9f60 con 0x7f63ac0cad20 2023-11-24T06:29:47.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6398003530 con 0x7f63ac0cad20 2023-11-24T06:29:47.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f1577fff640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f1564003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c7c084600 con 0x7f2c840b2720 2023-11-24T06:29:47.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f2c80ff9640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7f2c7006e640 0x7f2c70070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 --> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c70071110 con 0x7f2c7006e640 2023-11-24T06:29:47.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.114+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c7c0849b0 con 0x7f2c840b2720 2023-11-24T06:29:47.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 Processor -- start 2023-11-24T06:29:47.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f2c83fff640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2c700664a0 0x7f2c70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f2c88df1640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7f2c7006e640 0x7f2c70070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91e4a79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00b25e0 0x7f91e015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91e4a79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e00cebf0 0x7f91e00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91e4a79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e00ca3a0 0x7f91e00ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91e4a79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00cbba0 con 0x7f91e00b25e0 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91e4a79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00cae60 con 0x7f91e00ca3a0 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91e4a79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00cb140 con 0x7f91e00cebf0 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f157c8f4640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1564005190 0x7f156400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f15777fe640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15640047d0 0x7f1564004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91ddd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e00cebf0 0x7f91e00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e00ca3a0 0x7f91e00ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91ddd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e00cebf0 0x7f91e00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:58084/0 (socket says 172.21.15.143:58084) 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91ddd9b640 1 -- 172.21.15.143:0/3088076788 learned_addr learned my addr 172.21.15.143:0/3088076788 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00b25e0 0x7f91e015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f673f7fe640 1 --2- 172.21.15.143:0/3473004884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67400d1fb0 0x7f67400b2040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f674008c8f0 tx=0x7f673001f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa37ba66b88110eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f2c83fff640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2c700664a0 0x7f2c70068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c780ad000 tx=0x7f2c780a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531353496 0 0) 0x7f6398003530 con 0x7f63ac0cad20 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 >> v2:172.21.15.143:3300/0 conn(0x7f63ac15a4d0 msgr2=0x7f63ac0cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 --2- 172.21.15.143:0/323728526 >> v2:172.21.15.143:3300/0 conn(0x7f63ac15a4d0 0x7f63ac0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 >> v1:172.21.15.143:6789/0 conn(0x7f63ac0c9650 legacy=0x7f63ac0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac161280 con 0x7f63ac0cad20 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f639c001680 con 0x7f63ac0cad20 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 >> v1:172.21.15.146:6789/0 conn(0x7f63ac0cad20 legacy=0x7f63ac15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f6398003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63980047d0 0x7f6398004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63980053e0 0x7f639800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac15a8e0 con 0x7f63980047d0 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639800c320 con 0x7f63980053e0 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639800c4e0 con 0x7f63980039d0 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b1804640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f6398003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f673dffb640 1 -- 172.21.15.143:0/3473004884 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300af400 con 0x7f67400d1fb0 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f673dffb640 1 -- 172.21.15.143:0/3473004884 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300ab050 con 0x7f67400d1fb0 2023-11-24T06:29:47.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f673dffb640 1 -- 172.21.15.143:0/3473004884 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300af780 con 0x7f67400d1fb0 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 -- start start 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 -- 172.21.15.143:0/3088076788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e00cebf0 msgr2=0x7f91e00cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e00cebf0 0x7f91e00cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 -- 172.21.15.143:0/3088076788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e00ca3a0 msgr2=0x7f91e00ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e00ca3a0 0x7f91e00ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 -- 172.21.15.143:0/3088076788 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4009420 con 0x7f91e00b25e0 2023-11-24T06:29:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91ddd9b640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e00cebf0 0x7f91e00cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:47.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62e80aa460 con 0x7f62ec0b30f0 2023-11-24T06:29:47.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f67459aa640 1 -- 172.21.15.143:0/3473004884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67400d1fb0 msgr2=0x7f67400b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f67459aa640 1 --2- 172.21.15.143:0/3473004884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67400d1fb0 0x7f67400b2040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f674008c8f0 tx=0x7f673001f1c0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f2c88df1640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7f2c7006e640 0x7f2c70070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b1804640 1 -- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63980053e0 msgr2=0x7f639800ba40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:29:47.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f67459aa640 1 -- 172.21.15.143:0/3473004884 shutdown_connections 2023-11-24T06:29:47.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83480b0bd0 0x7f8348151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480c31e0 0x7f83480b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b1804640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63980053e0 0x7f639800ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b1804640 1 -- 172.21.15.143:0/323728526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63980047d0 msgr2=0x7f6398004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b1804640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63980047d0 0x7f6398004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8348165eb0 0x7f83480c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b1804640 1 -- 172.21.15.143:0/323728526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398003530 con 0x7f63980039d0 2023-11-24T06:29:47.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83480b3360 con 0x7f83480b0bd0 2023-11-24T06:29:47.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83480b3640 con 0x7f8348165eb0 2023-11-24T06:29:47.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f834e268640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83480b3920 con 0x7f83480c31e0 2023-11-24T06:29:47.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91ded9d640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e00ca3a0 0x7f91e00ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f67459aa640 1 --2- 172.21.15.143:0/3473004884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67400d1fb0 0x7f67400b2040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f67459aa640 1 --2- 172.21.15.143:0/3473004884 >> v2:172.21.15.143:3300/0 conn(0x7f674015d950 0x7f67400d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f67459aa640 1 -- 172.21.15.143:0/3473004884 >> 172.21.15.143:0/3473004884 conn(0x7f674009c7c0 msgr2=0x7f67400d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f91de59c640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00b25e0 0x7f91e015c980 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c410 tx=0x7f91d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f834c805640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8348165eb0 0x7f83480c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f834c805640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8348165eb0 0x7f83480c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42850/0 (socket says 172.21.15.143:42850) 2023-11-24T06:29:47.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f834c805640 1 -- 172.21.15.143:0/629373238 learned_addr learned my addr 172.21.15.143:0/629373238 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83480b0bd0 0x7f8348151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f63b2005640 1 -- 172.21.15.143:0/323728526 reap_dead start 2023-11-24T06:29:47.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f67459aa640 1 -- 172.21.15.143:0/3473004884 shutdown_connections 2023-11-24T06:29:47.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f83477fe640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480c31e0 0x7f83480b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== osd.0 v2:172.21.15.143:6800/1164316575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2c70071110 con 0x7f2c7006e640 2023-11-24T06:29:47.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f1577fff640 1 -- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1564005190 msgr2=0x7f156400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f1577fff640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1564005190 0x7f156400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f1577fff640 1 -- 172.21.15.143:0/3169392609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15640047d0 msgr2=0x7f1564004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f1577fff640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15640047d0 0x7f1564004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.118+0000 7f1577fff640 1 -- 172.21.15.143:0/3169392609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564003530 con 0x7f1564003a00 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62e27fc640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f62d0066540 0x7f62d0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62e8126c30 con 0x7f62ec0b30f0 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62e27fc640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7f62d006e760 0x7f62d0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62d0071230 con 0x7f62d006e760 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62e8126fe0 con 0x7f62ec0b30f0 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62f14d9640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f62d0066540 0x7f62d0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62f24db640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7f62d006e760 0x7f62d0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62f14d9640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f62d0066540 0x7f62d0068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0af0c0 tx=0x7f62dc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62f24db640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7f62d006e760 0x7f62d0070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 -- 172.21.15.143:0/629373238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480c31e0 msgr2=0x7f83480b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480c31e0 0x7f83480b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 -- 172.21.15.143:0/629373238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8348165eb0 msgr2=0x7f83480c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8348165eb0 0x7f83480c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 -- 172.21.15.143:0/629373238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340009b30 con 0x7f83480b0bd0 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0005cf0 con 0x7f91e00b25e0 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0005e50 con 0x7f91e00b25e0 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00cbe60 con 0x7f91e00b25e0 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0007310 con 0x7f91e00b25e0 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e015cec0 con 0x7f91e00b25e0 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f67459aa640 1 -- 172.21.15.143:0/3473004884 wait complete. 2023-11-24T06:29:47.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f67459aa640 1 Processor -- start 2023-11-24T06:29:47.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f8347fff640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83480b0bd0 0x7f8348151d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c400 tx=0x7f833c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f1577fff640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f1564003de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1568009bc0 tx=0x7f156801cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67f2cd3c4b36ba36 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== osd.2 v2:172.21.15.143:6824/1592203571 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f62d0071230 con 0x7f62d006e760 2023-11-24T06:29:47.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.122+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91e00d40f0 con 0x7f91e00b25e0 2023-11-24T06:29:47.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f67459aa640 1 -- start start 2023-11-24T06:29:47.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680a5730 con 0x7f1564003a00 2023-11-24T06:29:47.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15680a5890 con 0x7f1564003a00 2023-11-24T06:29:47.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f1576ffd640 1 -- 172.21.15.143:0/3169392609 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680a5730 con 0x7f1564003a00 2023-11-24T06:29:47.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b1804640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f6398003dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f639c013950 tx=0x7f639c0257d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6cfa81cfb1b2e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0052d0 con 0x7f83480b0bd0 2023-11-24T06:29:47.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c005430 con 0x7f83480b0bd0 2023-11-24T06:29:47.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c003840 con 0x7f83480b0bd0 2023-11-24T06:29:47.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83480b3c00 con 0x7f83480b0bd0 2023-11-24T06:29:47.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83481522c0 con 0x7f83480b0bd0 2023-11-24T06:29:47.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 msgr2=0x7f1564003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157e357640 1 --2- 172.21.15.143:0/3169392609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f1564003de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1568009bc0 tx=0x7f156801cb50 comp rx=0 tx=0).stop 2023-11-24T06:29:47.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157c8f4640 1 -- 172.21.15.143:0/3169392609 reap_dead start 2023-11-24T06:29:47.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 shutdown_connections 2023-11-24T06:29:47.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 >> 172.21.15.143:0/3169392609 conn(0x7f157808ceb0 msgr2=0x7f157809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0ae7c0 con 0x7f63980039d0 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c0ae920 con 0x7f63980039d0 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b0802640 1 -- 172.21.15.143:0/323728526 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0aed10 con 0x7f63980039d0 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b3a68640 1 -- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 msgr2=0x7f6398003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b3a68640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f6398003dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f639c013950 tx=0x7f639c0257d0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b3a68640 1 -- 172.21.15.143:0/323728526 shutdown_connections 2023-11-24T06:29:47.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b3a68640 1 --2- 172.21.15.143:0/323728526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f6398003dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f63b3a68640 1 -- 172.21.15.143:0/323728526 >> 172.21.15.143:0/323728526 conn(0x7f63ac0b0bf0 msgr2=0x7f63ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f67459aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67400d1fb0 0x7f674009e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 shutdown_connections 2023-11-24T06:29:47.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f157e357640 1 -- 172.21.15.143:0/3169392609 wait complete. 2023-11-24T06:29:47.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f67459aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f674015d570 0x7f674009e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f67459aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f674015d950 0x7f674009d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f67459aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400b6340 con 0x7f674015d950 2023-11-24T06:29:47.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f67459aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400b6620 con 0x7f674015d570 2023-11-24T06:29:47.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f67459aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400b6900 con 0x7f67400d1fb0 2023-11-24T06:29:47.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 Processor -- start 2023-11-24T06:29:47.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f63b3a68640 1 -- 172.21.15.143:0/323728526 shutdown_connections 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67400d1fb0 0x7f674009e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f674015d570 0x7f674009e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67400d1fb0 0x7f674009e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:58124/0 (socket says 172.21.15.143:58124) 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f674015d570 0x7f674009e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42856/0 (socket says 172.21.15.143:42856) 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 -- 172.21.15.143:0/628096315 learned_addr learned my addr 172.21.15.143:0/628096315 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 -- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f674015d570 msgr2=0x7f674009e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f674015d570 0x7f674009e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 -- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f674015d950 msgr2=0x7f674009d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f674015d950 0x7f674009d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f673effd640 1 -- 172.21.15.143:0/628096315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730009b30 con 0x7f67400d1fb0 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.126+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91d0007470 con 0x7f91e00b25e0 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f91ceffd640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91c0066570 0x7f91c0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91d0083a70 con 0x7f91e00b25e0 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f91ceffd640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7f91c006e790 0x7f91c0070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 --> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91c0071260 con 0x7f91c006e790 2023-11-24T06:29:47.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d0083e20 con 0x7f91e00b25e0 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8328000fd0 con 0x7f83480b0bd0 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 -- start start 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade415d570 0x7fade406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fade40ce8b0 0x7fade40ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade40d1cc0 con 0x7fade40d3020 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade40d1fa0 con 0x7fade40ce8b0 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fadeb89a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade40ce0b0 con 0x7fade415d570 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade8e35640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fade40d3020 0x7fade40d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45294/0 (socket says 172.21.15.143:45294) 2023-11-24T06:29:47.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade9636640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade415d570 0x7fade406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade8e35640 1 -- 172.21.15.143:0/3818833508 learned_addr learned my addr 172.21.15.143:0/3818833508 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade9e37640 1 --2- 172.21.15.143:0/3818833508 >> v2:172.21.15.146:3300/0 conn(0x7fade40ce8b0 0x7fade40ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f157e357640 1 Processor -- start 2023-11-24T06:29:47.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f157e357640 1 -- start start 2023-11-24T06:29:47.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f63b3a68640 1 -- 172.21.15.143:0/323728526 wait complete. 2023-11-24T06:29:47.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7f63b3a68640 1 Processor -- start 2023-11-24T06:29:47.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f673e7fc640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f674015d570 0x7f674009e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-24T06:29:47.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade9636640 1 -- 172.21.15.143:0/3818833508 >> v2:172.21.15.146:3300/0 conn(0x7fade40ce8b0 msgr2=0x7fade40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade9636640 1 --2- 172.21.15.143:0/3818833508 >> v2:172.21.15.146:3300/0 conn(0x7fade40ce8b0 0x7fade40ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade9636640 1 -- 172.21.15.143:0/3818833508 >> v1:172.21.15.146:6789/0 conn(0x7fade40d3020 legacy=0x7fade40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.130+0000 7fade9636640 1 -- 172.21.15.143:0/3818833508 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40ce390 con 0x7fade415d570 2023-11-24T06:29:47.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f673effd640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67400d1fb0 0x7f674009e0a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f673800c500 tx=0x7f673800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738005220 con 0x7f67400d1fb0 2023-11-24T06:29:47.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738005380 con 0x7f67400d1fb0 2023-11-24T06:29:47.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738007270 con 0x7f67400d1fb0 2023-11-24T06:29:47.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f91ded9d640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7f91c006e790 0x7f91c0070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f91ddd9b640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91c0066570 0x7f91c0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f15781f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f157815dc50 0x7f157815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f63b3a68640 1 -- start start 2023-11-24T06:29:47.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f157815f930 0x7f157815fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f15781f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f15781f76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:42886/0 (socket says 172.21.15.143:42886) 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 -- 172.21.15.143:0/2473733948 learned_addr learned my addr 172.21.15.143:0/2473733948 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780b6410 con 0x7f157815f930 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15781608b0 con 0x7f1564003a00 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15780b7200 con 0x7f157815dc50 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f15777fe640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f157815dc50 0x7f157815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 -- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f157815dc50 msgr2=0x7f157815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f157815dc50 0x7f157815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 -- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f157815f930 msgr2=0x7f157815fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f157815f930 0x7f157815fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780b65f0 con 0x7f1564003a00 2023-11-24T06:29:47.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7fade9636640 1 --2- 172.21.15.143:0/3818833508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade415d570 0x7fade406b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadd80097c0 tx=0x7fadd801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=988099da63e9b0a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400b6be0 con 0x7f67400d1fb0 2023-11-24T06:29:47.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f63b3a68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f63ac0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67400b5ff0 con 0x7f67400d1fb0 2023-11-24T06:29:47.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7fadd7fff640 1 -- 172.21.15.143:0/3818833508 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80ab660 con 0x7fade415d570 2023-11-24T06:29:47.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7fadd7fff640 1 -- 172.21.15.143:0/3818833508 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd80ab7c0 con 0x7fade415d570 2023-11-24T06:29:47.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7fadd7fff640 1 -- 172.21.15.143:0/3818833508 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80abb50 con 0x7fade415d570 2023-11-24T06:29:47.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1577fff640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f15781f76e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1568000c10 tx=0x7f1564005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680a5730 con 0x7f1564003a00 2023-11-24T06:29:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f63b3a68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63ac09a260 0x7f63ac202fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f91ded9d640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7f91c006e790 0x7f91c0070bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1568004020 con 0x7f1564003a00 2023-11-24T06:29:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680043d0 con 0x7f1564003a00 2023-11-24T06:29:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15780b68d0 con 0x7f1564003a00 2023-11-24T06:29:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.134+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15780b6e90 con 0x7f1564003a00 2023-11-24T06:29:47.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f91ddd9b640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91c0066570 0x7f91c0068a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91d40097c0 tx=0x7f91d40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 -- 172.21.15.143:0/3818833508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade415d570 msgr2=0x7fade406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15780c6b70 con 0x7f1564003a00 2023-11-24T06:29:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 --2- 172.21.15.143:0/3818833508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade415d570 0x7fade406b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadd80097c0 tx=0x7fadd801c480 comp rx=0 tx=0).stop 2023-11-24T06:29:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 -- 172.21.15.143:0/3818833508 shutdown_connections 2023-11-24T06:29:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 --2- 172.21.15.143:0/3818833508 >> v2:172.21.15.146:3300/0 conn(0x7fade40ce8b0 0x7fade40ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 --2- 172.21.15.143:0/3818833508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade415d570 0x7fade406b9d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 -- 172.21.15.143:0/3818833508 >> 172.21.15.143:0/3818833508 conn(0x7fade408ceb0 msgr2=0x7fade409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67400ced90 con 0x7f67400d1fb0 2023-11-24T06:29:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 -- 172.21.15.143:0/3818833508 shutdown_connections 2023-11-24T06:29:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 -- 172.21.15.143:0/3818833508 wait complete. 2023-11-24T06:29:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f833c0039a0 con 0x7f83480b0bd0 2023-11-24T06:29:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f8344ff9640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8334066540 0x7f8334068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67380073d0 con 0x7f67400d1fb0 2023-11-24T06:29:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== osd.1 v2:172.21.15.143:6808/3921027021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f91c0071260 con 0x7f91c006e790 2023-11-24T06:29:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f83477fe640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8334066540 0x7f8334068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15680b4040 con 0x7f1564003a00 2023-11-24T06:29:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f6727fff640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f672c066540 0x7f672c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 Processor -- start 2023-11-24T06:29:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7fadeb89a640 1 -- start start 2023-11-24T06:29:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f833c083350 con 0x7f83480b0bd0 2023-11-24T06:29:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f83477fe640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8334066540 0x7f8334068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83400ae000 tx=0x7f83400a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b3a68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63ac158730 0x7f63ac158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b3a68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac1590f0 con 0x7f63ac09a260 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63ac09a260 0x7f63ac202fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1804640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f63ac0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63ac09a260 0x7f63ac202fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46568/0 (socket says 172.21.15.143:46568) 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1804640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f63ac0c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:58146/0 (socket says 172.21.15.143:58146) 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 -- 172.21.15.143:0/1365584792 learned_addr learned my addr 172.21.15.143:0/1365584792 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac0c72a0 con 0x7f63ac158730 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac0c6720 con 0x7f63980039d0 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 -- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 msgr2=0x7f63ac0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63980039d0 0x7f63ac0c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 -- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63ac158730 msgr2=0x7f63ac158bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63ac158730 0x7f63ac158bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0c6a00 con 0x7f63ac09a260 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.138+0000 7f63b1003640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63ac09a260 0x7f63ac202fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c3c0 tx=0x7f63a800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a8003600 con 0x7f63ac09a260 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac0c6ce0 con 0x7f63ac09a260 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac09a6e0 con 0x7f63ac09a260 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a8003760 con 0x7f63ac09a260 2023-11-24T06:29:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a8003b30 con 0x7f63ac09a260 2023-11-24T06:29:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f8344ff9640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f833406e760 0x7f8334070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 --> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8334071230 con 0x7f833406e760 2023-11-24T06:29:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f833c085970 con 0x7f83480b0bd0 2023-11-24T06:29:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f673e7fc640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f672c066540 0x7f672c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67380837c0 con 0x7f67400d1fb0 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fadeb89a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fade40ce8b0 0x7fade4151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fadeb89a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade40d3020 0x7fade41526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fadeb89a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fade415d570 0x7fade40b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fadeb89a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40b73f0 con 0x7fade415d570 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fadeb89a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade41524a0 con 0x7fade40ce8b0 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fadeb89a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade4153030 con 0x7fade40d3020 2023-11-24T06:29:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f6727fff640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7f672c06e760 0x7f672c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 --> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f672c071230 con 0x7f672c06e760 2023-11-24T06:29:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6738085de0 con 0x7f67400d1fb0 2023-11-24T06:29:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6394000fd0 con 0x7f63ac09a260 2023-11-24T06:29:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fade415d570 0x7fade40b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fade415d570 0x7fade40b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:46584/0 (socket says 172.21.15.143:46584) 2023-11-24T06:29:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 -- 172.21.15.143:0/1720083257 learned_addr learned my addr 172.21.15.143:0/1720083257 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f834c805640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f833406e760 0x7f8334070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f673f7fe640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7f672c06e760 0x7f672c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 -- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade40d3020 msgr2=0x7fade41526e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T06:29:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fade40d3020 0x7fade41526e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 -- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fade40ce8b0 msgr2=0x7fade4151f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T06:29:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fade40ce8b0 0x7fade4151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f673e7fc640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f672c066540 0x7f672c068a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f674015e040 tx=0x7f6734008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 -- 172.21.15.143:0/1720083257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8009420 con 0x7fade415d570 2023-11-24T06:29:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f834c805640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f833406e760 0x7f8334070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7f1574ff9640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15580664f0 0x7f15580689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15680ef740 con 0x7f1564003a00 2023-11-24T06:29:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f673f7fe640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7f672c06e760 0x7f672c070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.142+0000 7fade9e37640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fade415d570 0x7fade40b2e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faddc009d20 tx=0x7faddc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f15777fe640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15580664f0 0x7f15580689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f1574ff9640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f155806e710 0x7f1558070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15580711e0 con 0x7f155806e710 2023-11-24T06:29:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00ced0 con 0x7fade415d570 2023-11-24T06:29:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc00f040 con 0x7fade415d570 2023-11-24T06:29:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc0146c0 con 0x7fade415d570 2023-11-24T06:29:47.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1568004530 con 0x7f1564003a00 2023-11-24T06:29:47.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== osd.3 v2:172.21.15.143:6816/2880360154 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8334071230 con 0x7f833406e760 2023-11-24T06:29:47.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade4153310 con 0x7fade415d570 2023-11-24T06:29:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f157c8f4640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f155806e710 0x7f1558070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f15777fe640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15580664f0 0x7f15580689b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1560001ec0 tx=0x7f15600089f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f157c8f4640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f155806e710 0x7f1558070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63a8003c90 con 0x7f63ac09a260 2023-11-24T06:29:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== osd.6 v2:172.21.15.146:6824/2587602061 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f672c071230 con 0x7f672c06e760 2023-11-24T06:29:47.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade41538d0 con 0x7fade415d570 2023-11-24T06:29:47.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== osd.4 v2:172.21.15.146:6801/3450437685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f15580711e0 con 0x7f155806e710 2023-11-24T06:29:47.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f63a27fc640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066570 0x7f6390068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.146+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63a8083e60 con 0x7f63ac09a260 2023-11-24T06:29:47.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fade40b2a80 con 0x7fade415d570 2023-11-24T06:29:47.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63a27fc640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f639006e790 0x7f6390070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faddc014820 con 0x7fade415d570 2023-11-24T06:29:47.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6390071260 con 0x7f639006e790 2023-11-24T06:29:47.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63a8084210 con 0x7f63ac09a260 2023-11-24T06:29:47.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63b2005640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f639006e790 0x7f6390070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63b2005640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f639006e790 0x7f6390070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 --> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62c8002cc0 con 0x7f62d006e760 2023-11-24T06:29:47.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadd5ffb640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fadc8066540 0x7fadc8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faddc086d30 con 0x7fade415d570 2023-11-24T06:29:47.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadd5ffb640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fadc806e5f0 0x7fadc8070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 --> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadc80710c0 con 0x7fadc806e5f0 2023-11-24T06:29:47.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faddc089210 con 0x7fade415d570 2023-11-24T06:29:47.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fade8e35640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fadc806e5f0 0x7fadc8070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63b1804640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066570 0x7f6390068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 --> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c841fa950 con 0x7f2c7006e640 2023-11-24T06:29:47.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fade9636640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fadc8066540 0x7fadc8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== osd.5 v2:172.21.15.146:6816/714537045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6390071260 con 0x7f639006e790 2023-11-24T06:29:47.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7fade8e35640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fadc806e5f0 0x7fadc8070a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.150+0000 7f62e27fc640 1 -- 172.21.15.143:0/2782578669 <== osd.2 v2:172.21.15.143:6824/1592203571 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62c8002cc0 con 0x7f62d006e760 2023-11-24T06:29:47.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== osd.7 v2:172.21.15.146:6800/2932726112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fadc80710c0 con 0x7fadc806e5f0 2023-11-24T06:29:47.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f2c80ff9640 1 -- 172.21.15.143:0/1614495822 <== osd.0 v2:172.21.15.143:6800/1164316575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c841fa950 con 0x7f2c7006e640 2023-11-24T06:29:47.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7f62d006e760 msgr2=0x7f62d0070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7f62d006e760 0x7f62d0070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f63b1804640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066570 0x7f6390068a30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f639c0b7000 tx=0x7f639c006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7fade9636640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fadc8066540 0x7fadc8068a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f62d0066540 msgr2=0x7f62d0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f62d0066540 0x7f62d0068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0af0c0 tx=0x7f62dc00b040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec0b30f0 msgr2=0x7f62ec0affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 --2- 172.21.15.143:0/2782578669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ec0b30f0 0x7f62ec0affe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f62e801b0b0 tx=0x7f62e801a220 comp rx=0 tx=0).stop 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62f24db640 1 -- 172.21.15.143:0/2782578669 reap_dead start 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 shutdown_connections 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.154+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 >> 172.21.15.143:0/2782578669 conn(0x7f62ec06ae90 msgr2=0x7f62ec0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7f2c7006e640 msgr2=0x7f2c70070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7f2c7006e640 0x7f2c70070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2c700664a0 msgr2=0x7f2c70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2c700664a0 0x7f2c70068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c780ad000 tx=0x7f2c780a6000 comp rx=0 tx=0).stop 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c840b2720 msgr2=0x7f2c84160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 --2- 172.21.15.143:0/1614495822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c840b2720 0x7f2c84160870 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00cba0 tx=0x7f2c7c00a430 comp rx=0 tx=0).stop 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c88df1640 1 -- 172.21.15.143:0/1614495822 reap_dead start 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 shutdown_connections 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 >> 172.21.15.143:0/1614495822 conn(0x7f2c8406ae90 msgr2=0x7f2c840af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 shutdown_connections 2023-11-24T06:29:47.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 shutdown_connections 2023-11-24T06:29:47.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f2c8a854640 1 -- 172.21.15.143:0/1614495822 wait complete. 2023-11-24T06:29:47.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.158+0000 7f62cffff640 1 -- 172.21.15.143:0/2782578669 wait complete. 2023-11-24T06:29:47.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 --> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f157806bf10 con 0x7f155806e710 2023-11-24T06:29:47.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f1574ff9640 1 -- 172.21.15.143:0/2473733948 <== osd.4 v2:172.21.15.146:6801/3450437685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f157000f040 con 0x7f155806e710 2023-11-24T06:29:47.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f155806e710 msgr2=0x7f1558070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f155806e710 0x7f1558070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15580664f0 msgr2=0x7f15580689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15580664f0 0x7f15580689b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1560001ec0 tx=0x7f15600089f0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 msgr2=0x7f15781f76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 --2- 172.21.15.143:0/2473733948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1564003a00 0x7f15781f76e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1568000c10 tx=0x7f1564005800 comp rx=0 tx=0).stop 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157c8f4640 1 -- 172.21.15.143:0/2473733948 reap_dead start 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 shutdown_connections 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 >> 172.21.15.143:0/2473733948 conn(0x7f157808ceb0 msgr2=0x7f15780b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 shutdown_connections 2023-11-24T06:29:47.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f157e357640 1 -- 172.21.15.143:0/2473733948 wait complete. 2023-11-24T06:29:47.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.170+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 --> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91e00cbce0 con 0x7f91c006e790 2023-11-24T06:29:47.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91ceffd640 1 -- 172.21.15.143:0/3088076788 <== osd.1 v2:172.21.15.143:6808/3921027021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91d8001c40 con 0x7f91c006e790 2023-11-24T06:29:47.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7f91c006e790 msgr2=0x7f91c0070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7f91c006e790 0x7f91c0070bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91c0066570 msgr2=0x7f91c0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91c0066570 0x7f91c0068a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91d40097c0 tx=0x7f91d40a6000 comp rx=0 tx=0).stop 2023-11-24T06:29:47.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 --> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67400ceab0 con 0x7f672c06e760 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00b25e0 msgr2=0x7f91e015c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 --2- 172.21.15.143:0/3088076788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e00b25e0 0x7f91e015c980 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c410 tx=0x7f91d000c8d0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91ded9d640 1 -- 172.21.15.143:0/3088076788 reap_dead start 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 shutdown_connections 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.174+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 >> 172.21.15.143:0/3088076788 conn(0x7f91e008cd00 msgr2=0x7f91e00aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 shutdown_connections 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f91e4a79640 1 -- 172.21.15.143:0/3088076788 wait complete. 2023-11-24T06:29:47.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 --> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8328002cc0 con 0x7f833406e760 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f6727fff640 1 -- 172.21.15.143:0/628096315 <== osd.6 v2:172.21.15.146:6824/2587602061 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6730009190 con 0x7f672c06e760 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7f672c06e760 msgr2=0x7f672c070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7f672c06e760 0x7f672c070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f672c066540 msgr2=0x7f672c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f672c066540 0x7f672c068a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f674015e040 tx=0x7f6734008040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67400d1fb0 msgr2=0x7f674009e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 --2- 172.21.15.143:0/628096315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67400d1fb0 0x7f674009e0a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f673800c500 tx=0x7f673800c9c0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f673f7fe640 1 -- 172.21.15.143:0/628096315 reap_dead start 2023-11-24T06:29:47.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 shutdown_connections 2023-11-24T06:29:47.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 >> 172.21.15.143:0/628096315 conn(0x7f674009c7c0 msgr2=0x7f674006c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 shutdown_connections 2023-11-24T06:29:47.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.178+0000 7f67459aa640 1 -- 172.21.15.143:0/628096315 wait complete. 2023-11-24T06:29:47.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 --> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fade40d17e0 con 0x7fadc806e5f0 2023-11-24T06:29:47.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 --> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6394002cc0 con 0x7f639006e790 2023-11-24T06:29:47.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadd5ffb640 1 -- 172.21.15.143:0/1720083257 <== osd.7 v2:172.21.15.146:6800/2932726112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fade00058c0 con 0x7fadc806e5f0 2023-11-24T06:29:47.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f8344ff9640 1 -- 172.21.15.143:0/629373238 <== osd.3 v2:172.21.15.143:6816/2880360154 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8328002cc0 con 0x7f833406e760 2023-11-24T06:29:47.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f833406e760 msgr2=0x7f8334070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f833406e760 0x7f8334070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fadc806e5f0 msgr2=0x7fadc8070a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fadc806e5f0 0x7fadc8070a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8334066540 msgr2=0x7f8334068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8334066540 0x7f8334068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83400ae000 tx=0x7f83400a7070 comp rx=0 tx=0).stop 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83480b0bd0 msgr2=0x7f8348151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 --2- 172.21.15.143:0/629373238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83480b0bd0 0x7f8348151d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c400 tx=0x7f833c00c8c0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834c805640 1 -- 172.21.15.143:0/629373238 reap_dead start 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 shutdown_connections 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 >> 172.21.15.143:0/629373238 conn(0x7f83480d0210 msgr2=0x7f83480ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fadc8066540 msgr2=0x7fadc8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fadc8066540 0x7fadc8068a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd8004740 comp rx=0 tx=0).stop 2023-11-24T06:29:47.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fade415d570 msgr2=0x7fade40b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 --2- 172.21.15.143:0/1720083257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fade415d570 0x7fade40b2e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faddc009d20 tx=0x7faddc00c490 comp rx=0 tx=0).stop 2023-11-24T06:29:47.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f63a27fc640 1 -- 172.21.15.143:0/1365584792 <== osd.5 v2:172.21.15.146:6816/714537045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6394002cc0 con 0x7f639006e790 2023-11-24T06:29:47.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fade9e37640 1 -- 172.21.15.143:0/1720083257 reap_dead start 2023-11-24T06:29:47.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 shutdown_connections 2023-11-24T06:29:47.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 >> 172.21.15.143:0/1720083257 conn(0x7fade408ceb0 msgr2=0x7fade406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 shutdown_connections 2023-11-24T06:29:47.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7f834e268640 1 -- 172.21.15.143:0/629373238 wait complete. 2023-11-24T06:29:47.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.182+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 shutdown_connections 2023-11-24T06:29:47.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7fadeb89a640 1 -- 172.21.15.143:0/1720083257 wait complete. 2023-11-24T06:29:47.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f639006e790 msgr2=0x7f6390070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f639006e790 0x7f6390070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066570 msgr2=0x7f6390068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066570 0x7f6390068a30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f639c0b7000 tx=0x7f639c006040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63ac09a260 msgr2=0x7f63ac202fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 --2- 172.21.15.143:0/1365584792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63ac09a260 0x7f63ac202fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c3c0 tx=0x7f63a800c7c0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b2005640 1 -- 172.21.15.143:0/1365584792 reap_dead start 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 shutdown_connections 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.186+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 >> 172.21.15.143:0/1365584792 conn(0x7f63ac0b0bf0 msgr2=0x7f63ac0af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.190+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 shutdown_connections 2023-11-24T06:29:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.190+0000 7f63b3a68640 1 -- 172.21.15.143:0/1365584792 wait complete. 2023-11-24T06:29:47.213 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:47.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:29:47.214 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2023-11-24T06:29:47.214 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:29:47.217 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:47.217 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:47.218 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:29:47.218 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:29:47.225 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2023-11-24T06:29:47.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:29:47.234 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:47.234 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:29:47.236 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:47.236 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:29:47.240 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:47.240 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:29:47.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.442+0000 7fd13c357640 1 Processor -- start 2023-11-24T06:29:47.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13c357640 1 -- start start 2023-11-24T06:29:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13c357640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd13415d570 0x7fd13406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13a0f3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd13415d570 0x7fd13406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13a0f3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd13415d570 0x7fd13406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:46990/0 (socket says 172.21.15.143:46990) 2023-11-24T06:29:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13a0f3640 1 -- 172.21.15.143:0/1079217696 learned_addr learned my addr 172.21.15.143:0/1079217696 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340d1cc0 con 0x7fd1340d3020 2023-11-24T06:29:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340d1fa0 con 0x7fd1340ce8b0 2023-11-24T06:29:47.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.446+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1340ce0b0 con 0x7fd13415d570 2023-11-24T06:29:47.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.450+0000 7fd13a0f3640 1 -- 172.21.15.143:0/1079217696 >> v1:172.21.15.146:6789/0 conn(0x7fd1340ce8b0 legacy=0x7fd1340ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.450+0000 7fd13a0f3640 1 -- 172.21.15.143:0/1079217696 >> v1:172.21.15.143:6789/0 conn(0x7fd1340d3020 legacy=0x7fd1340d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.450+0000 7fd13a0f3640 1 -- 172.21.15.143:0/1079217696 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340ce390 con 0x7fd13415d570 2023-11-24T06:29:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.454+0000 7fd13a0f3640 1 --2- 172.21.15.143:0/1079217696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13415d570 0x7fd13406b9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd130009870 tx=0x7fd13001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc97a01c9adb36e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.454+0000 7fd1390f1640 1 -- 172.21.15.143:0/1079217696 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300ab650 con 0x7fd13415d570 2023-11-24T06:29:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.454+0000 7fd1390f1640 1 -- 172.21.15.143:0/1079217696 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300ab7b0 con 0x7fd13415d570 2023-11-24T06:29:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.454+0000 7fd1390f1640 1 -- 172.21.15.143:0/1079217696 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300abb40 con 0x7fd13415d570 2023-11-24T06:29:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13415d570 msgr2=0x7fd13406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 --2- 172.21.15.143:0/1079217696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13415d570 0x7fd13406b9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd130009870 tx=0x7fd13001c560 comp rx=0 tx=0).stop 2023-11-24T06:29:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 shutdown_connections 2023-11-24T06:29:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 --2- 172.21.15.143:0/1079217696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13415d570 0x7fd13406b9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 >> 172.21.15.143:0/1079217696 conn(0x7fd13408ceb0 msgr2=0x7fd13409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 shutdown_connections 2023-11-24T06:29:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 -- 172.21.15.143:0/1079217696 wait complete. 2023-11-24T06:29:47.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.458+0000 7fd13c357640 1 Processor -- start 2023-11-24T06:29:47.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 -- start start 2023-11-24T06:29:47.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7f6e3677d640 1 Processor -- start 2023-11-24T06:29:47.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7f6e3677d640 1 -- start start 2023-11-24T06:29:47.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 0x7fd1340cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1340d3020 0x7fd1340b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13415d570 0x7fd1340b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340cd5c0 con 0x7fd1340ce8b0 2023-11-24T06:29:47.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340b6f00 con 0x7fd1340d3020 2023-11-24T06:29:47.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13c357640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340b7180 con 0x7fd13415d570 2023-11-24T06:29:47.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 0x7fd1340cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 0x7fd1340cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37270/0 (socket says 172.21.15.143:37270) 2023-11-24T06:29:47.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 -- 172.21.15.143:0/175647493 learned_addr learned my addr 172.21.15.143:0/175647493 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd1398f2640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1340d3020 0x7fd1340b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 -- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13415d570 msgr2=0x7fd1340b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13415d570 0x7fd1340b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 -- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1340d3020 msgr2=0x7fd1340b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1340d3020 0x7fd1340b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 -- 172.21.15.143:0/175647493 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300094d0 con 0x7fd1340ce8b0 2023-11-24T06:29:47.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd1398f2640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1340d3020 0x7fd1340b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.462+0000 7fd13a0f3640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 0x7fd1340cd080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd130019170 tx=0x7fd13001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3677d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e280df280 0x7f6e2804fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3677d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28007520 0x7f6e2804ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3677d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e280540f0 con 0x7f6e28033cd0 2023-11-24T06:29:47.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3677d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e28038060 con 0x7f6e280df280 2023-11-24T06:29:47.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3677d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280df660 con 0x7f6e28007520 2023-11-24T06:29:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b4800 con 0x7fd1340ce8b0 2023-11-24T06:29:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300b4980 con 0x7fd1340ce8b0 2023-11-24T06:29:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b4d30 con 0x7fd1340ce8b0 2023-11-24T06:29:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3577b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e280df280 0x7f6e2804fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e34f7a640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6e28033cd0 0x7f6e280e2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:42310/0 (socket says 172.21.15.143:42310) 2023-11-24T06:29:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e34f7a640 1 -- 172.21.15.143:0/1600576743 learned_addr learned my addr 172.21.15.143:0/1600576743 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e3577b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e280df280 0x7f6e2804fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47016/0 (socket says 172.21.15.143:47016) 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e35f7c640 1 --2- 172.21.15.143:0/1600576743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28007520 0x7f6e2804ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e27fff640 1 -- 172.21.15.143:0/1600576743 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386126488 0 0) 0x7f6e280540f0 con 0x7f6e28033cd0 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e27fff640 1 -- 172.21.15.143:0/1600576743 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e1c003530 con 0x7f6e28033cd0 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1340b7460 con 0x7fd1340ce8b0 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1340b7a20 con 0x7fd1340ce8b0 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e35f7c640 1 -- 172.21.15.143:0/1600576743 >> v2:172.21.15.146:3300/0 conn(0x7f6e280df280 msgr2=0x7f6e2804fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e35f7c640 1 --2- 172.21.15.143:0/1600576743 >> v2:172.21.15.146:3300/0 conn(0x7f6e280df280 0x7f6e2804fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e35f7c640 1 -- 172.21.15.143:0/1600576743 >> v1:172.21.15.146:6789/0 conn(0x7f6e28033cd0 legacy=0x7f6e280e2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7f6e35f7c640 1 -- 172.21.15.143:0/1600576743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280543d0 con 0x7f6e28007520 2023-11-24T06:29:47.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.466+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13404e930 con 0x7fd1340ce8b0 2023-11-24T06:29:47.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1300b3380 con 0x7fd1340ce8b0 2023-11-24T06:29:47.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7f6e35f7c640 1 --2- 172.21.15.143:0/1600576743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28007520 0x7f6e2804ffb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e300501f0 tx=0x7f6e3009b0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b060dd8e8d62b8cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7f816c194640 1 Processor -- start 2023-11-24T06:29:47.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7f6e27fff640 1 -- 172.21.15.143:0/1600576743 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3012a600 con 0x7f6e28007520 2023-11-24T06:29:47.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7f6e27fff640 1 -- 172.21.15.143:0/1600576743 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30126050 con 0x7f6e28007520 2023-11-24T06:29:47.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7f6e27fff640 1 -- 172.21.15.143:0/1600576743 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3012aa60 con 0x7f6e28007520 2023-11-24T06:29:47.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7f816c194640 1 -- start start 2023-11-24T06:29:47.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b68879640 1 Processor -- start 2023-11-24T06:29:47.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 -- 172.21.15.143:0/1600576743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28007520 msgr2=0x7f6e2804ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 --2- 172.21.15.143:0/1600576743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28007520 0x7f6e2804ffb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e300501f0 tx=0x7f6e3009b0f0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b68879640 1 -- start start 2023-11-24T06:29:47.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 -- 172.21.15.143:0/1600576743 shutdown_connections 2023-11-24T06:29:47.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 --2- 172.21.15.143:0/1600576743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28007520 0x7f6e2804ffb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816c194640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f816415d570 0x7f816406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816c194640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f81640d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816c194640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81640ce8b0 0x7f81640ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 --2- 172.21.15.143:0/1600576743 >> v2:172.21.15.146:3300/0 conn(0x7f6e280df280 0x7f6e2804fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 -- 172.21.15.143:0/1600576743 >> 172.21.15.143:0/1600576743 conn(0x7f6e28009f90 msgr2=0x7f6e2800a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816c194640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640d39c0 con 0x7f816415d570 2023-11-24T06:29:47.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816c194640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640d1cc0 con 0x7f81640ce8b0 2023-11-24T06:29:47.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816c194640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81640d1fa0 con 0x7f81640d3020 2023-11-24T06:29:47.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 -- 172.21.15.143:0/1600576743 shutdown_connections 2023-11-24T06:29:47.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816a731640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81640ce8b0 0x7f81640ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816a731640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81640ce8b0 0x7f81640ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47028/0 (socket says 172.21.15.143:47028) 2023-11-24T06:29:47.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816a731640 1 -- 172.21.15.143:0/1737051339 learned_addr learned my addr 172.21.15.143:0/1737051339 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b68879640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b640ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b68879640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1b6406d040 0x7f1b640ac520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f78ae6ea640 1 Processor -- start 2023-11-24T06:29:47.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.470+0000 7fd12affd640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1180664c0 0x7fd118068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f816a731640 1 -- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 msgr2=0x7f81640d3480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:29:47.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f78ae6ea640 1 -- start start 2023-11-24T06:29:47.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b68879640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640c9650 con 0x7f1b6415d570 2023-11-24T06:29:47.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7fd1398f2640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1180664c0 0x7fd118068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b68879640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640c98a0 con 0x7f1b6406d040 2023-11-24T06:29:47.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b62d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1b6406d040 0x7f1b640ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f1b61d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b640ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1300ab5f0 con 0x7fd1340ce8b0 2023-11-24T06:29:47.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.474+0000 7f6e3677d640 1 -- 172.21.15.143:0/1600576743 wait complete. 2023-11-24T06:29:47.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b61d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b640ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43786/0 (socket says 172.21.15.143:43786) 2023-11-24T06:29:47.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b62d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1b6406d040 0x7f1b640ac520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37286/0 (socket says 172.21.15.143:37286) 2023-11-24T06:29:47.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b62d9d640 1 -- 172.21.15.143:0/936145876 learned_addr learned my addr 172.21.15.143:0/936145876 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b68879640 1 -- 172.21.15.143:0/936145876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640c9b80 con 0x7f1b640cc3f0 2023-11-24T06:29:47.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3677d640 1 Processor -- start 2023-11-24T06:29:47.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3677d640 1 -- start start 2023-11-24T06:29:47.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b62d9d640 1 -- 172.21.15.143:0/936145876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 msgr2=0x7f1b640ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b62d9d640 1 --2- 172.21.15.143:0/936145876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b640ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b62d9d640 1 -- 172.21.15.143:0/936145876 >> v1:172.21.15.143:6789/0 conn(0x7f1b6415d570 legacy=0x7f1b640cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78ae6ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f78a806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f1b62d9d640 1 -- 172.21.15.143:0/936145876 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640ac000 con 0x7f1b6406d040 2023-11-24T06:29:47.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78ae6ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80ccbd0 con 0x7f78a80cab60 2023-11-24T06:29:47.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78ae6ea640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a806dac0 con 0x7f78a806d480 2023-11-24T06:29:47.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78ae6ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a806dda0 con 0x7f78a80ce070 2023-11-24T06:29:47.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7fd1398f2640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1180664c0 0x7fd118068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1341f9fc0 tx=0x7fd124009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a77fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f78a806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f816972f640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f81640d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f8169f30640 1 --2- 172.21.15.143:0/1737051339 >> v2:172.21.15.143:3300/0 conn(0x7f816415d570 0x7f816406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f816a731640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f81640d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f816a731640 1 -- 172.21.15.143:0/1737051339 >> v2:172.21.15.143:3300/0 conn(0x7f816415d570 msgr2=0x7f816406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f816a731640 1 --2- 172.21.15.143:0/1737051339 >> v2:172.21.15.143:3300/0 conn(0x7f816415d570 0x7f816406b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f816a731640 1 -- 172.21.15.143:0/1737051339 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640ce0b0 con 0x7f81640ce8b0 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f816972f640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f81640d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a77fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f78a806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43798/0 (socket says 172.21.15.143:43798) 2023-11-24T06:29:47.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a77fe640 1 -- 172.21.15.143:0/3294565265 learned_addr learned my addr 172.21.15.143:0/3294565265 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3677d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 0x7f6e280471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3677d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28033cd0 0x7f6e2817df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3677d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280df280 0x7f6e2804a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f8169f30640 1 --2- 172.21.15.143:0/1737051339 >> v2:172.21.15.143:3300/0 conn(0x7f816415d570 0x7f816406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e34f7a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28033cd0 0x7f6e2817df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e34f7a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28033cd0 0x7f6e2817df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43804/0 (socket says 172.21.15.143:43804) 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3577b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 0x7f6e280471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3577b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 0x7f6e280471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47042/0 (socket says 172.21.15.143:47042) 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e35f7c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280df280 0x7f6e2804a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e35f7c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280df280 0x7f6e2804a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37288/0 (socket says 172.21.15.143:37288) 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e34f7a640 1 -- 172.21.15.143:0/2177371009 learned_addr learned my addr 172.21.15.143:0/2177371009 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840270077 0 0) 0x7f78a806dac0 con 0x7f78a806d480 2023-11-24T06:29:47.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788c003530 con 0x7f78a806d480 2023-11-24T06:29:47.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7fd13765a640 1 Processor -- start 2023-11-24T06:29:47.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2817dae0 con 0x7f6e280df280 2023-11-24T06:29:47.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280476f0 con 0x7f6e28007520 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2817ce60 con 0x7f6e28033cd0 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1845766698 0 0) 0x7f788c003530 con 0x7f78a806d480 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 msgr2=0x7f78a806cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a6ffd640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f78a806cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.478+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 >> v1:172.21.15.143:6789/0 conn(0x7f78a80cab60 legacy=0x7f78a80caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a806e080 con 0x7f78a806d480 2023-11-24T06:29:47.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f7898001680 con 0x7f78a806d480 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 >> v1:172.21.15.146:6789/0 conn(0x7f78a806d480 legacy=0x7f78a816b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f788c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c003f50 0x7f788c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f788c004d10 0x7f788c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a806dda0 con 0x7f788c004d10 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c00baa0 con 0x7f788c003f50 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c00bc60 con 0x7f78a80ce070 2023-11-24T06:29:47.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd13765a640 1 -- start start 2023-11-24T06:29:47.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3577b640 1 -- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28033cd0 msgr2=0x7f6e2817df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3577b640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28033cd0 0x7f6e2817df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3577b640 1 -- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280df280 msgr2=0x7f6e2804a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3577b640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280df280 0x7f6e2804a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3577b640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3004f7e0 con 0x7f6e28007520 2023-11-24T06:29:47.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 Processor -- start 2023-11-24T06:29:47.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a7fff640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f788c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a77fe640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c003f50 0x7f788c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78acc87640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f788c004d10 0x7f788c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3577b640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 0x7f6e280471b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00d990 tx=0x7f6e2c00de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f1b62d9d640 1 --2- 172.21.15.143:0/936145876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6406d040 0x7f1b640ac520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009e50 tx=0x7f1b5c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1545cbc6ddb0dab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd13765a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1300cab60 0x7fd1300caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd13765a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 0x7fd13006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd13765a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300ccbd0 con 0x7fd13006d480 2023-11-24T06:29:47.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd13765a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13006dac0 con 0x7fd1300cab60 2023-11-24T06:29:47.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd13765a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13006dda0 con 0x7fd1300cb480 2023-11-24T06:29:47.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f816a731640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f81640ced40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81640c6e60 tx=0x7f815c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=790226fe9495456f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f1b6159a640 1 -- 172.21.15.143:0/936145876 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a56c0 con 0x7f1b6406d040 2023-11-24T06:29:47.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 0x7fd13006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 0x7fd13006cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43828/0 (socket says 172.21.15.143:43828) 2023-11-24T06:29:47.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 -- 172.21.15.143:0/2781456477 learned_addr learned my addr 172.21.15.143:0/2781456477 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd1353f6640 1 --2- 172.21.15.143:0/2781456477 >> v2:172.21.15.143:3300/0 conn(0x7fd1300cab60 0x7fd1300caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1300ebbe0 con 0x7fd1340ce8b0 2023-11-24T06:29:47.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f1b6159a640 1 -- 172.21.15.143:0/936145876 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0a5820 con 0x7f1b6406d040 2023-11-24T06:29:47.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f8168f2e640 1 -- 172.21.15.143:0/1737051339 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0a5840 con 0x7f81640ce8b0 2023-11-24T06:29:47.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f8168f2e640 1 -- 172.21.15.143:0/1737051339 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0a59a0 con 0x7f81640ce8b0 2023-11-24T06:29:47.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f8168f2e640 1 -- 172.21.15.143:0/1737051339 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0a5d30 con 0x7f81640ce8b0 2023-11-24T06:29:47.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f1b6159a640 1 -- 172.21.15.143:0/936145876 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a5bb0 con 0x7f1b6406d040 2023-11-24T06:29:47.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c007a90 con 0x7f6e28007520 2023-11-24T06:29:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 -- 172.21.15.143:0/2781456477 >> v2:172.21.15.143:3300/0 conn(0x7fd1300cab60 msgr2=0x7fd1300caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 --2- 172.21.15.143:0/2781456477 >> v2:172.21.15.143:3300/0 conn(0x7fd1300cab60 0x7fd1300caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 -- 172.21.15.143:0/2781456477 >> v1:172.21.15.143:6789/0 conn(0x7fd13006d480 legacy=0x7fd1300cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c007bf0 con 0x7f6e28007520 2023-11-24T06:29:47.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c010470 con 0x7f6e28007520 2023-11-24T06:29:47.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2817d140 con 0x7f6e28007520 2023-11-24T06:29:47.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a7fff640 1 -- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c003f50 msgr2=0x7f788c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a7fff640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c003f50 0x7f788c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a7fff640 1 -- 172.21.15.143:0/3294565265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f788c004d10 msgr2=0x7f788c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a7fff640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f788c004d10 0x7f788c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f78a7fff640 1 -- 172.21.15.143:0/3294565265 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a806e080 con 0x7f78a80ce070 2023-11-24T06:29:47.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 -- 172.21.15.143:0/936145876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6406d040 msgr2=0x7f1b640ac520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 --2- 172.21.15.143:0/936145876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6406d040 0x7f1b640ac520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009e50 tx=0x7f1b5c01c870 comp rx=0 tx=0).stop 2023-11-24T06:29:47.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 -- 172.21.15.143:0/936145876 shutdown_connections 2023-11-24T06:29:47.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 --2- 172.21.15.143:0/936145876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6406d040 0x7f1b640ac520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 --2- 172.21.15.143:0/936145876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b640ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 -- 172.21.15.143:0/936145876 >> 172.21.15.143:0/936145876 conn(0x7f1b640b0bf0 msgr2=0x7f1b640b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f78a77fe640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c003f50 0x7f788c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7fd134bf5640 1 -- 172.21.15.143:0/2781456477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13006e080 con 0x7fd1300cb480 2023-11-24T06:29:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 -- start start 2023-11-24T06:29:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f40580d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f405815d950 0x7f40580d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40580d1fb0 0x7f40580b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40580cf100 con 0x7f40580d1fb0 2023-11-24T06:29:47.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40580d2410 con 0x7f405815d950 2023-11-24T06:29:47.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.482+0000 7f405f701640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580cf590 con 0x7f405815d570 2023-11-24T06:29:47.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405d49d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f40580d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2817d700 con 0x7f6e28007520 2023-11-24T06:29:47.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405d49d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f40580d04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43834/0 (socket says 172.21.15.143:43834) 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405d49d640 1 -- 172.21.15.143:0/1187863879 learned_addr learned my addr 172.21.15.143:0/1187863879 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 -- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 msgr2=0x7f81640ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f81640ced40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81640c6e60 tx=0x7f815c01c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 -- 172.21.15.143:0/1737051339 shutdown_connections 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f81640ced40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 --2- 172.21.15.143:0/1737051339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f81640d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 --2- 172.21.15.143:0/1737051339 >> v2:172.21.15.143:3300/0 conn(0x7f816415d570 0x7f816406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f816c194640 1 -- 172.21.15.143:0/1737051339 >> 172.21.15.143:0/1737051339 conn(0x7f816408ceb0 msgr2=0x7f816409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 -- 172.21.15.143:0/936145876 shutdown_connections 2023-11-24T06:29:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405dc9e640 1 --2- 172.21.15.143:0/1187863879 >> v2:172.21.15.143:3300/0 conn(0x7f40580d1fb0 0x7f40580b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e280089b0 con 0x7f6e28007520 2023-11-24T06:29:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405cc9c640 1 --2- 172.21.15.143:0/1187863879 >> v2:172.21.15.146:3300/0 conn(0x7f405815d950 0x7f40580d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405cc9c640 1 -- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 msgr2=0x7f40580d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6e2c0105d0 con 0x7f6e28007520 2023-11-24T06:29:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f816c194640 1 -- 172.21.15.143:0/1737051339 shutdown_connections 2023-11-24T06:29:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f1b68879640 1 -- 172.21.15.143:0/936145876 wait complete. 2023-11-24T06:29:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405cc9c640 1 --2- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f40580d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405cc9c640 1 -- 172.21.15.143:0/1187863879 >> v2:172.21.15.143:3300/0 conn(0x7f40580d1fb0 msgr2=0x7f40580b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405cc9c640 1 --2- 172.21.15.143:0/1187863879 >> v2:172.21.15.143:3300/0 conn(0x7f40580d1fb0 0x7f40580b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.486+0000 7f405cc9c640 1 -- 172.21.15.143:0/1187863879 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580ce4f0 con 0x7f405815d950 2023-11-24T06:29:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f405d49d640 1 --2- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f40580d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 Processor -- start 2023-11-24T06:29:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7fd134bf5640 1 --2- 172.21.15.143:0/2781456477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 0x7fd13006cf40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd120009870 tx=0x7fd12001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80c5c3ce6c9a0cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f6e25ffb640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e140664f0 0x7f6e140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 -- start start 2023-11-24T06:29:47.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e2c083f20 con 0x7f6e28007520 2023-11-24T06:29:47.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f6e34f7a640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e140664f0 0x7f6e140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f816c194640 1 -- 172.21.15.143:0/1737051339 wait complete. 2023-11-24T06:29:47.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7fd127fff640 1 -- 172.21.15.143:0/2781456477 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200ac640 con 0x7fd1300cb480 2023-11-24T06:29:47.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78a7fff640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f788c003980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001d70 tx=0x7f78a001c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabef14590ac1184 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b6406d040 0x7f1b64149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7fd127fff640 1 -- 172.21.15.143:0/2781456477 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1200ac7a0 con 0x7fd1300cb480 2023-11-24T06:29:47.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7fd127fff640 1 -- 172.21.15.143:0/2781456477 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200acb30 con 0x7fd1300cb480 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b6415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6415d570 0x7f1b6409c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6415e340 con 0x7f1b6415d570 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64160e20 con 0x7f1b6406d040 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b68879640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6415e0a0 con 0x7f1b640cc3f0 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b6415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b6415db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43848/0 (socket says 172.21.15.143:43848) 2023-11-24T06:29:47.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 -- 172.21.15.143:0/2029099489 learned_addr learned my addr 172.21.15.143:0/2029099489 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b6259c640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b6406d040 0x7f1b64149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b62d9d640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6415d570 0x7f1b6409c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0003b80 con 0x7f78a80ce070 2023-11-24T06:29:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0003ce0 con 0x7f78a80ce070 2023-11-24T06:29:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78a6ffd640 1 -- 172.21.15.143:0/3294565265 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00052c0 con 0x7f78a80ce070 2023-11-24T06:29:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 -- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b6406d040 msgr2=0x7f1b64149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b6406d040 0x7f1b64149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 -- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6415d570 msgr2=0x7f1b6409c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6415d570 0x7f1b6409c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 -- 172.21.15.143:0/2029099489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009b30 con 0x7f1b640cc3f0 2023-11-24T06:29:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7fd13765a640 1 -- 172.21.15.143:0/2781456477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 msgr2=0x7fd13006cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7fd13765a640 1 --2- 172.21.15.143:0/2781456477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 0x7fd13006cf40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd120009870 tx=0x7fd12001c500 comp rx=0 tx=0).stop 2023-11-24T06:29:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78ae6ea640 1 -- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 msgr2=0x7f788c003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/3294565265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80ce070 0x7f788c003980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001d70 tx=0x7f78a001c660 comp rx=0 tx=0).stop 2023-11-24T06:29:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f78acc87640 1 -- 172.21.15.143:0/3294565265 reap_dead start 2023-11-24T06:29:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f78ae6ea640 1 -- 172.21.15.143:0/3294565265 shutdown_connections 2023-11-24T06:29:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f78ae6ea640 1 -- 172.21.15.143:0/3294565265 >> 172.21.15.143:0/3294565265 conn(0x7f78a80b0bf0 msgr2=0x7f78a80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f1b61d9b640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b6415db60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e8a0 tx=0x7f1b5400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f78ae6ea640 1 -- 172.21.15.143:0/3294565265 shutdown_connections 2023-11-24T06:29:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f6e34f7a640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e140664f0 0x7f6e140689b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e2818c100 tx=0x7f6e2000a1e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.490+0000 7f816c194640 1 Processor -- start 2023-11-24T06:29:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 -- start start 2023-11-24T06:29:47.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 -- 172.21.15.143:0/2781456477 shutdown_connections 2023-11-24T06:29:47.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 --2- 172.21.15.143:0/2781456477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1300cb480 0x7fd13006cf40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 --2- 172.21.15.143:0/2781456477 >> v2:172.21.15.143:3300/0 conn(0x7fd1300cab60 0x7fd1300caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 -- 172.21.15.143:0/2781456477 >> 172.21.15.143:0/2781456477 conn(0x7fd1300b0bf0 msgr2=0x7fd1300b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f78ae6ea640 1 -- 172.21.15.143:0/3294565265 wait complete. 2023-11-24T06:29:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 -- 172.21.15.143:0/2781456477 shutdown_connections 2023-11-24T06:29:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f405cc9c640 1 --2- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405815d950 0x7f40580d1a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f405808d140 tx=0x7f404801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90e40a82934e3163 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f816414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f816414bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f816415d570 0x7f8164153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81641fde40 con 0x7f816415d570 2023-11-24T06:29:47.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164159310 con 0x7f81640ce8b0 2023-11-24T06:29:47.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81640cc950 con 0x7f81640d3020 2023-11-24T06:29:47.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816a731640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f816415d570 0x7f8164153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f816414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f816414c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47096/0 (socket says 172.21.15.143:47096) 2023-11-24T06:29:47.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 -- 172.21.15.143:0/2269041897 learned_addr learned my addr 172.21.15.143:0/2269041897 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816972f640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f816414bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f404ffff640 1 -- 172.21.15.143:0/1187863879 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480a8910 con 0x7f405815d950 2023-11-24T06:29:47.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f404ffff640 1 -- 172.21.15.143:0/1187863879 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40480a8a70 con 0x7f405815d950 2023-11-24T06:29:47.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f404ffff640 1 -- 172.21.15.143:0/1187863879 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480a8e00 con 0x7f405815d950 2023-11-24T06:29:47.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 -- 172.21.15.143:0/2781456477 wait complete. 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 -- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 msgr2=0x7f816414bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f816414bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 -- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f816415d570 msgr2=0x7f8164153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f816415d570 0x7f8164153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 -- 172.21.15.143:0/2269041897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c009b30 con 0x7f81640ce8b0 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f8169f30640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f816414c7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f816000c7f0 tx=0x7f816000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160007820 con 0x7f81640ce8b0 2023-11-24T06:29:47.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54009510 con 0x7f1b640cc3f0 2023-11-24T06:29:47.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400c940 con 0x7f1b640cc3f0 2023-11-24T06:29:47.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54009510 con 0x7f1b640cc3f0 2023-11-24T06:29:47.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f78ae6ea640 1 Processor -- start 2023-11-24T06:29:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160007980 con 0x7f81640ce8b0 2023-11-24T06:29:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160007d30 con 0x7f81640ce8b0 2023-11-24T06:29:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b64160480 con 0x7f1b640cc3f0 2023-11-24T06:29:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64160a40 con 0x7f1b640cc3f0 2023-11-24T06:29:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6409d250 con 0x7f1b640cc3f0 2023-11-24T06:29:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81640ccc30 con 0x7f81640ce8b0 2023-11-24T06:29:47.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.494+0000 7fd13765a640 1 Processor -- start 2023-11-24T06:29:47.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e2c0b5280 con 0x7f6e28007520 2023-11-24T06:29:47.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 -- start start 2023-11-24T06:29:47.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81640cd1f0 con 0x7f81640ce8b0 2023-11-24T06:29:47.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 -- start start 2023-11-24T06:29:47.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 -- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405815d950 msgr2=0x7f40580d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 --2- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405815d950 0x7f40580d1a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f405808d140 tx=0x7f404801ec70 comp rx=0 tx=0).stop 2023-11-24T06:29:47.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 0x7f78a80b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 0x7fd130156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 0x7fd13015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 0x7fd130162680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78a80c3d60 0x7f78a80c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 -- 172.21.15.143:0/1187863879 shutdown_connections 2023-11-24T06:29:47.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 --2- 172.21.15.143:0/1187863879 >> v2:172.21.15.143:3300/0 conn(0x7f40580d1fb0 0x7f40580b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 --2- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405815d950 0x7f40580d1a70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 --2- 172.21.15.143:0/1187863879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f40580d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 -- 172.21.15.143:0/1187863879 >> 172.21.15.143:0/1187863879 conn(0x7f405809c7c0 msgr2=0x7f40580d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b5400cab0 con 0x7f1b640cc3f0 2023-11-24T06:29:47.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd1353f6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 0x7fd130156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd134bf5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 0x7fd13015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81640a13b0 con 0x7f81640ce8b0 2023-11-24T06:29:47.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd134bf5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 0x7fd13015fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47106/0 (socket says 172.21.15.143:47106) 2023-11-24T06:29:47.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd1353f6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 0x7fd130156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43854/0 (socket says 172.21.15.143:43854) 2023-11-24T06:29:47.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81600113f0 con 0x7f81640ce8b0 2023-11-24T06:29:47.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 0x7f78a80b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 0x7f78a80b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47100/0 (socket says 172.21.15.143:47100) 2023-11-24T06:29:47.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80c5410 0x7f78a80c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80c5890 con 0x7f78a80c3d60 2023-11-24T06:29:47.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80b43a0 con 0x7f78a8163980 2023-11-24T06:29:47.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78ae6ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80c2cc0 con 0x7f78a80c5410 2023-11-24T06:29:47.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78a7fff640 1 -- 172.21.15.143:0/2761823017 learned_addr learned my addr 172.21.15.143:0/2761823017 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd135bf7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 0x7fd130162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd135bf7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 0x7fd130162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37340/0 (socket says 172.21.15.143:37340) 2023-11-24T06:29:47.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f405f701640 1 -- 172.21.15.143:0/1187863879 shutdown_connections 2023-11-24T06:29:47.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7f78acc87640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80c5410 0x7f78a80c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd134bf5640 1 -- 172.21.15.143:0/3670476903 learned_addr learned my addr 172.21.15.143:0/3670476903 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130161490 con 0x7fd1300cb480 2023-11-24T06:29:47.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130156ab0 con 0x7fd1300cab60 2023-11-24T06:29:47.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.498+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd130161920 con 0x7fd13006d480 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f78a7fff640 1 -- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80c5410 msgr2=0x7f78a80c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f78a7fff640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80c5410 0x7f78a80c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f78a7fff640 1 -- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78a80c3d60 msgr2=0x7f78a80c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f78a7fff640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78a80c3d60 0x7f78a80c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f78a7fff640 1 -- 172.21.15.143:0/2761823017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80c2fa0 con 0x7f78a8163980 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd134bf5640 1 -- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 msgr2=0x7fd130156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd134bf5640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 0x7fd130156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd134bf5640 1 -- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 msgr2=0x7fd130162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd134bf5640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 0x7fd130162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd134bf5640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200094d0 con 0x7fd1300cab60 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd135bf7640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 0x7fd130162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd1353f6640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 0x7fd130156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7fd134bf5640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 0x7fd13015fe00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd12001cda0 tx=0x7fd1200192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f815a7fc640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f81480664c0 0x7f8148068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81600840b0 con 0x7f81640ce8b0 2023-11-24T06:29:47.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f78a7fff640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 0x7f78a80b3e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78a001cf00 tx=0x7f788c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f405f701640 1 -- 172.21.15.143:0/1187863879 wait complete. 2023-11-24T06:29:47.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f816972f640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f81480664c0 0x7f8148068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f1b52ffd640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1b440664d0 0x7f1b44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f816972f640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f81480664c0 0x7f8148068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81640cc2f0 tx=0x7f8154008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f1b6259c640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1b440664d0 0x7f1b44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b54083bd0 con 0x7f1b640cc3f0 2023-11-24T06:29:47.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f405f701640 1 Processor -- start 2023-11-24T06:29:47.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f1b6259c640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1b440664d0 0x7f1b44068990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b580016c0 tx=0x7f1b58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.502+0000 7f405f701640 1 -- start start 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405f701640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 0x7f40580c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405f701640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f4058158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405f701640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f405815d950 0x7f405815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405f701640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40580c9e20 con 0x7f405815d950 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405f701640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40580c8480 con 0x7f40580d1fb0 2023-11-24T06:29:47.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405f701640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580c8910 con 0x7f405815d570 2023-11-24T06:29:47.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00ba070 con 0x7f78a8163980 2023-11-24T06:29:47.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8160051650 con 0x7f81640ce8b0 2023-11-24T06:29:47.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b54051060 con 0x7f1b640cc3f0 2023-11-24T06:29:47.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0007dc0 con 0x7f78a8163980 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00a9660 con 0x7f78a8163980 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200b6600 con 0x7fd1300cab60 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1200b6760 con 0x7fd1300cab60 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200b6af0 con 0x7fd1300cab60 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd130160880 con 0x7fd1300cab60 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd130160e40 con 0x7fd1300cab60 2023-11-24T06:29:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 0x7f40580c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 0x7f40580c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47118/0 (socket says 172.21.15.143:47118) 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 -- 172.21.15.143:0/3658809663 learned_addr learned my addr 172.21.15.143:0/3658809663 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405cc9c640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f4058158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405dc9e640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f405815d950 0x7f405815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 -- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 msgr2=0x7f4058158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f4058158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 -- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f405815d950 msgr2=0x7f405815b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f405815d950 0x7f405815b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 -- 172.21.15.143:0/3658809663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540094d0 con 0x7f40580d1fb0 2023-11-24T06:29:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405dc9e640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f405815d950 0x7f405815b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80c3280 con 0x7f78a8163980 2023-11-24T06:29:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80c3840 con 0x7f78a8163980 2023-11-24T06:29:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a809d250 con 0x7f78a8163980 2023-11-24T06:29:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.506+0000 7f405d49d640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 0x7f40580c98e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f405400e990 tx=0x7f405400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400c9e0 con 0x7f40580d1fb0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405400cb40 con 0x7f40580d1fb0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400ceb0 con 0x7f40580d1fb0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4048009420 con 0x7f40580d1fb0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40580c7b50 con 0x7f40580d1fb0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4038005260 con 0x7f40580d1fb0 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1200b6c50 con 0x7fd1300cab60 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7fd125ffb640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd114066570 0x7fd114068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.510+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd12011e6a0 con 0x7fd1300cab60 2023-11-24T06:29:47.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78a00a97c0 con 0x7f78a8163980 2023-11-24T06:29:47.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130161600 con 0x7fd1300cab60 2023-11-24T06:29:47.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7fd1353f6640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd114066570 0x7fd114068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4054013470 con 0x7f40580d1fb0 2023-11-24T06:29:47.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7fd1353f6640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd114066570 0x7fd114068a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007a70 tx=0x7fd12c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f78a4ff9640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7890066540 0x7f7890068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78a011d9d0 con 0x7f78a8163980 2023-11-24T06:29:47.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f78a77fe640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7890066540 0x7f7890068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f404dffb640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f403c0664c0 0x7f403c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f405cc9c640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f403c0664c0 0x7f403c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.514+0000 7f78a77fe640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7890066540 0x7f7890068a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78a81fac10 tx=0x7f7894008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.518+0000 7f405cc9c640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f403c0664c0 0x7f403c068980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f405808d140 tx=0x7f40480bf040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.518+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78a00eaf80 con 0x7f78a8163980 2023-11-24T06:29:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.518+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4054054990 con 0x7f40580d1fb0 2023-11-24T06:29:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.518+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1200ebb90 con 0x7fd1300cab60 2023-11-24T06:29:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.526+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4054050cd0 con 0x7f40580d1fb0 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.534+0000 7f12c6ac9640 1 Processor -- start 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.534+0000 7f12c6ac9640 1 -- start start 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c6ac9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12c015d570 0x7f12c006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c6ac9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f12c00d3020 0x7f12c00d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c6ac9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c00d39f0 con 0x7f12c00ce8b0 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c6ac9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c00d1cc0 con 0x7f12c00d3020 2023-11-24T06:29:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c6ac9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c00d1fa0 con 0x7f12c015d570 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c5066640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12c00ce8b0 0x7f12c00ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:42336/0 (socket says 172.21.15.143:42336) 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c5066640 1 -- 172.21.15.143:0/1036428257 learned_addr learned my addr 172.21.15.143:0/1036428257 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247301609 0 0) 0x7f12c00d39f0 con 0x7f12c00ce8b0 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b0003530 con 0x7f12c00ce8b0 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648224125 0 0) 0x7f12b0003530 con 0x7f12c00ce8b0 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 >> v2:172.21.15.146:3300/0 conn(0x7f12c015d570 msgr2=0x7f12c006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c4865640 1 --2- 172.21.15.143:0/1036428257 >> v2:172.21.15.146:3300/0 conn(0x7f12c015d570 0x7f12c006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 --2- 172.21.15.143:0/1036428257 >> v2:172.21.15.146:3300/0 conn(0x7f12c015d570 0x7f12c006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 >> v2:172.21.15.143:3300/0 conn(0x7f12c00d3020 msgr2=0x7f12c00d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 --2- 172.21.15.143:0/1036428257 >> v2:172.21.15.143:3300/0 conn(0x7f12c00d3020 0x7f12c00d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00ce0b0 con 0x7f12c00ce8b0 2023-11-24T06:29:47.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f12b8001a00 con 0x7f12c00ce8b0 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 >> v1:172.21.15.146:6789/0 conn(0x7f12c00ce8b0 legacy=0x7f12c00ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12b0003980 0x7f12b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b00047d0 0x7f12b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12b00052b0 0x7f12b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00d1cc0 con 0x7f12b00047d0 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00d1fa0 con 0x7f12b00052b0 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b000c230 con 0x7f12b0003980 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c5066640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12b00052b0 0x7f12b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.538+0000 7f12c4865640 1 --2- 172.21.15.143:0/1036428257 >> v2:172.21.15.146:3300/0 conn(0x7f12c015d570 0x7f12c006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.542+0000 7f12c4865640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12b0003980 0x7f12b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.542+0000 7f12c5066640 1 -- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12b0003980 msgr2=0x7f12b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.542+0000 7f12c5066640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12b0003980 0x7f12b0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.542+0000 7f12c5066640 1 -- 172.21.15.143:0/1036428257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b00047d0 msgr2=0x7f12b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.542+0000 7f12c5066640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b00047d0 0x7f12b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.542+0000 7f12c5066640 1 -- 172.21.15.143:0/1036428257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00ce0b0 con 0x7f12b00052b0 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12c5066640 1 -- 172.21.15.143:0/1036428257 reap_dead start 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12c5066640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12b00052b0 0x7f12b000b990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12b800a8d0 tx=0x7f12b801fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59fd5b15a8d9f944 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b80a9720 con 0x7f12b00052b0 2023-11-24T06:29:47.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12bf7fe640 1 -- 172.21.15.143:0/1036428257 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b80a9880 con 0x7f12b00052b0 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12b00052b0 msgr2=0x7f12b000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12b00052b0 0x7f12b000b990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12b800a8d0 tx=0x7f12b801fb20 comp rx=0 tx=0).stop 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.546+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1036428257 shutdown_connections 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.550+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1036428257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12b00052b0 0x7f12b000b990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.550+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1036428257 >> 172.21.15.143:0/1036428257 conn(0x7f12c008ceb0 msgr2=0x7f12c009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.550+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1036428257 shutdown_connections 2023-11-24T06:29:47.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.550+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1036428257 wait complete. 2023-11-24T06:29:47.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.550+0000 7f12c6ac9640 1 Processor -- start 2023-11-24T06:29:47.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.550+0000 7f12c6ac9640 1 -- start start 2023-11-24T06:29:47.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c6ac9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0150f90 0x7f12c015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c6ac9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 0x7f12c00c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c6ac9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c00c9b60 0x7f12c00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 0x7f12c00c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 0x7f12c00c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37364/0 (socket says 172.21.15.143:37364) 2023-11-24T06:29:47.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c4865640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0150f90 0x7f12c015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c4865640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0150f90 0x7f12c015dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47154/0 (socket says 172.21.15.143:47154) 2023-11-24T06:29:47.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 -- 172.21.15.143:0/1416261228 learned_addr learned my addr 172.21.15.143:0/1416261228 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:47.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c015eb60 con 0x7f12c0151370 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c015e5a0 con 0x7f12c0150f90 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c015e880 con 0x7f12c00c9b60 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c5066640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c00c9b60 0x7f12c00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 -- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c00c9b60 msgr2=0x7f12c00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c00c9b60 0x7f12c00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 -- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0150f90 msgr2=0x7f12c015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0150f90 0x7f12c015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12bffff640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00c8e20 con 0x7f12c0151370 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.554+0000 7f12c5066640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c00c9b60 0x7f12c00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.558+0000 7f12bffff640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 0x7f12c00c9620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00b430 tx=0x7f12ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.558+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011830 con 0x7f12c0151370 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.558+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac011990 con 0x7f12c0151370 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.558+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011d40 con 0x7f12c0151370 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.558+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c00c9100 con 0x7f12c0151370 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.558+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c015e360 con 0x7f12c0151370 2023-11-24T06:29:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.562+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c00c8c80 con 0x7f12c0151370 2023-11-24T06:29:47.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.562+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12ac01a400 con 0x7f12c0151370 2023-11-24T06:29:47.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.562+0000 7f12bd7fa640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f12a40664f0 0x7f12a40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:47.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.570+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12ac054330 con 0x7f12c0151370 2023-11-24T06:29:47.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.574+0000 7f12c4865640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f12a40664f0 0x7f12a40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:47.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.574+0000 7f12c4865640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f12a40664f0 0x7f12a40689b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12b4006b20 tx=0x7f12b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:47.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.574+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12ac050e00 con 0x7f12c0151370 2023-11-24T06:29:47.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.798+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd13406b7b0 con 0x7fd1340ce8b0 2023-11-24T06:29:47.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.798+0000 7fd12affd640 1 -- 172.21.15.143:0/175647493 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1300ef200 con 0x7fd1340ce8b0 2023-11-24T06:29:47.803 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:47.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1180664c0 msgr2=0x7fd118068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1180664c0 0x7fd118068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1341f9fc0 tx=0x7fd124009040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 msgr2=0x7fd1340cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 0x7fd1340cd080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd130019170 tx=0x7fd13001ada0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 shutdown_connections 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1180664c0 0x7fd118068980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13415d570 0x7fd1340b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1340d3020 0x7fd1340b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 --2- 172.21.15.143:0/175647493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340ce8b0 0x7fd1340cd080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 >> 172.21.15.143:0/175647493 conn(0x7fd13408ceb0 msgr2=0x7fd1340b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 shutdown_connections 2023-11-24T06:29:47.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.802+0000 7fd13c357640 1 -- 172.21.15.143:0/175647493 wait complete. 2023-11-24T06:29:47.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.830+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1b640cb6e0 con 0x7f1b640cc3f0 2023-11-24T06:29:47.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.830+0000 7f1b52ffd640 1 -- 172.21.15.143:0/2029099489 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b54054680 con 0x7f1b640cc3f0 2023-11-24T06:29:47.835 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:47.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e28005370 con 0x7f6e28007520 2023-11-24T06:29:47.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1b440664d0 msgr2=0x7f1b44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1b440664d0 0x7f1b44068990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b580016c0 tx=0x7f1b58009040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 msgr2=0x7f1b6415db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b6415db60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e8a0 tx=0x7f1b5400eca0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 shutdown_connections 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1b440664d0 0x7f1b44068990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6415d570 0x7f1b6409c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b640cc3f0 0x7f1b6415db60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 --2- 172.21.15.143:0/2029099489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b6406d040 0x7f1b64149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 >> 172.21.15.143:0/2029099489 conn(0x7f1b640b0bf0 msgr2=0x7f1b640ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 shutdown_connections 2023-11-24T06:29:47.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f1b68879640 1 -- 172.21.15.143:0/2029099489 wait complete. 2023-11-24T06:29:47.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.834+0000 7f6e25ffb640 1 -- 172.21.15.143:0/2177371009 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e2c01f020 con 0x7f6e28007520 2023-11-24T06:29:47.840 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:47.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f816404e930 con 0x7f81640ce8b0 2023-11-24T06:29:47.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e140664f0 msgr2=0x7f6e140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e140664f0 0x7f6e140689b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e2818c100 tx=0x7f6e2000a1e0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 msgr2=0x7f6e280471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 0x7f6e280471b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00d990 tx=0x7f6e2c00de50 comp rx=0 tx=0).stop 2023-11-24T06:29:47.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f815a7fc640 1 -- 172.21.15.143:0/2269041897 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8160054c70 con 0x7f81640ce8b0 2023-11-24T06:29:47.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 shutdown_connections 2023-11-24T06:29:47.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e140664f0 0x7f6e140689b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280df280 0x7f6e2804a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e28033cd0 0x7f6e2817df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 --2- 172.21.15.143:0/2177371009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e28007520 0x7f6e280471b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.838+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 >> 172.21.15.143:0/2177371009 conn(0x7f6e28009f90 msgr2=0x7f6e280d8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.845 INFO:teuthology.orchestra.run.smithi143.stdout:55834574852 2023-11-24T06:29:47.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd13009d250 con 0x7fd1300cab60 2023-11-24T06:29:47.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 shutdown_connections 2023-11-24T06:29:47.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f6e3677d640 1 -- 172.21.15.143:0/2177371009 wait complete. 2023-11-24T06:29:47.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7fd125ffb640 1 -- 172.21.15.143:0/3670476903 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1200b1030 con 0x7fd1300cab60 2023-11-24T06:29:47.846 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:47.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78a80b43a0 con 0x7f78a8163980 2023-11-24T06:29:47.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f81480664c0 msgr2=0x7f8148068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f81480664c0 0x7f8148068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81640cc2f0 tx=0x7f8154008040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd114066570 msgr2=0x7fd114068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7fd13765a640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd114066570 0x7fd114068a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007a70 tx=0x7fd12c008040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 msgr2=0x7fd13015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7fd13765a640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 0x7fd13015fe00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd12001cda0 tx=0x7fd1200192a0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 msgr2=0x7f816414c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f816414c7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f816000c7f0 tx=0x7f816000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 shutdown_connections 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f81480664c0 0x7f8148068980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f816415d570 0x7f8164153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81640d3020 0x7f816414bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 --2- 172.21.15.143:0/2269041897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81640ce8b0 0x7f816414c7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.842+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 >> 172.21.15.143:0/2269041897 conn(0x7f816408ceb0 msgr2=0x7f81640b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 shutdown_connections 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f816c194640 1 -- 172.21.15.143:0/2269041897 wait complete. 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 shutdown_connections 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd114066570 0x7fd114068a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300cb480 0x7fd130162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1300cab60 0x7fd13015fe00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 --2- 172.21.15.143:0/3670476903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13006d480 0x7fd130156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 >> 172.21.15.143:0/3670476903 conn(0x7fd1300b0bf0 msgr2=0x7fd1300b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 shutdown_connections 2023-11-24T06:29:47.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78a4ff9640 1 -- 172.21.15.143:0/2761823017 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78a00ee5a0 con 0x7f78a8163980 2023-11-24T06:29:47.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7fd13765a640 1 -- 172.21.15.143:0/3670476903 wait complete. 2023-11-24T06:29:47.852 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7890066540 msgr2=0x7f7890068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7890066540 0x7f7890068a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78a81fac10 tx=0x7f7894008040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 msgr2=0x7f78a80b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 0x7f78a80b3e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78a001cf00 tx=0x7f788c005800 comp rx=0 tx=0).stop 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 shutdown_connections 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7890066540 0x7f7890068a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78a80c5410 0x7f78a80c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78a80c3d60 0x7f78a80c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 --2- 172.21.15.143:0/2761823017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78a8163980 0x7f78a80b3e60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.846+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 >> 172.21.15.143:0/2761823017 conn(0x7f78a80b0bf0 msgr2=0x7f78a80ac790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.850+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 shutdown_connections 2023-11-24T06:29:47.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.850+0000 7f78ae6ea640 1 -- 172.21.15.143:0/2761823017 wait complete. 2023-11-24T06:29:47.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.850+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40380057e0 con 0x7f40580d1fb0 2023-11-24T06:29:47.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.854+0000 7f404dffb640 1 -- 172.21.15.143:0/3658809663 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4054017090 con 0x7f40580d1fb0 2023-11-24T06:29:47.860 INFO:teuthology.orchestra.run.smithi143.stdout:55834574852 2023-11-24T06:29:47.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f403c0664c0 msgr2=0x7f403c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f403c0664c0 0x7f403c068980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f405808d140 tx=0x7f40480bf040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 msgr2=0x7f40580c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 0x7f40580c98e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f405400e990 tx=0x7f405400ee50 comp rx=0 tx=0).stop 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 shutdown_connections 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f403c0664c0 0x7f403c068980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f405815d950 0x7f405815b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f405815d570 0x7f4058158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 --2- 172.21.15.143:0/3658809663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40580d1fb0 0x7f40580c98e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 >> 172.21.15.143:0/3658809663 conn(0x7f405809c7c0 msgr2=0x7f4058161300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 shutdown_connections 2023-11-24T06:29:47.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.858+0000 7f405f701640 1 -- 172.21.15.143:0/3658809663 wait complete. 2023-11-24T06:29:47.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-24T06:29:47.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-11-24T06:29:47.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-24T06:29:47.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-24T06:29:47.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-24T06:29:47.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-11-24T06:29:47.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.898+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f12c015e360 con 0x7f12c0151370 2023-11-24T06:29:47.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.898+0000 7f12bd7fa640 1 -- 172.21.15.143:0/1416261228 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12ac015020 con 0x7f12c0151370 2023-11-24T06:29:47.903 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:47.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f12a40664f0 msgr2=0x7f12a40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f12a40664f0 0x7f12a40689b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12b4006b20 tx=0x7f12b4008040 comp rx=0 tx=0).stop 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 msgr2=0x7f12c00c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 0x7f12c00c9620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00b430 tx=0x7f12ac00b8f0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 shutdown_connections 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f12a40664f0 0x7f12a40689b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c00c9b60 0x7f12c00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12c0151370 0x7f12c00c9620 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 --2- 172.21.15.143:0/1416261228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0150f90 0x7f12c015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 >> 172.21.15.143:0/1416261228 conn(0x7f12c008ceb0 msgr2=0x7f12c00b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 shutdown_connections 2023-11-24T06:29:47.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:47.902+0000 7f12c6ac9640 1 -- 172.21.15.143:0/1416261228 wait complete. 2023-11-24T06:29:47.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-24T06:29:48.839 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:29:48.878 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:29:48.887 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:29:48.891 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:29:48.892 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:29:48.895 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:29:48.903 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:29:48.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:29:49.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 Processor -- start 2023-11-24T06:29:49.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 -- start start 2023-11-24T06:29:49.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f632806dc30 0x7f63280cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63280ae590 0x7f63280cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632815f870 con 0x7f632806e010 2023-11-24T06:29:49.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632815c7c0 con 0x7f632806dc30 2023-11-24T06:29:49.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f632ce74640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632815fd00 con 0x7f63280ae590 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f63277fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f632806dc30 0x7f63280cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f63277fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f632806dc30 0x7f63280cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47168/0 (socket says 172.21.15.143:47168) 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f63277fe640 1 -- 172.21.15.143:0/380807194 learned_addr learned my addr 172.21.15.143:0/380807194 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.046+0000 7f6327fff640 1 --2- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63280ae590 0x7f63280cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.050+0000 7f63277fe640 1 -- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63280ae590 msgr2=0x7f63280cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.050+0000 7f63277fe640 1 --2- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63280ae590 0x7f63280cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.050+0000 7f63277fe640 1 -- 172.21.15.143:0/380807194 >> v1:172.21.15.143:6789/0 conn(0x7f632806e010 legacy=0x7f63280ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.050+0000 7f63277fe640 1 -- 172.21.15.143:0/380807194 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632815ef40 con 0x7f632806dc30 2023-11-24T06:29:49.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f63277fe640 1 --2- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632806dc30 0x7f63280cae00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6320009e50 tx=0x7f632001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8c07436431cfa7d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f63267fc640 1 -- 172.21.15.143:0/380807194 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200a56b0 con 0x7f632806dc30 2023-11-24T06:29:49.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f63267fc640 1 -- 172.21.15.143:0/380807194 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63200a5810 con 0x7f632806dc30 2023-11-24T06:29:49.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f63267fc640 1 -- 172.21.15.143:0/380807194 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200a56b0 con 0x7f632806dc30 2023-11-24T06:29:49.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 -- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632806dc30 msgr2=0x7f63280cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 --2- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632806dc30 0x7f63280cae00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6320009e50 tx=0x7f632001c940 comp rx=0 tx=0).stop 2023-11-24T06:29:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 -- 172.21.15.143:0/380807194 shutdown_connections 2023-11-24T06:29:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 --2- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63280ae590 0x7f63280cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 --2- 172.21.15.143:0/380807194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632806dc30 0x7f63280cae00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 -- 172.21.15.143:0/380807194 >> 172.21.15.143:0/380807194 conn(0x7f63280cf0d0 msgr2=0x7f63280cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 -- 172.21.15.143:0/380807194 shutdown_connections 2023-11-24T06:29:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.054+0000 7f632ce74640 1 -- 172.21.15.143:0/380807194 wait complete. 2023-11-24T06:29:49.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.058+0000 7f632ce74640 1 Processor -- start 2023-11-24T06:29:49.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.058+0000 7f632ce74640 1 -- start start 2023-11-24T06:29:49.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f632806dc30 0x7f632813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63280ae590 0x7f632815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f632815d8d0 0x7f632815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6326ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63280ae590 0x7f632815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6326ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63280ae590 0x7f632815ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47178/0 (socket says 172.21.15.143:47178) 2023-11-24T06:29:49.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6326ffd640 1 -- 172.21.15.143:0/4161999441 learned_addr learned my addr 172.21.15.143:0/4161999441 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632815e290 con 0x7f632806dc30 2023-11-24T06:29:49.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f632815d8d0 0x7f632815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632809c700 con 0x7f63280ae590 2023-11-24T06:29:49.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c5680 con 0x7f632815d8d0 2023-11-24T06:29:49.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 -- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63280ae590 msgr2=0x7f632815ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63280ae590 0x7f632815ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 -- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f632806dc30 msgr2=0x7f632813cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f632806dc30 0x7f632813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009b30 con 0x7f632815d8d0 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f6327fff640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f632815d8d0 0x7f632815dd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f63180099f0 tx=0x7f6318009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631801f070 con 0x7f632815d8d0 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318004020 con 0x7f632815d8d0 2023-11-24T06:29:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180043b0 con 0x7f632815d8d0 2023-11-24T06:29:49.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632815d3b0 con 0x7f632815d8d0 2023-11-24T06:29:49.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.062+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632815a820 con 0x7f632815d8d0 2023-11-24T06:29:49.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.066+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f631801b8d0 con 0x7f632815d8d0 2023-11-24T06:29:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.066+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632804e850 con 0x7f632815d8d0 2023-11-24T06:29:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.070+0000 7f630ffff640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6314066470 0x7f6314068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.070+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f631808bc10 con 0x7f632815d8d0 2023-11-24T06:29:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.070+0000 7f63277fe640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6314066470 0x7f6314068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.070+0000 7f63277fe640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6314066470 0x7f6314068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63200ae000 tx=0x7f6320004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.074+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6318059070 con 0x7f632815d8d0 2023-11-24T06:29:49.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 Processor -- start 2023-11-24T06:29:49.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 -- start start 2023-11-24T06:29:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f74b549a640 1 Processor -- start 2023-11-24T06:29:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f74b549a640 1 -- start start 2023-11-24T06:29:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc0cc360 0x7f76dc0ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f76dc0cb3e0 0x7f76dc0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc0cb830 con 0x7f76dc1619d0 2023-11-24T06:29:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0cdf90 con 0x7f76dc0cb3e0 2023-11-24T06:29:49.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e43df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0ce270 con 0x7f76dc0cc360 2023-11-24T06:29:49.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e297c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f76dc0cb3e0 0x7f76dc0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e217b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f76dc1619d0 0x7f76dc0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32776/0 (socket says 172.21.15.143:32776) 2023-11-24T06:29:49.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.110+0000 7f76e217b640 1 -- 172.21.15.143:0/3297078446 learned_addr learned my addr 172.21.15.143:0/3297078446 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:49.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442099895 0 0) 0x7f76dc0cb830 con 0x7f76dc1619d0 2023-11-24T06:29:49.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c8003530 con 0x7f76dc1619d0 2023-11-24T06:29:49.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038836408 0 0) 0x7f76c8003530 con 0x7f76dc1619d0 2023-11-24T06:29:49.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc0cc360 msgr2=0x7f76dc0ae590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:29:49.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc0cc360 0x7f76dc0ae590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 >> v2:172.21.15.143:3300/0 conn(0x7f76dc0cb3e0 msgr2=0x7f76dc0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 --2- 172.21.15.143:0/3297078446 >> v2:172.21.15.143:3300/0 conn(0x7f76dc0cb3e0 0x7f76dc0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0ce550 con 0x7f76dc1619d0 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f76d40019e0 con 0x7f76dc1619d0 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 >> v1:172.21.15.143:6789/0 conn(0x7f76dc1619d0 legacy=0x7f76dc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c80039a0 0x7f76c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c80047d0 0x7f76c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76c8005190 0x7f76c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0cdf90 con 0x7f76c8005190 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0ce270 con 0x7f76c80039a0 2023-11-24T06:29:49.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c800c0c0 con 0x7f76c80047d0 2023-11-24T06:29:49.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74b549a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f74b00b12e0 0x7f74b006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74b549a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74b549a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74b015d5e0 0x7f74b00b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74b549a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b015e0b0 con 0x7f74b00b12e0 2023-11-24T06:29:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74b549a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b015ddd0 con 0x7f74b015d5e0 2023-11-24T06:29:49.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74b549a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b006da60 con 0x7f74b01591c0 2023-11-24T06:29:49.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f74b00b12e0 0x7f74b006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f74b00b12e0 0x7f74b006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37410/0 (socket says 172.21.15.143:37410) 2023-11-24T06:29:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 -- 172.21.15.143:0/3789898308 learned_addr learned my addr 172.21.15.143:0/3789898308 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e197a640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c80047d0 0x7f76c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 -- 172.21.15.143:0/3789898308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 msgr2=0x7f74b015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 --2- 172.21.15.143:0/3789898308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 -- 172.21.15.143:0/3789898308 >> v2:172.21.15.146:3300/0 conn(0x7f74b015d5e0 msgr2=0x7f74b00b29e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:29:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 --2- 172.21.15.143:0/3789898308 >> v2:172.21.15.146:3300/0 conn(0x7f74b015d5e0 0x7f74b00b29e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f74aeffd640 1 -- 172.21.15.143:0/3789898308 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b006dd40 con 0x7f74b00b12e0 2023-11-24T06:29:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e297c640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76c8005190 0x7f76c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e217b640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c80039a0 0x7f76c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e197a640 1 -- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c80039a0 msgr2=0x7f76c8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e197a640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c80039a0 0x7f76c8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e197a640 1 -- 172.21.15.143:0/3297078446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76c8005190 msgr2=0x7f76c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e197a640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76c8005190 0x7f76c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.114+0000 7f76e197a640 1 -- 172.21.15.143:0/3297078446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0ce550 con 0x7f76c80047d0 2023-11-24T06:29:49.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f595ffff640 1 Processor -- start 2023-11-24T06:29:49.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f595ffff640 1 -- start start 2023-11-24T06:29:49.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f76e197a640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c80047d0 0x7f76c8004c50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f76dc1655a0 tx=0x7f76d801c240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0f554739124362e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80ab600 con 0x7f76c80047d0 2023-11-24T06:29:49.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f74aeffd640 1 --2- 172.21.15.143:0/3789898308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b00b12e0 0x7f74b006e260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74b00cff60 tx=0x7f74a401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be922f21646294da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d80a7050 con 0x7f76c80047d0 2023-11-24T06:29:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.118+0000 7f76e1179640 1 -- 172.21.15.143:0/3297078446 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80ab9e0 con 0x7f76c80047d0 2023-11-24T06:29:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e43df640 1 -- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c80047d0 msgr2=0x7f76c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e43df640 1 --2- 172.21.15.143:0/3297078446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c80047d0 0x7f76c8004c50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f76dc1655a0 tx=0x7f76d801c240 comp rx=0 tx=0).stop 2023-11-24T06:29:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74adffb640 1 -- 172.21.15.143:0/3789898308 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40a89d0 con 0x7f74b00b12e0 2023-11-24T06:29:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e297c640 1 -- 172.21.15.143:0/3297078446 reap_dead start 2023-11-24T06:29:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74adffb640 1 -- 172.21.15.143:0/3789898308 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40a8b30 con 0x7f74b00b12e0 2023-11-24T06:29:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74adffb640 1 -- 172.21.15.143:0/3789898308 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40b0440 con 0x7f74b00b12e0 2023-11-24T06:29:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59600cb5c0 0x7f59600b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f59600b1300 0x7f59600ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595ffff640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59600c9f00 con 0x7f596015d310 2023-11-24T06:29:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595ffff640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600b1790 con 0x7f59600b1300 2023-11-24T06:29:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595ffff640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5960161a70 con 0x7f59600cb5c0 2023-11-24T06:29:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e43df640 1 -- 172.21.15.143:0/3297078446 shutdown_connections 2023-11-24T06:29:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e43df640 1 -- 172.21.15.143:0/3297078446 >> 172.21.15.143:0/3297078446 conn(0x7f76dc0b0bf0 msgr2=0x7f76dc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f59600b1300 0x7f59600ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f59600b1300 0x7f59600ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37424/0 (socket says 172.21.15.143:37424) 2023-11-24T06:29:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 -- 172.21.15.143:0/3328855930 learned_addr learned my addr 172.21.15.143:0/3328855930 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595e7fc640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59600cb5c0 0x7f59600b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 -- 172.21.15.143:0/3789898308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b00b12e0 msgr2=0x7f74b006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 --2- 172.21.15.143:0/3789898308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b00b12e0 0x7f74b006e260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74b00cff60 tx=0x7f74a401ed10 comp rx=0 tx=0).stop 2023-11-24T06:29:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e43df640 1 -- 172.21.15.143:0/3297078446 shutdown_connections 2023-11-24T06:29:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 -- 172.21.15.143:0/3328855930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59600cb5c0 msgr2=0x7f59600b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59600cb5c0 0x7f59600b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 -- 172.21.15.143:0/3328855930 >> v1:172.21.15.143:6789/0 conn(0x7f596015d310 legacy=0x7f59600c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595f7fe640 1 -- 172.21.15.143:0/3328855930 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960161140 con 0x7f59600b1300 2023-11-24T06:29:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f595e7fc640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59600cb5c0 0x7f59600b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:49.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 -- 172.21.15.143:0/3789898308 shutdown_connections 2023-11-24T06:29:49.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 --2- 172.21.15.143:0/3789898308 >> v2:172.21.15.146:3300/0 conn(0x7f74b015d5e0 0x7f74b00b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 --2- 172.21.15.143:0/3789898308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 --2- 172.21.15.143:0/3789898308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b00b12e0 0x7f74b006e260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 -- 172.21.15.143:0/3789898308 >> 172.21.15.143:0/3789898308 conn(0x7f74b006ae90 msgr2=0x7f74b00b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 -- 172.21.15.143:0/3789898308 shutdown_connections 2023-11-24T06:29:49.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f74b549a640 1 -- 172.21.15.143:0/3789898308 wait complete. 2023-11-24T06:29:49.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.122+0000 7f76e43df640 1 -- 172.21.15.143:0/3297078446 wait complete. 2023-11-24T06:29:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 Processor -- start 2023-11-24T06:29:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 -- start start 2023-11-24T06:29:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 0x7f76dc0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f595f7fe640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600b1300 0x7f59600ccca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5954009870 tx=0x7f595401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84366b7610ef574 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f74b549a640 1 Processor -- start 2023-11-24T06:29:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f74b549a640 1 -- start start 2023-11-24T06:29:49.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f74b549a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 0x7f74b015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76dc0af1a0 0x7f76dc09b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc15c840 0x7f76dc0999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc15c420 con 0x7f76dc0af1a0 2023-11-24T06:29:49.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f595dffb640 1 -- 172.21.15.143:0/3328855930 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540ab600 con 0x7f59600b1300 2023-11-24T06:29:49.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f595dffb640 1 -- 172.21.15.143:0/3328855930 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540a7050 con 0x7f59600b1300 2023-11-24T06:29:49.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc09bd20 con 0x7f76dc0aedc0 2023-11-24T06:29:49.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e217b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 0x7f76dc0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f595dffb640 1 -- 172.21.15.143:0/3328855930 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540ab980 con 0x7f59600b1300 2023-11-24T06:29:49.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e217b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 0x7f76dc0c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47188/0 (socket says 172.21.15.143:47188) 2023-11-24T06:29:49.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e217b640 1 -- 172.21.15.143:0/2058357778 learned_addr learned my addr 172.21.15.143:0/2058357778 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.126+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc09c000 con 0x7f76dc15c840 2023-11-24T06:29:49.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 0x7f74b015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 0x7f74b015c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47194/0 (socket says 172.21.15.143:47194) 2023-11-24T06:29:49.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 -- 172.21.15.143:0/3798193011 learned_addr learned my addr 172.21.15.143:0/3798193011 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74b549a640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b0070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e197a640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76dc0af1a0 0x7f76dc09b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74b549a640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b015d5e0 0x7f74b0070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74b549a640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b013cd10 con 0x7f74b015d5e0 2023-11-24T06:29:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74b549a640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b013bcb0 con 0x7f74b00b12e0 2023-11-24T06:29:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74b549a640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b013bf50 con 0x7f74b01591c0 2023-11-24T06:29:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e217b640 1 -- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc15c840 msgr2=0x7f76dc0999e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e217b640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc15c840 0x7f76dc0999e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e217b640 1 -- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76dc0af1a0 msgr2=0x7f76dc09b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e217b640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76dc0af1a0 0x7f76dc09b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e217b640 1 -- 172.21.15.143:0/2058357778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc15c040 con 0x7f76dc0aedc0 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e197a640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76dc0af1a0 0x7f76dc09b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74ae7fc640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b0070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 -- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 msgr2=0x7f74b0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b0070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 -- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b015d5e0 msgr2=0x7f74b0070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b015d5e0 0x7f74b0070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40094d0 con 0x7f74b00b12e0 2023-11-24T06:29:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 -- 172.21.15.143:0/3328855930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600b1300 msgr2=0x7f59600ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600b1300 0x7f59600ccca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5954009870 tx=0x7f595401c540 comp rx=0 tx=0).stop 2023-11-24T06:29:49.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f74aeffd640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 0x7f74b015c040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000c10 tx=0x7f74a401bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 -- 172.21.15.143:0/3328855930 shutdown_connections 2023-11-24T06:29:49.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600b1300 0x7f59600ccca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 --2- 172.21.15.143:0/3328855930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59600cb5c0 0x7f59600b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 -- 172.21.15.143:0/3328855930 >> 172.21.15.143:0/3328855930 conn(0x7f59600cbb50 msgr2=0x7f59600cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 -- 172.21.15.143:0/3328855930 shutdown_connections 2023-11-24T06:29:49.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e217b640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 0x7f76dc0c8c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f76d400e510 tx=0x7f76d400e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f595ffff640 1 -- 172.21.15.143:0/3328855930 wait complete. 2023-11-24T06:29:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4017070 con 0x7f76dc0aedc0 2023-11-24T06:29:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4012590 con 0x7f76dc0aedc0 2023-11-24T06:29:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4012740 con 0x7f76dc0aedc0 2023-11-24T06:29:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc09c2e0 con 0x7f76dc0aedc0 2023-11-24T06:29:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.130+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc15ce90 con 0x7f76dc0aedc0 2023-11-24T06:29:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc09c470 con 0x7f76dc0aedc0 2023-11-24T06:29:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40c1070 con 0x7f74b00b12e0 2023-11-24T06:29:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40b0c80 con 0x7f74b00b12e0 2023-11-24T06:29:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40bb420 con 0x7f74b00b12e0 2023-11-24T06:29:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f74b549a640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b013c230 con 0x7f74b00b12e0 2023-11-24T06:29:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f74b549a640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b013c7f0 con 0x7f74b00b12e0 2023-11-24T06:29:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 Processor -- start 2023-11-24T06:29:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 -- start start 2023-11-24T06:29:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 0x7f5960155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600cb5c0 0x7f5960158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b013c9e0 con 0x7f74b00b12e0 2023-11-24T06:29:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f596015d310 0x7f5960158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596015da80 con 0x7f59600cb5c0 2023-11-24T06:29:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596015dd60 con 0x7f59600b1300 2023-11-24T06:29:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595ffff640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596015e040 con 0x7f596015d310 2023-11-24T06:29:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f44226c9640 1 Processor -- start 2023-11-24T06:29:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f44226c9640 1 -- start start 2023-11-24T06:29:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 0x7f5960155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 0x7f5960155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47196/0 (socket says 172.21.15.143:47196) 2023-11-24T06:29:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 -- 172.21.15.143:0/417507634 learned_addr learned my addr 172.21.15.143:0/417507634 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595f7fe640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f596015d310 0x7f5960158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 -- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f596015d310 msgr2=0x7f5960158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f596015d310 0x7f5960158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595e7fc640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600cb5c0 0x7f5960158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 -- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600cb5c0 msgr2=0x7f5960158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600cb5c0 0x7f5960158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595effd640 1 -- 172.21.15.143:0/417507634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009420 con 0x7f59600b1300 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595e7fc640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600cb5c0 0x7f5960158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.134+0000 7f595f7fe640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f596015d310 0x7f5960158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76d40128a0 con 0x7f76dc0aedc0 2023-11-24T06:29:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f595effd640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 0x7f5960155520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f595800c7a0 tx=0x7f595800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74a40b7040 con 0x7f74b00b12e0 2023-11-24T06:29:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f44226c9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f441c0d3020 0x7f441c0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f44226c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c06c0e0 con 0x7f441c15d570 2023-11-24T06:29:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f44226c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0d39f0 con 0x7f441c0ce8b0 2023-11-24T06:29:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f44226c9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0d1cc0 con 0x7f441c0d3020 2023-11-24T06:29:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f76d2ffd640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76c00664c0 0x7f76c0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76d40840e0 con 0x7f76dc0aedc0 2023-11-24T06:29:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f441b7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f441c0d3020 0x7f441c0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f441b7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f441c0d3020 0x7f441c0d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47210/0 (socket says 172.21.15.143:47210) 2023-11-24T06:29:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f441b7fe640 1 -- 172.21.15.143:0/3559624314 learned_addr learned my addr 172.21.15.143:0/3559624314 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f74977fe640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f749c0664c0 0x7f749c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74a41219a0 con 0x7f74b00b12e0 2023-11-24T06:29:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f76e197a640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76c00664c0 0x7f76c0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f441b7fe640 1 -- 172.21.15.143:0/3559624314 >> v1:172.21.15.146:6789/0 conn(0x7f441c0ce8b0 legacy=0x7f441c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f441b7fe640 1 -- 172.21.15.143:0/3559624314 >> v1:172.21.15.143:6789/0 conn(0x7f441c15d570 legacy=0x7f441c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f441b7fe640 1 -- 172.21.15.143:0/3559624314 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0d1fa0 con 0x7f441c0d3020 2023-11-24T06:29:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.138+0000 7f74ae7fc640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f749c0664c0 0x7f749c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.142+0000 7f76e197a640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76c00664c0 0x7f76c0068980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ad000 tx=0x7f76d8004780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.142+0000 7f74ae7fc640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f749c0664c0 0x7f749c068980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74b015cbb0 tx=0x7f74a0009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.142+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958003b80 con 0x7f59600b1300 2023-11-24T06:29:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.142+0000 7f595ffff640 1 -- 172.21.15.143:0/417507634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59540094d0 con 0x7f59600b1300 2023-11-24T06:29:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.142+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76d40515d0 con 0x7f76dc0aedc0 2023-11-24T06:29:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.142+0000 7f595ffff640 1 -- 172.21.15.143:0/417507634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596015e600 con 0x7f59600b1300 2023-11-24T06:29:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f441b7fe640 1 --2- 172.21.15.143:0/3559624314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0d3020 0x7f441c0d34b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4410009870 tx=0x7f441001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d513a246a3d555 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f595ffff640 1 -- 172.21.15.143:0/417507634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596004e850 con 0x7f59600b1300 2023-11-24T06:29:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958003ce0 con 0x7f59600b1300 2023-11-24T06:29:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800aa70 con 0x7f59600b1300 2023-11-24T06:29:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f441affd640 1 -- 172.21.15.143:0/3559624314 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100aa670 con 0x7f441c0d3020 2023-11-24T06:29:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f441affd640 1 -- 172.21.15.143:0/3559624314 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100aa7d0 con 0x7f441c0d3020 2023-11-24T06:29:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f441affd640 1 -- 172.21.15.143:0/3559624314 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100aab60 con 0x7f441c0d3020 2023-11-24T06:29:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74a40eee00 con 0x7f74b00b12e0 2023-11-24T06:29:49.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f44226c9640 1 -- 172.21.15.143:0/3559624314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0d3020 msgr2=0x7f441c0d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.146+0000 7f44226c9640 1 --2- 172.21.15.143:0/3559624314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0d3020 0x7f441c0d34b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4410009870 tx=0x7f441001c510 comp rx=0 tx=0).stop 2023-11-24T06:29:49.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f595800abd0 con 0x7f59600b1300 2023-11-24T06:29:49.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f59477fe640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f594c066470 0x7f594c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5958084550 con 0x7f59600b1300 2023-11-24T06:29:49.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f44226c9640 1 -- 172.21.15.143:0/3559624314 shutdown_connections 2023-11-24T06:29:49.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f44226c9640 1 --2- 172.21.15.143:0/3559624314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0d3020 0x7f441c0d34b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f44226c9640 1 -- 172.21.15.143:0/3559624314 >> 172.21.15.143:0/3559624314 conn(0x7f441c08ceb0 msgr2=0x7f441c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f44226c9640 1 -- 172.21.15.143:0/3559624314 shutdown_connections 2023-11-24T06:29:49.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f595e7fc640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f594c066470 0x7f594c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f44226c9640 1 -- 172.21.15.143:0/3559624314 wait complete. 2023-11-24T06:29:49.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5958051b00 con 0x7f59600b1300 2023-11-24T06:29:49.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.150+0000 7f595e7fc640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f594c066470 0x7f594c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5960067a10 tx=0x7f5950008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 Processor -- start 2023-11-24T06:29:49.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 -- start start 2023-11-24T06:29:49.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0ce8b0 0x7f441c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 0x7f441c0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f441c15d570 0x7f441c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c15ed70 con 0x7f441c15d570 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c160790 con 0x7f441c0ce8b0 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.154+0000 7f44226c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c15e720 con 0x7f441c0d3020 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441b7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 0x7f441c0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441b7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 0x7f441c0cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43982/0 (socket says 172.21.15.143:43982) 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441b7fe640 1 -- 172.21.15.143:0/776499128 learned_addr learned my addr 172.21.15.143:0/776499128 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0ce8b0 0x7f441c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f4420c66640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f441c15d570 0x7f441c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 -- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 msgr2=0x7f441c0cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 0x7f441c0cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 -- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f441c15d570 msgr2=0x7f441c152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f441c15d570 0x7f441c152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 -- 172.21.15.143:0/776499128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100094d0 con 0x7f441c0ce8b0 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f4420c66640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f441c15d570 0x7f441c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441b7fe640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 0x7f441c0cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.158+0000 7f441bfff640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0ce8b0 0x7f441c15f200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f441400c680 tx=0x7f441400cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.162+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414003b80 con 0x7f441c0ce8b0 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.162+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414003ce0 con 0x7f441c0ce8b0 2023-11-24T06:29:49.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.162+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414005310 con 0x7f441c0ce8b0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.162+0000 7f44226c9640 1 -- 172.21.15.143:0/776499128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c15ea00 con 0x7f441c0ce8b0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.162+0000 7f44226c9640 1 -- 172.21.15.143:0/776499128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c15f740 con 0x7f441c0ce8b0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.166+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4414005470 con 0x7f441c0ce8b0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.166+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0d0360 con 0x7f441c0ce8b0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.166+0000 7f4418ff9640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44080664a0 0x7f4408068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.166+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4414083bc0 con 0x7f441c0ce8b0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.166+0000 7f441b7fe640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44080664a0 0x7f4408068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.166+0000 7f441b7fe640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44080664a0 0x7f4408068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f441001c550 tx=0x7f44100b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.174+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4414050fa0 con 0x7f441c0ce8b0 2023-11-24T06:29:49.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.198+0000 7fee1f5a1640 1 Processor -- start 2023-11-24T06:29:49.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.198+0000 7fee1f5a1640 1 -- start start 2023-11-24T06:29:49.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1f5a1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee180b12e0 0x7fee18159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1f5a1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 0x7fee180b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1f5a1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fee180b2f20 0x7fee18070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1f5a1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1815e0b0 con 0x7fee180b2f20 2023-11-24T06:29:49.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1f5a1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180b3370 con 0x7fee180b12e0 2023-11-24T06:29:49.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1f5a1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee18159960 con 0x7fee1806e260 2023-11-24T06:29:49.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 0x7fee180b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1db3e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fee180b2f20 0x7fee18070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 0x7fee180b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:43990/0 (socket says 172.21.15.143:43990) 2023-11-24T06:29:49.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 -- 172.21.15.143:0/3277113329 learned_addr learned my addr 172.21.15.143:0/3277113329 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1d33d640 1 --2- 172.21.15.143:0/3277113329 >> v2:172.21.15.146:3300/0 conn(0x7fee180b12e0 0x7fee18159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 -- 172.21.15.143:0/3277113329 >> v2:172.21.15.146:3300/0 conn(0x7fee180b12e0 msgr2=0x7fee18159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 --2- 172.21.15.143:0/3277113329 >> v2:172.21.15.146:3300/0 conn(0x7fee180b12e0 0x7fee18159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 -- 172.21.15.143:0/3277113329 >> v2:172.21.15.143:3300/0 conn(0x7fee180b2f20 msgr2=0x7fee18070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 --2- 172.21.15.143:0/3277113329 >> v2:172.21.15.143:3300/0 conn(0x7fee180b2f20 0x7fee18070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1cb3c640 1 -- 172.21.15.143:0/3277113329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1815daf0 con 0x7fee1806e260 2023-11-24T06:29:49.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7fee1db3e640 1 --2- 172.21.15.143:0/3277113329 >> v2:172.21.15.143:3300/0 conn(0x7fee180b2f20 0x7fee18070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:49.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.202+0000 7f94038c9640 1 Processor -- start 2023-11-24T06:29:49.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f94038c9640 1 -- start start 2023-11-24T06:29:49.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f94038c9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93fc159420 0x7f93fc06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f94038c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc0b30f0 0x7f93fc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f64c329a640 1 Processor -- start 2023-11-24T06:29:49.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f9400e64640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f93fc15d0a0 0x7f93fc0b29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32808/0 (socket says 172.21.15.143:32808) 2023-11-24T06:29:49.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f9400e64640 1 -- 172.21.15.143:0/3045342035 learned_addr learned my addr 172.21.15.143:0/3045342035 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:49.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f9401665640 1 --2- 172.21.15.143:0/3045342035 >> v2:172.21.15.146:3300/0 conn(0x7f93fc159420 0x7f93fc06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f9401e66640 1 --2- 172.21.15.143:0/3045342035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc0b30f0 0x7f93fc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc15daf0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.206+0000 7f64c329a640 1 -- start start 2023-11-24T06:29:49.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc15e0b0 con 0x7f93fc159420 2023-11-24T06:29:49.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7fee1cb3c640 1 --2- 172.21.15.143:0/3277113329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 0x7fee180b29e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee180b1c20 tx=0x7fee1401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87181a0de24ec684 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc15ddd0 con 0x7f93fc0b30f0 2023-11-24T06:29:49.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7fee0ffff640 1 -- 172.21.15.143:0/3277113329 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140aa5f0 con 0x7fee1806e260 2023-11-24T06:29:49.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7fee0ffff640 1 -- 172.21.15.143:0/3277113329 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee140aa750 con 0x7fee1806e260 2023-11-24T06:29:49.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7fee0ffff640 1 -- 172.21.15.143:0/3277113329 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140aaae0 con 0x7fee1806e260 2023-11-24T06:29:49.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f93f3fff640 1 -- 172.21.15.143:0/3045342035 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983488401 0 0) 0x7f93fc15daf0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f93f3fff640 1 -- 172.21.15.143:0/3045342035 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e8003530 con 0x7f93fc15d0a0 2023-11-24T06:29:49.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f9401e66640 1 -- 172.21.15.143:0/3045342035 >> v2:172.21.15.146:3300/0 conn(0x7f93fc159420 msgr2=0x7f93fc06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f9401e66640 1 --2- 172.21.15.143:0/3045342035 >> v2:172.21.15.146:3300/0 conn(0x7f93fc159420 0x7f93fc06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f9401e66640 1 -- 172.21.15.143:0/3045342035 >> v1:172.21.15.143:6789/0 conn(0x7f93fc15d0a0 legacy=0x7f93fc0b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f9401e66640 1 -- 172.21.15.143:0/3045342035 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc06da60 con 0x7f93fc0b30f0 2023-11-24T06:29:49.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c329a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc15f7a0 0x7f64bc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c0835640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc15f7a0 0x7f64bc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c0835640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc15f7a0 0x7f64bc0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:44004/0 (socket says 172.21.15.143:44004) 2023-11-24T06:29:49.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c1837640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f64bc0d0340 0x7f64bc0d0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32814/0 (socket says 172.21.15.143:32814) 2023-11-24T06:29:49.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c1036640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f64bc15b1e0 0x7f64bc06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:42350/0 (socket says 172.21.15.143:42350) 2023-11-24T06:29:49.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c0835640 1 -- 172.21.15.143:0/895825588 learned_addr learned my addr 172.21.15.143:0/895825588 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0cb7f0 con 0x7f64bc0d0340 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0cbd40 con 0x7f64bc15b1e0 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0cba60 con 0x7f64bc15f7a0 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145826502 0 0) 0x7f64bc0cb7f0 con 0x7f64bc0d0340 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a8003530 con 0x7f64bc0d0340 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856062226 0 0) 0x7f64bc0cbd40 con 0x7f64bc15b1e0 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64bc0cb7f0 con 0x7f64bc15b1e0 2023-11-24T06:29:49.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2515489289 0 0) 0x7f64bc0cb7f0 con 0x7f64bc15b1e0 2023-11-24T06:29:49.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc15f7a0 msgr2=0x7f64bc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc15f7a0 0x7f64bc0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 >> v1:172.21.15.143:6789/0 conn(0x7f64bc0d0340 legacy=0x7f64bc0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.210+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0d0a30 con 0x7f64bc15b1e0 2023-11-24T06:29:49.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3277113329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 msgr2=0x7fee180b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3277113329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 0x7fee180b29e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee180b1c20 tx=0x7fee1401c4f0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f64b4001a00 con 0x7f64bc15b1e0 2023-11-24T06:29:49.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 >> v1:172.21.15.146:6789/0 conn(0x7f64bc15b1e0 legacy=0x7f64bc06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64a8003b10 0x7f64a8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64a80047d0 0x7f64a8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64a800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0cba60 con 0x7f64a8005150 2023-11-24T06:29:49.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8005960 con 0x7f64a8003b10 2023-11-24T06:29:49.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8005b20 con 0x7f64a80047d0 2023-11-24T06:29:49.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1837640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64a800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1036640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64a8003b10 0x7f64a8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c0835640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64a80047d0 0x7f64a8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1837640 1 -- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64a80047d0 msgr2=0x7f64a8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1837640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64a80047d0 0x7f64a8004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1837640 1 -- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64a8003b10 msgr2=0x7f64a8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1837640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64a8003b10 0x7f64a8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f64c1837640 1 -- 172.21.15.143:0/895825588 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0d0a30 con 0x7f64a8005150 2023-11-24T06:29:49.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3277113329 shutdown_connections 2023-11-24T06:29:49.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3277113329 >> v2:172.21.15.143:3300/0 conn(0x7fee180b2f20 0x7fee18070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3277113329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1806e260 0x7fee180b29e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3277113329 >> v2:172.21.15.146:3300/0 conn(0x7fee180b12e0 0x7fee18159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7f9401e66640 1 --2- 172.21.15.143:0/3045342035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc0b30f0 0x7f93fc070a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00a860 tx=0x7f93ec020b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa9cdf6a37afe77d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3277113329 >> 172.21.15.143:0/3277113329 conn(0x7fee1806ae90 msgr2=0x7fee180b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3277113329 shutdown_connections 2023-11-24T06:29:49.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.214+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3277113329 wait complete. 2023-11-24T06:29:49.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f93f3fff640 1 -- 172.21.15.143:0/3045342035 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0a9bf0 con 0x7f93fc0b30f0 2023-11-24T06:29:49.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f93f3fff640 1 -- 172.21.15.143:0/3045342035 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec0a9d50 con 0x7f93fc0b30f0 2023-11-24T06:29:49.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f93f3fff640 1 -- 172.21.15.143:0/3045342035 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0b1660 con 0x7f93fc0b30f0 2023-11-24T06:29:49.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc0b30f0 msgr2=0x7f93fc070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 --2- 172.21.15.143:0/3045342035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc0b30f0 0x7f93fc070a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00a860 tx=0x7f93ec020b00 comp rx=0 tx=0).stop 2023-11-24T06:29:49.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 shutdown_connections 2023-11-24T06:29:49.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 --2- 172.21.15.143:0/3045342035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc0b30f0 0x7f93fc070a50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 --2- 172.21.15.143:0/3045342035 >> v2:172.21.15.146:3300/0 conn(0x7f93fc159420 0x7f93fc06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 >> 172.21.15.143:0/3045342035 conn(0x7f93fc06ae90 msgr2=0x7f93fc0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7fee1f5a1640 1 Processor -- start 2023-11-24T06:29:49.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7fee1f5a1640 1 -- start start 2023-11-24T06:29:49.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 shutdown_connections 2023-11-24T06:29:49.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f64c1837640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64a800fda0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0c49f0 tx=0x7f64ac01ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f35bcdb65461b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0ac030 con 0x7f64a8005150 2023-11-24T06:29:49.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1f5a1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 0x7fee1815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1f5a1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee180b12e0 0x7fee18155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1f5a1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 0x7fee18134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac0a8b30 con 0x7f64a8005150 2023-11-24T06:29:49.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64b3fff640 1 -- 172.21.15.143:0/895825588 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac007110 con 0x7f64a8005150 2023-11-24T06:29:49.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 0x7fee18134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 0x7fee18134490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37502/0 (socket says 172.21.15.143:37502) 2023-11-24T06:29:49.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1cb3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee180b12e0 0x7fee18155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1cb3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee180b12e0 0x7fee18155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:44024/0 (socket says 172.21.15.143:44024) 2023-11-24T06:29:49.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1d33d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 0x7fee1815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1d33d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 0x7fee1815c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47250/0 (socket says 172.21.15.143:47250) 2023-11-24T06:29:49.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.218+0000 7f94038c9640 1 -- 172.21.15.143:0/3045342035 wait complete. 2023-11-24T06:29:49.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f94038c9640 1 Processor -- start 2023-11-24T06:29:49.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 -- 172.21.15.143:0/3825363735 learned_addr learned my addr 172.21.15.143:0/3825363735 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18152010 con 0x7fee180b2f20 2023-11-24T06:29:49.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 msgr2=0x7f64a800fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18151440 con 0x7fee1806e260 2023-11-24T06:29:49.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64c329a640 1 --2- 172.21.15.143:0/895825588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64a800fda0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0c49f0 tx=0x7f64ac01ef10 comp rx=0 tx=0).stop 2023-11-24T06:29:49.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee18155e90 con 0x7fee180b12e0 2023-11-24T06:29:49.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64c1837640 1 -- 172.21.15.143:0/895825588 reap_dead start 2023-11-24T06:29:49.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f94038c9640 1 -- start start 2023-11-24T06:29:49.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 shutdown_connections 2023-11-24T06:29:49.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 >> 172.21.15.143:0/895825588 conn(0x7f64bc0701a0 msgr2=0x7f64bc0705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 -- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee180b12e0 msgr2=0x7fee18155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee180b12e0 0x7fee18155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 -- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 msgr2=0x7fee1815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 0x7fee1815c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1db3e640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10009a70 con 0x7fee180b2f20 2023-11-24T06:29:49.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.222+0000 7fee1d33d640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 0x7fee1815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:49.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7fee1db3e640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 0x7fee18134490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee10009e60 tx=0x7fee1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 shutdown_connections 2023-11-24T06:29:49.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f94038c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93fc0b30f0 0x7f93fc154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f94038c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93fc159420 0x7f93fc14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401665640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93fc0b30f0 0x7f93fc154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10009cd0 con 0x7fee180b2f20 2023-11-24T06:29:49.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f64c329a640 1 -- 172.21.15.143:0/895825588 wait complete. 2023-11-24T06:29:49.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401665640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93fc0b30f0 0x7f93fc154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37510/0 (socket says 172.21.15.143:37510) 2023-11-24T06:29:49.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f94038c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc15d0a0 0x7f93fc2048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f94038c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc14d000 con 0x7f93fc0b30f0 2023-11-24T06:29:49.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f94038c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc153f50 con 0x7f93fc159420 2023-11-24T06:29:49.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f94038c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc154230 con 0x7f93fc15d0a0 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401665640 1 -- 172.21.15.143:0/4282511748 learned_addr learned my addr 172.21.15.143:0/4282511748 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc15d0a0 0x7f93fc2048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 -- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93fc159420 msgr2=0x7f93fc14e890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93fc159420 0x7f93fc14e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 -- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93fc0b30f0 msgr2=0x7f93fc154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93fc0b30f0 0x7f93fc154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 -- 172.21.15.143:0/4282511748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec00a4d0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f9401e66640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc15d0a0 0x7f93fc2048a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0b0000 tx=0x7f93ec01d8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee140094d0 con 0x7fee180b2f20 2023-11-24T06:29:49.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee18071520 con 0x7fee180b2f20 2023-11-24T06:29:49.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000f040 con 0x7fee180b2f20 2023-11-24T06:29:49.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10017be0 con 0x7fee180b2f20 2023-11-24T06:29:49.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.226+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0a99f0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec0a9b50 con 0x7f93fc15d0a0 2023-11-24T06:29:49.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc15d8c0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0b2d50 con 0x7f93fc15d0a0 2023-11-24T06:29:49.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc14d2e0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc04e850 con 0x7f93fc15d0a0 2023-11-24T06:29:49.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f64c329a640 1 Processor -- start 2023-11-24T06:29:49.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7f64c329a640 1 -- start start 2023-11-24T06:29:49.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf8005260 con 0x7fee180b2f20 2023-11-24T06:29:49.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.230+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee10017d40 con 0x7fee180b2f20 2023-11-24T06:29:49.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c329a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64bc0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c329a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64bc15e360 0x7f64bc1f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c329a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc1f2430 0x7f64bc0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c329a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc1f28e0 con 0x7f64a8005150 2023-11-24T06:29:49.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c329a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0c5dc0 con 0x7f64bc15e360 2023-11-24T06:29:49.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c329a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0c9190 con 0x7f64bc1f2430 2023-11-24T06:29:49.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93ec0bc460 con 0x7f93fc15d0a0 2023-11-24T06:29:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c0835640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64bc15e360 0x7f64bc1f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c0835640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64bc15e360 0x7f64bc1f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47256/0 (socket says 172.21.15.143:47256) 2023-11-24T06:29:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64bc0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64bc0ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37520/0 (socket says 172.21.15.143:37520) 2023-11-24T06:29:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 -- 172.21.15.143:0/2686173891 learned_addr learned my addr 172.21.15.143:0/2686173891 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7fee0dffb640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fedfc066570 0x7fedfc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee1008c9f0 con 0x7fee180b2f20 2023-11-24T06:29:49.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 -- 172.21.15.143:0/2686173891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc1f2430 msgr2=0x7f64bc0c84b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:29:49.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc1f2430 0x7f64bc0c84b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 -- 172.21.15.143:0/2686173891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64bc15e360 msgr2=0x7f64bc1f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64bc15e360 0x7f64bc1f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 -- 172.21.15.143:0/2686173891 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0b4150 con 0x7f64a8005150 2023-11-24T06:29:49.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f93f1ffb640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f93e0066470 0x7f93e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93ec11eaa0 con 0x7f93fc15d0a0 2023-11-24T06:29:49.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f64c1036640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64bc0ca230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f64b4007790 tx=0x7f64b400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7f9401665640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f93e0066470 0x7f93e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.234+0000 7fee1d33d640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fedfc066570 0x7fedfc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.238+0000 7f9401665640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f93e0066470 0x7f93e0068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93f800b240 tx=0x7f93f800b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.238+0000 7fee1d33d640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fedfc066570 0x7fedfc068a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee08004630 tx=0x7fee08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.238+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93ec0ec050 con 0x7f93fc15d0a0 2023-11-24T06:29:49.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.242+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4007880 con 0x7f64a8005150 2023-11-24T06:29:49.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.242+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b40079e0 con 0x7f64a8005150 2023-11-24T06:29:49.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.242+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4007880 con 0x7f64a8005150 2023-11-24T06:29:49.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.242+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee10059ee0 con 0x7fee180b2f20 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.242+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc0c9470 con 0x7f64a8005150 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.246+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc0c9a30 con 0x7f64a8005150 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.246+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc04e850 con 0x7f64a8005150 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.246+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64b401d460 con 0x7f64a8005150 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.246+0000 7f64b1ffb640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f64a0066500 0x7f64a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.250+0000 7f64c0835640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f64a0066500 0x7f64a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.254+0000 7f64c0835640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f64a0066500 0x7f64a00689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0cb6b0 tx=0x7f64b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.254+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b4054ef0 con 0x7f64a8005150 2023-11-24T06:29:49.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.258+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64b40512c0 con 0x7f64a8005150 2023-11-24T06:29:49.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.414+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6328070d90 con 0x7f632815d8d0 2023-11-24T06:29:49.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.418+0000 7f630ffff640 1 -- 172.21.15.143:0/4161999441 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f631805c690 con 0x7f632815d8d0 2023-11-24T06:29:49.420 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:49.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.418+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6314066470 msgr2=0x7f6314068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.418+0000 7f632ce74640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6314066470 0x7f6314068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63200ae000 tx=0x7f6320004ac0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.418+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f632815d8d0 msgr2=0x7f632815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.418+0000 7f632ce74640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f632815d8d0 0x7f632815dd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f63180099f0 tx=0x7f6318009eb0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.418+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 shutdown_connections 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6314066470 0x7f6314068930 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63200ae000 tx=0x7f6320004ac0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f632815d8d0 0x7f632815dd50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63280ae590 0x7f632815ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 --2- 172.21.15.143:0/4161999441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f632806dc30 0x7f632813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 >> 172.21.15.143:0/4161999441 conn(0x7f63280cf0d0 msgr2=0x7f6328154770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 shutdown_connections 2023-11-24T06:29:49.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.422+0000 7f632ce74640 1 -- 172.21.15.143:0/4161999441 wait complete. 2023-11-24T06:29:49.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-11-24T06:29:49.457 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.462+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f76dc09d250 con 0x7f76dc0aedc0 2023-11-24T06:29:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.462+0000 7f76d2ffd640 1 -- 172.21.15.143:0/2058357778 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76d40018d0 con 0x7f76dc0aedc0 2023-11-24T06:29:49.467 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2023-11-24T06:29:49.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.466+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76c00664c0 msgr2=0x7f76c0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.466+0000 7f76e43df640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76c00664c0 0x7f76c0068980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ad000 tx=0x7f76d8004780 comp rx=0 tx=0).stop 2023-11-24T06:29:49.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.466+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 msgr2=0x7f76dc0c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.466+0000 7f76e43df640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 0x7f76dc0c8c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f76d400e510 tx=0x7f76d400e9d0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 shutdown_connections 2023-11-24T06:29:49.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76c00664c0 0x7f76c0068980 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76dc15c840 0x7f76dc0999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76dc0af1a0 0x7f76dc09b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 --2- 172.21.15.143:0/2058357778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76dc0aedc0 0x7f76dc0c8c10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 >> 172.21.15.143:0/2058357778 conn(0x7f76dc0b0bf0 msgr2=0x7f76dc0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 shutdown_connections 2023-11-24T06:29:49.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.470+0000 7f76e43df640 1 -- 172.21.15.143:0/2058357778 wait complete. 2023-11-24T06:29:49.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.478+0000 7f595ffff640 1 -- 172.21.15.143:0/417507634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f59600c9f00 con 0x7f59600b1300 2023-11-24T06:29:49.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.478+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f74b004e850 con 0x7f74b00b12e0 2023-11-24T06:29:49.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.486+0000 7f59477fe640 1 -- 172.21.15.143:0/417507634 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59600c9f00 con 0x7f59600b1300 2023-11-24T06:29:49.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.486+0000 7f74977fe640 1 -- 172.21.15.143:0/3798193011 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74a40f2420 con 0x7f74b00b12e0 2023-11-24T06:29:49.489 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:49.489 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:49.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.486+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f749c0664c0 msgr2=0x7f749c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.486+0000 7f74957fa640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f749c0664c0 0x7f749c068980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74b015cbb0 tx=0x7f74a0009110 comp rx=0 tx=0).stop 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.486+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 msgr2=0x7f74b015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.486+0000 7f74957fa640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 0x7f74b015c040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000c10 tx=0x7f74a401bab0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 -- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f594c066470 msgr2=0x7f594c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f594c066470 0x7f594c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5960067a10 tx=0x7f5950008040 comp rx=0 tx=0).stop 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 -- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 msgr2=0x7f5960155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 0x7f5960155520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f595800c7a0 tx=0x7f595800cc60 comp rx=0 tx=0).stop 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 shutdown_connections 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f749c0664c0 0x7f749c068980 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74b015d5e0 0x7f74b0070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74b01591c0 0x7f74b0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 --2- 172.21.15.143:0/3798193011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00b12e0 0x7f74b015c040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 >> 172.21.15.143:0/3798193011 conn(0x7f74b006ae90 msgr2=0x7f74b00b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 -- 172.21.15.143:0/417507634 shutdown_connections 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f594c066470 0x7f594c068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f596015d310 0x7f5960158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59600cb5c0 0x7f5960158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 --2- 172.21.15.143:0/417507634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59600b1300 0x7f5960155520 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 -- 172.21.15.143:0/417507634 >> 172.21.15.143:0/417507634 conn(0x7f59600cbb50 msgr2=0x7f5960070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 shutdown_connections 2023-11-24T06:29:49.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f74957fa640 1 -- 172.21.15.143:0/3798193011 wait complete. 2023-11-24T06:29:49.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 -- 172.21.15.143:0/417507634 shutdown_connections 2023-11-24T06:29:49.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.490+0000 7f59457fa640 1 -- 172.21.15.143:0/417507634 wait complete. 2023-11-24T06:29:49.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.494+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f441c0b5d10 con 0x7f441c0ce8b0 2023-11-24T06:29:49.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.498+0000 7f4418ff9640 1 -- 172.21.15.143:0/776499128 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44140545c0 con 0x7f441c0ce8b0 2023-11-24T06:29:49.500 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2023-11-24T06:29:49.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-11-24T06:29:49.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44080664a0 msgr2=0x7f4408068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44080664a0 0x7f4408068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f441001c550 tx=0x7f44100b5040 comp rx=0 tx=0).stop 2023-11-24T06:29:49.505 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0ce8b0 msgr2=0x7f441c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0ce8b0 0x7f441c15f200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f441400c680 tx=0x7f441400cb40 comp rx=0 tx=0).stop 2023-11-24T06:29:49.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 shutdown_connections 2023-11-24T06:29:49.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44080664a0 0x7f4408068960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f441c15d570 0x7f441c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f441c0d3020 0x7f441c0cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 --2- 172.21.15.143:0/776499128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c0ce8b0 0x7f441c15f200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 >> 172.21.15.143:0/776499128 conn(0x7f441c08ceb0 msgr2=0x7f441c159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 shutdown_connections 2023-11-24T06:29:49.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.502+0000 7f44027fc640 1 -- 172.21.15.143:0/776499128 wait complete. 2023-11-24T06:29:49.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-11-24T06:29:49.522 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-11-24T06:29:49.531 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fedf8005510 con 0x7fee180b2f20 2023-11-24T06:29:49.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee0dffb640 1 -- 172.21.15.143:0/3825363735 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee1005d500 con 0x7fee180b2f20 2023-11-24T06:29:49.537 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:49.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-11-24T06:29:49.542 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fedfc066570 msgr2=0x7fedfc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fedfc066570 0x7fedfc068a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee08004630 tx=0x7fee08008040 comp rx=0 tx=0).stop 2023-11-24T06:29:49.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 msgr2=0x7fee18134490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 0x7fee18134490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee10009e60 tx=0x7fee1000c490 comp rx=0 tx=0).stop 2023-11-24T06:29:49.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 shutdown_connections 2023-11-24T06:29:49.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fedfc066570 0x7fedfc068a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee180b2f20 0x7fee18134490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee180b12e0 0x7fee18155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 --2- 172.21.15.143:0/3825363735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1806e260 0x7fee1815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 >> 172.21.15.143:0/3825363735 conn(0x7fee1806ae90 msgr2=0x7fee180aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 shutdown_connections 2023-11-24T06:29:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.534+0000 7fee1f5a1640 1 -- 172.21.15.143:0/3825363735 wait complete. 2023-11-24T06:29:49.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.538+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64bc0ce840 con 0x7f64a8005150 2023-11-24T06:29:49.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.538+0000 7f64b1ffb640 1 -- 172.21.15.143:0/2686173891 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64b4051460 con 0x7f64a8005150 2023-11-24T06:29:49.545 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2023-11-24T06:29:49.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93fc154370 con 0x7f93fc15d0a0 2023-11-24T06:29:49.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f93f1ffb640 1 -- 172.21.15.143:0/4282511748 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93fc154370 con 0x7f93fc15d0a0 2023-11-24T06:29:49.546 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2023-11-24T06:29:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f64a0066500 msgr2=0x7f64a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f64a0066500 0x7f64a00689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0cb6b0 tx=0x7f64b8008040 comp rx=0 tx=0).stop 2023-11-24T06:29:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 msgr2=0x7f64bc0ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64bc0ca230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f64b4007790 tx=0x7f64b400f5a0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 shutdown_connections 2023-11-24T06:29:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f64a0066500 0x7f64a00689c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64bc1f2430 0x7f64bc0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64bc15e360 0x7f64bc1f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 --2- 172.21.15.143:0/2686173891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64a8005150 0x7f64bc0ca230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 >> 172.21.15.143:0/2686173891 conn(0x7f64bc0701a0 msgr2=0x7f64bc0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 shutdown_connections 2023-11-24T06:29:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f64c329a640 1 -- 172.21.15.143:0/2686173891 wait complete. 2023-11-24T06:29:49.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f93e0066470 msgr2=0x7f93e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f93e0066470 0x7f93e0068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93f800b240 tx=0x7f93f800b3a0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc15d0a0 msgr2=0x7f93fc2048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc15d0a0 0x7f93fc2048a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0b0000 tx=0x7f93ec01d8a0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 shutdown_connections 2023-11-24T06:29:49.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f93e0066470 0x7f93e0068930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93fc15d0a0 0x7f93fc2048a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93fc159420 0x7f93fc14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 --2- 172.21.15.143:0/4282511748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93fc0b30f0 0x7f93fc154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.542+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 >> 172.21.15.143:0/4282511748 conn(0x7f93fc06ae90 msgr2=0x7f93fc0af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.546+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 shutdown_connections 2023-11-24T06:29:49.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.546+0000 7f94038c9640 1 -- 172.21.15.143:0/4282511748 wait complete. 2023-11-24T06:29:49.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-11-24T06:29:49.566 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-11-24T06:29:49.571 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-24T06:29:49.572 DEBUG:teuthology.parallel:result is None 2023-11-24T06:29:49.572 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:29:49.573 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:29:49.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.742+0000 7ff50b5aa640 1 Processor -- start 2023-11-24T06:29:49.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.742+0000 7ff50b5aa640 1 -- start start 2023-11-24T06:29:49.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff50b5aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5040b1ef0 0x7ff504164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff50b5aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50415a700 con 0x7ff5040b36c0 2023-11-24T06:29:49.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff50b5aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5040b2620 con 0x7ff50415a320 2023-11-24T06:29:49.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff50b5aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040b2900 con 0x7ff5040b1ef0 2023-11-24T06:29:49.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff508b45640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff5040b36c0 0x7ff504070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32826/0 (socket says 172.21.15.143:32826) 2023-11-24T06:29:49.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff508b45640 1 -- 172.21.15.143:0/4069455941 learned_addr learned my addr 172.21.15.143:0/4069455941 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:49.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 --2- 172.21.15.143:0/4069455941 >> v2:172.21.15.146:3300/0 conn(0x7ff5040b1ef0 0x7ff504164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049855718 0 0) 0x7ff50415a700 con 0x7ff5040b36c0 2023-11-24T06:29:49.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f0005740 con 0x7ff5040b36c0 2023-11-24T06:29:49.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341018351 0 0) 0x7ff4f0005740 con 0x7ff5040b36c0 2023-11-24T06:29:49.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 >> v2:172.21.15.146:3300/0 conn(0x7ff5040b1ef0 msgr2=0x7ff504164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 --2- 172.21.15.143:0/4069455941 >> v2:172.21.15.146:3300/0 conn(0x7ff5040b1ef0 0x7ff504164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 >> v1:172.21.15.146:6789/0 conn(0x7ff50415a320 legacy=0x7ff504070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040b2be0 con 0x7ff5040b36c0 2023-11-24T06:29:49.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7ff4f4001680 con 0x7ff5040b36c0 2023-11-24T06:29:49.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 >> v1:172.21.15.143:6789/0 conn(0x7ff5040b36c0 legacy=0x7ff504070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4f0005b90 0x7ff4f0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00069e0 0x7ff4f0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4f00073a0 0x7ff4f000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b2900 con 0x7ff4f00073a0 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f000e240 con 0x7ff4f0005b90 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f000e400 con 0x7ff4f00069e0 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4f00073a0 0x7ff4f000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509346640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4f0005b90 0x7ff4f0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff508b45640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00069e0 0x7ff4f0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 -- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00069e0 msgr2=0x7ff4f0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00069e0 0x7ff4f0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 -- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4f0005b90 msgr2=0x7ff4f0005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:49.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4f0005b90 0x7ff4f0005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.746+0000 7ff509b47640 1 -- 172.21.15.143:0/4069455941 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0005740 con 0x7ff4f00073a0 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff509b47640 1 -- 172.21.15.143:0/4069455941 reap_dead start 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff509b47640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4f00073a0 0x7ff4f000dba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009fc0 tx=0x7ff4fc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a02b1146566105a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5ab0 con 0x7ff4f00073a0 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00f040 con 0x7ff4f00073a0 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff4fbfff640 1 -- 172.21.15.143:0/4069455941 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5e90 con 0x7ff4f00073a0 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 -- 172.21.15.143:0/4069455941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4f00073a0 msgr2=0x7ff4f000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4f00073a0 0x7ff4f000dba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009fc0 tx=0x7ff4fc01cca0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 -- 172.21.15.143:0/4069455941 shutdown_connections 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/4069455941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4f00073a0 0x7ff4f000dba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 -- 172.21.15.143:0/4069455941 >> 172.21.15.143:0/4069455941 conn(0x7ff5040b0bf0 msgr2=0x7ff5040b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 -- 172.21.15.143:0/4069455941 shutdown_connections 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.750+0000 7ff50b5aa640 1 -- 172.21.15.143:0/4069455941 wait complete. 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 Processor -- start 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- start start 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00073a0 0x7ff5040cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff50415b750 0x7ff5041ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 0x7ff504154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415d640 con 0x7ff504158500 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040cf920 con 0x7ff50415b750 2023-11-24T06:29:49.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff504155fc0 con 0x7ff4f00073a0 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 0x7ff504154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 0x7ff504154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37542/0 (socket says 172.21.15.143:37542) 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 -- 172.21.15.143:0/2937998098 learned_addr learned my addr 172.21.15.143:0/2937998098 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509346640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00073a0 0x7ff5040cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff508b45640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff50415b750 0x7ff5041ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 -- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00073a0 msgr2=0x7ff5040cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00073a0 0x7ff5040cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 -- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff50415b750 msgr2=0x7ff5041ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff50415b750 0x7ff5041ef950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 -- 172.21.15.143:0/2937998098 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50415bcc0 con 0x7ff504158500 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff509b47640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 0x7ff504154c20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0987d0 tx=0x7ff4fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0aeec0 con 0x7ff504158500 2023-11-24T06:29:49.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0a5ab0 con 0x7ff504158500 2023-11-24T06:29:49.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5ea0 con 0x7ff504158500 2023-11-24T06:29:49.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50415bfa0 con 0x7ff504158500 2023-11-24T06:29:49.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50415c560 con 0x7ff504158500 2023-11-24T06:29:49.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.754+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff504156150 con 0x7ff504158500 2023-11-24T06:29:49.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.758+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4fc0039a0 con 0x7ff504158500 2023-11-24T06:29:49.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.758+0000 7ff4f9ffb640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff4e80664a0 0x7ff4e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:49.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.758+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4fc11ee50 con 0x7ff504158500 2023-11-24T06:29:49.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.758+0000 7ff509346640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff4e80664a0 0x7ff4e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:49.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.758+0000 7ff509346640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff4e80664a0 0x7ff4e8068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff500000c10 tx=0x7ff500009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:49.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.762+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4fc0ec370 con 0x7ff504158500 2023-11-24T06:29:49.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.910+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5040b2340 con 0x7ff4e80664a0 2023-11-24T06:29:49.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.918+0000 7ff4f9ffb640 1 -- 172.21.15.143:0/2937998098 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7ff500001440 con 0x7ff4e80664a0 2023-11-24T06:29:49.924 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:49.926 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:29:49.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff4e80664a0 msgr2=0x7ff4e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff4e80664a0 0x7ff4e8068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff500000c10 tx=0x7ff500009040 comp rx=0 tx=0).stop 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 msgr2=0x7ff504154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 0x7ff504154c20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0987d0 tx=0x7ff4fc009750 comp rx=0 tx=0).stop 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 shutdown_connections 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff4e80664a0 0x7ff4e8068960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff504158500 0x7ff504154c20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff50415b750 0x7ff5041ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 --2- 172.21.15.143:0/2937998098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4f00073a0 0x7ff5040cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:49.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 >> 172.21.15.143:0/2937998098 conn(0x7ff5040b0bf0 msgr2=0x7ff50406d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:49.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 shutdown_connections 2023-11-24T06:29:49.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:49.922+0000 7ff50b5aa640 1 -- 172.21.15.143:0/2937998098 wait complete. 2023-11-24T06:29:49.945 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-24T06:29:48.208276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2887680,"data_stored":1751867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.895509"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413188+0000","last_change":"2023-11-24T06:29:41.035477+0000","last_active":"2023-11-24T06:29:42.413188+0000","last_peered":"2023-11-24T06:29:42.413188+0000","last_clean":"2023-11-24T06:29:42.413188+0000","last_became_active":"2023-11-24T06:29:41.035174+0000","last_became_peered":"2023-11-24T06:29:41.035174+0000","last_unstale":"2023-11-24T06:29:42.413188+0000","last_undegraded":"2023-11-24T06:29:42.413188+0000","last_fullsized":"2023-11-24T06:29:42.413188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010247+0000","last_change":"2023-11-24T06:29:41.022068+0000","last_active":"2023-11-24T06:29:42.010247+0000","last_peered":"2023-11-24T06:29:42.010247+0000","last_clean":"2023-11-24T06:29:42.010247+0000","last_became_active":"2023-11-24T06:29:41.021715+0000","last_became_peered":"2023-11-24T06:29:41.021715+0000","last_unstale":"2023-11-24T06:29:42.010247+0000","last_undegraded":"2023-11-24T06:29:42.010247+0000","last_fullsized":"2023-11-24T06:29:42.010247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411078+0000","last_change":"2023-11-24T06:29:41.024602+0000","last_active":"2023-11-24T06:29:42.411078+0000","last_peered":"2023-11-24T06:29:42.411078+0000","last_clean":"2023-11-24T06:29:42.411078+0000","last_became_active":"2023-11-24T06:29:41.024285+0000","last_became_peered":"2023-11-24T06:29:41.024285+0000","last_unstale":"2023-11-24T06:29:42.411078+0000","last_undegraded":"2023-11-24T06:29:42.411078+0000","last_fullsized":"2023-11-24T06:29:42.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412375+0000","last_change":"2023-11-24T06:29:41.041359+0000","last_active":"2023-11-24T06:29:42.412375+0000","last_peered":"2023-11-24T06:29:42.412375+0000","last_clean":"2023-11-24T06:29:42.412375+0000","last_became_active":"2023-11-24T06:29:41.040996+0000","last_became_peered":"2023-11-24T06:29:41.040996+0000","last_unstale":"2023-11-24T06:29:42.412375+0000","last_undegraded":"2023-11-24T06:29:42.412375+0000","last_fullsized":"2023-11-24T06:29:42.412375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412762+0000","last_change":"2023-11-24T06:29:41.034177+0000","last_active":"2023-11-24T06:29:42.412762+0000","last_peered":"2023-11-24T06:29:42.412762+0000","last_clean":"2023-11-24T06:29:42.412762+0000","last_became_active":"2023-11-24T06:29:41.033446+0000","last_became_peered":"2023-11-24T06:29:41.033446+0000","last_unstale":"2023-11-24T06:29:42.412762+0000","last_undegraded":"2023-11-24T06:29:42.412762+0000","last_fullsized":"2023-11-24T06:29:42.412762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411687+0000","last_change":"2023-11-24T06:29:41.038649+0000","last_active":"2023-11-24T06:29:42.411687+0000","last_peered":"2023-11-24T06:29:42.411687+0000","last_clean":"2023-11-24T06:29:42.411687+0000","last_became_active":"2023-11-24T06:29:41.038301+0000","last_became_peered":"2023-11-24T06:29:41.038301+0000","last_unstale":"2023-11-24T06:29:42.411687+0000","last_undegraded":"2023-11-24T06:29:42.411687+0000","last_fullsized":"2023-11-24T06:29:42.411687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.023574+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.023253+0000","last_became_peered":"2023-11-24T06:29:41.023253+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008553+0000","last_change":"2023-11-24T06:29:41.047704+0000","last_active":"2023-11-24T06:29:42.008553+0000","last_peered":"2023-11-24T06:29:42.008553+0000","last_clean":"2023-11-24T06:29:42.008553+0000","last_became_active":"2023-11-24T06:29:41.047479+0000","last_became_peered":"2023-11-24T06:29:41.047479+0000","last_unstale":"2023-11-24T06:29:42.008553+0000","last_undegraded":"2023-11-24T06:29:42.008553+0000","last_fullsized":"2023-11-24T06:29:42.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413219+0000","last_change":"2023-11-24T06:29:41.038737+0000","last_active":"2023-11-24T06:29:42.413219+0000","last_peered":"2023-11-24T06:29:42.413219+0000","last_clean":"2023-11-24T06:29:42.413219+0000","last_became_active":"2023-11-24T06:29:41.038472+0000","last_became_peered":"2023-11-24T06:29:41.038472+0000","last_unstale":"2023-11-24T06:29:42.413219+0000","last_undegraded":"2023-11-24T06:29:42.413219+0000","last_fullsized":"2023-11-24T06:29:42.413219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402616+0000","last_change":"2023-11-24T06:29:41.045851+0000","last_active":"2023-11-24T06:29:42.402616+0000","last_peered":"2023-11-24T06:29:42.402616+0000","last_clean":"2023-11-24T06:29:42.402616+0000","last_became_active":"2023-11-24T06:29:41.044799+0000","last_became_peered":"2023-11-24T06:29:41.044799+0000","last_unstale":"2023-11-24T06:29:42.402616+0000","last_undegraded":"2023-11-24T06:29:42.402616+0000","last_fullsized":"2023-11-24T06:29:42.402616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402357+0000","last_change":"2023-11-24T06:29:41.045092+0000","last_active":"2023-11-24T06:29:42.402357+0000","last_peered":"2023-11-24T06:29:42.402357+0000","last_clean":"2023-11-24T06:29:42.402357+0000","last_became_active":"2023-11-24T06:29:41.044758+0000","last_became_peered":"2023-11-24T06:29:41.044758+0000","last_unstale":"2023-11-24T06:29:42.402357+0000","last_undegraded":"2023-11-24T06:29:42.402357+0000","last_fullsized":"2023-11-24T06:29:42.402357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411929+0000","last_change":"2023-11-24T06:29:41.029744+0000","last_active":"2023-11-24T06:29:42.411929+0000","last_peered":"2023-11-24T06:29:42.411929+0000","last_clean":"2023-11-24T06:29:42.411929+0000","last_became_active":"2023-11-24T06:29:41.029413+0000","last_became_peered":"2023-11-24T06:29:41.029413+0000","last_unstale":"2023-11-24T06:29:42.411929+0000","last_undegraded":"2023-11-24T06:29:42.411929+0000","last_fullsized":"2023-11-24T06:29:42.411929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:40.396297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009191+0000","last_change":"2023-11-24T06:29:41.032796+0000","last_active":"2023-11-24T06:29:42.009191+0000","last_peered":"2023-11-24T06:29:42.009191+0000","last_clean":"2023-11-24T06:29:42.009191+0000","last_became_active":"2023-11-24T06:29:41.032526+0000","last_became_peered":"2023-11-24T06:29:41.032526+0000","last_unstale":"2023-11-24T06:29:42.009191+0000","last_undegraded":"2023-11-24T06:29:42.009191+0000","last_fullsized":"2023-11-24T06:29:42.009191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410937+0000","last_change":"2023-11-24T06:29:41.022282+0000","last_active":"2023-11-24T06:29:42.410937+0000","last_peered":"2023-11-24T06:29:42.410937+0000","last_clean":"2023-11-24T06:29:42.410937+0000","last_became_active":"2023-11-24T06:29:41.021823+0000","last_became_peered":"2023-11-24T06:29:41.021823+0000","last_unstale":"2023-11-24T06:29:42.410937+0000","last_undegraded":"2023-11-24T06:29:42.410937+0000","last_fullsized":"2023-11-24T06:29:42.410937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:06.770793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010312+0000","last_change":"2023-11-24T06:29:41.013047+0000","last_active":"2023-11-24T06:29:42.010312+0000","last_peered":"2023-11-24T06:29:42.010312+0000","last_clean":"2023-11-24T06:29:42.010312+0000","last_became_active":"2023-11-24T06:29:41.012696+0000","last_became_peered":"2023-11-24T06:29:41.012696+0000","last_unstale":"2023-11-24T06:29:42.010312+0000","last_undegraded":"2023-11-24T06:29:42.010312+0000","last_fullsized":"2023-11-24T06:29:42.010312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041964+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.041680+0000","last_became_peered":"2023-11-24T06:29:41.041680+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412021+0000","last_change":"2023-11-24T06:29:41.041640+0000","last_active":"2023-11-24T06:29:42.412021+0000","last_peered":"2023-11-24T06:29:42.412021+0000","last_clean":"2023-11-24T06:29:42.412021+0000","last_became_active":"2023-11-24T06:29:41.040550+0000","last_became_peered":"2023-11-24T06:29:41.040550+0000","last_unstale":"2023-11-24T06:29:42.412021+0000","last_undegraded":"2023-11-24T06:29:42.412021+0000","last_fullsized":"2023-11-24T06:29:42.412021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009398+0000","last_change":"2023-11-24T06:29:41.033224+0000","last_active":"2023-11-24T06:29:42.009398+0000","last_peered":"2023-11-24T06:29:42.009398+0000","last_clean":"2023-11-24T06:29:42.009398+0000","last_became_active":"2023-11-24T06:29:41.032892+0000","last_became_peered":"2023-11-24T06:29:41.032892+0000","last_unstale":"2023-11-24T06:29:42.009398+0000","last_undegraded":"2023-11-24T06:29:42.009398+0000","last_fullsized":"2023-11-24T06:29:42.009398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413054+0000","last_change":"2023-11-24T06:29:41.026686+0000","last_active":"2023-11-24T06:29:42.413054+0000","last_peered":"2023-11-24T06:29:42.413054+0000","last_clean":"2023-11-24T06:29:42.413054+0000","last_became_active":"2023-11-24T06:29:41.026385+0000","last_became_peered":"2023-11-24T06:29:41.026385+0000","last_unstale":"2023-11-24T06:29:42.413054+0000","last_undegraded":"2023-11-24T06:29:42.413054+0000","last_fullsized":"2023-11-24T06:29:42.413054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402323+0000","last_change":"2023-11-24T06:29:41.036431+0000","last_active":"2023-11-24T06:29:42.402323+0000","last_peered":"2023-11-24T06:29:42.402323+0000","last_clean":"2023-11-24T06:29:42.402323+0000","last_became_active":"2023-11-24T06:29:41.035252+0000","last_became_peered":"2023-11-24T06:29:41.035252+0000","last_unstale":"2023-11-24T06:29:42.402323+0000","last_undegraded":"2023-11-24T06:29:42.402323+0000","last_fullsized":"2023-11-24T06:29:42.402323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411213+0000","last_change":"2023-11-24T06:29:41.035408+0000","last_active":"2023-11-24T06:29:42.411213+0000","last_peered":"2023-11-24T06:29:42.411213+0000","last_clean":"2023-11-24T06:29:42.411213+0000","last_became_active":"2023-11-24T06:29:41.035123+0000","last_became_peered":"2023-11-24T06:29:41.035123+0000","last_unstale":"2023-11-24T06:29:42.411213+0000","last_undegraded":"2023-11-24T06:29:42.411213+0000","last_fullsized":"2023-11-24T06:29:42.411213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411820+0000","last_change":"2023-11-24T06:29:41.038635+0000","last_active":"2023-11-24T06:29:42.411820+0000","last_peered":"2023-11-24T06:29:42.411820+0000","last_clean":"2023-11-24T06:29:42.411820+0000","last_became_active":"2023-11-24T06:29:41.038315+0000","last_became_peered":"2023-11-24T06:29:41.038315+0000","last_unstale":"2023-11-24T06:29:42.411820+0000","last_undegraded":"2023-11-24T06:29:42.411820+0000","last_fullsized":"2023-11-24T06:29:42.411820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009568+0000","last_change":"2023-11-24T06:29:41.032241+0000","last_active":"2023-11-24T06:29:42.009568+0000","last_peered":"2023-11-24T06:29:42.009568+0000","last_clean":"2023-11-24T06:29:42.009568+0000","last_became_active":"2023-11-24T06:29:41.031925+0000","last_became_peered":"2023-11-24T06:29:41.031925+0000","last_unstale":"2023-11-24T06:29:42.009568+0000","last_undegraded":"2023-11-24T06:29:42.009568+0000","last_fullsized":"2023-11-24T06:29:42.009568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041084+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.040726+0000","last_became_peered":"2023-11-24T06:29:41.040726+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009949+0000","last_change":"2023-11-24T06:29:41.032304+0000","last_active":"2023-11-24T06:29:42.009949+0000","last_peered":"2023-11-24T06:29:42.009949+0000","last_clean":"2023-11-24T06:29:42.009949+0000","last_became_active":"2023-11-24T06:29:41.031960+0000","last_became_peered":"2023-11-24T06:29:41.031960+0000","last_unstale":"2023-11-24T06:29:42.009949+0000","last_undegraded":"2023-11-24T06:29:42.009949+0000","last_fullsized":"2023-11-24T06:29:42.009949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402649+0000","last_change":"2023-11-24T06:29:41.034986+0000","last_active":"2023-11-24T06:29:42.402649+0000","last_peered":"2023-11-24T06:29:42.402649+0000","last_clean":"2023-11-24T06:29:42.402649+0000","last_became_active":"2023-11-24T06:29:41.034673+0000","last_became_peered":"2023-11-24T06:29:41.034673+0000","last_unstale":"2023-11-24T06:29:42.402649+0000","last_undegraded":"2023-11-24T06:29:42.402649+0000","last_fullsized":"2023-11-24T06:29:42.402649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009912+0000","last_change":"2023-11-24T06:29:41.027454+0000","last_active":"2023-11-24T06:29:42.009912+0000","last_peered":"2023-11-24T06:29:42.009912+0000","last_clean":"2023-11-24T06:29:42.009912+0000","last_became_active":"2023-11-24T06:29:41.027070+0000","last_became_peered":"2023-11-24T06:29:41.027070+0000","last_unstale":"2023-11-24T06:29:42.009912+0000","last_undegraded":"2023-11-24T06:29:42.009912+0000","last_fullsized":"2023-11-24T06:29:42.009912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010197+0000","last_change":"2023-11-24T06:29:41.031595+0000","last_active":"2023-11-24T06:29:42.010197+0000","last_peered":"2023-11-24T06:29:42.010197+0000","last_clean":"2023-11-24T06:29:42.010197+0000","last_became_active":"2023-11-24T06:29:41.031166+0000","last_became_peered":"2023-11-24T06:29:41.031166+0000","last_unstale":"2023-11-24T06:29:42.010197+0000","last_undegraded":"2023-11-24T06:29:42.010197+0000","last_fullsized":"2023-11-24T06:29:42.010197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411267+0000","last_change":"2023-11-24T06:29:41.021334+0000","last_active":"2023-11-24T06:29:42.411267+0000","last_peered":"2023-11-24T06:29:42.411267+0000","last_clean":"2023-11-24T06:29:42.411267+0000","last_became_active":"2023-11-24T06:29:41.021017+0000","last_became_peered":"2023-11-24T06:29:41.021017+0000","last_unstale":"2023-11-24T06:29:42.411267+0000","last_undegraded":"2023-11-24T06:29:42.411267+0000","last_fullsized":"2023-11-24T06:29:42.411267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411952+0000","last_change":"2023-11-24T06:29:41.043308+0000","last_active":"2023-11-24T06:29:42.411952+0000","last_peered":"2023-11-24T06:29:42.411952+0000","last_clean":"2023-11-24T06:29:42.411952+0000","last_became_active":"2023-11-24T06:29:41.043002+0000","last_became_peered":"2023-11-24T06:29:41.043002+0000","last_unstale":"2023-11-24T06:29:42.411952+0000","last_undegraded":"2023-11-24T06:29:42.411952+0000","last_fullsized":"2023-11-24T06:29:42.411952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009327+0000","last_change":"2023-11-24T06:29:41.042006+0000","last_active":"2023-11-24T06:29:42.009327+0000","last_peered":"2023-11-24T06:29:42.009327+0000","last_clean":"2023-11-24T06:29:42.009327+0000","last_became_active":"2023-11-24T06:29:41.041797+0000","last_became_peered":"2023-11-24T06:29:41.041797+0000","last_unstale":"2023-11-24T06:29:42.009327+0000","last_undegraded":"2023-11-24T06:29:42.009327+0000","last_fullsized":"2023-11-24T06:29:42.009327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402419+0000","last_change":"2023-11-24T06:29:41.029343+0000","last_active":"2023-11-24T06:29:42.402419+0000","last_peered":"2023-11-24T06:29:42.402419+0000","last_clean":"2023-11-24T06:29:42.402419+0000","last_became_active":"2023-11-24T06:29:41.028864+0000","last_became_peered":"2023-11-24T06:29:41.028864+0000","last_unstale":"2023-11-24T06:29:42.402419+0000","last_undegraded":"2023-11-24T06:29:42.402419+0000","last_fullsized":"2023-11-24T06:29:42.402419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411954+0000","last_change":"2023-11-24T06:29:41.011893+0000","last_active":"2023-11-24T06:29:42.411954+0000","last_peered":"2023-11-24T06:29:42.411954+0000","last_clean":"2023-11-24T06:29:42.411954+0000","last_became_active":"2023-11-24T06:29:41.011583+0000","last_became_peered":"2023-11-24T06:29:41.011583+0000","last_unstale":"2023-11-24T06:29:42.411954+0000","last_undegraded":"2023-11-24T06:29:42.411954+0000","last_fullsized":"2023-11-24T06:29:42.411954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:11.429086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009417+0000","last_change":"2023-11-24T06:29:40.343794+0000","last_active":"2023-11-24T06:29:42.009417+0000","last_peered":"2023-11-24T06:29:42.009417+0000","last_clean":"2023-11-24T06:29:42.009417+0000","last_became_active":"2023-11-24T06:29:40.343471+0000","last_became_peered":"2023-11-24T06:29:40.343471+0000","last_unstale":"2023-11-24T06:29:42.009417+0000","last_undegraded":"2023-11-24T06:29:42.009417+0000","last_fullsized":"2023-11-24T06:29:42.009417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411310+0000","last_change":"2023-11-24T06:29:41.026911+0000","last_active":"2023-11-24T06:29:42.411310+0000","last_peered":"2023-11-24T06:29:42.411310+0000","last_clean":"2023-11-24T06:29:42.411310+0000","last_became_active":"2023-11-24T06:29:41.026653+0000","last_became_peered":"2023-11-24T06:29:41.026653+0000","last_unstale":"2023-11-24T06:29:42.411310+0000","last_undegraded":"2023-11-24T06:29:42.411310+0000","last_fullsized":"2023-11-24T06:29:42.411310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402184+0000","last_change":"2023-11-24T06:29:40.341320+0000","last_active":"2023-11-24T06:29:42.402184+0000","last_peered":"2023-11-24T06:29:42.402184+0000","last_clean":"2023-11-24T06:29:42.402184+0000","last_became_active":"2023-11-24T06:29:40.340947+0000","last_became_peered":"2023-11-24T06:29:40.340947+0000","last_unstale":"2023-11-24T06:29:42.402184+0000","last_undegraded":"2023-11-24T06:29:42.402184+0000","last_fullsized":"2023-11-24T06:29:42.402184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008946+0000","last_change":"2023-11-24T06:29:40.332472+0000","last_active":"2023-11-24T06:29:42.008946+0000","last_peered":"2023-11-24T06:29:42.008946+0000","last_clean":"2023-11-24T06:29:42.008946+0000","last_became_active":"2023-11-24T06:29:40.331771+0000","last_became_peered":"2023-11-24T06:29:40.331771+0000","last_unstale":"2023-11-24T06:29:42.008946+0000","last_undegraded":"2023-11-24T06:29:42.008946+0000","last_fullsized":"2023-11-24T06:29:42.008946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009748+0000","last_change":"2023-11-24T06:29:41.029570+0000","last_active":"2023-11-24T06:29:42.009748+0000","last_peered":"2023-11-24T06:29:42.009748+0000","last_clean":"2023-11-24T06:29:42.009748+0000","last_became_active":"2023-11-24T06:29:41.029260+0000","last_became_peered":"2023-11-24T06:29:41.029260+0000","last_unstale":"2023-11-24T06:29:42.009748+0000","last_undegraded":"2023-11-24T06:29:42.009748+0000","last_fullsized":"2023-11-24T06:29:42.009748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411476+0000","last_change":"2023-11-24T06:29:40.336272+0000","last_active":"2023-11-24T06:29:42.411476+0000","last_peered":"2023-11-24T06:29:42.411476+0000","last_clean":"2023-11-24T06:29:42.411476+0000","last_became_active":"2023-11-24T06:29:40.335981+0000","last_became_peered":"2023-11-24T06:29:40.335981+0000","last_unstale":"2023-11-24T06:29:42.411476+0000","last_undegraded":"2023-11-24T06:29:42.411476+0000","last_fullsized":"2023-11-24T06:29:42.411476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010158+0000","last_change":"2023-11-24T06:29:41.027455+0000","last_active":"2023-11-24T06:29:42.010158+0000","last_peered":"2023-11-24T06:29:42.010158+0000","last_clean":"2023-11-24T06:29:42.010158+0000","last_became_active":"2023-11-24T06:29:41.027066+0000","last_became_peered":"2023-11-24T06:29:41.027066+0000","last_unstale":"2023-11-24T06:29:42.010158+0000","last_undegraded":"2023-11-24T06:29:42.010158+0000","last_fullsized":"2023-11-24T06:29:42.010158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402623+0000","last_change":"2023-11-24T06:29:40.349835+0000","last_active":"2023-11-24T06:29:42.402623+0000","last_peered":"2023-11-24T06:29:42.402623+0000","last_clean":"2023-11-24T06:29:42.402623+0000","last_became_active":"2023-11-24T06:29:40.349318+0000","last_became_peered":"2023-11-24T06:29:40.349318+0000","last_unstale":"2023-11-24T06:29:42.402623+0000","last_undegraded":"2023-11-24T06:29:42.402623+0000","last_fullsized":"2023-11-24T06:29:42.402623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:23.777269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412362+0000","last_change":"2023-11-24T06:29:41.035952+0000","last_active":"2023-11-24T06:29:42.412362+0000","last_peered":"2023-11-24T06:29:42.412362+0000","last_clean":"2023-11-24T06:29:42.412362+0000","last_became_active":"2023-11-24T06:29:41.035659+0000","last_became_peered":"2023-11-24T06:29:41.035659+0000","last_unstale":"2023-11-24T06:29:42.412362+0000","last_undegraded":"2023-11-24T06:29:42.412362+0000","last_fullsized":"2023-11-24T06:29:42.412362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412456+0000","last_change":"2023-11-24T06:29:40.346349+0000","last_active":"2023-11-24T06:29:42.412456+0000","last_peered":"2023-11-24T06:29:42.412456+0000","last_clean":"2023-11-24T06:29:42.412456+0000","last_became_active":"2023-11-24T06:29:40.345989+0000","last_became_peered":"2023-11-24T06:29:40.345989+0000","last_unstale":"2023-11-24T06:29:42.412456+0000","last_undegraded":"2023-11-24T06:29:42.412456+0000","last_fullsized":"2023-11-24T06:29:42.412456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:36.363583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411200+0000","last_change":"2023-11-24T06:29:41.038281+0000","last_active":"2023-11-24T06:29:42.411200+0000","last_peered":"2023-11-24T06:29:42.411200+0000","last_clean":"2023-11-24T06:29:42.411200+0000","last_became_active":"2023-11-24T06:29:41.038032+0000","last_became_peered":"2023-11-24T06:29:41.038032+0000","last_unstale":"2023-11-24T06:29:42.411200+0000","last_undegraded":"2023-11-24T06:29:42.411200+0000","last_fullsized":"2023-11-24T06:29:42.411200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009998+0000","last_change":"2023-11-24T06:29:40.346634+0000","last_active":"2023-11-24T06:29:42.009998+0000","last_peered":"2023-11-24T06:29:42.009998+0000","last_clean":"2023-11-24T06:29:42.009998+0000","last_became_active":"2023-11-24T06:29:40.346312+0000","last_became_peered":"2023-11-24T06:29:40.346312+0000","last_unstale":"2023-11-24T06:29:42.009998+0000","last_undegraded":"2023-11-24T06:29:42.009998+0000","last_fullsized":"2023-11-24T06:29:42.009998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412076+0000","last_change":"2023-11-24T06:29:41.021832+0000","last_active":"2023-11-24T06:29:42.412076+0000","last_peered":"2023-11-24T06:29:42.412076+0000","last_clean":"2023-11-24T06:29:42.412076+0000","last_became_active":"2023-11-24T06:29:41.021474+0000","last_became_peered":"2023-11-24T06:29:41.021474+0000","last_unstale":"2023-11-24T06:29:42.412076+0000","last_undegraded":"2023-11-24T06:29:42.412076+0000","last_fullsized":"2023-11-24T06:29:42.412076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:54.814389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402403+0000","last_change":"2023-11-24T06:29:40.341865+0000","last_active":"2023-11-24T06:29:42.402403+0000","last_peered":"2023-11-24T06:29:42.402403+0000","last_clean":"2023-11-24T06:29:42.402403+0000","last_became_active":"2023-11-24T06:29:40.341473+0000","last_became_peered":"2023-11-24T06:29:40.341473+0000","last_unstale":"2023-11-24T06:29:42.402403+0000","last_undegraded":"2023-11-24T06:29:42.402403+0000","last_fullsized":"2023-11-24T06:29:42.402403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412596+0000","last_change":"2023-11-24T06:29:41.032631+0000","last_active":"2023-11-24T06:29:42.412596+0000","last_peered":"2023-11-24T06:29:42.412596+0000","last_clean":"2023-11-24T06:29:42.412596+0000","last_became_active":"2023-11-24T06:29:41.032317+0000","last_became_peered":"2023-11-24T06:29:41.032317+0000","last_unstale":"2023-11-24T06:29:42.412596+0000","last_undegraded":"2023-11-24T06:29:42.412596+0000","last_fullsized":"2023-11-24T06:29:42.412596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411352+0000","last_change":"2023-11-24T06:29:40.346013+0000","last_active":"2023-11-24T06:29:42.411352+0000","last_peered":"2023-11-24T06:29:42.411352+0000","last_clean":"2023-11-24T06:29:42.411352+0000","last_became_active":"2023-11-24T06:29:40.345697+0000","last_became_peered":"2023-11-24T06:29:40.345697+0000","last_unstale":"2023-11-24T06:29:42.411352+0000","last_undegraded":"2023-11-24T06:29:42.411352+0000","last_fullsized":"2023-11-24T06:29:42.411352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410974+0000","last_change":"2023-11-24T06:29:41.022517+0000","last_active":"2023-11-24T06:29:42.410974+0000","last_peered":"2023-11-24T06:29:42.410974+0000","last_clean":"2023-11-24T06:29:42.410974+0000","last_became_active":"2023-11-24T06:29:41.022269+0000","last_became_peered":"2023-11-24T06:29:41.022269+0000","last_unstale":"2023-11-24T06:29:42.410974+0000","last_undegraded":"2023-11-24T06:29:42.410974+0000","last_fullsized":"2023-11-24T06:29:42.410974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412047+0000","last_change":"2023-11-24T06:29:40.333463+0000","last_active":"2023-11-24T06:29:42.412047+0000","last_peered":"2023-11-24T06:29:42.412047+0000","last_clean":"2023-11-24T06:29:42.412047+0000","last_became_active":"2023-11-24T06:29:40.333138+0000","last_became_peered":"2023-11-24T06:29:40.333138+0000","last_unstale":"2023-11-24T06:29:42.412047+0000","last_undegraded":"2023-11-24T06:29:42.412047+0000","last_fullsized":"2023-11-24T06:29:42.412047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412905+0000","last_change":"2023-11-24T06:29:41.034227+0000","last_active":"2023-11-24T06:29:42.412905+0000","last_peered":"2023-11-24T06:29:42.412905+0000","last_clean":"2023-11-24T06:29:42.412905+0000","last_became_active":"2023-11-24T06:29:41.033863+0000","last_became_peered":"2023-11-24T06:29:41.033863+0000","last_unstale":"2023-11-24T06:29:42.412905+0000","last_undegraded":"2023-11-24T06:29:42.412905+0000","last_fullsized":"2023-11-24T06:29:42.412905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402160+0000","last_change":"2023-11-24T06:29:40.339332+0000","last_active":"2023-11-24T06:29:42.402160+0000","last_peered":"2023-11-24T06:29:42.402160+0000","last_clean":"2023-11-24T06:29:42.402160+0000","last_became_active":"2023-11-24T06:29:40.338937+0000","last_became_peered":"2023-11-24T06:29:40.338937+0000","last_unstale":"2023-11-24T06:29:42.402160+0000","last_undegraded":"2023-11-24T06:29:42.402160+0000","last_fullsized":"2023-11-24T06:29:42.402160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402564+0000","last_change":"2023-11-24T06:29:41.022776+0000","last_active":"2023-11-24T06:29:42.402564+0000","last_peered":"2023-11-24T06:29:42.402564+0000","last_clean":"2023-11-24T06:29:42.402564+0000","last_became_active":"2023-11-24T06:29:41.022391+0000","last_became_peered":"2023-11-24T06:29:41.022391+0000","last_unstale":"2023-11-24T06:29:42.402564+0000","last_undegraded":"2023-11-24T06:29:42.402564+0000","last_fullsized":"2023-11-24T06:29:42.402564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009165+0000","last_change":"2023-11-24T06:29:40.330685+0000","last_active":"2023-11-24T06:29:42.009165+0000","last_peered":"2023-11-24T06:29:42.009165+0000","last_clean":"2023-11-24T06:29:42.009165+0000","last_became_active":"2023-11-24T06:29:40.330343+0000","last_became_peered":"2023-11-24T06:29:40.330343+0000","last_unstale":"2023-11-24T06:29:42.009165+0000","last_undegraded":"2023-11-24T06:29:42.009165+0000","last_fullsized":"2023-11-24T06:29:42.009165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412651+0000","last_change":"2023-11-24T06:29:41.033010+0000","last_active":"2023-11-24T06:29:42.412651+0000","last_peered":"2023-11-24T06:29:42.412651+0000","last_clean":"2023-11-24T06:29:42.412651+0000","last_became_active":"2023-11-24T06:29:41.032663+0000","last_became_peered":"2023-11-24T06:29:41.032663+0000","last_unstale":"2023-11-24T06:29:42.412651+0000","last_undegraded":"2023-11-24T06:29:42.412651+0000","last_fullsized":"2023-11-24T06:29:42.412651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412068+0000","last_change":"2023-11-24T06:29:40.344785+0000","last_active":"2023-11-24T06:29:42.412068+0000","last_peered":"2023-11-24T06:29:42.412068+0000","last_clean":"2023-11-24T06:29:42.412068+0000","last_became_active":"2023-11-24T06:29:40.344491+0000","last_became_peered":"2023-11-24T06:29:40.344491+0000","last_unstale":"2023-11-24T06:29:42.412068+0000","last_undegraded":"2023-11-24T06:29:42.412068+0000","last_fullsized":"2023-11-24T06:29:42.412068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:32.298231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413142+0000","last_change":"2023-11-24T06:29:41.030954+0000","last_active":"2023-11-24T06:29:42.413142+0000","last_peered":"2023-11-24T06:29:42.413142+0000","last_clean":"2023-11-24T06:29:42.413142+0000","last_became_active":"2023-11-24T06:29:41.030605+0000","last_became_peered":"2023-11-24T06:29:41.030605+0000","last_unstale":"2023-11-24T06:29:42.413142+0000","last_undegraded":"2023-11-24T06:29:42.413142+0000","last_fullsized":"2023-11-24T06:29:42.413142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009450+0000","last_change":"2023-11-24T06:29:40.330710+0000","last_active":"2023-11-24T06:29:42.009450+0000","last_peered":"2023-11-24T06:29:42.009450+0000","last_clean":"2023-11-24T06:29:42.009450+0000","last_became_active":"2023-11-24T06:29:40.330435+0000","last_became_peered":"2023-11-24T06:29:40.330435+0000","last_unstale":"2023-11-24T06:29:42.009450+0000","last_undegraded":"2023-11-24T06:29:42.009450+0000","last_fullsized":"2023-11-24T06:29:42.009450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:39.389505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413349+0000","last_change":"2023-11-24T06:29:41.032411+0000","last_active":"2023-11-24T06:29:42.413349+0000","last_peered":"2023-11-24T06:29:42.413349+0000","last_clean":"2023-11-24T06:29:42.413349+0000","last_became_active":"2023-11-24T06:29:41.032095+0000","last_became_peered":"2023-11-24T06:29:41.032095+0000","last_unstale":"2023-11-24T06:29:42.413349+0000","last_undegraded":"2023-11-24T06:29:42.413349+0000","last_fullsized":"2023-11-24T06:29:42.413349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:02.553538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010082+0000","last_change":"2023-11-24T06:29:40.337974+0000","last_active":"2023-11-24T06:29:42.010082+0000","last_peered":"2023-11-24T06:29:42.010082+0000","last_clean":"2023-11-24T06:29:42.010082+0000","last_became_active":"2023-11-24T06:29:40.337599+0000","last_became_peered":"2023-11-24T06:29:40.337599+0000","last_unstale":"2023-11-24T06:29:42.010082+0000","last_undegraded":"2023-11-24T06:29:42.010082+0000","last_fullsized":"2023-11-24T06:29:42.010082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412670+0000","last_change":"2023-11-24T06:29:41.040924+0000","last_active":"2023-11-24T06:29:42.412670+0000","last_peered":"2023-11-24T06:29:42.412670+0000","last_clean":"2023-11-24T06:29:42.412670+0000","last_became_active":"2023-11-24T06:29:41.040479+0000","last_became_peered":"2023-11-24T06:29:41.040479+0000","last_unstale":"2023-11-24T06:29:42.412670+0000","last_undegraded":"2023-11-24T06:29:42.412670+0000","last_fullsized":"2023-11-24T06:29:42.412670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009583+0000","last_change":"2023-11-24T06:29:40.336909+0000","last_active":"2023-11-24T06:29:42.009583+0000","last_peered":"2023-11-24T06:29:42.009583+0000","last_clean":"2023-11-24T06:29:42.009583+0000","last_became_active":"2023-11-24T06:29:40.336093+0000","last_became_peered":"2023-11-24T06:29:40.336093+0000","last_unstale":"2023-11-24T06:29:42.009583+0000","last_undegraded":"2023-11-24T06:29:42.009583+0000","last_fullsized":"2023-11-24T06:29:42.009583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:22.220406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412802+0000","last_change":"2023-11-24T06:29:41.044969+0000","last_active":"2023-11-24T06:29:42.412802+0000","last_peered":"2023-11-24T06:29:42.412802+0000","last_clean":"2023-11-24T06:29:42.412802+0000","last_became_active":"2023-11-24T06:29:41.044659+0000","last_became_peered":"2023-11-24T06:29:41.044659+0000","last_unstale":"2023-11-24T06:29:42.412802+0000","last_undegraded":"2023-11-24T06:29:42.412802+0000","last_fullsized":"2023-11-24T06:29:42.412802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:29:41.015301+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:29:41.015301+0000","last_peered":"2023-11-24T06:29:41.015301+0000","last_clean":"2023-11-24T06:29:41.015301+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:29:41.015301+0000","last_undegraded":"2023-11-24T06:29:41.015301+0000","last_fullsized":"2023-11-24T06:29:41.015301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411387+0000","last_change":"2023-11-24T06:29:40.333870+0000","last_active":"2023-11-24T06:29:42.411387+0000","last_peered":"2023-11-24T06:29:42.411387+0000","last_clean":"2023-11-24T06:29:42.411387+0000","last_became_active":"2023-11-24T06:29:40.330583+0000","last_became_peered":"2023-11-24T06:29:40.330583+0000","last_unstale":"2023-11-24T06:29:42.411387+0000","last_undegraded":"2023-11-24T06:29:42.411387+0000","last_fullsized":"2023-11-24T06:29:42.411387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008984+0000","last_change":"2023-11-24T06:29:41.044278+0000","last_active":"2023-11-24T06:29:42.008984+0000","last_peered":"2023-11-24T06:29:42.008984+0000","last_clean":"2023-11-24T06:29:42.008984+0000","last_became_active":"2023-11-24T06:29:41.044029+0000","last_became_peered":"2023-11-24T06:29:41.044029+0000","last_unstale":"2023-11-24T06:29:42.008984+0000","last_undegraded":"2023-11-24T06:29:42.008984+0000","last_fullsized":"2023-11-24T06:29:42.008984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411686+0000","last_change":"2023-11-24T06:29:40.351531+0000","last_active":"2023-11-24T06:29:42.411686+0000","last_peered":"2023-11-24T06:29:42.411686+0000","last_clean":"2023-11-24T06:29:42.411686+0000","last_became_active":"2023-11-24T06:29:40.351232+0000","last_became_peered":"2023-11-24T06:29:40.351232+0000","last_unstale":"2023-11-24T06:29:42.411686+0000","last_undegraded":"2023-11-24T06:29:42.411686+0000","last_fullsized":"2023-11-24T06:29:42.411686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410953+0000","last_change":"2023-11-24T06:29:41.027965+0000","last_active":"2023-11-24T06:29:42.410953+0000","last_peered":"2023-11-24T06:29:42.410953+0000","last_clean":"2023-11-24T06:29:42.410953+0000","last_became_active":"2023-11-24T06:29:41.027713+0000","last_became_peered":"2023-11-24T06:29:41.027713+0000","last_unstale":"2023-11-24T06:29:42.410953+0000","last_undegraded":"2023-11-24T06:29:42.410953+0000","last_fullsized":"2023-11-24T06:29:42.410953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009419+0000","last_change":"2023-11-24T06:29:40.328364+0000","last_active":"2023-11-24T06:29:42.009419+0000","last_peered":"2023-11-24T06:29:42.009419+0000","last_clean":"2023-11-24T06:29:42.009419+0000","last_became_active":"2023-11-24T06:29:40.328059+0000","last_became_peered":"2023-11-24T06:29:40.328059+0000","last_unstale":"2023-11-24T06:29:42.009419+0000","last_undegraded":"2023-11-24T06:29:42.009419+0000","last_fullsized":"2023-11-24T06:29:42.009419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010410+0000","last_change":"2023-11-24T06:29:41.018318+0000","last_active":"2023-11-24T06:29:42.010410+0000","last_peered":"2023-11-24T06:29:42.010410+0000","last_clean":"2023-11-24T06:29:42.010410+0000","last_became_active":"2023-11-24T06:29:41.018026+0000","last_became_peered":"2023-11-24T06:29:41.018026+0000","last_unstale":"2023-11-24T06:29:42.010410+0000","last_undegraded":"2023-11-24T06:29:42.010410+0000","last_fullsized":"2023-11-24T06:29:42.010410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412136+0000","last_change":"2023-11-24T06:29:40.347685+0000","last_active":"2023-11-24T06:29:42.412136+0000","last_peered":"2023-11-24T06:29:42.412136+0000","last_clean":"2023-11-24T06:29:42.412136+0000","last_became_active":"2023-11-24T06:29:40.345649+0000","last_became_peered":"2023-11-24T06:29:40.345649+0000","last_unstale":"2023-11-24T06:29:42.412136+0000","last_undegraded":"2023-11-24T06:29:42.412136+0000","last_fullsized":"2023-11-24T06:29:42.412136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:50.641651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412373+0000","last_change":"2023-11-24T06:29:41.021761+0000","last_active":"2023-11-24T06:29:42.412373+0000","last_peered":"2023-11-24T06:29:42.412373+0000","last_clean":"2023-11-24T06:29:42.412373+0000","last_became_active":"2023-11-24T06:29:41.021424+0000","last_became_peered":"2023-11-24T06:29:41.021424+0000","last_unstale":"2023-11-24T06:29:42.412373+0000","last_undegraded":"2023-11-24T06:29:42.412373+0000","last_fullsized":"2023-11-24T06:29:42.412373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010388+0000","last_change":"2023-11-24T06:29:40.347121+0000","last_active":"2023-11-24T06:29:42.010388+0000","last_peered":"2023-11-24T06:29:42.010388+0000","last_clean":"2023-11-24T06:29:42.010388+0000","last_became_active":"2023-11-24T06:29:40.346921+0000","last_became_peered":"2023-11-24T06:29:40.346921+0000","last_unstale":"2023-11-24T06:29:42.010388+0000","last_undegraded":"2023-11-24T06:29:42.010388+0000","last_fullsized":"2023-11-24T06:29:42.010388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412698+0000","last_change":"2023-11-24T06:29:41.043988+0000","last_active":"2023-11-24T06:29:42.412698+0000","last_peered":"2023-11-24T06:29:42.412698+0000","last_clean":"2023-11-24T06:29:42.412698+0000","last_became_active":"2023-11-24T06:29:41.042979+0000","last_became_peered":"2023-11-24T06:29:41.042979+0000","last_unstale":"2023-11-24T06:29:42.412698+0000","last_undegraded":"2023-11-24T06:29:42.412698+0000","last_fullsized":"2023-11-24T06:29:42.412698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412954+0000","last_change":"2023-11-24T06:29:40.354819+0000","last_active":"2023-11-24T06:29:42.412954+0000","last_peered":"2023-11-24T06:29:42.412954+0000","last_clean":"2023-11-24T06:29:42.412954+0000","last_became_active":"2023-11-24T06:29:40.354555+0000","last_became_peered":"2023-11-24T06:29:40.354555+0000","last_unstale":"2023-11-24T06:29:42.412954+0000","last_undegraded":"2023-11-24T06:29:42.412954+0000","last_fullsized":"2023-11-24T06:29:42.412954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010353+0000","last_change":"2023-11-24T06:29:41.026151+0000","last_active":"2023-11-24T06:29:42.010353+0000","last_peered":"2023-11-24T06:29:42.010353+0000","last_clean":"2023-11-24T06:29:42.010353+0000","last_became_active":"2023-11-24T06:29:41.025056+0000","last_became_peered":"2023-11-24T06:29:41.025056+0000","last_unstale":"2023-11-24T06:29:42.010353+0000","last_undegraded":"2023-11-24T06:29:42.010353+0000","last_fullsized":"2023-11-24T06:29:42.010353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:43.232209+0000","last_change":"2023-11-24T06:29:40.339825+0000","last_active":"2023-11-24T06:29:43.232209+0000","last_peered":"2023-11-24T06:29:43.232209+0000","last_clean":"2023-11-24T06:29:43.232209+0000","last_became_active":"2023-11-24T06:29:40.339532+0000","last_became_peered":"2023-11-24T06:29:40.339532+0000","last_unstale":"2023-11-24T06:29:43.232209+0000","last_undegraded":"2023-11-24T06:29:43.232209+0000","last_fullsized":"2023-11-24T06:29:43.232209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010070+0000","last_change":"2023-11-24T06:29:41.034827+0000","last_active":"2023-11-24T06:29:42.010070+0000","last_peered":"2023-11-24T06:29:42.010070+0000","last_clean":"2023-11-24T06:29:42.010070+0000","last_became_active":"2023-11-24T06:29:41.034571+0000","last_became_peered":"2023-11-24T06:29:41.034571+0000","last_unstale":"2023-11-24T06:29:42.010070+0000","last_undegraded":"2023-11-24T06:29:42.010070+0000","last_fullsized":"2023-11-24T06:29:42.010070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402710+0000","last_change":"2023-11-24T06:29:40.349652+0000","last_active":"2023-11-24T06:29:42.402710+0000","last_peered":"2023-11-24T06:29:42.402710+0000","last_clean":"2023-11-24T06:29:42.402710+0000","last_became_active":"2023-11-24T06:29:40.348929+0000","last_became_peered":"2023-11-24T06:29:40.348929+0000","last_unstale":"2023-11-24T06:29:42.402710+0000","last_undegraded":"2023-11-24T06:29:42.402710+0000","last_fullsized":"2023-11-24T06:29:42.402710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411201+0000","last_change":"2023-11-24T06:29:41.020681+0000","last_active":"2023-11-24T06:29:42.411201+0000","last_peered":"2023-11-24T06:29:42.411201+0000","last_clean":"2023-11-24T06:29:42.411201+0000","last_became_active":"2023-11-24T06:29:41.020398+0000","last_became_peered":"2023-11-24T06:29:41.020398+0000","last_unstale":"2023-11-24T06:29:42.411201+0000","last_undegraded":"2023-11-24T06:29:42.411201+0000","last_fullsized":"2023-11-24T06:29:42.411201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411695+0000","last_change":"2023-11-24T06:29:40.350908+0000","last_active":"2023-11-24T06:29:42.411695+0000","last_peered":"2023-11-24T06:29:42.411695+0000","last_clean":"2023-11-24T06:29:42.411695+0000","last_became_active":"2023-11-24T06:29:40.350583+0000","last_became_peered":"2023-11-24T06:29:40.350583+0000","last_unstale":"2023-11-24T06:29:42.411695+0000","last_undegraded":"2023-11-24T06:29:42.411695+0000","last_fullsized":"2023-11-24T06:29:42.411695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412962+0000","last_change":"2023-11-24T06:29:41.023906+0000","last_active":"2023-11-24T06:29:42.412962+0000","last_peered":"2023-11-24T06:29:42.412962+0000","last_clean":"2023-11-24T06:29:42.412962+0000","last_became_active":"2023-11-24T06:29:41.023643+0000","last_became_peered":"2023-11-24T06:29:41.023643+0000","last_unstale":"2023-11-24T06:29:42.412962+0000","last_undegraded":"2023-11-24T06:29:42.412962+0000","last_fullsized":"2023-11-24T06:29:42.412962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010301+0000","last_change":"2023-11-24T06:29:40.351462+0000","last_active":"2023-11-24T06:29:42.010301+0000","last_peered":"2023-11-24T06:29:42.010301+0000","last_clean":"2023-11-24T06:29:42.010301+0000","last_became_active":"2023-11-24T06:29:40.351124+0000","last_became_peered":"2023-11-24T06:29:40.351124+0000","last_unstale":"2023-11-24T06:29:42.010301+0000","last_undegraded":"2023-11-24T06:29:42.010301+0000","last_fullsized":"2023-11-24T06:29:42.010301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010499+0000","last_change":"2023-11-24T06:29:41.020690+0000","last_active":"2023-11-24T06:29:42.010499+0000","last_peered":"2023-11-24T06:29:42.010499+0000","last_clean":"2023-11-24T06:29:42.010499+0000","last_became_active":"2023-11-24T06:29:41.020427+0000","last_became_peered":"2023-11-24T06:29:41.020427+0000","last_unstale":"2023-11-24T06:29:42.010499+0000","last_undegraded":"2023-11-24T06:29:42.010499+0000","last_fullsized":"2023-11-24T06:29:42.010499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010425+0000","last_change":"2023-11-24T06:29:40.328181+0000","last_active":"2023-11-24T06:29:42.010425+0000","last_peered":"2023-11-24T06:29:42.010425+0000","last_clean":"2023-11-24T06:29:42.010425+0000","last_became_active":"2023-11-24T06:29:40.327692+0000","last_became_peered":"2023-11-24T06:29:40.327692+0000","last_unstale":"2023-11-24T06:29:42.010425+0000","last_undegraded":"2023-11-24T06:29:42.010425+0000","last_fullsized":"2023-11-24T06:29:42.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009320+0000","last_change":"2023-11-24T06:29:41.022705+0000","last_active":"2023-11-24T06:29:42.009320+0000","last_peered":"2023-11-24T06:29:42.009320+0000","last_clean":"2023-11-24T06:29:42.009320+0000","last_became_active":"2023-11-24T06:29:41.022442+0000","last_became_peered":"2023-11-24T06:29:41.022442+0000","last_unstale":"2023-11-24T06:29:42.009320+0000","last_undegraded":"2023-11-24T06:29:42.009320+0000","last_fullsized":"2023-11-24T06:29:42.009320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412948+0000","last_change":"2023-11-24T06:29:40.351303+0000","last_active":"2023-11-24T06:29:42.412948+0000","last_peered":"2023-11-24T06:29:42.412948+0000","last_clean":"2023-11-24T06:29:42.412948+0000","last_became_active":"2023-11-24T06:29:40.350893+0000","last_became_peered":"2023-11-24T06:29:40.350893+0000","last_unstale":"2023-11-24T06:29:42.412948+0000","last_undegraded":"2023-11-24T06:29:42.412948+0000","last_fullsized":"2023-11-24T06:29:42.412948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:29.563013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402349+0000","last_change":"2023-11-24T06:29:41.030215+0000","last_active":"2023-11-24T06:29:42.402349+0000","last_peered":"2023-11-24T06:29:42.402349+0000","last_clean":"2023-11-24T06:29:42.402349+0000","last_became_active":"2023-11-24T06:29:41.029775+0000","last_became_peered":"2023-11-24T06:29:41.029775+0000","last_unstale":"2023-11-24T06:29:42.402349+0000","last_undegraded":"2023-11-24T06:29:42.402349+0000","last_fullsized":"2023-11-24T06:29:42.402349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.039473+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.039150+0000","last_became_peered":"2023-11-24T06:29:41.039150+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412823+0000","last_change":"2023-11-24T06:29:40.351147+0000","last_active":"2023-11-24T06:29:42.412823+0000","last_peered":"2023-11-24T06:29:42.412823+0000","last_clean":"2023-11-24T06:29:42.412823+0000","last_became_active":"2023-11-24T06:29:40.350837+0000","last_became_peered":"2023-11-24T06:29:40.350837+0000","last_unstale":"2023-11-24T06:29:42.412823+0000","last_undegraded":"2023-11-24T06:29:42.412823+0000","last_fullsized":"2023-11-24T06:29:42.412823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:00.101428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412531+0000","last_change":"2023-11-24T06:29:41.042212+0000","last_active":"2023-11-24T06:29:42.412531+0000","last_peered":"2023-11-24T06:29:42.412531+0000","last_clean":"2023-11-24T06:29:42.412531+0000","last_became_active":"2023-11-24T06:29:41.041751+0000","last_became_peered":"2023-11-24T06:29:41.041751+0000","last_unstale":"2023-11-24T06:29:42.412531+0000","last_undegraded":"2023-11-24T06:29:42.412531+0000","last_fullsized":"2023-11-24T06:29:42.412531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412849+0000","last_change":"2023-11-24T06:29:40.351090+0000","last_active":"2023-11-24T06:29:42.412849+0000","last_peered":"2023-11-24T06:29:42.412849+0000","last_clean":"2023-11-24T06:29:42.412849+0000","last_became_active":"2023-11-24T06:29:40.350722+0000","last_became_peered":"2023-11-24T06:29:40.350722+0000","last_unstale":"2023-11-24T06:29:42.412849+0000","last_undegraded":"2023-11-24T06:29:42.412849+0000","last_fullsized":"2023-11-24T06:29:42.412849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411181+0000","last_change":"2023-11-24T06:29:41.044968+0000","last_active":"2023-11-24T06:29:42.411181+0000","last_peered":"2023-11-24T06:29:42.411181+0000","last_clean":"2023-11-24T06:29:42.411181+0000","last_became_active":"2023-11-24T06:29:41.044679+0000","last_became_peered":"2023-11-24T06:29:41.044679+0000","last_unstale":"2023-11-24T06:29:42.411181+0000","last_undegraded":"2023-11-24T06:29:42.411181+0000","last_fullsized":"2023-11-24T06:29:42.411181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009975+0000","last_change":"2023-11-24T06:29:40.347084+0000","last_active":"2023-11-24T06:29:42.009975+0000","last_peered":"2023-11-24T06:29:42.009975+0000","last_clean":"2023-11-24T06:29:42.009975+0000","last_became_active":"2023-11-24T06:29:40.346829+0000","last_became_peered":"2023-11-24T06:29:40.346829+0000","last_unstale":"2023-11-24T06:29:42.009975+0000","last_undegraded":"2023-11-24T06:29:42.009975+0000","last_fullsized":"2023-11-24T06:29:42.009975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009898+0000","last_change":"2023-11-24T06:29:41.032848+0000","last_active":"2023-11-24T06:29:42.009898+0000","last_peered":"2023-11-24T06:29:42.009898+0000","last_clean":"2023-11-24T06:29:42.009898+0000","last_became_active":"2023-11-24T06:29:41.032572+0000","last_became_peered":"2023-11-24T06:29:41.032572+0000","last_unstale":"2023-11-24T06:29:42.009898+0000","last_undegraded":"2023-11-24T06:29:42.009898+0000","last_fullsized":"2023-11-24T06:29:42.009898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411279+0000","last_change":"2023-11-24T06:29:40.353473+0000","last_active":"2023-11-24T06:29:42.411279+0000","last_peered":"2023-11-24T06:29:42.411279+0000","last_clean":"2023-11-24T06:29:42.411279+0000","last_became_active":"2023-11-24T06:29:40.353135+0000","last_became_peered":"2023-11-24T06:29:40.353135+0000","last_unstale":"2023-11-24T06:29:42.411279+0000","last_undegraded":"2023-11-24T06:29:42.411279+0000","last_fullsized":"2023-11-24T06:29:42.411279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:29:49.949 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:29:50.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.118+0000 7f8b05fc1640 1 Processor -- start 2023-11-24T06:29:50.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8b05fc1640 1 -- start start 2023-11-24T06:29:50.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8b05fc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8b0015ed00 0x7f8b0015e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8b05fc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0015f110 con 0x7f8b00160be0 2023-11-24T06:29:50.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8b05fc1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0015e900 con 0x7f8b000b3ec0 2023-11-24T06:29:50.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8b05fc1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0006c650 con 0x7f8b0015ed00 2023-11-24T06:29:50.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8afffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8b0015ed00 0x7f8b0015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8aff7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8b00160be0 0x7f8b000b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32840/0 (socket says 172.21.15.143:32840) 2023-11-24T06:29:50.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8aff7fe640 1 -- 172.21.15.143:0/680506365 learned_addr learned my addr 172.21.15.143:0/680506365 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:50.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8afffff640 1 -- 172.21.15.143:0/680506365 >> v1:172.21.15.146:6789/0 conn(0x7f8b000b3ec0 legacy=0x7f8b0015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8afffff640 1 -- 172.21.15.143:0/680506365 >> v1:172.21.15.143:6789/0 conn(0x7f8b00160be0 legacy=0x7f8b000b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8afffff640 1 -- 172.21.15.143:0/680506365 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0006c830 con 0x7f8b0015ed00 2023-11-24T06:29:50.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.122+0000 7f8afeffd640 1 -- 172.21.15.143:0/680506365 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710959482 0 0) 0x7f8b0015f110 con 0x7f8b00160be0 2023-11-24T06:29:50.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8afffff640 1 --2- 172.21.15.143:0/680506365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b0015ed00 0x7f8b0015e250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009d90 tx=0x7f8af801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdcb548a891d5e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8afeffd640 1 -- 172.21.15.143:0/680506365 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80a59e0 con 0x7f8b0015ed00 2023-11-24T06:29:50.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8afeffd640 1 -- 172.21.15.143:0/680506365 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af80a5b40 con 0x7f8b0015ed00 2023-11-24T06:29:50.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8afeffd640 1 -- 172.21.15.143:0/680506365 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80ad440 con 0x7f8b0015ed00 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 -- 172.21.15.143:0/680506365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b0015ed00 msgr2=0x7f8b0015e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/680506365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b0015ed00 0x7f8b0015e250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009d90 tx=0x7f8af801c920 comp rx=0 tx=0).stop 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 -- 172.21.15.143:0/680506365 shutdown_connections 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/680506365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b0015ed00 0x7f8b0015e250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 -- 172.21.15.143:0/680506365 >> 172.21.15.143:0/680506365 conn(0x7f8b000b0bf0 msgr2=0x7f8b000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 -- 172.21.15.143:0/680506365 shutdown_connections 2023-11-24T06:29:50.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 -- 172.21.15.143:0/680506365 wait complete. 2023-11-24T06:29:50.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 Processor -- start 2023-11-24T06:29:50.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.126+0000 7f8b05fc1640 1 -- start start 2023-11-24T06:29:50.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 0x7f8b0009b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b0015ed00 0x7f8b0015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00160be0 0x7f8b000999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00158fe0 con 0x7f8b000b3ec0 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b001583d0 con 0x7f8b00160be0 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b001586b0 con 0x7f8b0015ed00 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 0x7f8b0009b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 0x7f8b0009b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37570/0 (socket says 172.21.15.143:37570) 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 -- 172.21.15.143:0/122219326 learned_addr learned my addr 172.21.15.143:0/122219326 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8af7fff640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b0015ed00 0x7f8b0015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8afffff640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00160be0 0x7f8b000999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 -- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b0015ed00 msgr2=0x7f8b0015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b0015ed00 0x7f8b0015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 -- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00160be0 msgr2=0x7f8b000999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00160be0 0x7f8b000999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 -- 172.21.15.143:0/122219326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8009a70 con 0x7f8b000b3ec0 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8afffff640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00160be0 0x7f8b000999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8af7fff640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b0015ed00 0x7f8b0015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8aff7fe640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 0x7f8b0009b400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c410 tx=0x7f8af000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00074e0 con 0x7f8b000b3ec0 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0007640 con 0x7f8b000b3ec0 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0004a30 con 0x7f8b000b3ec0 2023-11-24T06:29:50.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b00158990 con 0x7f8b000b3ec0 2023-11-24T06:29:50.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0015c800 con 0x7f8b000b3ec0 2023-11-24T06:29:50.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b00070950 con 0x7f8b000b3ec0 2023-11-24T06:29:50.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.130+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8af0004b90 con 0x7f8b000b3ec0 2023-11-24T06:29:50.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.134+0000 7f8afcff9640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ae00664c0 0x7f8ae0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.134+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8af0083c90 con 0x7f8b000b3ec0 2023-11-24T06:29:50.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.134+0000 7f8af7fff640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ae00664c0 0x7f8ae0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.134+0000 7f8af7fff640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ae00664c0 0x7f8ae0068980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b0015a730 tx=0x7f8ae8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.138+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8af00510f0 con 0x7f8b000b3ec0 2023-11-24T06:29:50.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.286+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b00159120 con 0x7f8ae00664c0 2023-11-24T06:29:50.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.290+0000 7f8afcff9640 1 -- 172.21.15.143:0/122219326 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7f8ae80013f0 con 0x7f8ae00664c0 2023-11-24T06:29:50.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:50.300 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ae00664c0 msgr2=0x7f8ae0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ae00664c0 0x7f8ae0068980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b0015a730 tx=0x7f8ae8009040 comp rx=0 tx=0).stop 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 msgr2=0x7f8b0009b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 0x7f8b0009b400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c410 tx=0x7f8af000c8d0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 shutdown_connections 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ae00664c0 0x7f8ae0068980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00160be0 0x7f8b000999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b0015ed00 0x7f8b0015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 --2- 172.21.15.143:0/122219326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b000b3ec0 0x7f8b0009b400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 >> 172.21.15.143:0/122219326 conn(0x7f8b000b0bf0 msgr2=0x7f8b000b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:50.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 shutdown_connections 2023-11-24T06:29:50.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.294+0000 7f8b05fc1640 1 -- 172.21.15.143:0/122219326 wait complete. 2023-11-24T06:29:50.319 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:29:50.208825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2887680,"data_stored":1751867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.202565"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413188+0000","last_change":"2023-11-24T06:29:41.035477+0000","last_active":"2023-11-24T06:29:42.413188+0000","last_peered":"2023-11-24T06:29:42.413188+0000","last_clean":"2023-11-24T06:29:42.413188+0000","last_became_active":"2023-11-24T06:29:41.035174+0000","last_became_peered":"2023-11-24T06:29:41.035174+0000","last_unstale":"2023-11-24T06:29:42.413188+0000","last_undegraded":"2023-11-24T06:29:42.413188+0000","last_fullsized":"2023-11-24T06:29:42.413188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010247+0000","last_change":"2023-11-24T06:29:41.022068+0000","last_active":"2023-11-24T06:29:42.010247+0000","last_peered":"2023-11-24T06:29:42.010247+0000","last_clean":"2023-11-24T06:29:42.010247+0000","last_became_active":"2023-11-24T06:29:41.021715+0000","last_became_peered":"2023-11-24T06:29:41.021715+0000","last_unstale":"2023-11-24T06:29:42.010247+0000","last_undegraded":"2023-11-24T06:29:42.010247+0000","last_fullsized":"2023-11-24T06:29:42.010247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411078+0000","last_change":"2023-11-24T06:29:41.024602+0000","last_active":"2023-11-24T06:29:42.411078+0000","last_peered":"2023-11-24T06:29:42.411078+0000","last_clean":"2023-11-24T06:29:42.411078+0000","last_became_active":"2023-11-24T06:29:41.024285+0000","last_became_peered":"2023-11-24T06:29:41.024285+0000","last_unstale":"2023-11-24T06:29:42.411078+0000","last_undegraded":"2023-11-24T06:29:42.411078+0000","last_fullsized":"2023-11-24T06:29:42.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412375+0000","last_change":"2023-11-24T06:29:41.041359+0000","last_active":"2023-11-24T06:29:42.412375+0000","last_peered":"2023-11-24T06:29:42.412375+0000","last_clean":"2023-11-24T06:29:42.412375+0000","last_became_active":"2023-11-24T06:29:41.040996+0000","last_became_peered":"2023-11-24T06:29:41.040996+0000","last_unstale":"2023-11-24T06:29:42.412375+0000","last_undegraded":"2023-11-24T06:29:42.412375+0000","last_fullsized":"2023-11-24T06:29:42.412375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412762+0000","last_change":"2023-11-24T06:29:41.034177+0000","last_active":"2023-11-24T06:29:42.412762+0000","last_peered":"2023-11-24T06:29:42.412762+0000","last_clean":"2023-11-24T06:29:42.412762+0000","last_became_active":"2023-11-24T06:29:41.033446+0000","last_became_peered":"2023-11-24T06:29:41.033446+0000","last_unstale":"2023-11-24T06:29:42.412762+0000","last_undegraded":"2023-11-24T06:29:42.412762+0000","last_fullsized":"2023-11-24T06:29:42.412762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411687+0000","last_change":"2023-11-24T06:29:41.038649+0000","last_active":"2023-11-24T06:29:42.411687+0000","last_peered":"2023-11-24T06:29:42.411687+0000","last_clean":"2023-11-24T06:29:42.411687+0000","last_became_active":"2023-11-24T06:29:41.038301+0000","last_became_peered":"2023-11-24T06:29:41.038301+0000","last_unstale":"2023-11-24T06:29:42.411687+0000","last_undegraded":"2023-11-24T06:29:42.411687+0000","last_fullsized":"2023-11-24T06:29:42.411687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.023574+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.023253+0000","last_became_peered":"2023-11-24T06:29:41.023253+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008553+0000","last_change":"2023-11-24T06:29:41.047704+0000","last_active":"2023-11-24T06:29:42.008553+0000","last_peered":"2023-11-24T06:29:42.008553+0000","last_clean":"2023-11-24T06:29:42.008553+0000","last_became_active":"2023-11-24T06:29:41.047479+0000","last_became_peered":"2023-11-24T06:29:41.047479+0000","last_unstale":"2023-11-24T06:29:42.008553+0000","last_undegraded":"2023-11-24T06:29:42.008553+0000","last_fullsized":"2023-11-24T06:29:42.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413219+0000","last_change":"2023-11-24T06:29:41.038737+0000","last_active":"2023-11-24T06:29:42.413219+0000","last_peered":"2023-11-24T06:29:42.413219+0000","last_clean":"2023-11-24T06:29:42.413219+0000","last_became_active":"2023-11-24T06:29:41.038472+0000","last_became_peered":"2023-11-24T06:29:41.038472+0000","last_unstale":"2023-11-24T06:29:42.413219+0000","last_undegraded":"2023-11-24T06:29:42.413219+0000","last_fullsized":"2023-11-24T06:29:42.413219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402616+0000","last_change":"2023-11-24T06:29:41.045851+0000","last_active":"2023-11-24T06:29:42.402616+0000","last_peered":"2023-11-24T06:29:42.402616+0000","last_clean":"2023-11-24T06:29:42.402616+0000","last_became_active":"2023-11-24T06:29:41.044799+0000","last_became_peered":"2023-11-24T06:29:41.044799+0000","last_unstale":"2023-11-24T06:29:42.402616+0000","last_undegraded":"2023-11-24T06:29:42.402616+0000","last_fullsized":"2023-11-24T06:29:42.402616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402357+0000","last_change":"2023-11-24T06:29:41.045092+0000","last_active":"2023-11-24T06:29:42.402357+0000","last_peered":"2023-11-24T06:29:42.402357+0000","last_clean":"2023-11-24T06:29:42.402357+0000","last_became_active":"2023-11-24T06:29:41.044758+0000","last_became_peered":"2023-11-24T06:29:41.044758+0000","last_unstale":"2023-11-24T06:29:42.402357+0000","last_undegraded":"2023-11-24T06:29:42.402357+0000","last_fullsized":"2023-11-24T06:29:42.402357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411929+0000","last_change":"2023-11-24T06:29:41.029744+0000","last_active":"2023-11-24T06:29:42.411929+0000","last_peered":"2023-11-24T06:29:42.411929+0000","last_clean":"2023-11-24T06:29:42.411929+0000","last_became_active":"2023-11-24T06:29:41.029413+0000","last_became_peered":"2023-11-24T06:29:41.029413+0000","last_unstale":"2023-11-24T06:29:42.411929+0000","last_undegraded":"2023-11-24T06:29:42.411929+0000","last_fullsized":"2023-11-24T06:29:42.411929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:40.396297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009191+0000","last_change":"2023-11-24T06:29:41.032796+0000","last_active":"2023-11-24T06:29:42.009191+0000","last_peered":"2023-11-24T06:29:42.009191+0000","last_clean":"2023-11-24T06:29:42.009191+0000","last_became_active":"2023-11-24T06:29:41.032526+0000","last_became_peered":"2023-11-24T06:29:41.032526+0000","last_unstale":"2023-11-24T06:29:42.009191+0000","last_undegraded":"2023-11-24T06:29:42.009191+0000","last_fullsized":"2023-11-24T06:29:42.009191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:36.841759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410937+0000","last_change":"2023-11-24T06:29:41.022282+0000","last_active":"2023-11-24T06:29:42.410937+0000","last_peered":"2023-11-24T06:29:42.410937+0000","last_clean":"2023-11-24T06:29:42.410937+0000","last_became_active":"2023-11-24T06:29:41.021823+0000","last_became_peered":"2023-11-24T06:29:41.021823+0000","last_unstale":"2023-11-24T06:29:42.410937+0000","last_undegraded":"2023-11-24T06:29:42.410937+0000","last_fullsized":"2023-11-24T06:29:42.410937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:06.770793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010312+0000","last_change":"2023-11-24T06:29:41.013047+0000","last_active":"2023-11-24T06:29:42.010312+0000","last_peered":"2023-11-24T06:29:42.010312+0000","last_clean":"2023-11-24T06:29:42.010312+0000","last_became_active":"2023-11-24T06:29:41.012696+0000","last_became_peered":"2023-11-24T06:29:41.012696+0000","last_unstale":"2023-11-24T06:29:42.010312+0000","last_undegraded":"2023-11-24T06:29:42.010312+0000","last_fullsized":"2023-11-24T06:29:42.010312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041964+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.041680+0000","last_became_peered":"2023-11-24T06:29:41.041680+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412021+0000","last_change":"2023-11-24T06:29:41.041640+0000","last_active":"2023-11-24T06:29:42.412021+0000","last_peered":"2023-11-24T06:29:42.412021+0000","last_clean":"2023-11-24T06:29:42.412021+0000","last_became_active":"2023-11-24T06:29:41.040550+0000","last_became_peered":"2023-11-24T06:29:41.040550+0000","last_unstale":"2023-11-24T06:29:42.412021+0000","last_undegraded":"2023-11-24T06:29:42.412021+0000","last_fullsized":"2023-11-24T06:29:42.412021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:36:29.195562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009398+0000","last_change":"2023-11-24T06:29:41.033224+0000","last_active":"2023-11-24T06:29:42.009398+0000","last_peered":"2023-11-24T06:29:42.009398+0000","last_clean":"2023-11-24T06:29:42.009398+0000","last_became_active":"2023-11-24T06:29:41.032892+0000","last_became_peered":"2023-11-24T06:29:41.032892+0000","last_unstale":"2023-11-24T06:29:42.009398+0000","last_undegraded":"2023-11-24T06:29:42.009398+0000","last_fullsized":"2023-11-24T06:29:42.009398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413054+0000","last_change":"2023-11-24T06:29:41.026686+0000","last_active":"2023-11-24T06:29:42.413054+0000","last_peered":"2023-11-24T06:29:42.413054+0000","last_clean":"2023-11-24T06:29:42.413054+0000","last_became_active":"2023-11-24T06:29:41.026385+0000","last_became_peered":"2023-11-24T06:29:41.026385+0000","last_unstale":"2023-11-24T06:29:42.413054+0000","last_undegraded":"2023-11-24T06:29:42.413054+0000","last_fullsized":"2023-11-24T06:29:42.413054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402323+0000","last_change":"2023-11-24T06:29:41.036431+0000","last_active":"2023-11-24T06:29:42.402323+0000","last_peered":"2023-11-24T06:29:42.402323+0000","last_clean":"2023-11-24T06:29:42.402323+0000","last_became_active":"2023-11-24T06:29:41.035252+0000","last_became_peered":"2023-11-24T06:29:41.035252+0000","last_unstale":"2023-11-24T06:29:42.402323+0000","last_undegraded":"2023-11-24T06:29:42.402323+0000","last_fullsized":"2023-11-24T06:29:42.402323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411213+0000","last_change":"2023-11-24T06:29:41.035408+0000","last_active":"2023-11-24T06:29:42.411213+0000","last_peered":"2023-11-24T06:29:42.411213+0000","last_clean":"2023-11-24T06:29:42.411213+0000","last_became_active":"2023-11-24T06:29:41.035123+0000","last_became_peered":"2023-11-24T06:29:41.035123+0000","last_unstale":"2023-11-24T06:29:42.411213+0000","last_undegraded":"2023-11-24T06:29:42.411213+0000","last_fullsized":"2023-11-24T06:29:42.411213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411820+0000","last_change":"2023-11-24T06:29:41.038635+0000","last_active":"2023-11-24T06:29:42.411820+0000","last_peered":"2023-11-24T06:29:42.411820+0000","last_clean":"2023-11-24T06:29:42.411820+0000","last_became_active":"2023-11-24T06:29:41.038315+0000","last_became_peered":"2023-11-24T06:29:41.038315+0000","last_unstale":"2023-11-24T06:29:42.411820+0000","last_undegraded":"2023-11-24T06:29:42.411820+0000","last_fullsized":"2023-11-24T06:29:42.411820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009568+0000","last_change":"2023-11-24T06:29:41.032241+0000","last_active":"2023-11-24T06:29:42.009568+0000","last_peered":"2023-11-24T06:29:42.009568+0000","last_clean":"2023-11-24T06:29:42.009568+0000","last_became_active":"2023-11-24T06:29:41.031925+0000","last_became_peered":"2023-11-24T06:29:41.031925+0000","last_unstale":"2023-11-24T06:29:42.009568+0000","last_undegraded":"2023-11-24T06:29:42.009568+0000","last_fullsized":"2023-11-24T06:29:42.009568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411377+0000","last_change":"2023-11-24T06:29:41.041084+0000","last_active":"2023-11-24T06:29:42.411377+0000","last_peered":"2023-11-24T06:29:42.411377+0000","last_clean":"2023-11-24T06:29:42.411377+0000","last_became_active":"2023-11-24T06:29:41.040726+0000","last_became_peered":"2023-11-24T06:29:41.040726+0000","last_unstale":"2023-11-24T06:29:42.411377+0000","last_undegraded":"2023-11-24T06:29:42.411377+0000","last_fullsized":"2023-11-24T06:29:42.411377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009949+0000","last_change":"2023-11-24T06:29:41.032304+0000","last_active":"2023-11-24T06:29:42.009949+0000","last_peered":"2023-11-24T06:29:42.009949+0000","last_clean":"2023-11-24T06:29:42.009949+0000","last_became_active":"2023-11-24T06:29:41.031960+0000","last_became_peered":"2023-11-24T06:29:41.031960+0000","last_unstale":"2023-11-24T06:29:42.009949+0000","last_undegraded":"2023-11-24T06:29:42.009949+0000","last_fullsized":"2023-11-24T06:29:42.009949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402649+0000","last_change":"2023-11-24T06:29:41.034986+0000","last_active":"2023-11-24T06:29:42.402649+0000","last_peered":"2023-11-24T06:29:42.402649+0000","last_clean":"2023-11-24T06:29:42.402649+0000","last_became_active":"2023-11-24T06:29:41.034673+0000","last_became_peered":"2023-11-24T06:29:41.034673+0000","last_unstale":"2023-11-24T06:29:42.402649+0000","last_undegraded":"2023-11-24T06:29:42.402649+0000","last_fullsized":"2023-11-24T06:29:42.402649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009912+0000","last_change":"2023-11-24T06:29:41.027454+0000","last_active":"2023-11-24T06:29:42.009912+0000","last_peered":"2023-11-24T06:29:42.009912+0000","last_clean":"2023-11-24T06:29:42.009912+0000","last_became_active":"2023-11-24T06:29:41.027070+0000","last_became_peered":"2023-11-24T06:29:41.027070+0000","last_unstale":"2023-11-24T06:29:42.009912+0000","last_undegraded":"2023-11-24T06:29:42.009912+0000","last_fullsized":"2023-11-24T06:29:42.009912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010197+0000","last_change":"2023-11-24T06:29:41.031595+0000","last_active":"2023-11-24T06:29:42.010197+0000","last_peered":"2023-11-24T06:29:42.010197+0000","last_clean":"2023-11-24T06:29:42.010197+0000","last_became_active":"2023-11-24T06:29:41.031166+0000","last_became_peered":"2023-11-24T06:29:41.031166+0000","last_unstale":"2023-11-24T06:29:42.010197+0000","last_undegraded":"2023-11-24T06:29:42.010197+0000","last_fullsized":"2023-11-24T06:29:42.010197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:25.524283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411267+0000","last_change":"2023-11-24T06:29:41.021334+0000","last_active":"2023-11-24T06:29:42.411267+0000","last_peered":"2023-11-24T06:29:42.411267+0000","last_clean":"2023-11-24T06:29:42.411267+0000","last_became_active":"2023-11-24T06:29:41.021017+0000","last_became_peered":"2023-11-24T06:29:41.021017+0000","last_unstale":"2023-11-24T06:29:42.411267+0000","last_undegraded":"2023-11-24T06:29:42.411267+0000","last_fullsized":"2023-11-24T06:29:42.411267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411952+0000","last_change":"2023-11-24T06:29:41.043308+0000","last_active":"2023-11-24T06:29:42.411952+0000","last_peered":"2023-11-24T06:29:42.411952+0000","last_clean":"2023-11-24T06:29:42.411952+0000","last_became_active":"2023-11-24T06:29:41.043002+0000","last_became_peered":"2023-11-24T06:29:41.043002+0000","last_unstale":"2023-11-24T06:29:42.411952+0000","last_undegraded":"2023-11-24T06:29:42.411952+0000","last_fullsized":"2023-11-24T06:29:42.411952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009327+0000","last_change":"2023-11-24T06:29:41.042006+0000","last_active":"2023-11-24T06:29:42.009327+0000","last_peered":"2023-11-24T06:29:42.009327+0000","last_clean":"2023-11-24T06:29:42.009327+0000","last_became_active":"2023-11-24T06:29:41.041797+0000","last_became_peered":"2023-11-24T06:29:41.041797+0000","last_unstale":"2023-11-24T06:29:42.009327+0000","last_undegraded":"2023-11-24T06:29:42.009327+0000","last_fullsized":"2023-11-24T06:29:42.009327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402419+0000","last_change":"2023-11-24T06:29:41.029343+0000","last_active":"2023-11-24T06:29:42.402419+0000","last_peered":"2023-11-24T06:29:42.402419+0000","last_clean":"2023-11-24T06:29:42.402419+0000","last_became_active":"2023-11-24T06:29:41.028864+0000","last_became_peered":"2023-11-24T06:29:41.028864+0000","last_unstale":"2023-11-24T06:29:42.402419+0000","last_undegraded":"2023-11-24T06:29:42.402419+0000","last_fullsized":"2023-11-24T06:29:42.402419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411954+0000","last_change":"2023-11-24T06:29:41.011893+0000","last_active":"2023-11-24T06:29:42.411954+0000","last_peered":"2023-11-24T06:29:42.411954+0000","last_clean":"2023-11-24T06:29:42.411954+0000","last_became_active":"2023-11-24T06:29:41.011583+0000","last_became_peered":"2023-11-24T06:29:41.011583+0000","last_unstale":"2023-11-24T06:29:42.411954+0000","last_undegraded":"2023-11-24T06:29:42.411954+0000","last_fullsized":"2023-11-24T06:29:42.411954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:11.429086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009417+0000","last_change":"2023-11-24T06:29:40.343794+0000","last_active":"2023-11-24T06:29:42.009417+0000","last_peered":"2023-11-24T06:29:42.009417+0000","last_clean":"2023-11-24T06:29:42.009417+0000","last_became_active":"2023-11-24T06:29:40.343471+0000","last_became_peered":"2023-11-24T06:29:40.343471+0000","last_unstale":"2023-11-24T06:29:42.009417+0000","last_undegraded":"2023-11-24T06:29:42.009417+0000","last_fullsized":"2023-11-24T06:29:42.009417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411310+0000","last_change":"2023-11-24T06:29:41.026911+0000","last_active":"2023-11-24T06:29:42.411310+0000","last_peered":"2023-11-24T06:29:42.411310+0000","last_clean":"2023-11-24T06:29:42.411310+0000","last_became_active":"2023-11-24T06:29:41.026653+0000","last_became_peered":"2023-11-24T06:29:41.026653+0000","last_unstale":"2023-11-24T06:29:42.411310+0000","last_undegraded":"2023-11-24T06:29:42.411310+0000","last_fullsized":"2023-11-24T06:29:42.411310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402184+0000","last_change":"2023-11-24T06:29:40.341320+0000","last_active":"2023-11-24T06:29:42.402184+0000","last_peered":"2023-11-24T06:29:42.402184+0000","last_clean":"2023-11-24T06:29:42.402184+0000","last_became_active":"2023-11-24T06:29:40.340947+0000","last_became_peered":"2023-11-24T06:29:40.340947+0000","last_unstale":"2023-11-24T06:29:42.402184+0000","last_undegraded":"2023-11-24T06:29:42.402184+0000","last_fullsized":"2023-11-24T06:29:42.402184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008946+0000","last_change":"2023-11-24T06:29:40.332472+0000","last_active":"2023-11-24T06:29:42.008946+0000","last_peered":"2023-11-24T06:29:42.008946+0000","last_clean":"2023-11-24T06:29:42.008946+0000","last_became_active":"2023-11-24T06:29:40.331771+0000","last_became_peered":"2023-11-24T06:29:40.331771+0000","last_unstale":"2023-11-24T06:29:42.008946+0000","last_undegraded":"2023-11-24T06:29:42.008946+0000","last_fullsized":"2023-11-24T06:29:42.008946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009748+0000","last_change":"2023-11-24T06:29:41.029570+0000","last_active":"2023-11-24T06:29:42.009748+0000","last_peered":"2023-11-24T06:29:42.009748+0000","last_clean":"2023-11-24T06:29:42.009748+0000","last_became_active":"2023-11-24T06:29:41.029260+0000","last_became_peered":"2023-11-24T06:29:41.029260+0000","last_unstale":"2023-11-24T06:29:42.009748+0000","last_undegraded":"2023-11-24T06:29:42.009748+0000","last_fullsized":"2023-11-24T06:29:42.009748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411476+0000","last_change":"2023-11-24T06:29:40.336272+0000","last_active":"2023-11-24T06:29:42.411476+0000","last_peered":"2023-11-24T06:29:42.411476+0000","last_clean":"2023-11-24T06:29:42.411476+0000","last_became_active":"2023-11-24T06:29:40.335981+0000","last_became_peered":"2023-11-24T06:29:40.335981+0000","last_unstale":"2023-11-24T06:29:42.411476+0000","last_undegraded":"2023-11-24T06:29:42.411476+0000","last_fullsized":"2023-11-24T06:29:42.411476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010158+0000","last_change":"2023-11-24T06:29:41.027455+0000","last_active":"2023-11-24T06:29:42.010158+0000","last_peered":"2023-11-24T06:29:42.010158+0000","last_clean":"2023-11-24T06:29:42.010158+0000","last_became_active":"2023-11-24T06:29:41.027066+0000","last_became_peered":"2023-11-24T06:29:41.027066+0000","last_unstale":"2023-11-24T06:29:42.010158+0000","last_undegraded":"2023-11-24T06:29:42.010158+0000","last_fullsized":"2023-11-24T06:29:42.010158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402623+0000","last_change":"2023-11-24T06:29:40.349835+0000","last_active":"2023-11-24T06:29:42.402623+0000","last_peered":"2023-11-24T06:29:42.402623+0000","last_clean":"2023-11-24T06:29:42.402623+0000","last_became_active":"2023-11-24T06:29:40.349318+0000","last_became_peered":"2023-11-24T06:29:40.349318+0000","last_unstale":"2023-11-24T06:29:42.402623+0000","last_undegraded":"2023-11-24T06:29:42.402623+0000","last_fullsized":"2023-11-24T06:29:42.402623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:23.777269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412362+0000","last_change":"2023-11-24T06:29:41.035952+0000","last_active":"2023-11-24T06:29:42.412362+0000","last_peered":"2023-11-24T06:29:42.412362+0000","last_clean":"2023-11-24T06:29:42.412362+0000","last_became_active":"2023-11-24T06:29:41.035659+0000","last_became_peered":"2023-11-24T06:29:41.035659+0000","last_unstale":"2023-11-24T06:29:42.412362+0000","last_undegraded":"2023-11-24T06:29:42.412362+0000","last_fullsized":"2023-11-24T06:29:42.412362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412456+0000","last_change":"2023-11-24T06:29:40.346349+0000","last_active":"2023-11-24T06:29:42.412456+0000","last_peered":"2023-11-24T06:29:42.412456+0000","last_clean":"2023-11-24T06:29:42.412456+0000","last_became_active":"2023-11-24T06:29:40.345989+0000","last_became_peered":"2023-11-24T06:29:40.345989+0000","last_unstale":"2023-11-24T06:29:42.412456+0000","last_undegraded":"2023-11-24T06:29:42.412456+0000","last_fullsized":"2023-11-24T06:29:42.412456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:36.363583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411200+0000","last_change":"2023-11-24T06:29:41.038281+0000","last_active":"2023-11-24T06:29:42.411200+0000","last_peered":"2023-11-24T06:29:42.411200+0000","last_clean":"2023-11-24T06:29:42.411200+0000","last_became_active":"2023-11-24T06:29:41.038032+0000","last_became_peered":"2023-11-24T06:29:41.038032+0000","last_unstale":"2023-11-24T06:29:42.411200+0000","last_undegraded":"2023-11-24T06:29:42.411200+0000","last_fullsized":"2023-11-24T06:29:42.411200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:51.648443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009998+0000","last_change":"2023-11-24T06:29:40.346634+0000","last_active":"2023-11-24T06:29:42.009998+0000","last_peered":"2023-11-24T06:29:42.009998+0000","last_clean":"2023-11-24T06:29:42.009998+0000","last_became_active":"2023-11-24T06:29:40.346312+0000","last_became_peered":"2023-11-24T06:29:40.346312+0000","last_unstale":"2023-11-24T06:29:42.009998+0000","last_undegraded":"2023-11-24T06:29:42.009998+0000","last_fullsized":"2023-11-24T06:29:42.009998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412076+0000","last_change":"2023-11-24T06:29:41.021832+0000","last_active":"2023-11-24T06:29:42.412076+0000","last_peered":"2023-11-24T06:29:42.412076+0000","last_clean":"2023-11-24T06:29:42.412076+0000","last_became_active":"2023-11-24T06:29:41.021474+0000","last_became_peered":"2023-11-24T06:29:41.021474+0000","last_unstale":"2023-11-24T06:29:42.412076+0000","last_undegraded":"2023-11-24T06:29:42.412076+0000","last_fullsized":"2023-11-24T06:29:42.412076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:54.814389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402403+0000","last_change":"2023-11-24T06:29:40.341865+0000","last_active":"2023-11-24T06:29:42.402403+0000","last_peered":"2023-11-24T06:29:42.402403+0000","last_clean":"2023-11-24T06:29:42.402403+0000","last_became_active":"2023-11-24T06:29:40.341473+0000","last_became_peered":"2023-11-24T06:29:40.341473+0000","last_unstale":"2023-11-24T06:29:42.402403+0000","last_undegraded":"2023-11-24T06:29:42.402403+0000","last_fullsized":"2023-11-24T06:29:42.402403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412596+0000","last_change":"2023-11-24T06:29:41.032631+0000","last_active":"2023-11-24T06:29:42.412596+0000","last_peered":"2023-11-24T06:29:42.412596+0000","last_clean":"2023-11-24T06:29:42.412596+0000","last_became_active":"2023-11-24T06:29:41.032317+0000","last_became_peered":"2023-11-24T06:29:41.032317+0000","last_unstale":"2023-11-24T06:29:42.412596+0000","last_undegraded":"2023-11-24T06:29:42.412596+0000","last_fullsized":"2023-11-24T06:29:42.412596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411352+0000","last_change":"2023-11-24T06:29:40.346013+0000","last_active":"2023-11-24T06:29:42.411352+0000","last_peered":"2023-11-24T06:29:42.411352+0000","last_clean":"2023-11-24T06:29:42.411352+0000","last_became_active":"2023-11-24T06:29:40.345697+0000","last_became_peered":"2023-11-24T06:29:40.345697+0000","last_unstale":"2023-11-24T06:29:42.411352+0000","last_undegraded":"2023-11-24T06:29:42.411352+0000","last_fullsized":"2023-11-24T06:29:42.411352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410974+0000","last_change":"2023-11-24T06:29:41.022517+0000","last_active":"2023-11-24T06:29:42.410974+0000","last_peered":"2023-11-24T06:29:42.410974+0000","last_clean":"2023-11-24T06:29:42.410974+0000","last_became_active":"2023-11-24T06:29:41.022269+0000","last_became_peered":"2023-11-24T06:29:41.022269+0000","last_unstale":"2023-11-24T06:29:42.410974+0000","last_undegraded":"2023-11-24T06:29:42.410974+0000","last_fullsized":"2023-11-24T06:29:42.410974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412047+0000","last_change":"2023-11-24T06:29:40.333463+0000","last_active":"2023-11-24T06:29:42.412047+0000","last_peered":"2023-11-24T06:29:42.412047+0000","last_clean":"2023-11-24T06:29:42.412047+0000","last_became_active":"2023-11-24T06:29:40.333138+0000","last_became_peered":"2023-11-24T06:29:40.333138+0000","last_unstale":"2023-11-24T06:29:42.412047+0000","last_undegraded":"2023-11-24T06:29:42.412047+0000","last_fullsized":"2023-11-24T06:29:42.412047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412905+0000","last_change":"2023-11-24T06:29:41.034227+0000","last_active":"2023-11-24T06:29:42.412905+0000","last_peered":"2023-11-24T06:29:42.412905+0000","last_clean":"2023-11-24T06:29:42.412905+0000","last_became_active":"2023-11-24T06:29:41.033863+0000","last_became_peered":"2023-11-24T06:29:41.033863+0000","last_unstale":"2023-11-24T06:29:42.412905+0000","last_undegraded":"2023-11-24T06:29:42.412905+0000","last_fullsized":"2023-11-24T06:29:42.412905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:22.197063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402160+0000","last_change":"2023-11-24T06:29:40.339332+0000","last_active":"2023-11-24T06:29:42.402160+0000","last_peered":"2023-11-24T06:29:42.402160+0000","last_clean":"2023-11-24T06:29:42.402160+0000","last_became_active":"2023-11-24T06:29:40.338937+0000","last_became_peered":"2023-11-24T06:29:40.338937+0000","last_unstale":"2023-11-24T06:29:42.402160+0000","last_undegraded":"2023-11-24T06:29:42.402160+0000","last_fullsized":"2023-11-24T06:29:42.402160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402564+0000","last_change":"2023-11-24T06:29:41.022776+0000","last_active":"2023-11-24T06:29:42.402564+0000","last_peered":"2023-11-24T06:29:42.402564+0000","last_clean":"2023-11-24T06:29:42.402564+0000","last_became_active":"2023-11-24T06:29:41.022391+0000","last_became_peered":"2023-11-24T06:29:41.022391+0000","last_unstale":"2023-11-24T06:29:42.402564+0000","last_undegraded":"2023-11-24T06:29:42.402564+0000","last_fullsized":"2023-11-24T06:29:42.402564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009165+0000","last_change":"2023-11-24T06:29:40.330685+0000","last_active":"2023-11-24T06:29:42.009165+0000","last_peered":"2023-11-24T06:29:42.009165+0000","last_clean":"2023-11-24T06:29:42.009165+0000","last_became_active":"2023-11-24T06:29:40.330343+0000","last_became_peered":"2023-11-24T06:29:40.330343+0000","last_unstale":"2023-11-24T06:29:42.009165+0000","last_undegraded":"2023-11-24T06:29:42.009165+0000","last_fullsized":"2023-11-24T06:29:42.009165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412651+0000","last_change":"2023-11-24T06:29:41.033010+0000","last_active":"2023-11-24T06:29:42.412651+0000","last_peered":"2023-11-24T06:29:42.412651+0000","last_clean":"2023-11-24T06:29:42.412651+0000","last_became_active":"2023-11-24T06:29:41.032663+0000","last_became_peered":"2023-11-24T06:29:41.032663+0000","last_unstale":"2023-11-24T06:29:42.412651+0000","last_undegraded":"2023-11-24T06:29:42.412651+0000","last_fullsized":"2023-11-24T06:29:42.412651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:58.852010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412068+0000","last_change":"2023-11-24T06:29:40.344785+0000","last_active":"2023-11-24T06:29:42.412068+0000","last_peered":"2023-11-24T06:29:42.412068+0000","last_clean":"2023-11-24T06:29:42.412068+0000","last_became_active":"2023-11-24T06:29:40.344491+0000","last_became_peered":"2023-11-24T06:29:40.344491+0000","last_unstale":"2023-11-24T06:29:42.412068+0000","last_undegraded":"2023-11-24T06:29:42.412068+0000","last_fullsized":"2023-11-24T06:29:42.412068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:32.298231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413142+0000","last_change":"2023-11-24T06:29:41.030954+0000","last_active":"2023-11-24T06:29:42.413142+0000","last_peered":"2023-11-24T06:29:42.413142+0000","last_clean":"2023-11-24T06:29:42.413142+0000","last_became_active":"2023-11-24T06:29:41.030605+0000","last_became_peered":"2023-11-24T06:29:41.030605+0000","last_unstale":"2023-11-24T06:29:42.413142+0000","last_undegraded":"2023-11-24T06:29:42.413142+0000","last_fullsized":"2023-11-24T06:29:42.413142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009450+0000","last_change":"2023-11-24T06:29:40.330710+0000","last_active":"2023-11-24T06:29:42.009450+0000","last_peered":"2023-11-24T06:29:42.009450+0000","last_clean":"2023-11-24T06:29:42.009450+0000","last_became_active":"2023-11-24T06:29:40.330435+0000","last_became_peered":"2023-11-24T06:29:40.330435+0000","last_unstale":"2023-11-24T06:29:42.009450+0000","last_undegraded":"2023-11-24T06:29:42.009450+0000","last_fullsized":"2023-11-24T06:29:42.009450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:39.389505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.413349+0000","last_change":"2023-11-24T06:29:41.032411+0000","last_active":"2023-11-24T06:29:42.413349+0000","last_peered":"2023-11-24T06:29:42.413349+0000","last_clean":"2023-11-24T06:29:42.413349+0000","last_became_active":"2023-11-24T06:29:41.032095+0000","last_became_peered":"2023-11-24T06:29:41.032095+0000","last_unstale":"2023-11-24T06:29:42.413349+0000","last_undegraded":"2023-11-24T06:29:42.413349+0000","last_fullsized":"2023-11-24T06:29:42.413349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:02.553538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010082+0000","last_change":"2023-11-24T06:29:40.337974+0000","last_active":"2023-11-24T06:29:42.010082+0000","last_peered":"2023-11-24T06:29:42.010082+0000","last_clean":"2023-11-24T06:29:42.010082+0000","last_became_active":"2023-11-24T06:29:40.337599+0000","last_became_peered":"2023-11-24T06:29:40.337599+0000","last_unstale":"2023-11-24T06:29:42.010082+0000","last_undegraded":"2023-11-24T06:29:42.010082+0000","last_fullsized":"2023-11-24T06:29:42.010082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412670+0000","last_change":"2023-11-24T06:29:41.040924+0000","last_active":"2023-11-24T06:29:42.412670+0000","last_peered":"2023-11-24T06:29:42.412670+0000","last_clean":"2023-11-24T06:29:42.412670+0000","last_became_active":"2023-11-24T06:29:41.040479+0000","last_became_peered":"2023-11-24T06:29:41.040479+0000","last_unstale":"2023-11-24T06:29:42.412670+0000","last_undegraded":"2023-11-24T06:29:42.412670+0000","last_fullsized":"2023-11-24T06:29:42.412670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:13.930895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009583+0000","last_change":"2023-11-24T06:29:40.336909+0000","last_active":"2023-11-24T06:29:42.009583+0000","last_peered":"2023-11-24T06:29:42.009583+0000","last_clean":"2023-11-24T06:29:42.009583+0000","last_became_active":"2023-11-24T06:29:40.336093+0000","last_became_peered":"2023-11-24T06:29:40.336093+0000","last_unstale":"2023-11-24T06:29:42.009583+0000","last_undegraded":"2023-11-24T06:29:42.009583+0000","last_fullsized":"2023-11-24T06:29:42.009583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:22.220406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412802+0000","last_change":"2023-11-24T06:29:41.044969+0000","last_active":"2023-11-24T06:29:42.412802+0000","last_peered":"2023-11-24T06:29:42.412802+0000","last_clean":"2023-11-24T06:29:42.412802+0000","last_became_active":"2023-11-24T06:29:41.044659+0000","last_became_peered":"2023-11-24T06:29:41.044659+0000","last_unstale":"2023-11-24T06:29:42.412802+0000","last_undegraded":"2023-11-24T06:29:42.412802+0000","last_fullsized":"2023-11-24T06:29:42.412802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:36.000474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:29:41.015301+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:29:41.015301+0000","last_peered":"2023-11-24T06:29:41.015301+0000","last_clean":"2023-11-24T06:29:41.015301+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:29:41.015301+0000","last_undegraded":"2023-11-24T06:29:41.015301+0000","last_fullsized":"2023-11-24T06:29:41.015301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411387+0000","last_change":"2023-11-24T06:29:40.333870+0000","last_active":"2023-11-24T06:29:42.411387+0000","last_peered":"2023-11-24T06:29:42.411387+0000","last_clean":"2023-11-24T06:29:42.411387+0000","last_became_active":"2023-11-24T06:29:40.330583+0000","last_became_peered":"2023-11-24T06:29:40.330583+0000","last_unstale":"2023-11-24T06:29:42.411387+0000","last_undegraded":"2023-11-24T06:29:42.411387+0000","last_fullsized":"2023-11-24T06:29:42.411387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.008984+0000","last_change":"2023-11-24T06:29:41.044278+0000","last_active":"2023-11-24T06:29:42.008984+0000","last_peered":"2023-11-24T06:29:42.008984+0000","last_clean":"2023-11-24T06:29:42.008984+0000","last_became_active":"2023-11-24T06:29:41.044029+0000","last_became_peered":"2023-11-24T06:29:41.044029+0000","last_unstale":"2023-11-24T06:29:42.008984+0000","last_undegraded":"2023-11-24T06:29:42.008984+0000","last_fullsized":"2023-11-24T06:29:42.008984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411686+0000","last_change":"2023-11-24T06:29:40.351531+0000","last_active":"2023-11-24T06:29:42.411686+0000","last_peered":"2023-11-24T06:29:42.411686+0000","last_clean":"2023-11-24T06:29:42.411686+0000","last_became_active":"2023-11-24T06:29:40.351232+0000","last_became_peered":"2023-11-24T06:29:40.351232+0000","last_unstale":"2023-11-24T06:29:42.411686+0000","last_undegraded":"2023-11-24T06:29:42.411686+0000","last_fullsized":"2023-11-24T06:29:42.411686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.410953+0000","last_change":"2023-11-24T06:29:41.027965+0000","last_active":"2023-11-24T06:29:42.410953+0000","last_peered":"2023-11-24T06:29:42.410953+0000","last_clean":"2023-11-24T06:29:42.410953+0000","last_became_active":"2023-11-24T06:29:41.027713+0000","last_became_peered":"2023-11-24T06:29:41.027713+0000","last_unstale":"2023-11-24T06:29:42.410953+0000","last_undegraded":"2023-11-24T06:29:42.410953+0000","last_fullsized":"2023-11-24T06:29:42.410953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:56.810396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009419+0000","last_change":"2023-11-24T06:29:40.328364+0000","last_active":"2023-11-24T06:29:42.009419+0000","last_peered":"2023-11-24T06:29:42.009419+0000","last_clean":"2023-11-24T06:29:42.009419+0000","last_became_active":"2023-11-24T06:29:40.328059+0000","last_became_peered":"2023-11-24T06:29:40.328059+0000","last_unstale":"2023-11-24T06:29:42.009419+0000","last_undegraded":"2023-11-24T06:29:42.009419+0000","last_fullsized":"2023-11-24T06:29:42.009419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:53.807597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010410+0000","last_change":"2023-11-24T06:29:41.018318+0000","last_active":"2023-11-24T06:29:42.010410+0000","last_peered":"2023-11-24T06:29:42.010410+0000","last_clean":"2023-11-24T06:29:42.010410+0000","last_became_active":"2023-11-24T06:29:41.018026+0000","last_became_peered":"2023-11-24T06:29:41.018026+0000","last_unstale":"2023-11-24T06:29:42.010410+0000","last_undegraded":"2023-11-24T06:29:42.010410+0000","last_fullsized":"2023-11-24T06:29:42.010410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412136+0000","last_change":"2023-11-24T06:29:40.347685+0000","last_active":"2023-11-24T06:29:42.412136+0000","last_peered":"2023-11-24T06:29:42.412136+0000","last_clean":"2023-11-24T06:29:42.412136+0000","last_became_active":"2023-11-24T06:29:40.345649+0000","last_became_peered":"2023-11-24T06:29:40.345649+0000","last_unstale":"2023-11-24T06:29:42.412136+0000","last_undegraded":"2023-11-24T06:29:42.412136+0000","last_fullsized":"2023-11-24T06:29:42.412136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:50.641651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412373+0000","last_change":"2023-11-24T06:29:41.021761+0000","last_active":"2023-11-24T06:29:42.412373+0000","last_peered":"2023-11-24T06:29:42.412373+0000","last_clean":"2023-11-24T06:29:42.412373+0000","last_became_active":"2023-11-24T06:29:41.021424+0000","last_became_peered":"2023-11-24T06:29:41.021424+0000","last_unstale":"2023-11-24T06:29:42.412373+0000","last_undegraded":"2023-11-24T06:29:42.412373+0000","last_fullsized":"2023-11-24T06:29:42.412373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:01.108220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010388+0000","last_change":"2023-11-24T06:29:40.347121+0000","last_active":"2023-11-24T06:29:42.010388+0000","last_peered":"2023-11-24T06:29:42.010388+0000","last_clean":"2023-11-24T06:29:42.010388+0000","last_became_active":"2023-11-24T06:29:40.346921+0000","last_became_peered":"2023-11-24T06:29:40.346921+0000","last_unstale":"2023-11-24T06:29:42.010388+0000","last_undegraded":"2023-11-24T06:29:42.010388+0000","last_fullsized":"2023-11-24T06:29:42.010388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:35.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412698+0000","last_change":"2023-11-24T06:29:41.043988+0000","last_active":"2023-11-24T06:29:42.412698+0000","last_peered":"2023-11-24T06:29:42.412698+0000","last_clean":"2023-11-24T06:29:42.412698+0000","last_became_active":"2023-11-24T06:29:41.042979+0000","last_became_peered":"2023-11-24T06:29:41.042979+0000","last_unstale":"2023-11-24T06:29:42.412698+0000","last_undegraded":"2023-11-24T06:29:42.412698+0000","last_fullsized":"2023-11-24T06:29:42.412698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:13.597187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412954+0000","last_change":"2023-11-24T06:29:40.354819+0000","last_active":"2023-11-24T06:29:42.412954+0000","last_peered":"2023-11-24T06:29:42.412954+0000","last_clean":"2023-11-24T06:29:42.412954+0000","last_became_active":"2023-11-24T06:29:40.354555+0000","last_became_peered":"2023-11-24T06:29:40.354555+0000","last_unstale":"2023-11-24T06:29:42.412954+0000","last_undegraded":"2023-11-24T06:29:42.412954+0000","last_fullsized":"2023-11-24T06:29:42.412954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.971587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010353+0000","last_change":"2023-11-24T06:29:41.026151+0000","last_active":"2023-11-24T06:29:42.010353+0000","last_peered":"2023-11-24T06:29:42.010353+0000","last_clean":"2023-11-24T06:29:42.010353+0000","last_became_active":"2023-11-24T06:29:41.025056+0000","last_became_peered":"2023-11-24T06:29:41.025056+0000","last_unstale":"2023-11-24T06:29:42.010353+0000","last_undegraded":"2023-11-24T06:29:42.010353+0000","last_fullsized":"2023-11-24T06:29:42.010353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:30.569805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:43.232209+0000","last_change":"2023-11-24T06:29:40.339825+0000","last_active":"2023-11-24T06:29:43.232209+0000","last_peered":"2023-11-24T06:29:43.232209+0000","last_clean":"2023-11-24T06:29:43.232209+0000","last_became_active":"2023-11-24T06:29:40.339532+0000","last_became_peered":"2023-11-24T06:29:40.339532+0000","last_unstale":"2023-11-24T06:29:43.232209+0000","last_undegraded":"2023-11-24T06:29:43.232209+0000","last_fullsized":"2023-11-24T06:29:43.232209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:28.195753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010070+0000","last_change":"2023-11-24T06:29:41.034827+0000","last_active":"2023-11-24T06:29:42.010070+0000","last_peered":"2023-11-24T06:29:42.010070+0000","last_clean":"2023-11-24T06:29:42.010070+0000","last_became_active":"2023-11-24T06:29:41.034571+0000","last_became_peered":"2023-11-24T06:29:41.034571+0000","last_unstale":"2023-11-24T06:29:42.010070+0000","last_undegraded":"2023-11-24T06:29:42.010070+0000","last_fullsized":"2023-11-24T06:29:42.010070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:55.548673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402710+0000","last_change":"2023-11-24T06:29:40.349652+0000","last_active":"2023-11-24T06:29:42.402710+0000","last_peered":"2023-11-24T06:29:42.402710+0000","last_clean":"2023-11-24T06:29:42.402710+0000","last_became_active":"2023-11-24T06:29:40.348929+0000","last_became_peered":"2023-11-24T06:29:40.348929+0000","last_unstale":"2023-11-24T06:29:42.402710+0000","last_undegraded":"2023-11-24T06:29:42.402710+0000","last_fullsized":"2023-11-24T06:29:42.402710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411201+0000","last_change":"2023-11-24T06:29:41.020681+0000","last_active":"2023-11-24T06:29:42.411201+0000","last_peered":"2023-11-24T06:29:42.411201+0000","last_clean":"2023-11-24T06:29:42.411201+0000","last_became_active":"2023-11-24T06:29:41.020398+0000","last_became_peered":"2023-11-24T06:29:41.020398+0000","last_unstale":"2023-11-24T06:29:42.411201+0000","last_undegraded":"2023-11-24T06:29:42.411201+0000","last_fullsized":"2023-11-24T06:29:42.411201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:50.978379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411695+0000","last_change":"2023-11-24T06:29:40.350908+0000","last_active":"2023-11-24T06:29:42.411695+0000","last_peered":"2023-11-24T06:29:42.411695+0000","last_clean":"2023-11-24T06:29:42.411695+0000","last_became_active":"2023-11-24T06:29:40.350583+0000","last_became_peered":"2023-11-24T06:29:40.350583+0000","last_unstale":"2023-11-24T06:29:42.411695+0000","last_undegraded":"2023-11-24T06:29:42.411695+0000","last_fullsized":"2023-11-24T06:29:42.411695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:10.422293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412962+0000","last_change":"2023-11-24T06:29:41.023906+0000","last_active":"2023-11-24T06:29:42.412962+0000","last_peered":"2023-11-24T06:29:42.412962+0000","last_clean":"2023-11-24T06:29:42.412962+0000","last_became_active":"2023-11-24T06:29:41.023643+0000","last_became_peered":"2023-11-24T06:29:41.023643+0000","last_unstale":"2023-11-24T06:29:42.412962+0000","last_undegraded":"2023-11-24T06:29:42.412962+0000","last_fullsized":"2023-11-24T06:29:42.412962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:24.784061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010301+0000","last_change":"2023-11-24T06:29:40.351462+0000","last_active":"2023-11-24T06:29:42.010301+0000","last_peered":"2023-11-24T06:29:42.010301+0000","last_clean":"2023-11-24T06:29:42.010301+0000","last_became_active":"2023-11-24T06:29:40.351124+0000","last_became_peered":"2023-11-24T06:29:40.351124+0000","last_unstale":"2023-11-24T06:29:42.010301+0000","last_undegraded":"2023-11-24T06:29:42.010301+0000","last_fullsized":"2023-11-24T06:29:42.010301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:47.367838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010499+0000","last_change":"2023-11-24T06:29:41.020690+0000","last_active":"2023-11-24T06:29:42.010499+0000","last_peered":"2023-11-24T06:29:42.010499+0000","last_clean":"2023-11-24T06:29:42.010499+0000","last_became_active":"2023-11-24T06:29:41.020427+0000","last_became_peered":"2023-11-24T06:29:41.020427+0000","last_unstale":"2023-11-24T06:29:42.010499+0000","last_undegraded":"2023-11-24T06:29:42.010499+0000","last_fullsized":"2023-11-24T06:29:42.010499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:20.471053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.010425+0000","last_change":"2023-11-24T06:29:40.328181+0000","last_active":"2023-11-24T06:29:42.010425+0000","last_peered":"2023-11-24T06:29:42.010425+0000","last_clean":"2023-11-24T06:29:42.010425+0000","last_became_active":"2023-11-24T06:29:40.327692+0000","last_became_peered":"2023-11-24T06:29:40.327692+0000","last_unstale":"2023-11-24T06:29:42.010425+0000","last_undegraded":"2023-11-24T06:29:42.010425+0000","last_fullsized":"2023-11-24T06:29:42.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009320+0000","last_change":"2023-11-24T06:29:41.022705+0000","last_active":"2023-11-24T06:29:42.009320+0000","last_peered":"2023-11-24T06:29:42.009320+0000","last_clean":"2023-11-24T06:29:42.009320+0000","last_became_active":"2023-11-24T06:29:41.022442+0000","last_became_peered":"2023-11-24T06:29:41.022442+0000","last_unstale":"2023-11-24T06:29:42.009320+0000","last_undegraded":"2023-11-24T06:29:42.009320+0000","last_fullsized":"2023-11-24T06:29:42.009320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412948+0000","last_change":"2023-11-24T06:29:40.351303+0000","last_active":"2023-11-24T06:29:42.412948+0000","last_peered":"2023-11-24T06:29:42.412948+0000","last_clean":"2023-11-24T06:29:42.412948+0000","last_became_active":"2023-11-24T06:29:40.350893+0000","last_became_peered":"2023-11-24T06:29:40.350893+0000","last_unstale":"2023-11-24T06:29:42.412948+0000","last_undegraded":"2023-11-24T06:29:42.412948+0000","last_fullsized":"2023-11-24T06:29:42.412948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:10:29.563013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.402349+0000","last_change":"2023-11-24T06:29:41.030215+0000","last_active":"2023-11-24T06:29:42.402349+0000","last_peered":"2023-11-24T06:29:42.402349+0000","last_clean":"2023-11-24T06:29:42.402349+0000","last_became_active":"2023-11-24T06:29:41.029775+0000","last_became_peered":"2023-11-24T06:29:41.029775+0000","last_unstale":"2023-11-24T06:29:42.402349+0000","last_undegraded":"2023-11-24T06:29:42.402349+0000","last_fullsized":"2023-11-24T06:29:42.402349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:33.376376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412554+0000","last_change":"2023-11-24T06:29:41.039473+0000","last_active":"2023-11-24T06:29:42.412554+0000","last_peered":"2023-11-24T06:29:42.412554+0000","last_clean":"2023-11-24T06:29:42.412554+0000","last_became_active":"2023-11-24T06:29:41.039150+0000","last_became_peered":"2023-11-24T06:29:41.039150+0000","last_unstale":"2023-11-24T06:29:42.412554+0000","last_undegraded":"2023-11-24T06:29:42.412554+0000","last_fullsized":"2023-11-24T06:29:42.412554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:52.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412823+0000","last_change":"2023-11-24T06:29:40.351147+0000","last_active":"2023-11-24T06:29:42.412823+0000","last_peered":"2023-11-24T06:29:42.412823+0000","last_clean":"2023-11-24T06:29:42.412823+0000","last_became_active":"2023-11-24T06:29:40.350837+0000","last_became_peered":"2023-11-24T06:29:40.350837+0000","last_unstale":"2023-11-24T06:29:42.412823+0000","last_undegraded":"2023-11-24T06:29:42.412823+0000","last_fullsized":"2023-11-24T06:29:42.412823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:00.101428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412531+0000","last_change":"2023-11-24T06:29:41.042212+0000","last_active":"2023-11-24T06:29:42.412531+0000","last_peered":"2023-11-24T06:29:42.412531+0000","last_clean":"2023-11-24T06:29:42.412531+0000","last_became_active":"2023-11-24T06:29:41.041751+0000","last_became_peered":"2023-11-24T06:29:41.041751+0000","last_unstale":"2023-11-24T06:29:42.412531+0000","last_undegraded":"2023-11-24T06:29:42.412531+0000","last_fullsized":"2023-11-24T06:29:42.412531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:20.601141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.412849+0000","last_change":"2023-11-24T06:29:40.351090+0000","last_active":"2023-11-24T06:29:42.412849+0000","last_peered":"2023-11-24T06:29:42.412849+0000","last_clean":"2023-11-24T06:29:42.412849+0000","last_became_active":"2023-11-24T06:29:40.350722+0000","last_became_peered":"2023-11-24T06:29:40.350722+0000","last_unstale":"2023-11-24T06:29:42.412849+0000","last_undegraded":"2023-11-24T06:29:42.412849+0000","last_fullsized":"2023-11-24T06:29:42.412849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:55.803603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411181+0000","last_change":"2023-11-24T06:29:41.044968+0000","last_active":"2023-11-24T06:29:42.411181+0000","last_peered":"2023-11-24T06:29:42.411181+0000","last_clean":"2023-11-24T06:29:42.411181+0000","last_became_active":"2023-11-24T06:29:41.044679+0000","last_became_peered":"2023-11-24T06:29:41.044679+0000","last_unstale":"2023-11-24T06:29:42.411181+0000","last_undegraded":"2023-11-24T06:29:42.411181+0000","last_fullsized":"2023-11-24T06:29:42.411181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:22.462428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009975+0000","last_change":"2023-11-24T06:29:40.347084+0000","last_active":"2023-11-24T06:29:42.009975+0000","last_peered":"2023-11-24T06:29:42.009975+0000","last_clean":"2023-11-24T06:29:42.009975+0000","last_became_active":"2023-11-24T06:29:40.346829+0000","last_became_peered":"2023-11-24T06:29:40.346829+0000","last_unstale":"2023-11-24T06:29:42.009975+0000","last_undegraded":"2023-11-24T06:29:42.009975+0000","last_fullsized":"2023-11-24T06:29:42.009975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:58.342178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.009898+0000","last_change":"2023-11-24T06:29:41.032848+0000","last_active":"2023-11-24T06:29:42.009898+0000","last_peered":"2023-11-24T06:29:42.009898+0000","last_clean":"2023-11-24T06:29:42.009898+0000","last_became_active":"2023-11-24T06:29:41.032572+0000","last_became_peered":"2023-11-24T06:29:41.032572+0000","last_unstale":"2023-11-24T06:29:42.009898+0000","last_undegraded":"2023-11-24T06:29:42.009898+0000","last_fullsized":"2023-11-24T06:29:42.009898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:40.308956+0000","last_clean_scrub_stamp":"2023-11-24T06:29:40.308956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:37.370375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:29:42.411279+0000","last_change":"2023-11-24T06:29:40.353473+0000","last_active":"2023-11-24T06:29:42.411279+0000","last_peered":"2023-11-24T06:29:42.411279+0000","last_clean":"2023-11-24T06:29:42.411279+0000","last_became_active":"2023-11-24T06:29:40.353135+0000","last_became_peered":"2023-11-24T06:29:40.353135+0000","last_unstale":"2023-11-24T06:29:42.411279+0000","last_undegraded":"2023-11-24T06:29:42.411279+0000","last_fullsized":"2023-11-24T06:29:42.411279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:39.302164+0000","last_clean_scrub_stamp":"2023-11-24T06:29:39.302164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2770000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9810000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9570000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:29:50.323 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:29:50.323 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T06:29:50.324 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T06:29:50.324 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T06:29:50.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.490+0000 7f63aa172640 1 Processor -- start 2023-11-24T06:29:50.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.490+0000 7f63aa172640 1 -- start start 2023-11-24T06:29:50.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63aa172640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a40b36c0 0x7f63a40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63aa172640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63a4070da0 0x7f63a415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63aa172640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a415a700 con 0x7f63a415a320 2023-11-24T06:29:50.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63aa172640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a40b2430 con 0x7f63a4070da0 2023-11-24T06:29:50.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63aa172640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b2620 con 0x7f63a40b36c0 2023-11-24T06:29:50.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f63a415a320 0x7f63a4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32856/0 (socket says 172.21.15.143:32856) 2023-11-24T06:29:50.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a37fe640 1 -- 172.21.15.143:0/1673689777 learned_addr learned my addr 172.21.15.143:0/1673689777 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:50.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a2ffd640 1 --2- 172.21.15.143:0/1673689777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a40b36c0 0x7f63a40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a3fff640 1 --2- 172.21.15.143:0/1673689777 >> v2:172.21.15.146:3300/0 conn(0x7f63a4070da0 0x7f63a415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a27fc640 1 -- 172.21.15.143:0/1673689777 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993720833 0 0) 0x7f63a415a700 con 0x7f63a415a320 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a27fc640 1 -- 172.21.15.143:0/1673689777 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f638c003530 con 0x7f63a415a320 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a2ffd640 1 -- 172.21.15.143:0/1673689777 >> v2:172.21.15.146:3300/0 conn(0x7f63a4070da0 msgr2=0x7f63a415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a2ffd640 1 --2- 172.21.15.143:0/1673689777 >> v2:172.21.15.146:3300/0 conn(0x7f63a4070da0 0x7f63a415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a2ffd640 1 -- 172.21.15.143:0/1673689777 >> v1:172.21.15.143:6789/0 conn(0x7f63a415a320 legacy=0x7f63a4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a2ffd640 1 -- 172.21.15.143:0/1673689777 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40b2900 con 0x7f63a40b36c0 2023-11-24T06:29:50.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.494+0000 7f63a3fff640 1 --2- 172.21.15.143:0/1673689777 >> v2:172.21.15.146:3300/0 conn(0x7f63a4070da0 0x7f63a415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:50.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63a2ffd640 1 --2- 172.21.15.143:0/1673689777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a40b36c0 0x7f63a40b1ef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63980097c0 tx=0x7f639801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6170730a35610b15 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63a27fc640 1 -- 172.21.15.143:0/1673689777 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980ad660 con 0x7f63a40b36c0 2023-11-24T06:29:50.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63a27fc640 1 -- 172.21.15.143:0/1673689777 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63980ad7c0 con 0x7f63a40b36c0 2023-11-24T06:29:50.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63a27fc640 1 -- 172.21.15.143:0/1673689777 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980adb50 con 0x7f63a40b36c0 2023-11-24T06:29:50.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 -- 172.21.15.143:0/1673689777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a40b36c0 msgr2=0x7f63a40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 --2- 172.21.15.143:0/1673689777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a40b36c0 0x7f63a40b1ef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63980097c0 tx=0x7f639801c450 comp rx=0 tx=0).stop 2023-11-24T06:29:50.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 -- 172.21.15.143:0/1673689777 shutdown_connections 2023-11-24T06:29:50.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 --2- 172.21.15.143:0/1673689777 >> v2:172.21.15.146:3300/0 conn(0x7f63a4070da0 0x7f63a415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 --2- 172.21.15.143:0/1673689777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a40b36c0 0x7f63a40b1ef0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 -- 172.21.15.143:0/1673689777 >> 172.21.15.143:0/1673689777 conn(0x7f63a40b0bf0 msgr2=0x7f63a40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:50.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 -- 172.21.15.143:0/1673689777 shutdown_connections 2023-11-24T06:29:50.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 -- 172.21.15.143:0/1673689777 wait complete. 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 Processor -- start 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.498+0000 7f63aa172640 1 -- start start 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 0x7f63a40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a40b36c0 0x7f63a41569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a415a320 0x7f63a41506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a409a230 con 0x7f63a4070da0 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a41634b0 con 0x7f63a40b36c0 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4163790 con 0x7f63a415a320 2023-11-24T06:29:50.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 0x7f63a40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 0x7f63a40999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37578/0 (socket says 172.21.15.143:37578) 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 -- 172.21.15.143:0/4016950799 learned_addr learned my addr 172.21.15.143:0/4016950799 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a2ffd640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a40b36c0 0x7f63a41569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a3fff640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a415a320 0x7f63a41506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 -- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a415a320 msgr2=0x7f63a41506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a415a320 0x7f63a41506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 -- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a40b36c0 msgr2=0x7f63a41569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a40b36c0 0x7f63a41569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 -- 172.21.15.143:0/4016950799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c009a70 con 0x7f63a4070da0 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63a37fe640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 0x7f63a40999e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f639400c420 tx=0x7f639400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394005cf0 con 0x7f63a4070da0 2023-11-24T06:29:50.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394005e50 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940072d0 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6398009420 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a4163d50 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.502+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a4163f40 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.506+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6394007430 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.506+0000 7f638bfff640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066470 0x7f6390068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.506+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6394083330 con 0x7f63a4070da0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.506+0000 7f63a2ffd640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066470 0x7f6390068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.506+0000 7f63a2ffd640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066470 0x7f6390068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63980af000 tx=0x7f6398008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.510+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6394050850 con 0x7f63a4070da0 2023-11-24T06:29:50.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.690+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f63a4067520 con 0x7f63a4070da0 2023-11-24T06:29:50.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.690+0000 7f638bfff640 1 -- 172.21.15.143:0/4016950799 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6394053e70 con 0x7f63a4070da0 2023-11-24T06:29:50.696 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:50.696 INFO:teuthology.orchestra.run.smithi143.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T06:29:50.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066470 msgr2=0x7f6390068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066470 0x7f6390068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63980af000 tx=0x7f6398008040 comp rx=0 tx=0).stop 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 msgr2=0x7f63a40999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 0x7f63a40999e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f639400c420 tx=0x7f639400c820 comp rx=0 tx=0).stop 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 shutdown_connections 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6390066470 0x7f6390068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63a415a320 0x7f63a41506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a40b36c0 0x7f63a41569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 --2- 172.21.15.143:0/4016950799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63a4070da0 0x7f63a40999e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 >> 172.21.15.143:0/4016950799 conn(0x7f63a40b0bf0 msgr2=0x7f63a4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 shutdown_connections 2023-11-24T06:29:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.694+0000 7f63aa172640 1 -- 172.21.15.143:0/4016950799 wait complete. 2023-11-24T06:29:50.717 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T06:29:50.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:50.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.850+0000 7f8ee96ea640 1 Processor -- start 2023-11-24T06:29:50.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.850+0000 7f8ee96ea640 1 -- start start 2023-11-24T06:29:50.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee96ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee415d570 0x7f8ee406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee96ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee40d1cc0 con 0x7f8ee40d3020 2023-11-24T06:29:50.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee96ea640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee40d1fa0 con 0x7f8ee40ce8b0 2023-11-24T06:29:50.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee96ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40ce0b0 con 0x7f8ee415d570 2023-11-24T06:29:50.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8edbfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8ee40d3020 0x7f8ee40d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32870/0 (socket says 172.21.15.143:32870) 2023-11-24T06:29:50.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8edbfff640 1 -- 172.21.15.143:0/3599659989 learned_addr learned my addr 172.21.15.143:0/3599659989 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:50.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee2ffd640 1 --2- 172.21.15.143:0/3599659989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee415d570 0x7f8ee406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee27fc640 1 -- 172.21.15.143:0/3599659989 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240273615 0 0) 0x7f8ee40d1cc0 con 0x7f8ee40d3020 2023-11-24T06:29:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee27fc640 1 -- 172.21.15.143:0/3599659989 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed0003530 con 0x7f8ee40d3020 2023-11-24T06:29:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee2ffd640 1 -- 172.21.15.143:0/3599659989 >> v1:172.21.15.146:6789/0 conn(0x7f8ee40ce8b0 legacy=0x7f8ee40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee2ffd640 1 -- 172.21.15.143:0/3599659989 >> v1:172.21.15.143:6789/0 conn(0x7f8ee40d3020 legacy=0x7f8ee40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.854+0000 7f8ee2ffd640 1 -- 172.21.15.143:0/3599659989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40ce390 con 0x7f8ee415d570 2023-11-24T06:29:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee2ffd640 1 --2- 172.21.15.143:0/3599659989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee415d570 0x7f8ee406b9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097f0 tx=0x7f8ed401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62fa6d9ac2ae326 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee27fc640 1 -- 172.21.15.143:0/3599659989 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40ab600 con 0x7f8ee415d570 2023-11-24T06:29:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee27fc640 1 -- 172.21.15.143:0/3599659989 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed40a7050 con 0x7f8ee415d570 2023-11-24T06:29:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee27fc640 1 -- 172.21.15.143:0/3599659989 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40ab980 con 0x7f8ee415d570 2023-11-24T06:29:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- 172.21.15.143:0/3599659989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee415d570 msgr2=0x7f8ee406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/3599659989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee415d570 0x7f8ee406b9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097f0 tx=0x7f8ed401c430 comp rx=0 tx=0).stop 2023-11-24T06:29:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- 172.21.15.143:0/3599659989 shutdown_connections 2023-11-24T06:29:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/3599659989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee415d570 0x7f8ee406b9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- 172.21.15.143:0/3599659989 >> 172.21.15.143:0/3599659989 conn(0x7f8ee408ceb0 msgr2=0x7f8ee409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- 172.21.15.143:0/3599659989 shutdown_connections 2023-11-24T06:29:50.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- 172.21.15.143:0/3599659989 wait complete. 2023-11-24T06:29:50.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 Processor -- start 2023-11-24T06:29:50.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- start start 2023-11-24T06:29:50.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee40ce8b0 0x7f8ee40c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 0x7f8ee4160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ee415d570 0x7f8ee4160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee414baf0 con 0x7f8ee40d3020 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40c8120 con 0x7f8ee415d570 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.858+0000 7f8ee96ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40c8400 con 0x7f8ee40ce8b0 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 0x7f8ee4160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 0x7f8ee4160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37592/0 (socket says 172.21.15.143:37592) 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 -- 172.21.15.143:0/4149867179 learned_addr learned my addr 172.21.15.143:0/4149867179 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee2ffd640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee40ce8b0 0x7f8ee40c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 -- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee40ce8b0 msgr2=0x7f8ee40c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee40ce8b0 0x7f8ee40c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 -- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ee415d570 msgr2=0x7f8ee4160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee37fe640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ee415d570 0x7f8ee4160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ee415d570 0x7f8ee4160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 -- 172.21.15.143:0/4149867179 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4009420 con 0x7f8ee40d3020 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee2ffd640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee40ce8b0 0x7f8ee40c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee37fe640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ee415d570 0x7f8ee4160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edbfff640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 0x7f8ee4160250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c4d0 tx=0x7f8ecc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc005cf0 con 0x7f8ee40d3020 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc005e50 con 0x7f8ee40d3020 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee40c86e0 con 0x7f8ee40d3020 2023-11-24T06:29:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc007270 con 0x7f8ee40d3020 2023-11-24T06:29:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee40c8ca0 con 0x7f8ee40d3020 2023-11-24T06:29:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee4067520 con 0x7f8ee40d3020 2023-11-24T06:29:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.862+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ecc0073d0 con 0x7f8ee40d3020 2023-11-24T06:29:50.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.866+0000 7f8edb7fe640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ec4066470 0x7f8ec4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:50.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.866+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ecc0833d0 con 0x7f8ee40d3020 2023-11-24T06:29:50.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.866+0000 7f8ee2ffd640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ec4066470 0x7f8ec4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:50.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.866+0000 7f8ee2ffd640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ec4066470 0x7f8ec4068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40b5ff0 tx=0x7f8ed40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:50.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:50.870+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ecc050900 con 0x7f8ee40d3020 2023-11-24T06:29:51.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.018+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ee406b7b0 con 0x7f8ee40d3020 2023-11-24T06:29:51.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8edb7fe640 1 -- 172.21.15.143:0/4149867179 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f8ecc053f20 con 0x7f8ee40d3020 2023-11-24T06:29:51.025 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:51.025 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ec4066470 msgr2=0x7f8ec4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ec4066470 0x7f8ec4068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40b5ff0 tx=0x7f8ed40a6000 comp rx=0 tx=0).stop 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 msgr2=0x7f8ee4160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 0x7f8ee4160250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c4d0 tx=0x7f8ecc00c990 comp rx=0 tx=0).stop 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 shutdown_connections 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ec4066470 0x7f8ec4068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ee415d570 0x7f8ee4160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ee40d3020 0x7f8ee4160250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 --2- 172.21.15.143:0/4149867179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ee40ce8b0 0x7f8ee40c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 >> 172.21.15.143:0/4149867179 conn(0x7f8ee408ceb0 msgr2=0x7f8ee40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:51.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 shutdown_connections 2023-11-24T06:29:51.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.022+0000 7f8ee96ea640 1 -- 172.21.15.143:0/4149867179 wait complete. 2023-11-24T06:29:51.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:29:51.046 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:29:51.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385fdf5640 1 Processor -- start 2023-11-24T06:29:51.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385fdf5640 1 -- start start 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385fdf5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38580ccef0 0x7f3858071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385fdf5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580723c0 con 0x7f38580cd380 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385fdf5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580726a0 con 0x7f38581624f0 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385fdf5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3858072980 con 0x7f38580ccef0 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.182+0000 7f385e392640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f38580cd380 0x7f38580cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32878/0 (socket says 172.21.15.143:32878) 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385e392640 1 -- 172.21.15.143:0/3553088714 learned_addr learned my addr 172.21.15.143:0/3553088714 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385d390640 1 --2- 172.21.15.143:0/3553088714 >> v2:172.21.15.146:3300/0 conn(0x7f38580ccef0 0x7f3858071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603828474 0 0) 0x7f38580723c0 con 0x7f38580cd380 2023-11-24T06:29:51.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3844003530 con 0x7f38580cd380 2023-11-24T06:29:51.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277049620 0 0) 0x7f3844003530 con 0x7f38580cd380 2023-11-24T06:29:51.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 >> v2:172.21.15.146:3300/0 conn(0x7f38580ccef0 msgr2=0x7f3858071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:51.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 --2- 172.21.15.143:0/3553088714 >> v2:172.21.15.146:3300/0 conn(0x7f38580ccef0 0x7f3858071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 >> v1:172.21.15.146:6789/0 conn(0x7f38581624f0 legacy=0x7f38581628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385806c7e0 con 0x7f38580cd380 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f3850001a00 con 0x7f38580cd380 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 >> v1:172.21.15.143:6789/0 conn(0x7f38580cd380 legacy=0x7f38580cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3844003980 0x7f3844003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38440047d0 0x7f3844004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844005190 0x7f384400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3858072980 con 0x7f3844003980 2023-11-24T06:29:51.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384400c130 con 0x7f38440047d0 2023-11-24T06:29:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384400c2f0 con 0x7f3844005190 2023-11-24T06:29:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385db91640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3844003980 0x7f3844003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385d390640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38440047d0 0x7f3844004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385e392640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844005190 0x7f384400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385db91640 1 -- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844005190 msgr2=0x7f384400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385db91640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844005190 0x7f384400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385db91640 1 -- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38440047d0 msgr2=0x7f3844004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385db91640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38440047d0 0x7f3844004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385db91640 1 -- 172.21.15.143:0/3553088714 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844003530 con 0x7f3844003980 2023-11-24T06:29:51.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385e392640 1 -- 172.21.15.143:0/3553088714 reap_dead start 2023-11-24T06:29:51.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.186+0000 7f385d390640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38440047d0 0x7f3844004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:51.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385db91640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3844003980 0x7f3844003da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3854001780 tx=0x7f385401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9f0ee4349b04a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540052d0 con 0x7f3844003980 2023-11-24T06:29:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854005450 con 0x7f3844003980 2023-11-24T06:29:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385cb8f640 1 -- 172.21.15.143:0/3553088714 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854003840 con 0x7f3844003980 2023-11-24T06:29:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 -- 172.21.15.143:0/3553088714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3844003980 msgr2=0x7f3844003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3844003980 0x7f3844003da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3854001780 tx=0x7f385401c3d0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 -- 172.21.15.143:0/3553088714 shutdown_connections 2023-11-24T06:29:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 --2- 172.21.15.143:0/3553088714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3844003980 0x7f3844003da0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 -- 172.21.15.143:0/3553088714 >> 172.21.15.143:0/3553088714 conn(0x7f38580b0c80 msgr2=0x7f38580b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 -- 172.21.15.143:0/3553088714 shutdown_connections 2023-11-24T06:29:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 -- 172.21.15.143:0/3553088714 wait complete. 2023-11-24T06:29:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 Processor -- start 2023-11-24T06:29:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.190+0000 7f385fdf5640 1 -- start start 2023-11-24T06:29:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844003980 0x7f385815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f385809a110 0x7f3858163120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 0x7f3858163660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38581fa880 con 0x7f38581fe7a0 2023-11-24T06:29:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38581fec80 con 0x7f385809a110 2023-11-24T06:29:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b37c0 con 0x7f3844003980 2023-11-24T06:29:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 0x7f3858163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 0x7f3858163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37606/0 (socket says 172.21.15.143:37606) 2023-11-24T06:29:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 -- 172.21.15.143:0/1522064174 learned_addr learned my addr 172.21.15.143:0/1522064174 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385db91640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844003980 0x7f385815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385d390640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f385809a110 0x7f3858163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 -- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844003980 msgr2=0x7f385815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844003980 0x7f385815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 -- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f385809a110 msgr2=0x7f3858163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f385809a110 0x7f3858163120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 -- 172.21.15.143:0/1522064174 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580b3aa0 con 0x7f38581fe7a0 2023-11-24T06:29:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385e392640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 0x7f3858163660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f385806ea30 tx=0x7f385000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000ec10 con 0x7f38581fe7a0 2023-11-24T06:29:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385000ed70 con 0x7f38581fe7a0 2023-11-24T06:29:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580b3d80 con 0x7f38581fe7a0 2023-11-24T06:29:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000eee0 con 0x7f38581fe7a0 2023-11-24T06:29:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3858163f30 con 0x7f38581fe7a0 2023-11-24T06:29:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38581fa9c0 con 0x7f38581fe7a0 2023-11-24T06:29:51.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.194+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3850013660 con 0x7f38581fe7a0 2023-11-24T06:29:51.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.198+0000 7f384e7fc640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f383c066470 0x7f383c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.198+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3850084200 con 0x7f38581fe7a0 2023-11-24T06:29:51.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.198+0000 7f385db91640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f383c066470 0x7f383c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.198+0000 7f385db91640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f383c066470 0x7f383c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3854001750 tx=0x7f38540011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.202+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38581fa9c0 con 0x7f38581fe7a0 2023-11-24T06:29:51.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.350+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38581fa9c0 con 0x7f38581fe7a0 2023-11-24T06:29:51.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.350+0000 7f384e7fc640 1 -- 172.21.15.143:0/1522064174 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38581fa9c0 con 0x7f38581fe7a0 2023-11-24T06:29:51.356 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f383c066470 msgr2=0x7f383c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f383c066470 0x7f383c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3854001750 tx=0x7f38540011a0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 msgr2=0x7f3858163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 0x7f3858163660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f385806ea30 tx=0x7f385000e530 comp rx=0 tx=0).stop 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 shutdown_connections 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f383c066470 0x7f383c068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38581fe7a0 0x7f3858163660 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f385809a110 0x7f3858163120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 --2- 172.21.15.143:0/1522064174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3844003980 0x7f385815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 >> 172.21.15.143:0/1522064174 conn(0x7f38580b0c80 msgr2=0x7f3858165ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:51.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 shutdown_connections 2023-11-24T06:29:51.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.354+0000 7f385fdf5640 1 -- 172.21.15.143:0/1522064174 wait complete. 2023-11-24T06:29:51.377 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:29:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f11a4a13640 1 Processor -- start 2023-11-24T06:29:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f11a4a13640 1 -- start start 2023-11-24T06:29:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f11a4a13640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11a00ae4a0 0x7f11a015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f11a4a13640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00b3510 con 0x7f11a00ce420 2023-11-24T06:29:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f11a4a13640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00b37f0 con 0x7f11a00cd850 2023-11-24T06:29:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f11a4a13640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a00b3ad0 con 0x7f11a00ae4a0 2023-11-24T06:29:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119ed9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f11a00ce420 0x7f11a006c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32880/0 (socket says 172.21.15.143:32880) 2023-11-24T06:29:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119ed9d640 1 -- 172.21.15.143:0/2365692676 learned_addr learned my addr 172.21.15.143:0/2365692676 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083225799 0 0) 0x7f11a00b3510 con 0x7f11a00ce420 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119e59c640 1 --2- 172.21.15.143:0/2365692676 >> v2:172.21.15.146:3300/0 conn(0x7f11a00ae4a0 0x7f11a015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1188003530 con 0x7f11a00ce420 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094922636 0 0) 0x7f1188003530 con 0x7f11a00ce420 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 >> v2:172.21.15.146:3300/0 conn(0x7f11a00ae4a0 msgr2=0x7f11a015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 --2- 172.21.15.143:0/2365692676 >> v2:172.21.15.146:3300/0 conn(0x7f11a00ae4a0 0x7f11a015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 >> v1:172.21.15.146:6789/0 conn(0x7f11a00cd850 legacy=0x7f11a00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a00b3db0 con 0x7f11a00ce420 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f1198001a00 con 0x7f11a00ce420 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 >> v1:172.21.15.143:6789/0 conn(0x7f11a00ce420 legacy=0x7f11a006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11880039d0 0x7f1188003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f1188004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1188005190 0x7f118800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00b3ad0 con 0x7f11880047d0 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118800c090 con 0x7f1188005190 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118800c250 con 0x7f11880039d0 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119dd9b640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f1188004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119e59c640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11880039d0 0x7f1188003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119ed9d640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1188005190 0x7f118800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119dd9b640 1 -- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11880039d0 msgr2=0x7f1188003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119dd9b640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11880039d0 0x7f1188003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119dd9b640 1 -- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1188005190 msgr2=0x7f118800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119dd9b640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1188005190 0x7f118800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119dd9b640 1 -- 172.21.15.143:0/2365692676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188003530 con 0x7f11880047d0 2023-11-24T06:29:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.518+0000 7f119ed9d640 1 -- 172.21.15.143:0/2365692676 reap_dead start 2023-11-24T06:29:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f119dd9b640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f1188004c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f11a006be60 tx=0x7f119401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687fc7f798483b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940052d0 con 0x7f11880047d0 2023-11-24T06:29:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11940a7050 con 0x7f11880047d0 2023-11-24T06:29:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f119d59a640 1 -- 172.21.15.143:0/2365692676 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194003600 con 0x7f11880047d0 2023-11-24T06:29:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 -- 172.21.15.143:0/2365692676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 msgr2=0x7f1188004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f1188004c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f11a006be60 tx=0x7f119401c340 comp rx=0 tx=0).stop 2023-11-24T06:29:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 -- 172.21.15.143:0/2365692676 shutdown_connections 2023-11-24T06:29:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 --2- 172.21.15.143:0/2365692676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f1188004c50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 -- 172.21.15.143:0/2365692676 >> 172.21.15.143:0/2365692676 conn(0x7f11a00b0c80 msgr2=0x7f11a00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 -- 172.21.15.143:0/2365692676 shutdown_connections 2023-11-24T06:29:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.522+0000 7f11a4a13640 1 -- 172.21.15.143:0/2365692676 wait complete. 2023-11-24T06:29:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 Processor -- start 2023-11-24T06:29:51.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 -- start start 2023-11-24T06:29:51.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f11a01f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11a0150170 0x7f11a00719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a0151ff0 0x7f11a0152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a01448e0 con 0x7f11880047d0 2023-11-24T06:29:51.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a01529b0 con 0x7f11a0151ff0 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a01f6430 con 0x7f11a0150170 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f11a01f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f11a01f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37626/0 (socket says 172.21.15.143:37626) 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 -- 172.21.15.143:0/636909340 learned_addr learned my addr 172.21.15.143:0/636909340 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119dd9b640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11a0150170 0x7f11a00719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119ed9d640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a0151ff0 0x7f11a0152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 -- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11a0150170 msgr2=0x7f11a00719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11a0150170 0x7f11a00719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 -- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a0151ff0 msgr2=0x7f11a0152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a0151ff0 0x7f11a0152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 -- 172.21.15.143:0/636909340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0071ee0 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119ed9d640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a0151ff0 0x7f11a0152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f119e59c640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f11a01f5ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1190011930 tx=0x7f1190011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900095b0 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190004240 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a0150730 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000f880 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.526+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a0150cf0 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.530+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a00b3080 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.530+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f119000f9e0 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.530+0000 7f118effd640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1180066470 0x7f1180068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.530+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11900845d0 con 0x7f11880047d0 2023-11-24T06:29:51.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.530+0000 7f119dd9b640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1180066470 0x7f1180068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.530+0000 7f119dd9b640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1180066470 0x7f1180068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11a00cdcc0 tx=0x7f11940011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.534+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1190051920 con 0x7f11880047d0 2023-11-24T06:29:51.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11a004e8c0 con 0x7f11880047d0 2023-11-24T06:29:51.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f118effd640 1 -- 172.21.15.143:0/636909340 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1190019020 con 0x7f11880047d0 2023-11-24T06:29:51.689 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:29:51.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1180066470 msgr2=0x7f1180068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1180066470 0x7f1180068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11a00cdcc0 tx=0x7f11940011a0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 msgr2=0x7f11a01f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f11a01f5ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1190011930 tx=0x7f1190011df0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 shutdown_connections 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1180066470 0x7f1180068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a0151ff0 0x7f11a0152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11a0150170 0x7f11a00719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 --2- 172.21.15.143:0/636909340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11880047d0 0x7f11a01f5ef0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 >> 172.21.15.143:0/636909340 conn(0x7f11a00b0c80 msgr2=0x7f11a0152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 shutdown_connections 2023-11-24T06:29:51.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.686+0000 7f11a4a13640 1 -- 172.21.15.143:0/636909340 wait complete. 2023-11-24T06:29:51.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:29:51.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad4732a640 1 Processor -- start 2023-11-24T06:29:51.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad4732a640 1 -- start start 2023-11-24T06:29:51.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad4732a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad4015d540 0x7fad4006d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad4732a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4006d9f0 con 0x7fad4006d590 2023-11-24T06:29:51.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad4732a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400cd400 con 0x7fad40072010 2023-11-24T06:29:51.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad4732a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40072860 con 0x7fad4015d540 2023-11-24T06:29:51.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad450c6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad4015d540 0x7fad4006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad448c5640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fad4006d590 0x7fad40071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32884/0 (socket says 172.21.15.143:32884) 2023-11-24T06:29:51.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad448c5640 1 -- 172.21.15.143:0/3909776573 learned_addr learned my addr 172.21.15.143:0/3909776573 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:51.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad450c6640 1 -- 172.21.15.143:0/3909776573 >> v1:172.21.15.146:6789/0 conn(0x7fad40072010 legacy=0x7fad400cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad450c6640 1 -- 172.21.15.143:0/3909776573 >> v1:172.21.15.143:6789/0 conn(0x7fad4006d590 legacy=0x7fad40071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad450c6640 1 -- 172.21.15.143:0/3909776573 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4006dc30 con 0x7fad4015d540 2023-11-24T06:29:51.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.846+0000 7fad37fff640 1 -- 172.21.15.143:0/3909776573 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414398791 0 0) 0x7fad30001120 con 0x7fad4006d590 2023-11-24T06:29:51.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad450c6640 1 --2- 172.21.15.143:0/3909776573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4015d540 0x7fad4006d050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097c0 tx=0x7fad3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34349fbb84f3d78c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad37fff640 1 -- 172.21.15.143:0/3909776573 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0ab600 con 0x7fad4015d540 2023-11-24T06:29:51.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad37fff640 1 -- 172.21.15.143:0/3909776573 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0a7050 con 0x7fad4015d540 2023-11-24T06:29:51.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad37fff640 1 -- 172.21.15.143:0/3909776573 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0ab980 con 0x7fad4015d540 2023-11-24T06:29:51.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 -- 172.21.15.143:0/3909776573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4015d540 msgr2=0x7fad4006d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 --2- 172.21.15.143:0/3909776573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4015d540 0x7fad4006d050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097c0 tx=0x7fad3c01c480 comp rx=0 tx=0).stop 2023-11-24T06:29:51.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 -- 172.21.15.143:0/3909776573 shutdown_connections 2023-11-24T06:29:51.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 --2- 172.21.15.143:0/3909776573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4015d540 0x7fad4006d050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 -- 172.21.15.143:0/3909776573 >> 172.21.15.143:0/3909776573 conn(0x7fad400b0c80 msgr2=0x7fad400b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:51.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 -- 172.21.15.143:0/3909776573 shutdown_connections 2023-11-24T06:29:51.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.850+0000 7fad4732a640 1 -- 172.21.15.143:0/3909776573 wait complete. 2023-11-24T06:29:51.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 Processor -- start 2023-11-24T06:29:51.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 -- start start 2023-11-24T06:29:51.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 0x7fad40147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad40072010 0x7fad401481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad4015d540 0x7fad4014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad401488f0 con 0x7fad4006d590 2023-11-24T06:29:51.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40098e40 con 0x7fad40072010 2023-11-24T06:29:51.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad40149640 con 0x7fad4015d540 2023-11-24T06:29:51.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 0x7fad40147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 0x7fad40147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37640/0 (socket says 172.21.15.143:37640) 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 -- 172.21.15.143:0/4048955624 learned_addr learned my addr 172.21.15.143:0/4048955624 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad448c5640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad40072010 0x7fad401481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 -- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad4015d540 msgr2=0x7fad4014a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad4015d540 0x7fad4014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 -- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad40072010 msgr2=0x7fad401481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad40072010 0x7fad401481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:51.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 -- 172.21.15.143:0/4048955624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009420 con 0x7fad4006d590 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad448c5640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad40072010 0x7fad401481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad450c6640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 0x7fad40147b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad3c01a0b0 tx=0x7fad3c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004030 con 0x7fad4006d590 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c004190 con 0x7fad4006d590 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004500 con 0x7fad4006d590 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40150e40 con 0x7fad4006d590 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.854+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40149bc0 con 0x7fad4006d590 2023-11-24T06:29:51.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.858+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4014f7f0 con 0x7fad4006d590 2023-11-24T06:29:51.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.858+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad3c003620 con 0x7fad4006d590 2023-11-24T06:29:51.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.858+0000 7fad35ffb640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad24066470 0x7fad24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:51.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.858+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad3c11eda0 con 0x7fad4006d590 2023-11-24T06:29:51.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.858+0000 7fad448c5640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad24066470 0x7fad24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:51.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.858+0000 7fad448c5640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad24066470 0x7fad24068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad400b2420 tx=0x7fad30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:51.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:51.862+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad3c0ec2a0 con 0x7fad4006d590 2023-11-24T06:29:52.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.010+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad4004e8c0 con 0x7fad4006d590 2023-11-24T06:29:52.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.010+0000 7fad35ffb640 1 -- 172.21.15.143:0/4048955624 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad3c0b0020 con 0x7fad4006d590 2023-11-24T06:29:52.016 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:29:52.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad24066470 msgr2=0x7fad24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad24066470 0x7fad24068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad400b2420 tx=0x7fad30009040 comp rx=0 tx=0).stop 2023-11-24T06:29:52.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 msgr2=0x7fad40147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 0x7fad40147b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad3c01a0b0 tx=0x7fad3c01acc0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 shutdown_connections 2023-11-24T06:29:52.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad24066470 0x7fad24068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad4015d540 0x7fad4014a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad40072010 0x7fad401481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 --2- 172.21.15.143:0/4048955624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad4006d590 0x7fad40147b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 >> 172.21.15.143:0/4048955624 conn(0x7fad400b0c80 msgr2=0x7fad400acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:52.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 shutdown_connections 2023-11-24T06:29:52.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.014+0000 7fad4732a640 1 -- 172.21.15.143:0/4048955624 wait complete. 2023-11-24T06:29:52.036 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:29:52.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 Processor -- start 2023-11-24T06:29:52.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 -- start start 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f063c15d570 0x7f063c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0ce8b0 0x7f063c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d1cc0 con 0x7f063c0d3020 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0d1fa0 con 0x7f063c15d570 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f0642217640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ce0b0 con 0x7f063c0ce8b0 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f063c15d570 0x7f063c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f063c15d570 0x7f063c06b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37646/0 (socket says 172.21.15.143:37646) 2023-11-24T06:29:52.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 -- 172.21.15.143:0/666739985 learned_addr learned my addr 172.21.15.143:0/666739985 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:52.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063bfff640 1 --2- 172.21.15.143:0/666739985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0ce8b0 0x7f063c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 -- 172.21.15.143:0/666739985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0ce8b0 msgr2=0x7f063c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:52.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 --2- 172.21.15.143:0/666739985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0ce8b0 0x7f063c0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 -- 172.21.15.143:0/666739985 >> v1:172.21.15.143:6789/0 conn(0x7f063c0d3020 legacy=0x7f063c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063b7fe640 1 -- 172.21.15.143:0/666739985 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0ce390 con 0x7f063c15d570 2023-11-24T06:29:52.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.170+0000 7f063a7fc640 1 -- 172.21.15.143:0/666739985 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585593 0 0) 0x7f063c0d1cc0 con 0x7f063c0d3020 2023-11-24T06:29:52.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f063b7fe640 1 --2- 172.21.15.143:0/666739985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15d570 0x7f063c06b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f062c009870 tx=0x7f062c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca9ff71e6dce4a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f063a7fc640 1 -- 172.21.15.143:0/666739985 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0a95f0 con 0x7f063c15d570 2023-11-24T06:29:52.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f063a7fc640 1 -- 172.21.15.143:0/666739985 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c0a9750 con 0x7f063c15d570 2023-11-24T06:29:52.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f063a7fc640 1 -- 172.21.15.143:0/666739985 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0a9ae0 con 0x7f063c15d570 2023-11-24T06:29:52.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 -- 172.21.15.143:0/666739985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15d570 msgr2=0x7f063c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 --2- 172.21.15.143:0/666739985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15d570 0x7f063c06b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f062c009870 tx=0x7f062c01c510 comp rx=0 tx=0).stop 2023-11-24T06:29:52.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 -- 172.21.15.143:0/666739985 shutdown_connections 2023-11-24T06:29:52.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 --2- 172.21.15.143:0/666739985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0ce8b0 0x7f063c0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 --2- 172.21.15.143:0/666739985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15d570 0x7f063c06b9d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 -- 172.21.15.143:0/666739985 >> 172.21.15.143:0/666739985 conn(0x7f063c08ceb0 msgr2=0x7f063c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:52.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 -- 172.21.15.143:0/666739985 shutdown_connections 2023-11-24T06:29:52.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.174+0000 7f0642217640 1 -- 172.21.15.143:0/666739985 wait complete. 2023-11-24T06:29:52.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 Processor -- start 2023-11-24T06:29:52.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 -- start start 2023-11-24T06:29:52.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 0x7f063c14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0d3020 0x7f063c0b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c15d570 0x7f063c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b7a00 con 0x7f063c0ce8b0 2023-11-24T06:29:52.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b7ce0 con 0x7f063c15d570 2023-11-24T06:29:52.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b7fc0 con 0x7f063c0d3020 2023-11-24T06:29:52.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 0x7f063c14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 0x7f063c14c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37656/0 (socket says 172.21.15.143:37656) 2023-11-24T06:29:52.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 -- 172.21.15.143:0/4025625781 learned_addr learned my addr 172.21.15.143:0/4025625781 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 -- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0d3020 msgr2=0x7f063c0b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063affd640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0d3020 0x7f063c0b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063bfff640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c15d570 0x7f063c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0d3020 0x7f063c0b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 -- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c15d570 msgr2=0x7f063c0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c15d570 0x7f063c0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 -- 172.21.15.143:0/4025625781 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0094d0 con 0x7f063c0ce8b0 2023-11-24T06:29:52.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063affd640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0d3020 0x7f063c0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f063b7fe640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 0x7f063c14c790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f062c0ab040 tx=0x7f062c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0b1800 con 0x7f063c0ce8b0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c0b1980 con 0x7f063c0ce8b0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0b1d30 con 0x7f063c0ce8b0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0b82a0 con 0x7f063c0ce8b0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.178+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0b5aa0 con 0x7f063c0ce8b0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.182+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c067520 con 0x7f063c0ce8b0 2023-11-24T06:29:52.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.182+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f062c0a8350 con 0x7f063c0ce8b0 2023-11-24T06:29:52.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.182+0000 7f0623fff640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0628066470 0x7f0628068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.182+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f062c11e820 con 0x7f063c0ce8b0 2023-11-24T06:29:52.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.182+0000 7f063affd640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0628066470 0x7f0628068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.182+0000 7f063affd640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0628066470 0x7f0628068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f063c0cd4b0 tx=0x7f0630009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.186+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f062c0ebca0 con 0x7f063c0ce8b0 2023-11-24T06:29:52.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.366+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f063c06b7b0 con 0x7f063c0ce8b0 2023-11-24T06:29:52.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.366+0000 7f0623fff640 1 -- 172.21.15.143:0/4025625781 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f062c11e030 con 0x7f063c0ce8b0 2023-11-24T06:29:52.371 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:29:52.371 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0628066470 msgr2=0x7f0628068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0628066470 0x7f0628068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f063c0cd4b0 tx=0x7f0630009040 comp rx=0 tx=0).stop 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 msgr2=0x7f063c14c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 0x7f063c14c790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f062c0ab040 tx=0x7f062c01ad50 comp rx=0 tx=0).stop 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 shutdown_connections 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0628066470 0x7f0628068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c15d570 0x7f063c0b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f063c0d3020 0x7f063c0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 --2- 172.21.15.143:0/4025625781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c0ce8b0 0x7f063c14c790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 >> 172.21.15.143:0/4025625781 conn(0x7f063c08ceb0 msgr2=0x7f063c0c7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:52.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 shutdown_connections 2023-11-24T06:29:52.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.370+0000 7f0642217640 1 -- 172.21.15.143:0/4025625781 wait complete. 2023-11-24T06:29:52.392 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:52.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.526+0000 7f3009380640 1 Processor -- start 2023-11-24T06:29:52.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.526+0000 7f3009380640 1 -- start start 2023-11-24T06:29:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3009380640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3004072510 0x7f30040cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3009380640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040cfd60 con 0x7f3004144910 2023-11-24T06:29:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3009380640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040cc790 con 0x7f30040b1270 2023-11-24T06:29:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3009380640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30040cf8d0 con 0x7f3004072510 2023-11-24T06:29:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f2ffa7fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3004144910 0x7f30040b0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32898/0 (socket says 172.21.15.143:32898) 2023-11-24T06:29:52.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f2ffa7fc640 1 -- 172.21.15.143:0/4100795753 learned_addr learned my addr 172.21.15.143:0/4100795753 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:52.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3002ffd640 1 --2- 172.21.15.143:0/4100795753 >> v2:172.21.15.146:3300/0 conn(0x7f3004072510 0x7f30040cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f30027fc640 1 -- 172.21.15.143:0/4100795753 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302809724 0 0) 0x7f30040cfd60 con 0x7f3004144910 2023-11-24T06:29:52.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f30027fc640 1 -- 172.21.15.143:0/4100795753 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff0003530 con 0x7f3004144910 2023-11-24T06:29:52.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3002ffd640 1 -- 172.21.15.143:0/4100795753 >> v1:172.21.15.146:6789/0 conn(0x7f30040b1270 legacy=0x7f300415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3002ffd640 1 -- 172.21.15.143:0/4100795753 >> v1:172.21.15.143:6789/0 conn(0x7f3004144910 legacy=0x7f30040b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.530+0000 7f3002ffd640 1 -- 172.21.15.143:0/4100795753 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004145190 con 0x7f3004072510 2023-11-24T06:29:52.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3002ffd640 1 --2- 172.21.15.143:0/4100795753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f30040cc090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009d90 tx=0x7f2ff401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ba1d5bf8d4e75c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f30027fc640 1 -- 172.21.15.143:0/4100795753 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40a5920 con 0x7f3004072510 2023-11-24T06:29:52.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f30027fc640 1 -- 172.21.15.143:0/4100795753 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff40a5a80 con 0x7f3004072510 2023-11-24T06:29:52.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f30027fc640 1 -- 172.21.15.143:0/4100795753 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40a5e10 con 0x7f3004072510 2023-11-24T06:29:52.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- 172.21.15.143:0/4100795753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 msgr2=0x7f30040cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 --2- 172.21.15.143:0/4100795753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f30040cc090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009d90 tx=0x7f2ff401c950 comp rx=0 tx=0).stop 2023-11-24T06:29:52.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- 172.21.15.143:0/4100795753 shutdown_connections 2023-11-24T06:29:52.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 --2- 172.21.15.143:0/4100795753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f30040cc090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- 172.21.15.143:0/4100795753 >> 172.21.15.143:0/4100795753 conn(0x7f300406a5b0 msgr2=0x7f300406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:52.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- 172.21.15.143:0/4100795753 shutdown_connections 2023-11-24T06:29:52.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- 172.21.15.143:0/4100795753 wait complete. 2023-11-24T06:29:52.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 Processor -- start 2023-11-24T06:29:52.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- start start 2023-11-24T06:29:52.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f3004142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 0x7f300415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3004144910 0x7f300413fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300415be70 con 0x7f30040b1270 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300415add0 con 0x7f3004072510 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.534+0000 7f3009380640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004142a70 con 0x7f3004144910 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 0x7f300415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 0x7f300415a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37666/0 (socket says 172.21.15.143:37666) 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 -- 172.21.15.143:0/4280129160 learned_addr learned my addr 172.21.15.143:0/4280129160 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f3002ffd640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f3004142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f30037fe640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3004144910 0x7f300413fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 -- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3004144910 msgr2=0x7f300413fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3004144910 0x7f300413fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 -- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 msgr2=0x7f3004142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f3004142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 -- 172.21.15.143:0/4280129160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4009a70 con 0x7f30040b1270 2023-11-24T06:29:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffa7fc640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 0x7f300415a890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00c4d0 tx=0x7f2fec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec005cf0 con 0x7f30040b1270 2023-11-24T06:29:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3004142d50 con 0x7f30040b1270 2023-11-24T06:29:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec005e50 con 0x7f30040b1270 2023-11-24T06:29:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec007270 con 0x7f30040b1270 2023-11-24T06:29:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300415c3a0 con 0x7f30040b1270 2023-11-24T06:29:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300404e850 con 0x7f30040b1270 2023-11-24T06:29:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fec0073d0 con 0x7f30040b1270 2023-11-24T06:29:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffbfff640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fe40664a0 0x7f2fe4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.538+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fec083340 con 0x7f30040b1270 2023-11-24T06:29:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.542+0000 7f3002ffd640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fe40664a0 0x7f2fe4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.542+0000 7f3002ffd640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fe40664a0 0x7f2fe4068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40af000 tx=0x7f2ff40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.542+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fec050880 con 0x7f30040b1270 2023-11-24T06:29:52.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.694+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f300406b220 con 0x7f30040b1270 2023-11-24T06:29:52.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.694+0000 7f2ffbfff640 1 -- 172.21.15.143:0/4280129160 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f2fec053ea0 con 0x7f30040b1270 2023-11-24T06:29:52.700 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:52.700 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fe40664a0 msgr2=0x7f2fe4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fe40664a0 0x7f2fe4068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40af000 tx=0x7f2ff40a7070 comp rx=0 tx=0).stop 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 msgr2=0x7f300415a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 0x7f300415a890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00c4d0 tx=0x7f2fec00c990 comp rx=0 tx=0).stop 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 shutdown_connections 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fe40664a0 0x7f2fe4068960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3004144910 0x7f300413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30040b1270 0x7f300415a890 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 --2- 172.21.15.143:0/4280129160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3004072510 0x7f3004142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 >> 172.21.15.143:0/4280129160 conn(0x7f300406a5b0 msgr2=0x7f30040b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:52.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 shutdown_connections 2023-11-24T06:29:52.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.698+0000 7f3009380640 1 -- 172.21.15.143:0/4280129160 wait complete. 2023-11-24T06:29:52.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:29:52.722 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:29:52.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 Processor -- start 2023-11-24T06:29:52.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 -- start start 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da015d630 0x7f8da00cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8da00ce200 0x7f8da00cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8da00cf300 0x7f8da006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00cf790 con 0x7f8da00ce200 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da006c620 con 0x7f8da00cf300 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8da6479640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00cbd80 con 0x7f8da015d630 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8d9f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8da00ce200 0x7f8da00cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8d9f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8da00ce200 0x7f8da00cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37674/0 (socket says 172.21.15.143:37674) 2023-11-24T06:29:52.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.858+0000 7f8d9f7fe640 1 -- 172.21.15.143:0/4072562546 learned_addr learned my addr 172.21.15.143:0/4072562546 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:52.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8da4a16640 1 --2- 172.21.15.143:0/4072562546 >> v2:172.21.15.146:3300/0 conn(0x7f8da00cf300 0x7f8da006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9ffff640 1 --2- 172.21.15.143:0/4072562546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da015d630 0x7f8da00cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9f7fe640 1 -- 172.21.15.143:0/4072562546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da015d630 msgr2=0x7f8da00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:52.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9f7fe640 1 --2- 172.21.15.143:0/4072562546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da015d630 0x7f8da00cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9f7fe640 1 -- 172.21.15.143:0/4072562546 >> v2:172.21.15.146:3300/0 conn(0x7f8da00cf300 msgr2=0x7f8da006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:52.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9f7fe640 1 --2- 172.21.15.143:0/4072562546 >> v2:172.21.15.146:3300/0 conn(0x7f8da00cf300 0x7f8da006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9f7fe640 1 -- 172.21.15.143:0/4072562546 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da006ba10 con 0x7f8da00ce200 2023-11-24T06:29:52.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8da4a16640 1 --2- 172.21.15.143:0/4072562546 >> v2:172.21.15.146:3300/0 conn(0x7f8da00cf300 0x7f8da006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:52.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9f7fe640 1 --2- 172.21.15.143:0/4072562546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00cedc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8da00c8250 tx=0x7f8d9401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634219dc0458bba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9effd640 1 -- 172.21.15.143:0/4072562546 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940aa5f0 con 0x7f8da00ce200 2023-11-24T06:29:52.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9effd640 1 -- 172.21.15.143:0/4072562546 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d940aa750 con 0x7f8da00ce200 2023-11-24T06:29:52.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.862+0000 7f8d9effd640 1 -- 172.21.15.143:0/4072562546 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940aaae0 con 0x7f8da00ce200 2023-11-24T06:29:52.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- 172.21.15.143:0/4072562546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 msgr2=0x7f8da00cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- 172.21.15.143:0/4072562546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00cedc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8da00c8250 tx=0x7f8d9401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- 172.21.15.143:0/4072562546 shutdown_connections 2023-11-24T06:29:52.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- 172.21.15.143:0/4072562546 >> v2:172.21.15.146:3300/0 conn(0x7f8da00cf300 0x7f8da006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- 172.21.15.143:0/4072562546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00cedc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- 172.21.15.143:0/4072562546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da015d630 0x7f8da00cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- 172.21.15.143:0/4072562546 >> 172.21.15.143:0/4072562546 conn(0x7f8da006e860 msgr2=0x7f8da006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:52.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- 172.21.15.143:0/4072562546 shutdown_connections 2023-11-24T06:29:52.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- 172.21.15.143:0/4072562546 wait complete. 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 Processor -- start 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- start start 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da00cf300 0x7f8da014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da015d630 0x7f8da00ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da014cee0 con 0x7f8da00ce200 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00c9320 con 0x7f8da015d630 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da6479640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da014fae0 con 0x7f8da00cf300 2023-11-24T06:29:52.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37680/0 (socket says 172.21.15.143:37680) 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 -- 172.21.15.143:0/3666470860 learned_addr learned my addr 172.21.15.143:0/3666470860 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9f7fe640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da00cf300 0x7f8da014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da4a16640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da015d630 0x7f8da00ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 -- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da00cf300 msgr2=0x7f8da014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da00cf300 0x7f8da014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 -- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da015d630 msgr2=0x7f8da00ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da015d630 0x7f8da00ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8d9ffff640 1 -- 172.21.15.143:0/3666470860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940094d0 con 0x7f8da00ce200 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.866+0000 7f8da4a16640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da015d630 0x7f8da00ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:52.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9ffff640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00c8cd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e930 tx=0x7f8d9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90009690 con 0x7f8da00ce200 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9000ca00 con 0x7f8da00ce200 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da014fdc0 con 0x7f8da00ce200 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000cd70 con 0x7f8da00ce200 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da014e390 con 0x7f8da00ce200 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da004e8c0 con 0x7f8da00ce200 2023-11-24T06:29:52.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d90013470 con 0x7f8da00ce200 2023-11-24T06:29:52.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9cff9640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d8c066470 0x7f8d8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:52.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d90083fa0 con 0x7f8da00ce200 2023-11-24T06:29:52.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.870+0000 7f8d9f7fe640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d8c066470 0x7f8d8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:52.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.874+0000 7f8d9f7fe640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d8c066470 0x7f8d8c068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d940ae000 tx=0x7f8d940b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:52.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:52.874+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d900b5280 con 0x7f8da00ce200 2023-11-24T06:29:53.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8da00d1e20 con 0x7f8da00ce200 2023-11-24T06:29:53.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8d9cff9640 1 -- 172.21.15.143:0/3666470860 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d900170a0 con 0x7f8da00ce200 2023-11-24T06:29:53.029 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:29:53.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d8c066470 msgr2=0x7f8d8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d8c066470 0x7f8d8c068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d940ae000 tx=0x7f8d940b5040 comp rx=0 tx=0).stop 2023-11-24T06:29:53.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 msgr2=0x7f8da00c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00c8cd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e930 tx=0x7f8d9000edf0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 shutdown_connections 2023-11-24T06:29:53.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d8c066470 0x7f8d8c068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da015d630 0x7f8da00ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da00cf300 0x7f8da014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 --2- 172.21.15.143:0/3666470860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8da00ce200 0x7f8da00c8cd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 >> 172.21.15.143:0/3666470860 conn(0x7f8da006e860 msgr2=0x7f8da015c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:53.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 shutdown_connections 2023-11-24T06:29:53.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.026+0000 7f8da6479640 1 -- 172.21.15.143:0/3666470860 wait complete. 2023-11-24T06:29:53.051 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:29:53.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 Processor -- start 2023-11-24T06:29:53.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 -- start start 2023-11-24T06:29:53.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840ccef0 0x7ff38406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3840b1f80 0x7ff38406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38415a050 con 0x7ff38406ddb0 2023-11-24T06:29:53.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3840722e0 con 0x7ff3840b1f80 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.186+0000 7ff38ad80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff384072860 con 0x7ff3840ccef0 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3840b1f80 0x7ff38406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3840b1f80 0x7ff38406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37686/0 (socket says 172.21.15.143:37686) 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 -- 172.21.15.143:0/328953231 learned_addr learned my addr 172.21.15.143:0/328953231 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff388b1c640 1 --2- 172.21.15.143:0/328953231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840ccef0 0x7ff38406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 -- 172.21.15.143:0/328953231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840ccef0 msgr2=0x7ff38406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 --2- 172.21.15.143:0/328953231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840ccef0 0x7ff38406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 -- 172.21.15.143:0/328953231 >> v1:172.21.15.143:6789/0 conn(0x7ff38406ddb0 legacy=0x7ff3840cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 -- 172.21.15.143:0/328953231 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840705e0 con 0x7ff3840b1f80 2023-11-24T06:29:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37bfff640 1 --2- 172.21.15.143:0/328953231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840b1f80 0x7ff38406d870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff37400bb10 tx=0x7ff37401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74f9406b5c3283f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37b7fe640 1 -- 172.21.15.143:0/328953231 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740a7b40 con 0x7ff3840b1f80 2023-11-24T06:29:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37b7fe640 1 -- 172.21.15.143:0/328953231 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740a7ca0 con 0x7ff3840b1f80 2023-11-24T06:29:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.190+0000 7ff37b7fe640 1 -- 172.21.15.143:0/328953231 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740af660 con 0x7ff3840b1f80 2023-11-24T06:29:53.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- 172.21.15.143:0/328953231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840b1f80 msgr2=0x7ff38406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 --2- 172.21.15.143:0/328953231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840b1f80 0x7ff38406d870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff37400bb10 tx=0x7ff37401ebe0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- 172.21.15.143:0/328953231 shutdown_connections 2023-11-24T06:29:53.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 --2- 172.21.15.143:0/328953231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840b1f80 0x7ff38406d870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 --2- 172.21.15.143:0/328953231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840ccef0 0x7ff38406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- 172.21.15.143:0/328953231 >> 172.21.15.143:0/328953231 conn(0x7ff3840b0c80 msgr2=0x7ff3840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:53.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- 172.21.15.143:0/328953231 shutdown_connections 2023-11-24T06:29:53.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- 172.21.15.143:0/328953231 wait complete. 2023-11-24T06:29:53.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 Processor -- start 2023-11-24T06:29:53.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- start start 2023-11-24T06:29:53.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff38406ddb0 0x7ff384159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840b1f80 0x7ff38414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 0x7ff3840af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384149d70 con 0x7ff3840ccef0 2023-11-24T06:29:53.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840ca870 con 0x7ff38406ddb0 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38ad80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c9c60 con 0x7ff3840b1f80 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 0x7ff3840af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 0x7ff3840af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37696/0 (socket says 172.21.15.143:37696) 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 -- 172.21.15.143:0/3881823533 learned_addr learned my addr 172.21.15.143:0/3881823533 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 -- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840b1f80 msgr2=0x7ff38414cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840b1f80 0x7ff38414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff388b1c640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff38406ddb0 0x7ff384159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 -- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff38406ddb0 msgr2=0x7ff384159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff38406ddb0 0x7ff384159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.194+0000 7ff38931d640 1 -- 172.21.15.143:0/3881823533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37400b770 con 0x7ff3840ccef0 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff38931d640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 0x7ff3840af060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c770 tx=0x7ff37c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c003b80 con 0x7ff3840ccef0 2023-11-24T06:29:53.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c003ce0 con 0x7ff3840ccef0 2023-11-24T06:29:53.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00aa90 con 0x7ff3840ccef0 2023-11-24T06:29:53.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3840c9f40 con 0x7ff3840ccef0 2023-11-24T06:29:53.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3840ca500 con 0x7ff3840ccef0 2023-11-24T06:29:53.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840caa00 con 0x7ff3840ccef0 2023-11-24T06:29:53.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff37c00abf0 con 0x7ff3840ccef0 2023-11-24T06:29:53.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff3797fa640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff370066470 0x7ff370068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff37c083d10 con 0x7ff3840ccef0 2023-11-24T06:29:53.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.198+0000 7ff388b1c640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff370066470 0x7ff370068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.202+0000 7ff388b1c640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff370066470 0x7ff370068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3800096f0 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.202+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff37c051190 con 0x7ff3840ccef0 2023-11-24T06:29:53.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.354+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff38404e8c0 con 0x7ff3840ccef0 2023-11-24T06:29:53.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.354+0000 7ff3797fa640 1 -- 172.21.15.143:0/3881823533 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff37c0547b0 con 0x7ff3840ccef0 2023-11-24T06:29:53.360 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:29:53.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff370066470 msgr2=0x7ff370068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff370066470 0x7ff370068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3800096f0 tx=0x7ff380008040 comp rx=0 tx=0).stop 2023-11-24T06:29:53.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 msgr2=0x7ff3840af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 0x7ff3840af060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c770 tx=0x7ff37c00cc30 comp rx=0 tx=0).stop 2023-11-24T06:29:53.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 shutdown_connections 2023-11-24T06:29:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff370066470 0x7ff370068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3840ccef0 0x7ff3840af060 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3840b1f80 0x7ff38414cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 --2- 172.21.15.143:0/3881823533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff38406ddb0 0x7ff384159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 >> 172.21.15.143:0/3881823533 conn(0x7ff3840b0c80 msgr2=0x7ff3840cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 shutdown_connections 2023-11-24T06:29:53.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.358+0000 7ff38ad80640 1 -- 172.21.15.143:0/3881823533 wait complete. 2023-11-24T06:29:53.381 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:29:53.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 Processor -- start 2023-11-24T06:29:53.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 -- start start 2023-11-24T06:29:53.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d081624f0 0x7f6d081628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6d080cd380 0x7f6d080cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080723c0 con 0x7f6d080ccef0 2023-11-24T06:29:53.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d08072980 con 0x7f6d080cd380 2023-11-24T06:29:53.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0f39d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080726a0 con 0x7f6d081624f0 2023-11-24T06:29:53.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6d080cd380 0x7f6d080cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6d080cd380 0x7f6d080cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37710/0 (socket says 172.21.15.143:37710) 2023-11-24T06:29:53.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 -- 172.21.15.143:0/1016546829 learned_addr learned my addr 172.21.15.143:0/1016546829 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:53.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d139640 1 --2- 172.21.15.143:0/1016546829 >> v2:172.21.15.146:3300/0 conn(0x7f6d081624f0 0x7f6d081628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 -- 172.21.15.143:0/1016546829 >> v2:172.21.15.146:3300/0 conn(0x7f6d081624f0 msgr2=0x7f6d081628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:53.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 --2- 172.21.15.143:0/1016546829 >> v2:172.21.15.146:3300/0 conn(0x7f6d081624f0 0x7f6d081628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 -- 172.21.15.143:0/1016546829 >> v1:172.21.15.146:6789/0 conn(0x7f6d080ccef0 legacy=0x7f6d08071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.518+0000 7f6d0d93a640 1 -- 172.21.15.143:0/1016546829 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0806c7e0 con 0x7f6d080cd380 2023-11-24T06:29:53.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0d93a640 1 --2- 172.21.15.143:0/1016546829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080cd380 0x7f6d080cb9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d0809d2b0 tx=0x7f6d0001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd687099b1d229fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6cfffff640 1 -- 172.21.15.143:0/1016546829 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000a56e0 con 0x7f6d080cd380 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6cfffff640 1 -- 172.21.15.143:0/1016546829 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000a5840 con 0x7f6d080cd380 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6cfffff640 1 -- 172.21.15.143:0/1016546829 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000a5bd0 con 0x7f6d080cd380 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 -- 172.21.15.143:0/1016546829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080cd380 msgr2=0x7f6d080cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/1016546829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080cd380 0x7f6d080cb9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d0809d2b0 tx=0x7f6d0001c910 comp rx=0 tx=0).stop 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 -- 172.21.15.143:0/1016546829 shutdown_connections 2023-11-24T06:29:53.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/1016546829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080cd380 0x7f6d080cb9e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/1016546829 >> v2:172.21.15.146:3300/0 conn(0x7f6d081624f0 0x7f6d081628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 -- 172.21.15.143:0/1016546829 >> 172.21.15.143:0/1016546829 conn(0x7f6d080b0c80 msgr2=0x7f6d080b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:53.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 -- 172.21.15.143:0/1016546829 shutdown_connections 2023-11-24T06:29:53.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.522+0000 7f6d0f39d640 1 -- 172.21.15.143:0/1016546829 wait complete. 2023-11-24T06:29:53.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 Processor -- start 2023-11-24T06:29:53.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 -- start start 2023-11-24T06:29:53.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 0x7f6d0809cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080cd380 0x7f6d0815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d081624f0 0x7f6d0809ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08099490 con 0x7f6d080ccef0 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08161090 con 0x7f6d080cd380 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080b1e10 con 0x7f6d081624f0 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 0x7f6d0809cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 0x7f6d0809cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37722/0 (socket says 172.21.15.143:37722) 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 -- 172.21.15.143:0/3643917095 learned_addr learned my addr 172.21.15.143:0/3643917095 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:53.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d93a640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d081624f0 0x7f6d0809ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0c938640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080cd380 0x7f6d0815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 -- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d081624f0 msgr2=0x7f6d0809ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d081624f0 0x7f6d0809ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 -- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080cd380 msgr2=0x7f6d0815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080cd380 0x7f6d0815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 -- 172.21.15.143:0/3643917095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d00009b30 con 0x7f6d080ccef0 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0d139640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 0x7f6d0809cc90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400e870 tx=0x7f6d0400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04009510 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400eec0 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d080b20f0 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400cb40 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.526+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d08161370 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.530+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0804e8c0 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.530+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d0400cca0 con 0x7f6d080ccef0 2023-11-24T06:29:53.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.530+0000 7f6cfdffb640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6cec066470 0x7f6cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.530+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d04083f70 con 0x7f6d080ccef0 2023-11-24T06:29:53.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.530+0000 7f6d0c938640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6cec066470 0x7f6cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.530+0000 7f6d0c938640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6cec066470 0x7f6cec068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d080af8e0 tx=0x7f6cf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.534+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d040b5280 con 0x7f6d080ccef0 2023-11-24T06:29:53.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.682+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d08070ee0 con 0x7f6d080ccef0 2023-11-24T06:29:53.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6cfdffb640 1 -- 172.21.15.143:0/3643917095 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d04017020 con 0x7f6d080ccef0 2023-11-24T06:29:53.689 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6cec066470 msgr2=0x7f6cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6cec066470 0x7f6cec068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d080af8e0 tx=0x7f6cf8009040 comp rx=0 tx=0).stop 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 msgr2=0x7f6d0809cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 0x7f6d0809cc90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400e870 tx=0x7f6d0400ec70 comp rx=0 tx=0).stop 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 shutdown_connections 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6cec066470 0x7f6cec068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d081624f0 0x7f6d0809ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080cd380 0x7f6d0815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 --2- 172.21.15.143:0/3643917095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d080ccef0 0x7f6d0809cc90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 >> 172.21.15.143:0/3643917095 conn(0x7f6d080b0c80 msgr2=0x7f6d080aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:53.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 shutdown_connections 2023-11-24T06:29:53.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.686+0000 7f6d0f39d640 1 -- 172.21.15.143:0/3643917095 wait complete. 2023-11-24T06:29:53.710 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:29:53.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.842+0000 7f2938ff8640 1 Processor -- start 2023-11-24T06:29:53.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.842+0000 7f2938ff8640 1 -- start start 2023-11-24T06:29:53.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2938ff8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2934144030 0x7f293406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2938ff8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f293409cc20 0x7f293406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2938ff8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293406d8b0 con 0x7f293406e280 2023-11-24T06:29:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2938ff8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2934145020 con 0x7f293409cc20 2023-11-24T06:29:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2938ff8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293409d0a0 con 0x7f2934144030 2023-11-24T06:29:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2932d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f293406e280 0x7f29340709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32920/0 (socket says 172.21.15.143:32920) 2023-11-24T06:29:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2932d9d640 1 -- 172.21.15.143:0/3470232962 learned_addr learned my addr 172.21.15.143:0/3470232962 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f293259c640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2934144030 0x7f293406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f292bfff640 1 --2- 172.21.15.143:0/3470232962 >> v2:172.21.15.146:3300/0 conn(0x7f293409cc20 0x7f293406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2931d9b640 1 -- 172.21.15.143:0/3470232962 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547813969 0 0) 0x7f293406d8b0 con 0x7f293406e280 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f2931d9b640 1 -- 172.21.15.143:0/3470232962 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2920003530 con 0x7f293406e280 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f292bfff640 1 -- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2934144030 msgr2=0x7f293406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f292bfff640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2934144030 0x7f293406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f292bfff640 1 -- 172.21.15.143:0/3470232962 >> v1:172.21.15.143:6789/0 conn(0x7f293406e280 legacy=0x7f29340709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f292bfff640 1 -- 172.21.15.143:0/3470232962 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293406cca0 con 0x7f293409cc20 2023-11-24T06:29:53.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.846+0000 7f293259c640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2934144030 0x7f293406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:29:53.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f292bfff640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293409cc20 0x7f293406dd40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f291c0097c0 tx=0x7f291c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c949954956ace10f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2931d9b640 1 -- 172.21.15.143:0/3470232962 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c0ab650 con 0x7f293409cc20 2023-11-24T06:29:53.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2931d9b640 1 -- 172.21.15.143:0/3470232962 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c0ab7b0 con 0x7f293409cc20 2023-11-24T06:29:53.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2931d9b640 1 -- 172.21.15.143:0/3470232962 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c0abb40 con 0x7f293409cc20 2023-11-24T06:29:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 -- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293409cc20 msgr2=0x7f293406dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293409cc20 0x7f293406dd40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f291c0097c0 tx=0x7f291c01c450 comp rx=0 tx=0).stop 2023-11-24T06:29:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 -- 172.21.15.143:0/3470232962 shutdown_connections 2023-11-24T06:29:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293409cc20 0x7f293406dd40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3470232962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2934144030 0x7f293406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 -- 172.21.15.143:0/3470232962 >> 172.21.15.143:0/3470232962 conn(0x7f29340b0bf0 msgr2=0x7f29340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:53.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 -- 172.21.15.143:0/3470232962 shutdown_connections 2023-11-24T06:29:53.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 -- 172.21.15.143:0/3470232962 wait complete. 2023-11-24T06:29:53.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 Processor -- start 2023-11-24T06:29:53.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.850+0000 7f2938ff8640 1 -- start start 2023-11-24T06:29:53.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293406e280 0x7f29340cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f293409cc20 0x7f29340cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 0x7f293415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340cd4f0 con 0x7f2934144030 2023-11-24T06:29:53.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341405c0 con 0x7f293406e280 2023-11-24T06:29:53.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340ccc50 con 0x7f293409cc20 2023-11-24T06:29:53.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 0x7f293415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 0x7f293415aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37724/0 (socket says 172.21.15.143:37724) 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 -- 172.21.15.143:0/3935529771 learned_addr learned my addr 172.21.15.143:0/3935529771 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f292bfff640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f293409cc20 0x7f29340cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f293259c640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293406e280 0x7f29340cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 -- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f293409cc20 msgr2=0x7f29340cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f293409cc20 0x7f29340cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 -- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293406e280 msgr2=0x7f29340cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:53.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293406e280 0x7f29340cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 -- 172.21.15.143:0/3935529771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924009420 con 0x7f2934144030 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2932d9d640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 0x7f293415aea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f292c00caa0 tx=0x7f292c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00ac00 con 0x7f2934144030 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00ad60 con 0x7f2934144030 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c012620 con 0x7f2934144030 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c009420 con 0x7f2934144030 2023-11-24T06:29:53.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29340cd210 con 0x7f2934144030 2023-11-24T06:29:53.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2934140400 con 0x7f2934144030 2023-11-24T06:29:53.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.854+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f292c007070 con 0x7f2934144030 2023-11-24T06:29:53.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.858+0000 7f292affd640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f29140664a0 0x7f2914068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:53.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.858+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f292c083d60 con 0x7f2934144030 2023-11-24T06:29:53.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.858+0000 7f293259c640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f29140664a0 0x7f2914068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:53.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.858+0000 7f293259c640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f29140664a0 0x7f2914068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2924009cf0 tx=0x7f2924009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:53.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:53.862+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f292c051280 con 0x7f2934144030 2023-11-24T06:29:54.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.038+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2934067520 con 0x7f2934144030 2023-11-24T06:29:54.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f292affd640 1 -- 172.21.15.143:0/3935529771 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f292c017090 con 0x7f2934144030 2023-11-24T06:29:54.045 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:54.045 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:29:54.045 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:29:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f29140664a0 msgr2=0x7f2914068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f29140664a0 0x7f2914068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2924009cf0 tx=0x7f2924009190 comp rx=0 tx=0).stop 2023-11-24T06:29:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 msgr2=0x7f293415aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 0x7f293415aea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f292c00caa0 tx=0x7f292c00cf60 comp rx=0 tx=0).stop 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 shutdown_connections 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f29140664a0 0x7f2914068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2934144030 0x7f293415aea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f293409cc20 0x7f29340cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 --2- 172.21.15.143:0/3935529771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293406e280 0x7f29340cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 >> 172.21.15.143:0/3935529771 conn(0x7f29340b0bf0 msgr2=0x7f29340b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 shutdown_connections 2023-11-24T06:29:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.042+0000 7f2938ff8640 1 -- 172.21.15.143:0/3935529771 wait complete. 2023-11-24T06:29:54.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:29:54.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff5649d0640 1 Processor -- start 2023-11-24T06:29:54.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff5649d0640 1 -- start start 2023-11-24T06:29:54.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff5649d0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5600d0320 0x7ff5600ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff5649d0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5600d21c0 con 0x7ff56015d500 2023-11-24T06:29:54.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff5649d0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5600cdcd0 con 0x7ff5600d3e80 2023-11-24T06:29:54.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff5649d0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5600d1ef0 con 0x7ff5600d0320 2023-11-24T06:29:54.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff55f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff56015d500 0x7ff5600d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32930/0 (socket says 172.21.15.143:32930) 2023-11-24T06:29:54.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.198+0000 7ff55f7fe640 1 -- 172.21.15.143:0/1132053378 learned_addr learned my addr 172.21.15.143:0/1132053378 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:54.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55ffff640 1 --2- 172.21.15.143:0/1132053378 >> v2:172.21.15.146:3300/0 conn(0x7ff5600d0320 0x7ff5600ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55e7fc640 1 -- 172.21.15.143:0/1132053378 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072908880 0 0) 0x7ff5600d21c0 con 0x7ff56015d500 2023-11-24T06:29:54.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55e7fc640 1 -- 172.21.15.143:0/1132053378 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff548003530 con 0x7ff56015d500 2023-11-24T06:29:54.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55ffff640 1 -- 172.21.15.143:0/1132053378 >> v1:172.21.15.146:6789/0 conn(0x7ff5600d3e80 legacy=0x7ff5600cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55e7fc640 1 -- 172.21.15.143:0/1132053378 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803995733 0 0) 0x7ff548003530 con 0x7ff56015d500 2023-11-24T06:29:54.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55ffff640 1 -- 172.21.15.143:0/1132053378 >> v1:172.21.15.143:6789/0 conn(0x7ff56015d500 legacy=0x7ff5600d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55ffff640 1 -- 172.21.15.143:0/1132053378 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600cdf70 con 0x7ff5600d0320 2023-11-24T06:29:54.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55ffff640 1 --2- 172.21.15.143:0/1132053378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff5600ced30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff558009d90 tx=0x7ff55801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64e5b484b5c7ab8a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:54.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55e7fc640 1 -- 172.21.15.143:0/1132053378 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550001680 con 0x7ff5600d0320 2023-11-24T06:29:54.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55e7fc640 1 -- 172.21.15.143:0/1132053378 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5580a5680 con 0x7ff5600d0320 2023-11-24T06:29:54.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.202+0000 7ff55e7fc640 1 -- 172.21.15.143:0/1132053378 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580a5a10 con 0x7ff5600d0320 2023-11-24T06:29:54.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- 172.21.15.143:0/1132053378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 msgr2=0x7ff5600ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1132053378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff5600ced30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff558009d90 tx=0x7ff55801c840 comp rx=0 tx=0).stop 2023-11-24T06:29:54.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- 172.21.15.143:0/1132053378 shutdown_connections 2023-11-24T06:29:54.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1132053378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff5600ced30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- 172.21.15.143:0/1132053378 >> 172.21.15.143:0/1132053378 conn(0x7ff56009c540 msgr2=0x7ff5600d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:54.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- 172.21.15.143:0/1132053378 shutdown_connections 2023-11-24T06:29:54.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- 172.21.15.143:0/1132053378 wait complete. 2023-11-24T06:29:54.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 Processor -- start 2023-11-24T06:29:54.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- start start 2023-11-24T06:29:54.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff56014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5600d3e80 0x7ff56015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 0x7ff5601539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56015cda0 con 0x7ff56015d500 2023-11-24T06:29:54.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560160880 con 0x7ff5600d0320 2023-11-24T06:29:54.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff5649d0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56015fc70 con 0x7ff5600d3e80 2023-11-24T06:29:54.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.206+0000 7ff55ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 0x7ff5601539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 0x7ff5601539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37732/0 (socket says 172.21.15.143:37732) 2023-11-24T06:29:54.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 -- 172.21.15.143:0/1963777373 learned_addr learned my addr 172.21.15.143:0/1963777373 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:54.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55f7fe640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff56014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55effd640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5600d3e80 0x7ff56015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 -- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5600d3e80 msgr2=0x7ff56015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5600d3e80 0x7ff56015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 -- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 msgr2=0x7ff56014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff56014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 -- 172.21.15.143:0/1963777373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558009a70 con 0x7ff56015d500 2023-11-24T06:29:54.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55effd640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5600d3e80 0x7ff56015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:54.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff55ffff640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 0x7ff5601539f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff5580b0040 tx=0x7ff5580195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:54.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558003ba0 con 0x7ff56015d500 2023-11-24T06:29:54.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558003d00 con 0x7ff56015d500 2023-11-24T06:29:54.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580ad890 con 0x7ff56015d500 2023-11-24T06:29:54.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56015ff50 con 0x7ff56015d500 2023-11-24T06:29:54.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff560160510 con 0x7ff56015d500 2023-11-24T06:29:54.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5601609f0 con 0x7ff56015d500 2023-11-24T06:29:54.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5580b4050 con 0x7ff56015d500 2023-11-24T06:29:54.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff547fff640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff54c066470 0x7ff54c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.210+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff55811ea20 con 0x7ff56015d500 2023-11-24T06:29:54.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.214+0000 7ff55f7fe640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff54c066470 0x7ff54c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.214+0000 7ff55f7fe640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff54c066470 0x7ff54c068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff550000fc0 tx=0x7ff5500019c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:54.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.214+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5580ebe90 con 0x7ff56015d500 2023-11-24T06:29:54.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.366+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff56004e850 con 0x7ff56015d500 2023-11-24T06:29:54.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff547fff640 1 -- 172.21.15.143:0/1963777373 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7ff558116e60 con 0x7ff56015d500 2023-11-24T06:29:54.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:54.373 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:29:54.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff54c066470 msgr2=0x7ff54c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff54c066470 0x7ff54c068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff550000fc0 tx=0x7ff5500019c0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 msgr2=0x7ff5601539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 0x7ff5601539f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff5580b0040 tx=0x7ff5580195e0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 shutdown_connections 2023-11-24T06:29:54.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff54c066470 0x7ff54c068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff56015d500 0x7ff5601539f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5600d3e80 0x7ff56015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 --2- 172.21.15.143:0/1963777373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5600d0320 0x7ff56014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 >> 172.21.15.143:0/1963777373 conn(0x7ff56009c540 msgr2=0x7ff5600c8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:54.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 shutdown_connections 2023-11-24T06:29:54.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.370+0000 7ff5649d0640 1 -- 172.21.15.143:0/1963777373 wait complete. 2023-11-24T06:29:54.397 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:29:54.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 Processor -- start 2023-11-24T06:29:54.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 -- start start 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98800af1e0 0x7f98800b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f98801444b0 0x7f988015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98800b04d0 con 0x7f98800b1260 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800af660 con 0x7f98801444b0 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f98871c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800af8c0 con 0x7f98800af1e0 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f9884f60640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f98800b1260 0x7f98800b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32938/0 (socket says 172.21.15.143:32938) 2023-11-24T06:29:54.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f9884f60640 1 -- 172.21.15.143:0/3617403280 learned_addr learned my addr 172.21.15.143:0/3617403280 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:54.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f9885761640 1 --2- 172.21.15.143:0/3617403280 >> v2:172.21.15.143:3300/0 conn(0x7f98801444b0 0x7f988015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.530+0000 7f9877fff640 1 --2- 172.21.15.143:0/3617403280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98800af1e0 0x7f98800b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f9885761640 1 -- 172.21.15.143:0/3617403280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98800af1e0 msgr2=0x7f98800b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:54.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f9885761640 1 --2- 172.21.15.143:0/3617403280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98800af1e0 0x7f98800b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f9885761640 1 -- 172.21.15.143:0/3617403280 >> v1:172.21.15.143:6789/0 conn(0x7f98800b1260 legacy=0x7f98800b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f9885761640 1 -- 172.21.15.143:0/3617403280 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800afba0 con 0x7f98801444b0 2023-11-24T06:29:54.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f9885761640 1 --2- 172.21.15.143:0/3617403280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98801444b0 0x7f988015bae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9878009d90 tx=0x7f987801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9babf119fc166abd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:54.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98777fe640 1 -- 172.21.15.143:0/3617403280 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780a5950 con 0x7f98801444b0 2023-11-24T06:29:54.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98777fe640 1 -- 172.21.15.143:0/3617403280 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98780a5ab0 con 0x7f98801444b0 2023-11-24T06:29:54.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98777fe640 1 -- 172.21.15.143:0/3617403280 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780a5e40 con 0x7f98801444b0 2023-11-24T06:29:54.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 -- 172.21.15.143:0/3617403280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98801444b0 msgr2=0x7f988015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 --2- 172.21.15.143:0/3617403280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98801444b0 0x7f988015bae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9878009d90 tx=0x7f987801c890 comp rx=0 tx=0).stop 2023-11-24T06:29:54.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 -- 172.21.15.143:0/3617403280 shutdown_connections 2023-11-24T06:29:54.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 --2- 172.21.15.143:0/3617403280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98801444b0 0x7f988015bae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 --2- 172.21.15.143:0/3617403280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98800af1e0 0x7f98800b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 -- 172.21.15.143:0/3617403280 >> 172.21.15.143:0/3617403280 conn(0x7f98800b55c0 msgr2=0x7f98800b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:54.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.534+0000 7f98871c4640 1 -- 172.21.15.143:0/3617403280 shutdown_connections 2023-11-24T06:29:54.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 -- 172.21.15.143:0/3617403280 wait complete. 2023-11-24T06:29:54.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 Processor -- start 2023-11-24T06:29:54.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 -- start start 2023-11-24T06:29:54.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 0x7f9880157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98800b1260 0x7f98801428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98801444b0 0x7f988013cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9880141ca0 con 0x7f98800af1e0 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988009aca0 con 0x7f98800b1260 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9880141090 con 0x7f98801444b0 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 0x7f9880157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 0x7f9880157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37756/0 (socket says 172.21.15.143:37756) 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 -- 172.21.15.143:0/1346373539 learned_addr learned my addr 172.21.15.143:0/1346373539 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9877fff640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98800b1260 0x7f98801428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9885761640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98801444b0 0x7f988013cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 -- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98801444b0 msgr2=0x7f988013cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98801444b0 0x7f988013cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 -- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98800b1260 msgr2=0x7f98801428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98800b1260 0x7f98801428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 -- 172.21.15.143:0/1346373539 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878009a70 con 0x7f98800af1e0 2023-11-24T06:29:54.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f9884f60640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 0x7f9880157570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f987c00c500 tx=0x7f987c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:54.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c005cf0 con 0x7f98800af1e0 2023-11-24T06:29:54.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c005e50 con 0x7f98800af1e0 2023-11-24T06:29:54.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.538+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9880141370 con 0x7f98800af1e0 2023-11-24T06:29:54.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0072f0 con 0x7f98800af1e0 2023-11-24T06:29:54.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9880141930 con 0x7f98800af1e0 2023-11-24T06:29:54.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9880067520 con 0x7f98800af1e0 2023-11-24T06:29:54.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f987c007450 con 0x7f98800af1e0 2023-11-24T06:29:54.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f98757fa640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f986c066470 0x7f986c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:54.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f987c0832d0 con 0x7f98800af1e0 2023-11-24T06:29:54.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f9877fff640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f986c066470 0x7f986c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:54.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.542+0000 7f9877fff640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f986c066470 0x7f986c068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f988013c370 tx=0x7f9870008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:54.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.546+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f987c050890 con 0x7f98800af1e0 2023-11-24T06:29:54.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98800b17e0 con 0x7f98800af1e0 2023-11-24T06:29:54.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98757fa640 1 -- 172.21.15.143:0/1346373539 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f987c053eb0 con 0x7f98800af1e0 2023-11-24T06:29:54.733 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:29:54.733 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:29:54.734 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:29:54.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f986c066470 msgr2=0x7f986c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f986c066470 0x7f986c068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f988013c370 tx=0x7f9870008040 comp rx=0 tx=0).stop 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 msgr2=0x7f9880157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 0x7f9880157570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f987c00c500 tx=0x7f987c00c9c0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 shutdown_connections 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f986c066470 0x7f986c068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98801444b0 0x7f988013cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98800b1260 0x7f98801428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 --2- 172.21.15.143:0/1346373539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98800af1e0 0x7f9880157570 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 >> 172.21.15.143:0/1346373539 conn(0x7f98800b55c0 msgr2=0x7f9880143730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 shutdown_connections 2023-11-24T06:29:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:54.730+0000 7f98871c4640 1 -- 172.21.15.143:0/1346373539 wait complete. 2023-11-24T06:29:55.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:29:40.691608+0000', 'modified': '2023-11-24T06:29:43.703911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/3721537838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 3721537838}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3721537838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:29:55.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:29:55.158 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T06:29:55.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.294+0000 7f5557cc9640 1 Processor -- start 2023-11-24T06:29:55.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.294+0000 7f5557cc9640 1 -- start start 2023-11-24T06:29:55.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5557cc9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f555015a4d0 0x7f55500c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5557cc9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555006d740 0x7f555006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5557cc9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555006e0d0 con 0x7f55500cad20 2023-11-24T06:29:55.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5557cc9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555015a8b0 con 0x7f555015a4d0 2023-11-24T06:29:55.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5557cc9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55500c9c30 con 0x7f555006d740 2023-11-24T06:29:55.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555a65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f555015a4d0 0x7f55500c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555264640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f55500cad20 0x7f555015e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32944/0 (socket says 172.21.15.143:32944) 2023-11-24T06:29:55.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555264640 1 -- 172.21.15.143:0/3092322675 learned_addr learned my addr 172.21.15.143:0/3092322675 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:55.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5556266640 1 --2- 172.21.15.143:0/3092322675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555006d740 0x7f555006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555a65640 1 -- 172.21.15.143:0/3092322675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555006d740 msgr2=0x7f555006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555a65640 1 --2- 172.21.15.143:0/3092322675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555006d740 0x7f555006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555a65640 1 -- 172.21.15.143:0/3092322675 >> v1:172.21.15.143:6789/0 conn(0x7f55500cad20 legacy=0x7f555015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.298+0000 7f5555a65640 1 -- 172.21.15.143:0/3092322675 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500c9f60 con 0x7f555015a4d0 2023-11-24T06:29:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5555a65640 1 --2- 172.21.15.143:0/3092322675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f555015a4d0 0x7f55500c9650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f554c0097c0 tx=0x7f554c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90f581bd8899db4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5554a63640 1 -- 172.21.15.143:0/3092322675 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0ac620 con 0x7f555015a4d0 2023-11-24T06:29:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5554a63640 1 -- 172.21.15.143:0/3092322675 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c0ac780 con 0x7f555015a4d0 2023-11-24T06:29:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5554a63640 1 -- 172.21.15.143:0/3092322675 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0acb10 con 0x7f555015a4d0 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 -- 172.21.15.143:0/3092322675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f555015a4d0 msgr2=0x7f55500c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3092322675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f555015a4d0 0x7f55500c9650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f554c0097c0 tx=0x7f554c01c3c0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 -- 172.21.15.143:0/3092322675 shutdown_connections 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3092322675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555006d740 0x7f555006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3092322675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f555015a4d0 0x7f55500c9650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 -- 172.21.15.143:0/3092322675 >> 172.21.15.143:0/3092322675 conn(0x7f55500b0bf0 msgr2=0x7f55500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 -- 172.21.15.143:0/3092322675 shutdown_connections 2023-11-24T06:29:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 -- 172.21.15.143:0/3092322675 wait complete. 2023-11-24T06:29:55.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 Processor -- start 2023-11-24T06:29:55.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 -- start start 2023-11-24T06:29:55.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.302+0000 7f5557cc9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555006d740 0x7f5550153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 0x7f55500ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555015a4d0 0x7f55500adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555009b0e0 con 0x7f55500cad20 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5550157160 con 0x7f555006d740 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5550156300 con 0x7f555015a4d0 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 0x7f55500ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 0x7f55500ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37762/0 (socket says 172.21.15.143:37762) 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 -- 172.21.15.143:0/3571633345 learned_addr learned my addr 172.21.15.143:0/3571633345 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5556266640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555015a4d0 0x7f55500adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555a65640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555006d740 0x7f5550153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 -- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555015a4d0 msgr2=0x7f55500adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555015a4d0 0x7f55500adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 -- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555006d740 msgr2=0x7f5550153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555006d740 0x7f5550153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 -- 172.21.15.143:0/3571633345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c009420 con 0x7f55500cad20 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5556266640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555015a4d0 0x7f55500adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555a65640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555006d740 0x7f5550153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5555264640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 0x7f55500ad620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f554000c500 tx=0x7f554000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f55467fc640 1 -- 172.21.15.143:0/3571633345 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540005cf0 con 0x7f55500cad20 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f55467fc640 1 -- 172.21.15.143:0/3571633345 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540005e50 con 0x7f55500cad20 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55501565e0 con 0x7f55500cad20 2023-11-24T06:29:55.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f55467fc640 1 -- 172.21.15.143:0/3571633345 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400072f0 con 0x7f55500cad20 2023-11-24T06:29:55.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5550156ba0 con 0x7f55500cad20 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.306+0000 7f55467fc640 1 -- 172.21.15.143:0/3571633345 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5540007450 con 0x7f55500cad20 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f55467fc640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5534066470 0x7f5534068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f55467fc640 1 -- 172.21.15.143:0/3571633345 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55400831f0 con 0x7f55500cad20 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5534066470 0x7f5534068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 Processor -- start 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- start start 2023-11-24T06:29:55.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5534066470 0x7f5534068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f554c0ae000 tx=0x7f554c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 0x55d19beae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beae5b0 0x55d19be63de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be64700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19bcce130 con 0x55d19beadc90 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19bcbb9a0 con 0x55d19beae5b0 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d19bcb8ed0 con 0x55d19be64320 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 0x55d19beae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 0x55d19beae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37772/0 (socket says 172.21.15.143:37772) 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 -- 172.21.15.143:0/659352334 learned_addr learned my addr 172.21.15.143:0/659352334 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 -- 172.21.15.143:0/659352334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 msgr2=0x55d19be64700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be64700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 -- 172.21.15.143:0/659352334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beae5b0 msgr2=0x55d19be63de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beae5b0 0x55d19be63de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 -- 172.21.15.143:0/659352334 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d19b9ac890 con 0x55d19beadc90 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f5555a65640 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 0x55d19beae070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f554c0af040 tx=0x7f554c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bf7008d3ac5e35 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f55337fe640 1 -- 172.21.15.143:0/659352334 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0bd070 con 0x55d19beadc90 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f55337fe640 1 -- 172.21.15.143:0/659352334 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c0b85b0 con 0x55d19beadc90 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f55337fe640 1 -- 172.21.15.143:0/659352334 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0b8920 con 0x55d19beadc90 2023-11-24T06:29:55.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- 172.21.15.143:0/659352334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 msgr2=0x55d19beae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 0x55d19beae070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f554c0af040 tx=0x7f554c004740 comp rx=0 tx=0).stop 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- 172.21.15.143:0/659352334 shutdown_connections 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be64700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beae5b0 0x55d19be63de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 --2- 172.21.15.143:0/659352334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beadc90 0x55d19beae070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- 172.21.15.143:0/659352334 >> 172.21.15.143:0/659352334 conn(0x55d19be602d0 msgr2=0x55d19be626c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- 172.21.15.143:0/659352334 shutdown_connections 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.310+0000 7f555b029000 1 -- 172.21.15.143:0/659352334 wait complete. 2023-11-24T06:29:55.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- start start 2023-11-24T06:29:55.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 Processor -- start 2023-11-24T06:29:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be68d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be69280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 0x55d19be7c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19bcb47c0 con 0x55d19beae5b0 2023-11-24T06:29:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19bc6cbf0 con 0x55d19beadc90 2023-11-24T06:29:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d19bc72a90 con 0x55d19be64320 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 10 client.0 _ll_register_callbacks cb 0x55d19be4f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 0x55d19be7c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 0x55d19be7c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37780/0 (socket says 172.21.15.143:37780) 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 -- 172.21.15.143:0/1582857017 learned_addr learned my addr 172.21.15.143:0/1582857017 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5555a65640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be68d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5555264640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be69280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 -- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 msgr2=0x55d19be68d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be68d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 -- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 msgr2=0x55d19be69280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be69280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 -- 172.21.15.143:0/1582857017 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55500c9f60 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5556266640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 0x55d19be7c910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55480079f0 tx=0x7f5548007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c015fa8ec59d24a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5530ff9640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5530ff9640 1 -- 172.21.15.143:0/1582857017 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800fc60 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5530ff9640 1 -- 172.21.15.143:0/1582857017 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f554800fdc0 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d19bc76470 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5530ff9640 1 -- 172.21.15.143:0/1582857017 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f554801d400 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 10 client.4641 fetch_fsmap learned FSMap version 8 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d19bc75190 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5530ff9640 1 -- 172.21.15.143:0/1582857017 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d19bc76470 con 0x55d19beae5b0 2023-11-24T06:29:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f5530ff9640 1 -- 172.21.15.143:0/1582857017 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f554801d560 con 0x55d19beae5b0 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 10 client.4641 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 20 client.4641 populate_metadata read hostname 'smithi143' 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19be7d320 0x55d19bebff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 4 client.4641 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.314+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 --> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d19bc79b50 con 0x55d19be7d320 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f5555a65640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19be7d320 0x55d19bebff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f5530ff9640 10 client.4641 ms_handle_connect on v2:172.21.15.146:6833/3721537838 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f5555a65640 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19be7d320 0x55d19bebff50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24a3082804897e3 server_cookie=74592e53447ee4e in_seq=0 out_seq=0 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f5530ff9640 1 -- 172.21.15.143:0/1582857017 <== mds.0 v2:172.21.15.146:6833/3721537838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d19bc79b50 con 0x55d19be7d320 2023-11-24T06:29:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f5530ff9640 10 client.4641 handle_command_reply: tid=0 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 client.4641 shutdown 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 msgr2=0x55d19be7c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 0x55d19be7c910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55480079f0 tx=0x7f5548007eb0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 shutdown_connections 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19be7d320 0x55d19bebff50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19beae5b0 0x55d19be7c910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be69280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 --2- 172.21.15.143:0/1582857017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be64320 0x55d19be68d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f5530ff9640 0 client.4641 ms_handle_reset on v2:172.21.15.146:6833/3721537838 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 >> 172.21.15.143:0/1582857017 conn(0x55d19be602d0 msgr2=0x55d19be626c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 shutdown_connections 2023-11-24T06:29:55.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 1 -- 172.21.15.143:0/1582857017 wait complete. 2023-11-24T06:29:55.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.318+0000 7f555b029000 20 client.4641 trim_cache size 0 max 16384 2023-11-24T06:29:55.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 Processor -- start 2023-11-24T06:29:55.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 -- start start 2023-11-24T06:29:55.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be602d0 0x55d19beabb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19beac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be907a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19b96d940 con 0x55d19be64320 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19bc6dd60 con 0x55d19beadc90 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d19bcf6140 con 0x55d19be602d0 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19beac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19beac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37796/0 (socket says 172.21.15.143:37796) 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 -- 172.21.15.143:0/1686466703 learned_addr learned my addr 172.21.15.143:0/1686466703 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555a65640 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be602d0 0x55d19beabb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5556266640 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be907a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 -- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be602d0 msgr2=0x55d19beabb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be602d0 0x55d19beabb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 -- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 msgr2=0x55d19be907a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be907a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.334+0000 7f5555264640 1 -- 172.21.15.143:0/1686466703 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d19bc5b490 con 0x55d19be64320 2023-11-24T06:29:55.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19beac070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f554000cec0 tx=0x7f55400585b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3617424609a3b504 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5533fff640 1 -- 172.21.15.143:0/1686466703 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540053d30 con 0x55d19be64320 2023-11-24T06:29:55.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5533fff640 1 -- 172.21.15.143:0/1686466703 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540052770 con 0x55d19be64320 2023-11-24T06:29:55.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5533fff640 1 -- 172.21.15.143:0/1686466703 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540050ae0 con 0x55d19be64320 2023-11-24T06:29:55.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- 172.21.15.143:0/1686466703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 msgr2=0x55d19beac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19beac070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f554000cec0 tx=0x7f55400585b0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- 172.21.15.143:0/1686466703 shutdown_connections 2023-11-24T06:29:55.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19beadc90 0x55d19be907a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19beac070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- 172.21.15.143:0/1686466703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19be602d0 0x55d19beabb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- 172.21.15.143:0/1686466703 >> 172.21.15.143:0/1686466703 conn(0x55d19be68f10 msgr2=0x55d19be626c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- 172.21.15.143:0/1686466703 shutdown_connections 2023-11-24T06:29:55.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- 172.21.15.143:0/1686466703 wait complete. 2023-11-24T06:29:55.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- start start 2023-11-24T06:29:55.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 Processor -- start 2023-11-24T06:29:55.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19be602d0 0x55d19be90bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19bebff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19beadc90 0x55d19bec0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19be5fc70 con 0x55d19be64320 2023-11-24T06:29:55.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19bc7e2e0 con 0x55d19be602d0 2023-11-24T06:29:55.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d19bc6ba10 con 0x55d19beadc90 2023-11-24T06:29:55.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 10 client.0 _ll_register_callbacks cb 0x55d19bd02c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:29:55.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19bebff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19bebff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37812/0 (socket says 172.21.15.143:37812) 2023-11-24T06:29:55.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 -- 172.21.15.143:0/434378292 learned_addr learned my addr 172.21.15.143:0/434378292 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555a65640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19be602d0 0x55d19be90bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5556266640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19beadc90 0x55d19bec0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 -- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19beadc90 msgr2=0x55d19bec0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19beadc90 0x55d19bec0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 -- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19be602d0 msgr2=0x55d19be90bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19be602d0 0x55d19be90bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 -- 172.21.15.143:0/434378292 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5550156ba0 con 0x55d19be64320 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5555264640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19bebff50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5540054360 tx=0x7f5540001290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1e39814c2a968a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5530ff9640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5530ff9640 1 -- 172.21.15.143:0/434378292 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540050710 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f5530ff9640 1 -- 172.21.15.143:0/434378292 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f554006be40 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.338+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d19bcb3110 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 1 -- 172.21.15.143:0/434378292 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5540081290 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 10 client.4647 fetch_fsmap learned FSMap version 8 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d19b9accc0 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 1 -- 172.21.15.143:0/434378292 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d19bcb3110 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 1 -- 172.21.15.143:0/434378292 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5540079020 con 0x55d19be64320 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:29:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 20 client.4647 populate_metadata read hostname 'smithi143' 2023-11-24T06:29:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19beae5b0 0x55d19bf16e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 4 client.4647 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:29:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 --> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d19bce29a0 con 0x55d19beae5b0 2023-11-24T06:29:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5555a65640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19beae5b0 0x55d19bf16e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 10 client.4647 ms_handle_connect on v2:172.21.15.146:6833/3721537838 2023-11-24T06:29:55.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5555a65640 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19beae5b0 0x55d19bf16e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b9b78fb2a0427f server_cookie=38d3ff24e90697 in_seq=0 out_seq=0 2023-11-24T06:29:55.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 1 -- 172.21.15.143:0/434378292 <== mds.0 v2:172.21.15.146:6833/3721537838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d19bce29a0 con 0x55d19beae5b0 2023-11-24T06:29:55.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 10 client.4647 handle_command_reply: tid=0 2023-11-24T06:29:55.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 client.4647 shutdown 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 msgr2=0x55d19bebff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19bebff50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5540054360 tx=0x7f5540001290 comp rx=0 tx=0).stop 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 shutdown_connections 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:6833/3721537838,v1:172.21.15.146:6835/3721537838] conn(0x55d19beae5b0 0x55d19bf16e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d19beadc90 0x55d19bec0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d19be64320 0x55d19bebff50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 --2- 172.21.15.143:0/434378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d19be602d0 0x55d19be90bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5530ff9640 0 client.4647 ms_handle_reset on v2:172.21.15.146:6833/3721537838 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 >> 172.21.15.143:0/434378292 conn(0x55d19be68f10 msgr2=0x55d19be62f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 shutdown_connections 2023-11-24T06:29:55.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 1 -- 172.21.15.143:0/434378292 wait complete. 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f555b029000 20 client.4647 trim_cache size 0 max 16384 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "039ed6d4-b5c2-4e8e-a15f-05a601a78248", 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4294, 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2023-11-24T06:29:55.355 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2023-11-24T06:29:55.356 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 14.019941255000001, 2023-11-24T06:29:55.356 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 8, 2023-11-24T06:29:55.356 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 20, 2023-11-24T06:29:55.356 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 20, 2023-11-24T06:29:55.356 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 21.580658936999999 2023-11-24T06:29:55.356 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5534066470 msgr2=0x7f5534068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5534066470 0x7f5534068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f554c0ae000 tx=0x7f554c008040 comp rx=0 tx=0).stop 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 msgr2=0x7f55500ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 0x7f55500ad620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f554000c500 tx=0x7f554000c9c0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 shutdown_connections 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5534066470 0x7f5534068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555015a4d0 0x7f55500adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55500cad20 0x7f55500ad620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 --2- 172.21.15.143:0/3571633345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555006d740 0x7f5550153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 >> 172.21.15.143:0/3571633345 conn(0x7f55500b0bf0 msgr2=0x7f555006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 shutdown_connections 2023-11-24T06:29:55.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.342+0000 7f5557cc9640 1 -- 172.21.15.143:0/3571633345 wait complete. 2023-11-24T06:29:55.365 INFO:teuthology.run_tasks:Running task kclient... 2023-11-24T06:29:55.392 INFO:tasks.kclient:Mounting kernel clients... 2023-11-24T06:29:55.392 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T06:29:55.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.393 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:29:55.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.406 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-11-24T06:29:55.474 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2023-11-24T06:29:55.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:29:55.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.476 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:29:55.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.529 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-11-24T06:29:55.594 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2023-11-24T06:29:55.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:29:55.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.597 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:29:55.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-11-24T06:29:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-11-24T06:29:55.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:29:55.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.675 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:29:55.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:55.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-11-24T06:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-11-24T06:29:55.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:29:55.797 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-24T06:29:55.797 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:29:55.797 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:29:55.797 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:29:55.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.930+0000 7f4547baa640 1 Processor -- start 2023-11-24T06:29:55.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.930+0000 7f4547baa640 1 -- start start 2023-11-24T06:29:55.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4547baa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f454006c650 0x7f454009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4547baa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45400709c0 0x7f4540070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4547baa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454006d8b0 con 0x7f4540144030 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4547baa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540145020 con 0x7f45400709c0 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4547baa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540071370 con 0x7f454006c650 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4545946640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4540144030 0x7f454006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32952/0 (socket says 172.21.15.143:32952) 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4546147640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45400709c0 0x7f4540070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4545946640 1 -- 172.21.15.143:0/4245179552 learned_addr learned my addr 172.21.15.143:0/4245179552 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4545145640 1 --2- 172.21.15.143:0/4245179552 >> v2:172.21.15.146:3300/0 conn(0x7f454006c650 0x7f454009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4544944640 1 -- 172.21.15.143:0/4245179552 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038585175 0 0) 0x7f454006d8b0 con 0x7f4540144030 2023-11-24T06:29:55.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4544944640 1 -- 172.21.15.143:0/4245179552 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f452c003530 con 0x7f4540144030 2023-11-24T06:29:55.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4546147640 1 -- 172.21.15.143:0/4245179552 >> v2:172.21.15.146:3300/0 conn(0x7f454006c650 msgr2=0x7f454009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:55.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4546147640 1 --2- 172.21.15.143:0/4245179552 >> v2:172.21.15.146:3300/0 conn(0x7f454006c650 0x7f454009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4546147640 1 -- 172.21.15.143:0/4245179552 >> v1:172.21.15.143:6789/0 conn(0x7f4540144030 legacy=0x7f454006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4546147640 1 -- 172.21.15.143:0/4245179552 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454006cca0 con 0x7f45400709c0 2023-11-24T06:29:55.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.934+0000 7f4545145640 1 --2- 172.21.15.143:0/4245179552 >> v2:172.21.15.146:3300/0 conn(0x7f454006c650 0x7f454009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:55.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4546147640 1 --2- 172.21.15.143:0/4245179552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45400709c0 0x7f4540070e30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f45400700a0 tx=0x7f453801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b45a7e1270e6d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4544944640 1 -- 172.21.15.143:0/4245179552 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380a5880 con 0x7f45400709c0 2023-11-24T06:29:55.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4544944640 1 -- 172.21.15.143:0/4245179552 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45380a59e0 con 0x7f45400709c0 2023-11-24T06:29:55.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4544944640 1 -- 172.21.15.143:0/4245179552 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380a5d70 con 0x7f45400709c0 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- 172.21.15.143:0/4245179552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45400709c0 msgr2=0x7f4540070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 --2- 172.21.15.143:0/4245179552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45400709c0 0x7f4540070e30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f45400700a0 tx=0x7f453801c8d0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- 172.21.15.143:0/4245179552 shutdown_connections 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 --2- 172.21.15.143:0/4245179552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45400709c0 0x7f4540070e30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 --2- 172.21.15.143:0/4245179552 >> v2:172.21.15.146:3300/0 conn(0x7f454006c650 0x7f454009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- 172.21.15.143:0/4245179552 >> 172.21.15.143:0/4245179552 conn(0x7f45400b0bf0 msgr2=0x7f45400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:55.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- 172.21.15.143:0/4245179552 shutdown_connections 2023-11-24T06:29:55.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- 172.21.15.143:0/4245179552 wait complete. 2023-11-24T06:29:55.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 Processor -- start 2023-11-24T06:29:55.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- start start 2023-11-24T06:29:55.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f454006c650 0x7f45401f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45400709c0 0x7f45401393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 0x7f45400cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45401f64f0 con 0x7f4540144030 2023-11-24T06:29:55.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b2e70 con 0x7f45400709c0 2023-11-24T06:29:55.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.938+0000 7f4547baa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540142000 con 0x7f454006c650 2023-11-24T06:29:55.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 0x7f45400cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 0x7f45400cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37832/0 (socket says 172.21.15.143:37832) 2023-11-24T06:29:55.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 -- 172.21.15.143:0/1880099511 learned_addr learned my addr 172.21.15.143:0/1880099511 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:55.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4545946640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f454006c650 0x7f45401f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4545145640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45400709c0 0x7f45401393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 -- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f454006c650 msgr2=0x7f45401f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f454006c650 0x7f45401f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 -- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45400709c0 msgr2=0x7f45401393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45400709c0 0x7f45401393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 -- 172.21.15.143:0/1880099511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4538009a70 con 0x7f4540144030 2023-11-24T06:29:55.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4545946640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f454006c650 0x7f45401f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:29:55.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4546147640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 0x7f45400cd280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f45380b0040 tx=0x7f4538019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380b9860 con 0x7f4540144030 2023-11-24T06:29:55.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45380b99c0 con 0x7f4540144030 2023-11-24T06:29:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45401422e0 con 0x7f4540144030 2023-11-24T06:29:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380b9d70 con 0x7f4540144030 2023-11-24T06:29:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45401428a0 con 0x7f4540144030 2023-11-24T06:29:55.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540067520 con 0x7f4540144030 2023-11-24T06:29:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.942+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45380ad440 con 0x7f4540144030 2023-11-24T06:29:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.946+0000 7f45367fc640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4524066470 0x7f4524068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.946+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f453811f1e0 con 0x7f4540144030 2023-11-24T06:29:55.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.946+0000 7f4545946640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4524066470 0x7f4524068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:55.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.946+0000 7f4545946640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4524066470 0x7f4524068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f453c000f70 tx=0x7f453c007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:55.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:55.950+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45380ec650 con 0x7f4540144030 2023-11-24T06:29:56.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45400caed0 con 0x7f4540144030 2023-11-24T06:29:56.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f45367fc640 1 -- 172.21.15.143:0/1880099511 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f45380efc70 con 0x7f4540144030 2023-11-24T06:29:56.134 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:29:56.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4524066470 msgr2=0x7f4524068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:56.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4524066470 0x7f4524068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f453c000f70 tx=0x7f453c007c10 comp rx=0 tx=0).stop 2023-11-24T06:29:56.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 msgr2=0x7f45400cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 0x7f45400cd280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f45380b0040 tx=0x7f4538019670 comp rx=0 tx=0).stop 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 shutdown_connections 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4524066470 0x7f4524068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4540144030 0x7f45400cd280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45400709c0 0x7f45401393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 --2- 172.21.15.143:0/1880099511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f454006c650 0x7f45401f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:56.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 >> 172.21.15.143:0/1880099511 conn(0x7f45400b0bf0 msgr2=0x7f45400723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:56.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 shutdown_connections 2023-11-24T06:29:56.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:56.130+0000 7f4547baa640 1 -- 172.21.15.143:0/1880099511 wait complete. 2023-11-24T06:29:56.154 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:29:56.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:29:56.154 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:29:56.155 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:29:56.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:29:56.155 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:29:56.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:29:56.155 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:29:56.155 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:29:56.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.155 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:29:56.164 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:29:56.164 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:56.165 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:29:56.166 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:56.167 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:29:56.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:56.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.279 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:29:56.298 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:29:56.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.300 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:29:56.374 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:56.375 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:29:56.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.376 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:56.376 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:56.376 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:29:56.376 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:29:56.376 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:29:56.376 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:56.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.469 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:29:56.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.528 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2023-11-24T06:29:56.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.577 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:56.578 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:56.578 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:29:56.578 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T06:29:56.578 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:56.660 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T06:29:56.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.660 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T06:29:56.661 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:56.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.830 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:56.830 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:56.830 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-11-24T06:29:56.830 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:29:56.831 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:56.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:29:56.872 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:29:56.928 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:29:56.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:29:56.929 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:29:56.979 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:29:56.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:56.980 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:29:57.085 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:29:57.085 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:29:57.191 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:29:57.191 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:29:57.191 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:29:57.191 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:29:57.191 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:29:57.194 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:29:57.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:29:57.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.217 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:29:57.294 INFO:teuthology.orchestra.run.smithi143.stdout:client4603 2023-11-24T06:29:57.295 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:57.295 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:29:57.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.345 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:29:57.408 INFO:teuthology.orchestra.run.smithi143.stdout:client4603 2023-11-24T06:29:57.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.408 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:29:57.470 INFO:teuthology.orchestra.run.smithi143.stdout:client4603 2023-11-24T06:29:57.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.470 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/039ed6d4-b5c2-4e8e-a15f-05a601a78248.client4603/status') 2023-11-24T06:29:57.537 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4603 (3)172.21.15.143:0/38774078 2023-11-24T06:29:57.538 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2023-11-24T06:29:57.538 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2023-11-24T06:29:57.538 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2023-11-24T06:29:57.538 INFO:teuthology.orchestra.run.smithi143.stderr:69 bytes copied, 5.0547e-05 s, 1.4 MB/s 2023-11-24T06:29:57.540 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-11-24T06:29:57.541 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:29:57.542 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:29:57.544 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:29:57.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9344f0f640 1 Processor -- start 2023-11-24T06:29:57.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9344f0f640 1 -- start start 2023-11-24T06:29:57.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9344f0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93400d3020 0x7f93400d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:57.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9344f0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934006c0e0 con 0x7f93400ce8b0 2023-11-24T06:29:57.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9344f0f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400d39f0 con 0x7f934015d570 2023-11-24T06:29:57.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9344f0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93400d1cc0 con 0x7f93400d3020 2023-11-24T06:29:57.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9335d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93400d3020 0x7f93400d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9335d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93400d3020 0x7f93400d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41100/0 (socket says 172.21.15.143:41100) 2023-11-24T06:29:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9335d9b640 1 -- 172.21.15.143:0/333094286 learned_addr learned my addr 172.21.15.143:0/333094286 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f933ed9d640 1 --1- 172.21.15.143:0/333094286 >> v1:172.21.15.143:6789/0 conn(0x7f93400ce8b0 0x7f93400ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53466/0 (socket says 172.21.15.143:53466) 2023-11-24T06:29:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9335d9b640 1 -- 172.21.15.143:0/333094286 >> v1:172.21.15.146:6789/0 conn(0x7f934015d570 legacy=0x7f934006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9335d9b640 1 -- 172.21.15.143:0/333094286 >> v1:172.21.15.143:6789/0 conn(0x7f93400ce8b0 legacy=0x7f93400ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.718+0000 7f9335d9b640 1 -- 172.21.15.143:0/333094286 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400d1fa0 con 0x7f93400d3020 2023-11-24T06:29:57.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9335d9b640 1 --2- 172.21.15.143:0/333094286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400d3020 0x7f93400d34b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9328009e50 tx=0x7f932801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af134dd97c6d8e25 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f933dd9b640 1 -- 172.21.15.143:0/333094286 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280a58a0 con 0x7f93400d3020 2023-11-24T06:29:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f933dd9b640 1 -- 172.21.15.143:0/333094286 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93280a5a00 con 0x7f93400d3020 2023-11-24T06:29:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f933dd9b640 1 -- 172.21.15.143:0/333094286 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280a5d90 con 0x7f93400d3020 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 -- 172.21.15.143:0/333094286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400d3020 msgr2=0x7f93400d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 --2- 172.21.15.143:0/333094286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400d3020 0x7f93400d34b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9328009e50 tx=0x7f932801c9e0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 -- 172.21.15.143:0/333094286 shutdown_connections 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 --2- 172.21.15.143:0/333094286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400d3020 0x7f93400d34b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 -- 172.21.15.143:0/333094286 >> 172.21.15.143:0/333094286 conn(0x7f934008ceb0 msgr2=0x7f934009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 -- 172.21.15.143:0/333094286 shutdown_connections 2023-11-24T06:29:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.722+0000 7f9344f0f640 1 -- 172.21.15.143:0/333094286 wait complete. 2023-11-24T06:29:57.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 Processor -- start 2023-11-24T06:29:57.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 -- start start 2023-11-24T06:29:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 0x7f9340150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93400d3020 0x7f9340151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934015d570 0x7f93400b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400c7c70 con 0x7f93400ce8b0 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400c7060 con 0x7f934015d570 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93400c7340 con 0x7f93400d3020 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 0x7f9340150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 0x7f9340150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41104/0 (socket says 172.21.15.143:41104) 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 -- 172.21.15.143:0/3684824327 learned_addr learned my addr 172.21.15.143:0/3684824327 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933ed9d640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934015d570 0x7f93400b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9335d9b640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93400d3020 0x7f9340151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 -- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93400d3020 msgr2=0x7f9340151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93400d3020 0x7f9340151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 -- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934015d570 msgr2=0x7f93400b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934015d570 0x7f93400b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 -- 172.21.15.143:0/3684824327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328009b30 con 0x7f93400ce8b0 2023-11-24T06:29:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f933e59c640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 0x7f9340150d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f933000c3c0 tx=0x7f933000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300052d0 con 0x7f93400ce8b0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330005430 con 0x7f93400ce8b0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93400c7620 con 0x7f93400ce8b0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330003840 con 0x7f93400ce8b0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.726+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93400b8c40 con 0x7f93400ce8b0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.730+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9340067520 con 0x7f93400ce8b0 2023-11-24T06:29:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.730+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93300039a0 con 0x7f93400ce8b0 2023-11-24T06:29:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.730+0000 7f93377fe640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9320066470 0x7f9320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.730+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9330083300 con 0x7f93400ce8b0 2023-11-24T06:29:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.730+0000 7f9335d9b640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9320066470 0x7f9320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.730+0000 7f9335d9b640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9320066470 0x7f9320068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f93280ae000 tx=0x7f93280a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.734+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9330050820 con 0x7f93400ce8b0 2023-11-24T06:29:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.914+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f934006b7b0 con 0x7f93400ce8b0 2023-11-24T06:29:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f93377fe640 1 -- 172.21.15.143:0/3684824327 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9330053e40 con 0x7f93400ce8b0 2023-11-24T06:29:57.921 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9320066470 msgr2=0x7f9320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9320066470 0x7f9320068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f93280ae000 tx=0x7f93280a7070 comp rx=0 tx=0).stop 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 msgr2=0x7f9340150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 0x7f9340150d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f933000c3c0 tx=0x7f933000c880 comp rx=0 tx=0).stop 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 shutdown_connections 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9320066470 0x7f9320068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934015d570 0x7f93400b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93400d3020 0x7f9340151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 --2- 172.21.15.143:0/3684824327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93400ce8b0 0x7f9340150d50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 >> 172.21.15.143:0/3684824327 conn(0x7f934008ceb0 msgr2=0x7f93400b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:57.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 shutdown_connections 2023-11-24T06:29:57.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:57.918+0000 7f9344f0f640 1 -- 172.21.15.143:0/3684824327 wait complete. 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:29:57.942 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:29:57.943 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:29:57.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.943 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:29:57.953 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:29:57.953 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:29:57.953 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:29:57.953 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:57.954 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:29:57.955 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:57.955 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:57.955 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:29:57.955 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:57.956 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:29:57.956 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42365sec preferred_lft 42365sec 2023-11-24T06:29:57.956 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:29:57.956 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.956 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:29:57.956 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:57.957 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:29:57.957 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.957 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:29:57.957 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:57.958 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:29:57.958 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.958 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:29:57.958 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.958 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:29:57.958 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:29:57.959 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-24T06:29:57.959 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:57.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:57.959 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:29:58.015 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:29:58.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.017 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:29:58.071 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:29:58.071 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:29:58.071 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:58.072 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:29:58.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.073 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:58.073 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:58.073 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:29:58.074 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:29:58.074 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:29:58.074 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:58.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.162 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:29:58.171 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:29:58.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.172 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2023-11-24T06:29:58.225 INFO:teuthology.orchestra.run.smithi143.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T06:29:58.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.225 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:58.225 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:58.225 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:29:58.225 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T06:29:58.226 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:58.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.311 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:29:58.373 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:29:58.374 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:29:58.374 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:29:58.374 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.374 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:29:58.374 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.375 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:29:58.375 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether b2:8f:9d:9e:44:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:29:58.375 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:29:58.375 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.375 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::b08f:9dff:fe9e:44e5/64 scope link 2023-11-24T06:29:58.376 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.377 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:29:58.441 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:29:58.441 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:29:58.441 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:29:58.441 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.441 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:29:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.442 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:29:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether b2:8f:9d:9e:44:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:29:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:29:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::b08f:9dff:fe9e:44e5/64 scope link 2023-11-24T06:29:58.443 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:58.444 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T06:29:58.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.444 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T06:29:58.445 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:58.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.590 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:29:58.590 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:29:58.590 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.1 up 2023-11-24T06:29:58.590 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:29:58.590 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:29:58.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:29:58.630 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T06:29:58.686 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:29:58.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:29:58.686 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:29:58.735 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-11-24T06:29:58.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.736 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:29:58.832 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:29:58.832 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:29:58.846 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:29:58.846 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:29:58.846 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:29:58.846 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 2@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:29:58.847 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:29:58.850 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:29:58.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.850 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:29:58.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.870 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:29:58.923 INFO:teuthology.orchestra.run.smithi143.stdout:client4508 2023-11-24T06:29:58.923 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:29:58.923 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:29:58.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:58.973 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:29:59.028 INFO:teuthology.orchestra.run.smithi143.stdout:client4508 2023-11-24T06:29:59.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.028 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:29:59.083 INFO:teuthology.orchestra.run.smithi143.stdout:client4508 2023-11-24T06:29:59.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.083 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/039ed6d4-b5c2-4e8e-a15f-05a601a78248.client4508/status') 2023-11-24T06:29:59.148 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4508 (3)172.21.15.143:0/1595843032 2023-11-24T06:29:59.148 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2023-11-24T06:29:59.148 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2023-11-24T06:29:59.149 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2023-11-24T06:29:59.149 INFO:teuthology.orchestra.run.smithi143.stderr:71 bytes copied, 8.3837e-05 s, 847 kB/s 2023-11-24T06:29:59.150 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-24T06:29:59.150 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:29:59.150 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:29:59.150 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:29:59.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 Processor -- start 2023-11-24T06:29:59.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 -- start start 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ea40d3020 0x7f4ea40d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ea40ce8b0 0x7f4ea40ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea406c0e0 con 0x7f4ea415d570 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40d39f0 con 0x7f4ea40d3020 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eabfc1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40d1cc0 con 0x7f4ea40ce8b0 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea9d5d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4ea415d570 0x7f4ea406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53482/0 (socket says 172.21.15.143:53482) 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea9d5d640 1 -- 172.21.15.143:0/536776721 learned_addr learned my addr 172.21.15.143:0/536776721 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:29:59.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea955c640 1 --2- 172.21.15.143:0/536776721 >> v2:172.21.15.143:3300/0 conn(0x7f4ea40d3020 0x7f4ea40d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:59.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4eaa55e640 1 --2- 172.21.15.143:0/536776721 >> v2:172.21.15.146:3300/0 conn(0x7f4ea40ce8b0 0x7f4ea40ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:59.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea955c640 1 -- 172.21.15.143:0/536776721 >> v2:172.21.15.146:3300/0 conn(0x7f4ea40ce8b0 msgr2=0x7f4ea40ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:29:59.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea955c640 1 --2- 172.21.15.143:0/536776721 >> v2:172.21.15.146:3300/0 conn(0x7f4ea40ce8b0 0x7f4ea40ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea955c640 1 -- 172.21.15.143:0/536776721 >> v1:172.21.15.143:6789/0 conn(0x7f4ea415d570 legacy=0x7f4ea406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:59.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea955c640 1 -- 172.21.15.143:0/536776721 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40d1fa0 con 0x7f4ea40d3020 2023-11-24T06:29:59.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.326+0000 7f4ea8d5b640 1 -- 172.21.15.143:0/536776721 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367691278 0 0) 0x7f4ea406c0e0 con 0x7f4ea415d570 2023-11-24T06:29:59.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4ea955c640 1 --2- 172.21.15.143:0/536776721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea40d3020 0x7f4ea40d34b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4ea406d730 tx=0x7f4e9401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ea1a50cd25d427 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:59.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4ea8d5b640 1 -- 172.21.15.143:0/536776721 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a7070 con 0x7f4ea40d3020 2023-11-24T06:29:59.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4ea8d5b640 1 -- 172.21.15.143:0/536776721 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940ab430 con 0x7f4ea40d3020 2023-11-24T06:29:59.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4ea8d5b640 1 -- 172.21.15.143:0/536776721 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940ab7c0 con 0x7f4ea40d3020 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 -- 172.21.15.143:0/536776721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea40d3020 msgr2=0x7f4ea40d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/536776721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea40d3020 0x7f4ea40d34b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4ea406d730 tx=0x7f4e9401c430 comp rx=0 tx=0).stop 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 -- 172.21.15.143:0/536776721 shutdown_connections 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/536776721 >> v2:172.21.15.146:3300/0 conn(0x7f4ea40ce8b0 0x7f4ea40ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/536776721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea40d3020 0x7f4ea40d34b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 -- 172.21.15.143:0/536776721 >> 172.21.15.143:0/536776721 conn(0x7f4ea408ceb0 msgr2=0x7f4ea409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 -- 172.21.15.143:0/536776721 shutdown_connections 2023-11-24T06:29:59.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.330+0000 7f4eabfc1640 1 -- 172.21.15.143:0/536776721 wait complete. 2023-11-24T06:29:59.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 Processor -- start 2023-11-24T06:29:59.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- start start 2023-11-24T06:29:59.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40ce8b0 0x7f4ea41577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:59.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40d3020 0x7f4ea40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:59.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 0x7f4ea40caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40c6cb0 con 0x7f4ea415d570 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea4158a70 con 0x7f4ea40ce8b0 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea4157e60 con 0x7f4ea40d3020 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 0x7f4ea40caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 0x7f4ea40caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41118/0 (socket says 172.21.15.143:41118) 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 -- 172.21.15.143:0/194339834 learned_addr learned my addr 172.21.15.143:0/194339834 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4ea9d5d640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40ce8b0 0x7f4ea41577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4ea955c640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40d3020 0x7f4ea40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:59.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 -- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40d3020 msgr2=0x7f4ea40ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40d3020 0x7f4ea40ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 -- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40ce8b0 msgr2=0x7f4ea41577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40ce8b0 0x7f4ea41577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 -- 172.21.15.143:0/194339834 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94009420 con 0x7f4ea415d570 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4ea9d5d640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40ce8b0 0x7f4ea41577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4ea955c640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40d3020 0x7f4ea40ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eaa55e640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 0x7f4ea40caa10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c007dc0 tx=0x7f4e9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c014420 con 0x7f4ea415d570 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0145a0 con 0x7f4ea415d570 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea4158140 con 0x7f4ea415d570 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c014950 con 0x7f4ea415d570 2023-11-24T06:29:59.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea4158700 con 0x7f4ea415d570 2023-11-24T06:29:59.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.334+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea4067520 con 0x7f4ea415d570 2023-11-24T06:29:59.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.338+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e9c014ab0 con 0x7f4ea415d570 2023-11-24T06:29:59.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.338+0000 7f4e9a7fc640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e88066470 0x7f4e88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:29:59.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.338+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e9c0847c0 con 0x7f4ea415d570 2023-11-24T06:29:59.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.338+0000 7f4ea9d5d640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e88066470 0x7f4e88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:29:59.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.338+0000 7f4ea9d5d640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e88066470 0x7f4e88068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0007fd0 tx=0x7f4ea0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:29:59.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.342+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e9c051c30 con 0x7f4ea415d570 2023-11-24T06:29:59.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ea40ca290 con 0x7f4ea415d570 2023-11-24T06:29:59.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4e9a7fc640 1 -- 172.21.15.143:0/194339834 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e9c055250 con 0x7f4ea415d570 2023-11-24T06:29:59.526 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e88066470 msgr2=0x7f4e88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e88066470 0x7f4e88068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0007fd0 tx=0x7f4ea0009040 comp rx=0 tx=0).stop 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 msgr2=0x7f4ea40caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 0x7f4ea40caa10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c007dc0 tx=0x7f4e9c00e4b0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 shutdown_connections 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e88066470 0x7f4e88068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ea415d570 0x7f4ea40caa10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40d3020 0x7f4ea40ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 --2- 172.21.15.143:0/194339834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40ce8b0 0x7f4ea41577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:29:59.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 >> 172.21.15.143:0/194339834 conn(0x7f4ea408ceb0 msgr2=0x7f4ea406c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:29:59.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 shutdown_connections 2023-11-24T06:29:59.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:29:59.522+0000 7f4eabfc1640 1 -- 172.21.15.143:0/194339834 wait complete. 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:29:59.547 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:29:59.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.548 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:29:59.558 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:29:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:29:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:29:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:29:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:29:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:29:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:29:59.563 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:29:59.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:29:59.563 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:29:59.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.680 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:29:59.700 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:29:59.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.702 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:29:59.769 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:29:59.769 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:29:59.769 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:29:59.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.770 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:29:59.771 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:29:59.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:29:59.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:29:59.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:29:59.771 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:29:59.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.870 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:29:59.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.880 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-11-24T06:29:59.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:29:59.934 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:29:59.934 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:29:59.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:29:59.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T06:29:59.935 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:00.021 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T06:30:00.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.021 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:00.021 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:00.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T06:30:00.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:30:00.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T06:30:00.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T06:30:00.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T06:30:00.022 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:00.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.195 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:00.195 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:00.195 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-11-24T06:30:00.195 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:30:00.195 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:00.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:00.240 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:00.291 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:30:00.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:00.291 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:00.342 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:30:00.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.342 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:00.572 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:00.573 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:00.573 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:30:00.573 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 1@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:30:00.573 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:30:00.576 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:30:00.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:00.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.597 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:00.663 INFO:teuthology.orchestra.run.smithi146.stdout:client4511 2023-11-24T06:30:00.663 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:00.663 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:00.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.713 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:00.768 INFO:teuthology.orchestra.run.smithi146.stdout:client4511 2023-11-24T06:30:00.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.769 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:00.820 INFO:teuthology.orchestra.run.smithi146.stdout:client4511 2023-11-24T06:30:00.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:00.821 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/039ed6d4-b5c2-4e8e-a15f-05a601a78248.client4511/status') 2023-11-24T06:30:00.881 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4511 (3)192.168.0.1:0/2699813734 2023-11-24T06:30:00.881 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2023-11-24T06:30:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2023-11-24T06:30:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2023-11-24T06:30:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:69 bytes copied, 6.8434e-05 s, 1.0 MB/s 2023-11-24T06:30:00.883 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-11-24T06:30:00.883 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:30:00.883 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:30:00.883 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:30:01.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.017+0000 7f8184301640 1 Processor -- start 2023-11-24T06:30:01.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.017+0000 7f8184301640 1 -- start start 2023-11-24T06:30:01.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f8184301640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f817c06c650 0x7f817c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:01.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f8184301640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c06d8b0 con 0x7f817c0709c0 2023-11-24T06:30:01.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f8184301640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c06cca0 con 0x7f817c144030 2023-11-24T06:30:01.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f8184301640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c145020 con 0x7f817c06c650 2023-11-24T06:30:01.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818289e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f817c0709c0 0x7f817c070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53492/0 (socket says 172.21.15.143:53492) 2023-11-24T06:30:01.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818289e640 1 -- 172.21.15.143:0/2559167320 learned_addr learned my addr 172.21.15.143:0/2559167320 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:01.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818189c640 1 --2- 172.21.15.143:0/2559167320 >> v2:172.21.15.146:3300/0 conn(0x7f817c06c650 0x7f817c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:01.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818109b640 1 -- 172.21.15.143:0/2559167320 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677747592 0 0) 0x7f817c06d8b0 con 0x7f817c0709c0 2023-11-24T06:30:01.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818109b640 1 -- 172.21.15.143:0/2559167320 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8168003530 con 0x7f817c0709c0 2023-11-24T06:30:01.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818189c640 1 -- 172.21.15.143:0/2559167320 >> v1:172.21.15.146:6789/0 conn(0x7f817c144030 legacy=0x7f817c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818189c640 1 -- 172.21.15.143:0/2559167320 >> v1:172.21.15.143:6789/0 conn(0x7f817c0709c0 legacy=0x7f817c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.021+0000 7f818189c640 1 -- 172.21.15.143:0/2559167320 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c06cf80 con 0x7f817c06c650 2023-11-24T06:30:01.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f818189c640 1 --2- 172.21.15.143:0/2559167320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c06c650 0x7f817c09cc20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f816c0097c0 tx=0x7f816c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7526ed0dc8907076 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:01.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f818109b640 1 -- 172.21.15.143:0/2559167320 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0ab400 con 0x7f817c06c650 2023-11-24T06:30:01.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f818109b640 1 -- 172.21.15.143:0/2559167320 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0a7050 con 0x7f817c06c650 2023-11-24T06:30:01.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f818109b640 1 -- 172.21.15.143:0/2559167320 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0ab780 con 0x7f817c06c650 2023-11-24T06:30:01.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 -- 172.21.15.143:0/2559167320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c06c650 msgr2=0x7f817c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 --2- 172.21.15.143:0/2559167320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c06c650 0x7f817c09cc20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f816c0097c0 tx=0x7f816c01c480 comp rx=0 tx=0).stop 2023-11-24T06:30:01.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 -- 172.21.15.143:0/2559167320 shutdown_connections 2023-11-24T06:30:01.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 --2- 172.21.15.143:0/2559167320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c06c650 0x7f817c09cc20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 -- 172.21.15.143:0/2559167320 >> 172.21.15.143:0/2559167320 conn(0x7f817c0b0bf0 msgr2=0x7f817c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:01.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 -- 172.21.15.143:0/2559167320 shutdown_connections 2023-11-24T06:30:01.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 -- 172.21.15.143:0/2559167320 wait complete. 2023-11-24T06:30:01.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 Processor -- start 2023-11-24T06:30:01.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.025+0000 7f8184301640 1 -- start start 2023-11-24T06:30:01.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 0x7f817c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:01.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c0709c0 0x7f817c142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:01.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f817c144030 0x7f817c13dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:01.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c13e1e0 con 0x7f817c06c650 2023-11-24T06:30:01.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c141990 con 0x7f817c0709c0 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c141c70 con 0x7f817c144030 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 0x7f817c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 0x7f817c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41134/0 (socket says 172.21.15.143:41134) 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 -- 172.21.15.143:0/2341535533 learned_addr learned my addr 172.21.15.143:0/2341535533 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818189c640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c0709c0 0x7f817c142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818289e640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f817c144030 0x7f817c13dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 -- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f817c144030 msgr2=0x7f817c13dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f817c144030 0x7f817c13dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 -- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c0709c0 msgr2=0x7f817c142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c0709c0 0x7f817c142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 -- 172.21.15.143:0/2341535533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009420 con 0x7f817c06c650 2023-11-24T06:30:01.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818189c640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c0709c0 0x7f817c142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:01.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f818209d640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 0x7f817c15aa90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f817800c3c0 tx=0x7f817800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780052d0 con 0x7f817c06c650 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8178005430 con 0x7f817c06c650 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c141f50 con 0x7f817c06c650 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178003840 con 0x7f817c06c650 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c142510 con 0x7f817c06c650 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c067520 con 0x7f817c06c650 2023-11-24T06:30:01.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.029+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81780039a0 con 0x7f817c06c650 2023-11-24T06:30:01.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.033+0000 7f8172ffd640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8160066470 0x7f8160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:01.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.033+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81780833c0 con 0x7f817c06c650 2023-11-24T06:30:01.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.033+0000 7f818189c640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8160066470 0x7f8160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:01.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.033+0000 7f818189c640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8160066470 0x7f8160068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f816c0ad000 tx=0x7f816c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:01.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.037+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8178050850 con 0x7f817c06c650 2023-11-24T06:30:01.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.217+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f817c0caed0 con 0x7f817c06c650 2023-11-24T06:30:01.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.217+0000 7f8172ffd640 1 -- 172.21.15.143:0/2341535533 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8178053e70 con 0x7f817c06c650 2023-11-24T06:30:01.224 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:30:01.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8160066470 msgr2=0x7f8160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8160066470 0x7f8160068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f816c0ad000 tx=0x7f816c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 msgr2=0x7f817c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 0x7f817c15aa90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f817800c3c0 tx=0x7f817800c880 comp rx=0 tx=0).stop 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 shutdown_connections 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8160066470 0x7f8160068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f817c144030 0x7f817c13dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f817c0709c0 0x7f817c142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 --2- 172.21.15.143:0/2341535533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f817c06c650 0x7f817c15aa90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 >> 172.21.15.143:0/2341535533 conn(0x7f817c0b0bf0 msgr2=0x7f817c13f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 shutdown_connections 2023-11-24T06:30:01.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:01.221+0000 7f8184301640 1 -- 172.21.15.143:0/2341535533 wait complete. 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:30:01.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:30:01.246 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:30:01.246 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:30:01.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.246 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.256 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-11-24T06:30:01.257 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.258 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:30:01.259 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:30:01.259 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-24T06:30:01.259 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.259 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:30:01.320 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:30:01.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.321 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:30:01.375 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:30:01.375 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:30:01.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.376 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:01.377 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:01.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:30:01.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:30:01.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:30:01.377 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:01.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.467 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:30:01.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:30:01.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.477 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-11-24T06:30:01.529 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T06:30:01.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.530 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:01.530 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:01.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:30:01.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T06:30:01.530 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:01.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.682 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:30:01.683 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether d2:f9:f1:dc:48:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:30:01.683 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:30:01.683 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.683 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::d0f9:f1ff:fedc:487f/64 scope link tentative 2023-11-24T06:30:01.683 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.684 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.746 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:30:01.747 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether d2:f9:f1:dc:48:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:30:01.747 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:30:01.747 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.747 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::d0f9:f1ff:fedc:487f/64 scope link tentative 2023-11-24T06:30:01.747 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:01.748 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T06:30:01.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.748 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:01.748 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:01.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T06:30:01.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:30:01.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T06:30:01.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T06:30:01.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T06:30:01.749 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:01.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:01.887 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:01.887 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:01.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2023-11-24T06:30:01.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:30:01.887 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:01.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:01.927 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T06:30:01.981 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:30:01.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:01.982 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:30:02.037 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-11-24T06:30:02.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:02.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:02.129 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:02.130 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:02.143 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:02.143 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:02.143 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:30:02.143 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 3@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:30:02.143 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:30:02.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:30:02.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:02.147 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:30:02.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:02.213 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:02.268 INFO:teuthology.orchestra.run.smithi146.stdout:client4683 2023-11-24T06:30:02.268 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:02.268 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:02.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:02.323 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:02.380 INFO:teuthology.orchestra.run.smithi146.stdout:client4683 2023-11-24T06:30:02.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:02.380 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:02.431 INFO:teuthology.orchestra.run.smithi146.stdout:client4683 2023-11-24T06:30:02.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:02.432 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/039ed6d4-b5c2-4e8e-a15f-05a601a78248.client4683/status') 2023-11-24T06:30:02.492 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4683 (3)172.21.15.146:0/390299323 2023-11-24T06:30:02.493 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2023-11-24T06:30:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2023-11-24T06:30:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2023-11-24T06:30:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:70 bytes copied, 4.8558e-05 s, 1.4 MB/s 2023-11-24T06:30:02.495 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T06:30:02.518 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:02.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 Processor -- start 2023-11-24T06:30:02.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 -- start start 2023-11-24T06:30:02.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef015d570 0x7f8ef006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ef00d3020 0x7f8ef00d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef00d39c0 con 0x7f8ef00ce8b0 2023-11-24T06:30:02.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef00d1cc0 con 0x7f8ef00d3020 2023-11-24T06:30:02.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef7632640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00d1fa0 con 0x7f8ef015d570 2023-11-24T06:30:02.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef5bcf640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8ef00ce8b0 0x7f8ef00ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53508/0 (socket says 172.21.15.143:53508) 2023-11-24T06:30:02.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef5bcf640 1 -- 172.21.15.143:0/121294564 learned_addr learned my addr 172.21.15.143:0/121294564 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:02.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef53ce640 1 --2- 172.21.15.143:0/121294564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef015d570 0x7f8ef006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef4bcd640 1 --2- 172.21.15.143:0/121294564 >> v2:172.21.15.146:3300/0 conn(0x7f8ef00d3020 0x7f8ef00d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ee7fff640 1 -- 172.21.15.143:0/121294564 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149740490 0 0) 0x7f8ef00d39c0 con 0x7f8ef00ce8b0 2023-11-24T06:30:02.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ee7fff640 1 -- 172.21.15.143:0/121294564 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8edc003530 con 0x7f8ef00ce8b0 2023-11-24T06:30:02.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef53ce640 1 -- 172.21.15.143:0/121294564 >> v2:172.21.15.146:3300/0 conn(0x7f8ef00d3020 msgr2=0x7f8ef00d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:02.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef53ce640 1 --2- 172.21.15.143:0/121294564 >> v2:172.21.15.146:3300/0 conn(0x7f8ef00d3020 0x7f8ef00d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef53ce640 1 -- 172.21.15.143:0/121294564 >> v1:172.21.15.143:6789/0 conn(0x7f8ef00ce8b0 legacy=0x7f8ef00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:02.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef53ce640 1 -- 172.21.15.143:0/121294564 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00ce0b0 con 0x7f8ef015d570 2023-11-24T06:30:02.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.657+0000 7f8ef4bcd640 1 --2- 172.21.15.143:0/121294564 >> v2:172.21.15.146:3300/0 conn(0x7f8ef00d3020 0x7f8ef00d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:02.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef53ce640 1 --2- 172.21.15.143:0/121294564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef015d570 0x7f8ef006b9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097c0 tx=0x7f8eec01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7593318bcee8b751 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:02.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ee7fff640 1 -- 172.21.15.143:0/121294564 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0ac640 con 0x7f8ef015d570 2023-11-24T06:30:02.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ee7fff640 1 -- 172.21.15.143:0/121294564 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0ac7a0 con 0x7f8ef015d570 2023-11-24T06:30:02.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ee7fff640 1 -- 172.21.15.143:0/121294564 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0acb30 con 0x7f8ef015d570 2023-11-24T06:30:02.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 -- 172.21.15.143:0/121294564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef015d570 msgr2=0x7f8ef006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:02.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 --2- 172.21.15.143:0/121294564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef015d570 0x7f8ef006b9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097c0 tx=0x7f8eec01c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 -- 172.21.15.143:0/121294564 shutdown_connections 2023-11-24T06:30:02.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 --2- 172.21.15.143:0/121294564 >> v2:172.21.15.146:3300/0 conn(0x7f8ef00d3020 0x7f8ef00d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 --2- 172.21.15.143:0/121294564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef015d570 0x7f8ef006b9d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 -- 172.21.15.143:0/121294564 >> 172.21.15.143:0/121294564 conn(0x7f8ef008ceb0 msgr2=0x7f8ef009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:02.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 -- 172.21.15.143:0/121294564 shutdown_connections 2023-11-24T06:30:02.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.661+0000 7f8ef7632640 1 -- 172.21.15.143:0/121294564 wait complete. 2023-11-24T06:30:02.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 Processor -- start 2023-11-24T06:30:02.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 -- start start 2023-11-24T06:30:02.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef00ce8b0 0x7f8ef00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 0x7f8ef015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef015d570 0x7f8ef0151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0152e10 con 0x7f8ef00d3020 2023-11-24T06:30:02.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0151220 con 0x7f8ef015d570 2023-11-24T06:30:02.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0160420 con 0x7f8ef00ce8b0 2023-11-24T06:30:02.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 0x7f8ef015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 0x7f8ef015fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41140/0 (socket says 172.21.15.143:41140) 2023-11-24T06:30:02.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 -- 172.21.15.143:0/3437080732 learned_addr learned my addr 172.21.15.143:0/3437080732 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:02.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef53ce640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef00ce8b0 0x7f8ef00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef5bcf640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef015d570 0x7f8ef0151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 -- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef00ce8b0 msgr2=0x7f8ef00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:02.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef00ce8b0 0x7f8ef00c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 -- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef015d570 msgr2=0x7f8ef0151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef015d570 0x7f8ef0151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 -- 172.21.15.143:0/3437080732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0009420 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef4bcd640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 0x7f8ef015fee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000ebe0 tx=0x7f8ee000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000eee0 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000cc30 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0013470 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.665+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec009420 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef0153300 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef0153520 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ee00135d0 con 0x7f8ef00d3020 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ee5ffb640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ed4066470 0x7f8ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ee0084170 con 0x7f8ef00d3020 2023-11-24T06:30:02.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ef53ce640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ed4066470 0x7f8ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.669+0000 7f8ef53ce640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ed4066470 0x7f8ed4068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ae000 tx=0x7f8eec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:02.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.673+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ee0051600 con 0x7f8ef00d3020 2023-11-24T06:30:02.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ef0067520 con 0x7f8ef00d3020 2023-11-24T06:30:02.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ee5ffb640 1 -- 172.21.15.143:0/3437080732 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f8ee0054c20 con 0x7f8ef00d3020 2023-11-24T06:30:02.830 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:02.830 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:02.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ed4066470 msgr2=0x7f8ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:02.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ed4066470 0x7f8ed4068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ae000 tx=0x7f8eec0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:02.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 msgr2=0x7f8ef015fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 0x7f8ef015fee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000ebe0 tx=0x7f8ee000c520 comp rx=0 tx=0).stop 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 shutdown_connections 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ed4066470 0x7f8ed4068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef015d570 0x7f8ef0151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef00d3020 0x7f8ef015fee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 --2- 172.21.15.143:0/3437080732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef00ce8b0 0x7f8ef00c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.825+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 >> 172.21.15.143:0/3437080732 conn(0x7f8ef008ceb0 msgr2=0x7f8ef00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.829+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 shutdown_connections 2023-11-24T06:30:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.829+0000 7f8ef7632640 1 -- 172.21.15.143:0/3437080732 wait complete. 2023-11-24T06:30:02.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:02.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:02.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.985+0000 7f01d03f8640 1 Processor -- start 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 -- start start 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f01c815d7f0 0x7f01c80d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80d37e0 0x7f01c80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f01c80b1630 0x7f01c80b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c806b980 con 0x7f01c815d7f0 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c80d3c60 con 0x7f01c80b1630 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01d03f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80b0090 con 0x7f01c80d37e0 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f01c815d7f0 0x7f01c80d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f01c815d7f0 0x7f01c80d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41154/0 (socket says 172.21.15.143:41154) 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01cd993640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80d37e0 0x7f01c80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 -- 172.21.15.143:0/458298847 learned_addr learned my addr 172.21.15.143:0/458298847 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:02.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce995640 1 --2- 172.21.15.143:0/458298847 >> v2:172.21.15.146:3300/0 conn(0x7f01c80b1630 0x7f01c80b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:02.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 -- 172.21.15.143:0/458298847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80d37e0 msgr2=0x7f01c80b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:02.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 --2- 172.21.15.143:0/458298847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80d37e0 0x7f01c80b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 -- 172.21.15.143:0/458298847 >> v2:172.21.15.146:3300/0 conn(0x7f01c80b1630 msgr2=0x7f01c80b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:02.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 --2- 172.21.15.143:0/458298847 >> v2:172.21.15.146:3300/0 conn(0x7f01c80b1630 0x7f01c80b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:02.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.989+0000 7f01ce194640 1 -- 172.21.15.143:0/458298847 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c80b0330 con 0x7f01c815d7f0 2023-11-24T06:30:02.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01ce194640 1 --2- 172.21.15.143:0/458298847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80d32a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01c806bb90 tx=0x7f01c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b70035b80198b37 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:02.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01cd192640 1 -- 172.21.15.143:0/458298847 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40ab600 con 0x7f01c815d7f0 2023-11-24T06:30:02.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01cd192640 1 -- 172.21.15.143:0/458298847 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c40a7050 con 0x7f01c815d7f0 2023-11-24T06:30:02.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01cd192640 1 -- 172.21.15.143:0/458298847 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40ab980 con 0x7f01c815d7f0 2023-11-24T06:30:03.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 -- 172.21.15.143:0/458298847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 msgr2=0x7f01c80d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 --2- 172.21.15.143:0/458298847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80d32a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01c806bb90 tx=0x7f01c401c500 comp rx=0 tx=0).stop 2023-11-24T06:30:03.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 -- 172.21.15.143:0/458298847 shutdown_connections 2023-11-24T06:30:03.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 --2- 172.21.15.143:0/458298847 >> v2:172.21.15.146:3300/0 conn(0x7f01c80b1630 0x7f01c80b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 --2- 172.21.15.143:0/458298847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80d37e0 0x7f01c80b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 --2- 172.21.15.143:0/458298847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80d32a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 -- 172.21.15.143:0/458298847 >> 172.21.15.143:0/458298847 conn(0x7f01c809c790 msgr2=0x7f01c808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 -- 172.21.15.143:0/458298847 shutdown_connections 2023-11-24T06:30:03.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 -- 172.21.15.143:0/458298847 wait complete. 2023-11-24T06:30:03.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 Processor -- start 2023-11-24T06:30:03.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.993+0000 7f01d03f8640 1 -- start start 2023-11-24T06:30:03.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80b1630 0x7f01c8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80d37e0 0x7f01c814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8152870 con 0x7f01c815d7f0 2023-11-24T06:30:03.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80b8c00 con 0x7f01c80d37e0 2023-11-24T06:30:03.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80b8ee0 con 0x7f01c80b1630 2023-11-24T06:30:03.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41158/0 (socket says 172.21.15.143:41158) 2023-11-24T06:30:03.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 -- 172.21.15.143:0/2562897007 learned_addr learned my addr 172.21.15.143:0/2562897007 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:03.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01cd993640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80d37e0 0x7f01c814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce194640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80b1630 0x7f01c8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 -- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80b1630 msgr2=0x7f01c8152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80b1630 0x7f01c8152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 -- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80d37e0 msgr2=0x7f01c814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80d37e0 0x7f01c814b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 -- 172.21.15.143:0/2562897007 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40094d0 con 0x7f01c815d7f0 2023-11-24T06:30:03.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01cd993640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80d37e0 0x7f01c814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:03.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01ce995640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80ced80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f01c000efc0 tx=0x7f01c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0009b10 con 0x7f01c815d7f0 2023-11-24T06:30:03.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c000f040 con 0x7f01c815d7f0 2023-11-24T06:30:03.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00146c0 con 0x7f01c815d7f0 2023-11-24T06:30:03.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c814fa90 con 0x7f01c815d7f0 2023-11-24T06:30:03.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8150050 con 0x7f01c815d7f0 2023-11-24T06:30:03.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c8150270 con 0x7f01c815d7f0 2023-11-24T06:30:03.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:02.997+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01c0014820 con 0x7f01c815d7f0 2023-11-24T06:30:03.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.001+0000 7f01beffd640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f01ac066470 0x7f01ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.001+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01c0084920 con 0x7f01c815d7f0 2023-11-24T06:30:03.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.001+0000 7f01ce194640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f01ac066470 0x7f01ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.001+0000 7f01ce194640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f01ac066470 0x7f01ac068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01c40ad000 tx=0x7f01c40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.005+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01c0051d80 con 0x7f01c815d7f0 2023-11-24T06:30:03.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.157+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01c804e8c0 con 0x7f01c815d7f0 2023-11-24T06:30:03.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.157+0000 7f01beffd640 1 -- 172.21.15.143:0/2562897007 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01c00180a0 con 0x7f01c815d7f0 2023-11-24T06:30:03.164 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f01ac066470 msgr2=0x7f01ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f01ac066470 0x7f01ac068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01c40ad000 tx=0x7f01c40a6000 comp rx=0 tx=0).stop 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 msgr2=0x7f01c80ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80ced80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f01c000efc0 tx=0x7f01c000c490 comp rx=0 tx=0).stop 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 shutdown_connections 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f01ac066470 0x7f01ac068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c815d7f0 0x7f01c80ced80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80d37e0 0x7f01c814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 --2- 172.21.15.143:0/2562897007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c80b1630 0x7f01c8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 >> 172.21.15.143:0/2562897007 conn(0x7f01c809c790 msgr2=0x7f01c80cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 shutdown_connections 2023-11-24T06:30:03.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.161+0000 7f01d03f8640 1 -- 172.21.15.143:0/2562897007 wait complete. 2023-11-24T06:30:03.185 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:03.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.321+0000 7f1fbb91d640 1 Processor -- start 2023-11-24T06:30:03.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.321+0000 7f1fbb91d640 1 -- start start 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fbb91d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fb415a290 0x7f1fb40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fbb91d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb4071170 con 0x7f1fb415ec60 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fbb91d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40cb690 con 0x7f1fb40b1f80 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fbb91d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40cb970 con 0x7f1fb415a290 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fb8eb8640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1fb415ec60 0x7f1fb40cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53512/0 (socket says 172.21.15.143:53512) 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fb8eb8640 1 -- 172.21.15.143:0/1053051432 learned_addr learned my addr 172.21.15.143:0/1053051432 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:03.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fb96b9640 1 --2- 172.21.15.143:0/1053051432 >> v2:172.21.15.146:3300/0 conn(0x7f1fb415a290 0x7f1fb40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626549663 0 0) 0x7f1fb4071170 con 0x7f1fb415ec60 2023-11-24T06:30:03.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa0005740 con 0x7f1fb415ec60 2023-11-24T06:30:03.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008089845 0 0) 0x7f1fb40cb690 con 0x7f1fb40b1f80 2023-11-24T06:30:03.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb4071170 con 0x7f1fb40b1f80 2023-11-24T06:30:03.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 587951164 0 0) 0x7f1fa0005740 con 0x7f1fb415ec60 2023-11-24T06:30:03.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fb96b9640 1 -- 172.21.15.143:0/1053051432 >> v1:172.21.15.146:6789/0 conn(0x7f1fb40b1f80 legacy=0x7f1fb406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fb96b9640 1 -- 172.21.15.143:0/1053051432 >> v1:172.21.15.143:6789/0 conn(0x7f1fb415ec60 legacy=0x7f1fb40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.325+0000 7f1fb96b9640 1 -- 172.21.15.143:0/1053051432 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40cbc50 con 0x7f1fb415a290 2023-11-24T06:30:03.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fb96b9640 1 --2- 172.21.15.143:0/1053051432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb415a290 0x7f1fb40707f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00097c0 tx=0x7f1fb001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15226c1f3947b6f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4001680 con 0x7f1fb415a290 2023-11-24T06:30:03.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb00a7050 con 0x7f1fb415a290 2023-11-24T06:30:03.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fabfff640 1 -- 172.21.15.143:0/1053051432 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00ab620 con 0x7f1fb415a290 2023-11-24T06:30:03.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 -- 172.21.15.143:0/1053051432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb415a290 msgr2=0x7f1fb40707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/1053051432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb415a290 0x7f1fb40707f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00097c0 tx=0x7f1fb001c310 comp rx=0 tx=0).stop 2023-11-24T06:30:03.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 -- 172.21.15.143:0/1053051432 shutdown_connections 2023-11-24T06:30:03.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/1053051432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb415a290 0x7f1fb40707f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 -- 172.21.15.143:0/1053051432 >> 172.21.15.143:0/1053051432 conn(0x7f1fb40b0c80 msgr2=0x7f1fb40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 -- 172.21.15.143:0/1053051432 shutdown_connections 2023-11-24T06:30:03.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 -- 172.21.15.143:0/1053051432 wait complete. 2023-11-24T06:30:03.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 Processor -- start 2023-11-24T06:30:03.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.329+0000 7f1fbb91d640 1 -- start start 2023-11-24T06:30:03.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb40b1f80 0x7f1fb41f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb415a290 0x7f1fb409cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 0x7f1fb41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb409d140 con 0x7f1fb415ec60 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41568c0 con 0x7f1fb40b1f80 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4156ba0 con 0x7f1fb415a290 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 0x7f1fb41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 0x7f1fb41554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41168/0 (socket says 172.21.15.143:41168) 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 -- 172.21.15.143:0/4264530180 learned_addr learned my addr 172.21.15.143:0/4264530180 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb96b9640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb40b1f80 0x7f1fb41f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb8eb8640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb415a290 0x7f1fb409cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 -- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb415a290 msgr2=0x7f1fb409cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb415a290 0x7f1fb409cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 -- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb40b1f80 msgr2=0x7f1fb41f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb40b1f80 0x7f1fb41f65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 -- 172.21.15.143:0/4264530180 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0009420 con 0x7f1fb415ec60 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fb9eba640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 0x7f1fb41554e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00c790 tx=0x7f1fac00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00cea0 con 0x7f1fb415ec60 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac003b80 con 0x7f1fb415ec60 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb4070f40 con 0x7f1fb415ec60 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00a850 con 0x7f1fb415ec60 2023-11-24T06:30:03.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb4157160 con 0x7f1fb415ec60 2023-11-24T06:30:03.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb404e8c0 con 0x7f1fb415ec60 2023-11-24T06:30:03.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.333+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1fac00a9b0 con 0x7f1fb415ec60 2023-11-24T06:30:03.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.337+0000 7f1fa9ffb640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1f980664a0 0x7f1f98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.337+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fac083c90 con 0x7f1fb415ec60 2023-11-24T06:30:03.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.337+0000 7f1fb96b9640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1f980664a0 0x7f1f98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.337+0000 7f1fb96b9640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1f980664a0 0x7f1f98068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00ad000 tx=0x7f1fb00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.341+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fac051120 con 0x7f1fb415ec60 2023-11-24T06:30:03.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.489+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fb4155a20 con 0x7f1fb415ec60 2023-11-24T06:30:03.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.489+0000 7f1fa9ffb640 1 -- 172.21.15.143:0/4264530180 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fac054740 con 0x7f1fb415ec60 2023-11-24T06:30:03.495 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:03.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1f980664a0 msgr2=0x7f1f98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1f980664a0 0x7f1f98068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00ad000 tx=0x7f1fb00a6000 comp rx=0 tx=0).stop 2023-11-24T06:30:03.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 msgr2=0x7f1fb41554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 0x7f1fb41554e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00c790 tx=0x7f1fac00cc50 comp rx=0 tx=0).stop 2023-11-24T06:30:03.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 shutdown_connections 2023-11-24T06:30:03.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1f980664a0 0x7f1f98068960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb415ec60 0x7f1fb41554e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb415a290 0x7f1fb409cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 --2- 172.21.15.143:0/4264530180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb40b1f80 0x7f1fb41f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 >> 172.21.15.143:0/4264530180 conn(0x7f1fb40b0c80 msgr2=0x7f1fb40b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 shutdown_connections 2023-11-24T06:30:03.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.493+0000 7f1fbb91d640 1 -- 172.21.15.143:0/4264530180 wait complete. 2023-11-24T06:30:03.516 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:03.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.649+0000 7fad13be7640 1 Processor -- start 2023-11-24T06:30:03.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad13be7640 1 -- start start 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad13be7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15a290 0x7fad0c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad13be7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad0c15ec60 0x7fad0c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad13be7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c071170 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad13be7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0cb690 con 0x7fad0c15ec60 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad13be7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0cb970 con 0x7fad0c15a290 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad0c15ec60 0x7fad0c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad0c15ec60 0x7fad0c0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41174/0 (socket says 172.21.15.143:41174) 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 -- 172.21.15.143:0/3744977457 learned_addr learned my addr 172.21.15.143:0/3744977457 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:03.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11983640 1 --2- 172.21.15.143:0/3744977457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15a290 0x7fad0c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 -- 172.21.15.143:0/3744977457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15a290 msgr2=0x7fad0c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:03.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 --2- 172.21.15.143:0/3744977457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15a290 0x7fad0c0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 -- 172.21.15.143:0/3744977457 >> v1:172.21.15.146:6789/0 conn(0x7fad0c0cc6b0 legacy=0x7fad0c0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.653+0000 7fad11182640 1 -- 172.21.15.143:0/3744977457 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0cbc50 con 0x7fad0c15ec60 2023-11-24T06:30:03.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad11182640 1 --2- 172.21.15.143:0/3744977457 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c15ec60 0x7fad0c0cc170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7facfc009870 tx=0x7facfc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a1c39c75deb52c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad10981640 1 -- 172.21.15.143:0/3744977457 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0aa430 con 0x7fad0c15ec60 2023-11-24T06:30:03.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad10981640 1 -- 172.21.15.143:0/3744977457 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0aa590 con 0x7fad0c15ec60 2023-11-24T06:30:03.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad10981640 1 -- 172.21.15.143:0/3744977457 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0aa920 con 0x7fad0c15ec60 2023-11-24T06:30:03.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 -- 172.21.15.143:0/3744977457 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c15ec60 msgr2=0x7fad0c0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 --2- 172.21.15.143:0/3744977457 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c15ec60 0x7fad0c0cc170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7facfc009870 tx=0x7facfc01c4b0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 -- 172.21.15.143:0/3744977457 shutdown_connections 2023-11-24T06:30:03.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 --2- 172.21.15.143:0/3744977457 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c15ec60 0x7fad0c0cc170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 --2- 172.21.15.143:0/3744977457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15a290 0x7fad0c0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 -- 172.21.15.143:0/3744977457 >> 172.21.15.143:0/3744977457 conn(0x7fad0c0b0c80 msgr2=0x7fad0c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 -- 172.21.15.143:0/3744977457 shutdown_connections 2023-11-24T06:30:03.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 -- 172.21.15.143:0/3744977457 wait complete. 2023-11-24T06:30:03.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 Processor -- start 2023-11-24T06:30:03.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.657+0000 7fad13be7640 1 -- start start 2023-11-24T06:30:03.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 0x7fad0c099150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad0c15a290 0x7fad0c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15ec60 0x7fad0c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c09c6f0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c099730 con 0x7fad0c15a290 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c099a10 con 0x7fad0c15ec60 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 0x7fad0c099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 0x7fad0c099150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41180/0 (socket says 172.21.15.143:41180) 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 -- 172.21.15.143:0/3121513458 learned_addr learned my addr 172.21.15.143:0/3121513458 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:03.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11182640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad0c15a290 0x7fad0c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad12184640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15ec60 0x7fad0c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 -- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15ec60 msgr2=0x7fad0c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15ec60 0x7fad0c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 -- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad0c15a290 msgr2=0x7fad0c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad0c15a290 0x7fad0c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 -- 172.21.15.143:0/3121513458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0094d0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad12184640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15ec60 0x7fad0c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:03.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11182640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad0c15a290 0x7fad0c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:03.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad11983640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 0x7fad0c099150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800b6c0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800b820 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800bb90 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c099cf0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c09a2b0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c04e8c0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.661+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad0800bcf0 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.665+0000 7fad027fc640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facf0066470 0x7facf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.665+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad08084430 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.665+0000 7fad11182640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facf0066470 0x7facf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.665+0000 7fad11182640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facf0066470 0x7facf0068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7facfc0ae000 tx=0x7facfc0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.669+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad08051890 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.813+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad0c15e870 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad027fc640 1 -- 172.21.15.143:0/3121513458 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad08011340 con 0x7fad0c0cc6b0 2023-11-24T06:30:03.823 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facf0066470 msgr2=0x7facf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facf0066470 0x7facf0068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7facfc0ae000 tx=0x7facfc0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 msgr2=0x7fad0c099150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 0x7fad0c099150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 shutdown_connections 2023-11-24T06:30:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facf0066470 0x7facf0068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0c15ec60 0x7fad0c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad0c15a290 0x7fad0c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 --2- 172.21.15.143:0/3121513458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0cc6b0 0x7fad0c099150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 >> 172.21.15.143:0/3121513458 conn(0x7fad0c0b0c80 msgr2=0x7fad0c0af950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 shutdown_connections 2023-11-24T06:30:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.817+0000 7fad13be7640 1 -- 172.21.15.143:0/3121513458 wait complete. 2023-11-24T06:30:03.842 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:03.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.973+0000 7f6347ed6640 1 Processor -- start 2023-11-24T06:30:03.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6347ed6640 1 -- start start 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6347ed6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f63400b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6347ed6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63400b36c0 0x7f6340070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6347ed6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634015a700 con 0x7f6340070bd0 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6347ed6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63400b2430 con 0x7f63400b36c0 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6347ed6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63400b2620 con 0x7f634015a320 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6346473640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6340070bd0 0x7f63400ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53524/0 (socket says 172.21.15.143:53524) 2023-11-24T06:30:03.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6346473640 1 -- 172.21.15.143:0/4021245089 learned_addr learned my addr 172.21.15.143:0/4021245089 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:03.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6345c72640 1 --2- 172.21.15.143:0/4021245089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f63400b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6345471640 1 --2- 172.21.15.143:0/4021245089 >> v2:172.21.15.146:3300/0 conn(0x7f63400b36c0 0x7f6340070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6344c70640 1 -- 172.21.15.143:0/4021245089 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550282583 0 0) 0x7f634015a700 con 0x7f6340070bd0 2023-11-24T06:30:03.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6344c70640 1 -- 172.21.15.143:0/4021245089 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f632c003530 con 0x7f6340070bd0 2023-11-24T06:30:03.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6345c72640 1 -- 172.21.15.143:0/4021245089 >> v2:172.21.15.146:3300/0 conn(0x7f63400b36c0 msgr2=0x7f6340070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:03.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6345c72640 1 --2- 172.21.15.143:0/4021245089 >> v2:172.21.15.146:3300/0 conn(0x7f63400b36c0 0x7f6340070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6345c72640 1 -- 172.21.15.143:0/4021245089 >> v1:172.21.15.143:6789/0 conn(0x7f6340070bd0 legacy=0x7f63400ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.977+0000 7f6345c72640 1 -- 172.21.15.143:0/4021245089 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400b2900 con 0x7f634015a320 2023-11-24T06:30:03.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6345c72640 1 --2- 172.21.15.143:0/4021245089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f63400b1ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f633c0097c0 tx=0x7f633c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d1c1637097d52f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6344c70640 1 -- 172.21.15.143:0/4021245089 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0ab680 con 0x7f634015a320 2023-11-24T06:30:03.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6344c70640 1 -- 172.21.15.143:0/4021245089 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0ab7e0 con 0x7f634015a320 2023-11-24T06:30:03.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6344c70640 1 -- 172.21.15.143:0/4021245089 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0abb50 con 0x7f634015a320 2023-11-24T06:30:03.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 -- 172.21.15.143:0/4021245089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 msgr2=0x7f63400b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 --2- 172.21.15.143:0/4021245089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f63400b1ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f633c0097c0 tx=0x7f633c01c480 comp rx=0 tx=0).stop 2023-11-24T06:30:03.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 -- 172.21.15.143:0/4021245089 shutdown_connections 2023-11-24T06:30:03.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 --2- 172.21.15.143:0/4021245089 >> v2:172.21.15.146:3300/0 conn(0x7f63400b36c0 0x7f6340070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 --2- 172.21.15.143:0/4021245089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f63400b1ef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 -- 172.21.15.143:0/4021245089 >> 172.21.15.143:0/4021245089 conn(0x7f63400b0bf0 msgr2=0x7f63400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:03.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 -- 172.21.15.143:0/4021245089 shutdown_connections 2023-11-24T06:30:03.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.981+0000 7f6347ed6640 1 -- 172.21.15.143:0/4021245089 wait complete. 2023-11-24T06:30:03.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 Processor -- start 2023-11-24T06:30:03.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- start start 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 0x7f6340142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63400b36c0 0x7f6340166470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f6340163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340153120 con 0x7f6340070bd0 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634015aa30 con 0x7f63400b36c0 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340142e80 con 0x7f634015a320 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 0x7f6340142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 0x7f6340142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41184/0 (socket says 172.21.15.143:41184) 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 -- 172.21.15.143:0/1354151011 learned_addr learned my addr 172.21.15.143:0/1354151011 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:03.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6346473640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f6340163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345471640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63400b36c0 0x7f6340166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 -- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 msgr2=0x7f6340163310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f6340163310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 -- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63400b36c0 msgr2=0x7f6340166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63400b36c0 0x7f6340166470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 -- 172.21.15.143:0/1354151011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009420 con 0x7f6340070bd0 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6345c72640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 0x7f6340142940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ad040 tx=0x7f633c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c004510 con 0x7f6340070bd0 2023-11-24T06:30:03.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0ab950 con 0x7f6340070bd0 2023-11-24T06:30:03.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0abcc0 con 0x7f6340070bd0 2023-11-24T06:30:03.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63401524a0 con 0x7f6340070bd0 2023-11-24T06:30:03.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6340152a60 con 0x7f6340070bd0 2023-11-24T06:30:03.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.985+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6340153390 con 0x7f6340070bd0 2023-11-24T06:30:03.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.989+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f633c003620 con 0x7f6340070bd0 2023-11-24T06:30:03.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.989+0000 7f63367fc640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6324066470 0x7f6324068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:03.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.989+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f633c11e200 con 0x7f6340070bd0 2023-11-24T06:30:03.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.989+0000 7f6345471640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6324066470 0x7f6324068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:03.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.989+0000 7f6345471640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6324066470 0x7f6324068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6340067e30 tx=0x7f6330008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:03.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:03.993+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f633c0eb560 con 0x7f6340070bd0 2023-11-24T06:30:04.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.145+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6340067520 con 0x7f6340070bd0 2023-11-24T06:30:04.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.145+0000 7f63367fc640 1 -- 172.21.15.143:0/1354151011 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f633c0eeb80 con 0x7f6340070bd0 2023-11-24T06:30:04.152 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:04.152 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6324066470 msgr2=0x7f6324068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6324066470 0x7f6324068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6340067e30 tx=0x7f6330008040 comp rx=0 tx=0).stop 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 msgr2=0x7f6340142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 0x7f6340142940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ad040 tx=0x7f633c019220 comp rx=0 tx=0).stop 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 shutdown_connections 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6324066470 0x7f6324068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f634015a320 0x7f6340163310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63400b36c0 0x7f6340166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 --2- 172.21.15.143:0/1354151011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6340070bd0 0x7f6340142940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 >> 172.21.15.143:0/1354151011 conn(0x7f63400b0bf0 msgr2=0x7f634015d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:04.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 shutdown_connections 2023-11-24T06:30:04.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.149+0000 7f6347ed6640 1 -- 172.21.15.143:0/1354151011 wait complete. 2023-11-24T06:30:04.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:04.173 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:04.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4613a16640 1 Processor -- start 2023-11-24T06:30:04.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4613a16640 1 -- start start 2023-11-24T06:30:04.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4613a16640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f460c0ce420 0x7f460c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4613a16640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0b3510 con 0x7f460c0cd850 2023-11-24T06:30:04.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4613a16640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0b37f0 con 0x7f460c0ae4a0 2023-11-24T06:30:04.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4613a16640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c0b3ad0 con 0x7f460c0ce420 2023-11-24T06:30:04.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4611fb3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f460c0cd850 0x7f460c06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53536/0 (socket says 172.21.15.143:53536) 2023-11-24T06:30:04.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4611fb3640 1 -- 172.21.15.143:0/1275054181 learned_addr learned my addr 172.21.15.143:0/1275054181 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:04.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4610fb1640 1 --2- 172.21.15.143:0/1275054181 >> v2:172.21.15.146:3300/0 conn(0x7f460c0ce420 0x7f460c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695272209 0 0) 0x7f460c0b3510 con 0x7f460c0cd850 2023-11-24T06:30:04.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.309+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f8003530 con 0x7f460c0cd850 2023-11-24T06:30:04.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829912618 0 0) 0x7f45f8003530 con 0x7f460c0cd850 2023-11-24T06:30:04.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 >> v2:172.21.15.146:3300/0 conn(0x7f460c0ce420 msgr2=0x7f460c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:04.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 --2- 172.21.15.143:0/1275054181 >> v2:172.21.15.146:3300/0 conn(0x7f460c0ce420 0x7f460c15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 >> v1:172.21.15.146:6789/0 conn(0x7f460c0ae4a0 legacy=0x7f460c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c0b3db0 con 0x7f460c0cd850 2023-11-24T06:30:04.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f4604001a00 con 0x7f460c0cd850 2023-11-24T06:30:04.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 >> v1:172.21.15.143:6789/0 conn(0x7f460c0cd850 legacy=0x7f460c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80039d0 0x7f45f8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f80047d0 0x7f45f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45f8005190 0x7f45f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0b3ad0 con 0x7f45f80047d0 2023-11-24T06:30:04.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f800c090 con 0x7f45f80039d0 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f800c250 con 0x7f45f8005190 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f80047d0 0x7f45f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f46117b2640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80039d0 0x7f45f8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4611fb3640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45f8005190 0x7f45f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 -- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45f8005190 msgr2=0x7f45f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45f8005190 0x7f45f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 -- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80039d0 msgr2=0x7f45f8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80039d0 0x7f45f8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 -- 172.21.15.143:0/1275054181 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8003530 con 0x7f45f80047d0 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f46117b2640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80039d0 0x7f45f8003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:04.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4611fb3640 1 -- 172.21.15.143:0/1275054181 reap_dead start 2023-11-24T06:30:04.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.313+0000 7f4610fb1640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f80047d0 0x7f45f8004c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009ab0 tx=0x7f45fc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ccadbff81480eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0a55e0 con 0x7f45f80047d0 2023-11-24T06:30:04.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc0a5740 con 0x7f45f80047d0 2023-11-24T06:30:04.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4603fff640 1 -- 172.21.15.143:0/1275054181 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0a5af0 con 0x7f45f80047d0 2023-11-24T06:30:04.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- 172.21.15.143:0/1275054181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f80047d0 msgr2=0x7f45f8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f80047d0 0x7f45f8004c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009ab0 tx=0x7f45fc01c9f0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- 172.21.15.143:0/1275054181 shutdown_connections 2023-11-24T06:30:04.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 --2- 172.21.15.143:0/1275054181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f80047d0 0x7f45f8004c50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- 172.21.15.143:0/1275054181 >> 172.21.15.143:0/1275054181 conn(0x7f460c0b0c80 msgr2=0x7f460c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:04.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- 172.21.15.143:0/1275054181 shutdown_connections 2023-11-24T06:30:04.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- 172.21.15.143:0/1275054181 wait complete. 2023-11-24T06:30:04.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 Processor -- start 2023-11-24T06:30:04.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- start start 2023-11-24T06:30:04.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80047d0 0x7f460c098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 0x7f460c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f460c0ada90 0x7f460c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0adf10 con 0x7f460c14f090 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c14f510 con 0x7f45f80047d0 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4613a16640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c14dff0 con 0x7f460c0ada90 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4610fb1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 0x7f460c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4610fb1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 0x7f460c0ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41204/0 (socket says 172.21.15.143:41204) 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4610fb1640 1 -- 172.21.15.143:0/3590924882 learned_addr learned my addr 172.21.15.143:0/3590924882 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f46117b2640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80047d0 0x7f460c098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.317+0000 7f4611fb3640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f460c0ada90 0x7f460c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4610fb1640 1 -- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f460c0ada90 msgr2=0x7f460c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4610fb1640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f460c0ada90 0x7f460c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4610fb1640 1 -- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80047d0 msgr2=0x7f460c098ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4610fb1640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80047d0 0x7f460c098ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4610fb1640 1 -- 172.21.15.143:0/3590924882 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c14e2d0 con 0x7f460c14f090 2023-11-24T06:30:04.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4610fb1640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 0x7f460c0ad550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45fc01c820 tx=0x7f45fc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0bd070 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc004020 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0043b0 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c14e5b0 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c14eb70 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c04e8c0 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45fc0b4070 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4601ffb640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f0066470 0x7f45f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.321+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45fc11e190 con 0x7f460c14f090 2023-11-24T06:30:04.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.325+0000 7f46117b2640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f0066470 0x7f45f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.325+0000 7f46117b2640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f0066470 0x7f45f0068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f460c0682a0 tx=0x7f4608009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.329+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45fc0eb620 con 0x7f460c14f090 2023-11-24T06:30:04.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.477+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f460c14ddd0 con 0x7f460c14f090 2023-11-24T06:30:04.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.477+0000 7f4601ffb640 1 -- 172.21.15.143:0/3590924882 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45fc0b20a0 con 0x7f460c14f090 2023-11-24T06:30:04.484 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:04.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f0066470 msgr2=0x7f45f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f0066470 0x7f45f0068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f460c0682a0 tx=0x7f4608009040 comp rx=0 tx=0).stop 2023-11-24T06:30:04.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 msgr2=0x7f460c0ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 0x7f460c0ad550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45fc01c820 tx=0x7f45fc0197f0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 shutdown_connections 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f0066470 0x7f45f0068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f460c0ada90 0x7f460c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f460c14f090 0x7f460c0ad550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 --2- 172.21.15.143:0/3590924882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45f80047d0 0x7f460c098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 >> 172.21.15.143:0/3590924882 conn(0x7f460c0b0c80 msgr2=0x7f460c15cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 shutdown_connections 2023-11-24T06:30:04.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.481+0000 7f4613a16640 1 -- 172.21.15.143:0/3590924882 wait complete. 2023-11-24T06:30:04.505 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:04.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.637+0000 7f7d44a32640 1 Processor -- start 2023-11-24T06:30:04.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.637+0000 7f7d44a32640 1 -- start start 2023-11-24T06:30:04.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d44a32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d4015ec60 0x7f7d400cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d44a32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d40070f00 con 0x7f7d400cc6b0 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d44a32640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d40071170 con 0x7f7d4015a290 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d44a32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400cb690 con 0x7f7d4015ec60 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d3ed9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7d400cc6b0 0x7f7d400b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53540/0 (socket says 172.21.15.143:53540) 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d35d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d4015ec60 0x7f7d400cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d3ed9d640 1 -- 172.21.15.143:0/3475170752 learned_addr learned my addr 172.21.15.143:0/3475170752 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d35d9b640 1 -- 172.21.15.143:0/3475170752 >> v1:172.21.15.146:6789/0 conn(0x7f7d4015a290 legacy=0x7f7d400707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d35d9b640 1 -- 172.21.15.143:0/3475170752 >> v1:172.21.15.143:6789/0 conn(0x7f7d400cc6b0 legacy=0x7f7d400b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.641+0000 7f7d35d9b640 1 -- 172.21.15.143:0/3475170752 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400cb970 con 0x7f7d4015ec60 2023-11-24T06:30:04.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d35d9b640 1 --2- 172.21.15.143:0/3475170752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015ec60 0x7f7d400cc170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7d300097c0 tx=0x7f7d3001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435daacee77c56e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d3dd9b640 1 -- 172.21.15.143:0/3475170752 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300ac600 con 0x7f7d4015ec60 2023-11-24T06:30:04.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d3dd9b640 1 -- 172.21.15.143:0/3475170752 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300a8050 con 0x7f7d4015ec60 2023-11-24T06:30:04.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d3dd9b640 1 -- 172.21.15.143:0/3475170752 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300ac980 con 0x7f7d4015ec60 2023-11-24T06:30:04.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 -- 172.21.15.143:0/3475170752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015ec60 msgr2=0x7f7d400cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 --2- 172.21.15.143:0/3475170752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015ec60 0x7f7d400cc170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7d300097c0 tx=0x7f7d3001c380 comp rx=0 tx=0).stop 2023-11-24T06:30:04.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 -- 172.21.15.143:0/3475170752 shutdown_connections 2023-11-24T06:30:04.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 --2- 172.21.15.143:0/3475170752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015ec60 0x7f7d400cc170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 -- 172.21.15.143:0/3475170752 >> 172.21.15.143:0/3475170752 conn(0x7f7d400b0c80 msgr2=0x7f7d400b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:04.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 -- 172.21.15.143:0/3475170752 shutdown_connections 2023-11-24T06:30:04.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 -- 172.21.15.143:0/3475170752 wait complete. 2023-11-24T06:30:04.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 Processor -- start 2023-11-24T06:30:04.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.645+0000 7f7d44a32640 1 -- start start 2023-11-24T06:30:04.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d400cc6b0 0x7f7d40147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 0x7f7d400af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4015ec60 0x7f7d4014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4014a1b0 con 0x7f7d4015a290 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4014a430 con 0x7f7d4015ec60 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400afe50 con 0x7f7d400cc6b0 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 0x7f7d400af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 0x7f7d400af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41230/0 (socket says 172.21.15.143:41230) 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 -- 172.21.15.143:0/1461259653 learned_addr learned my addr 172.21.15.143:0/1461259653 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d3ed9d640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4015ec60 0x7f7d4014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d3e59c640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d400cc6b0 0x7f7d40147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 -- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d400cc6b0 msgr2=0x7f7d40147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d400cc6b0 0x7f7d40147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 -- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4015ec60 msgr2=0x7f7d4014da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4015ec60 0x7f7d4014da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 -- 172.21.15.143:0/1461259653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30009420 con 0x7f7d4015a290 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d3e59c640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d400cc6b0 0x7f7d40147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d3ed9d640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4015ec60 0x7f7d4014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d35d9b640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 0x7f7d400af5b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d30019fb0 tx=0x7f7d3001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b7620 con 0x7f7d4015a290 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300b7780 con 0x7f7d4015a290 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4014a6f0 con 0x7f7d4015a290 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b7b30 con 0x7f7d4015a290 2023-11-24T06:30:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d40148450 con 0x7f7d4015a290 2023-11-24T06:30:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4014ac10 con 0x7f7d4015a290 2023-11-24T06:30:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.649+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d300b3040 con 0x7f7d4015a290 2023-11-24T06:30:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.653+0000 7f7d377fe640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d20066470 0x7f7d20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.653+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d3011e560 con 0x7f7d4015a290 2023-11-24T06:30:04.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.653+0000 7f7d3e59c640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d20066470 0x7f7d20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.653+0000 7f7d3e59c640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d20066470 0x7f7d20068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d28003ec0 tx=0x7f7d28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.657+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d4014ac10 con 0x7f7d4015a290 2023-11-24T06:30:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.805+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d4014ac10 con 0x7f7d4015a290 2023-11-24T06:30:04.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.805+0000 7f7d377fe640 1 -- 172.21.15.143:0/1461259653 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d4014ac10 con 0x7f7d4015a290 2023-11-24T06:30:04.812 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:04.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d20066470 msgr2=0x7f7d20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d20066470 0x7f7d20068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d28003ec0 tx=0x7f7d28009040 comp rx=0 tx=0).stop 2023-11-24T06:30:04.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 msgr2=0x7f7d400af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 0x7f7d400af5b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d30019fb0 tx=0x7f7d3001abc0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 shutdown_connections 2023-11-24T06:30:04.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d20066470 0x7f7d20068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4015ec60 0x7f7d4014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d4015a290 0x7f7d400af5b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 --2- 172.21.15.143:0/1461259653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d400cc6b0 0x7f7d40147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 >> 172.21.15.143:0/1461259653 conn(0x7f7d400b0c80 msgr2=0x7f7d4006c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:04.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 shutdown_connections 2023-11-24T06:30:04.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.809+0000 7f7d44a32640 1 -- 172.21.15.143:0/1461259653 wait complete. 2023-11-24T06:30:04.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:04.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 Processor -- start 2023-11-24T06:30:04.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 -- start start 2023-11-24T06:30:04.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff21815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff2180cd850 0x7ff2180cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180b3510 con 0x7ff2180ce250 2023-11-24T06:30:04.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180ce6e0 con 0x7ff2180cd850 2023-11-24T06:30:04.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21f735640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180b37f0 con 0x7ff2180ae4a0 2023-11-24T06:30:04.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff2180cd850 0x7ff2180cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff2180cd850 0x7ff2180cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41236/0 (socket says 172.21.15.143:41236) 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 -- 172.21.15.143:0/1538671989 learned_addr learned my addr 172.21.15.143:0/1538671989 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21d4d1640 1 --2- 172.21.15.143:0/1538671989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff21815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 -- 172.21.15.143:0/1538671989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 msgr2=0x7ff21815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 --2- 172.21.15.143:0/1538671989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff21815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 -- 172.21.15.143:0/1538671989 >> v1:172.21.15.146:6789/0 conn(0x7ff2180ce250 legacy=0x7ff21815eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.969+0000 7ff21ccd0640 1 -- 172.21.15.143:0/1538671989 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180b3ad0 con 0x7ff2180cd850 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21ccd0640 1 --2- 172.21.15.143:0/1538671989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff2180cdd10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff208009870 tx=0x7ff20801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582cbd3761c37996 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff20ffff640 1 -- 172.21.15.143:0/1538671989 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080aa670 con 0x7ff2180cd850 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff20ffff640 1 -- 172.21.15.143:0/1538671989 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080aa7d0 con 0x7ff2180cd850 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff20ffff640 1 -- 172.21.15.143:0/1538671989 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080aab60 con 0x7ff2180cd850 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 -- 172.21.15.143:0/1538671989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 msgr2=0x7ff2180cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 --2- 172.21.15.143:0/1538671989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff2180cdd10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff208009870 tx=0x7ff20801c510 comp rx=0 tx=0).stop 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 -- 172.21.15.143:0/1538671989 shutdown_connections 2023-11-24T06:30:04.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 --2- 172.21.15.143:0/1538671989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff2180cdd10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 --2- 172.21.15.143:0/1538671989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff21815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 -- 172.21.15.143:0/1538671989 >> 172.21.15.143:0/1538671989 conn(0x7ff2180b0c80 msgr2=0x7ff2180b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:04.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 -- 172.21.15.143:0/1538671989 shutdown_connections 2023-11-24T06:30:04.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.973+0000 7ff21f735640 1 -- 172.21.15.143:0/1538671989 wait complete. 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 Processor -- start 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 -- start start 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff218154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff218154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2180ce250 0x7ff2181f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180706a0 con 0x7ff2180cd850 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180af410 con 0x7ff2180ce250 2023-11-24T06:30:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180acaa0 con 0x7ff2180ae4a0 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff218154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff218154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41246/0 (socket says 172.21.15.143:41246) 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 -- 172.21.15.143:0/955124285 learned_addr learned my addr 172.21.15.143:0/955124285 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21d4d1640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff218154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21dcd2640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2180ce250 0x7ff2181f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 -- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 msgr2=0x7ff218154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff218154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 -- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2180ce250 msgr2=0x7ff2181f9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2180ce250 0x7ff2181f9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 -- 172.21.15.143:0/955124285 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080094d0 con 0x7ff2180cd850 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21dcd2640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2180ce250 0x7ff2181f9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21ccd0640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff218154c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2080ac040 tx=0x7ff20801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080b3800 con 0x7ff2180cd850 2023-11-24T06:30:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080b3980 con 0x7ff2180cd850 2023-11-24T06:30:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080b3d30 con 0x7ff2180cd850 2023-11-24T06:30:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180acd80 con 0x7ff2180cd850 2023-11-24T06:30:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.977+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2181551c0 con 0x7ff2180cd850 2023-11-24T06:30:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.981+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180cff90 con 0x7ff2180cd850 2023-11-24T06:30:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.981+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2080b2380 con 0x7ff2180cd850 2023-11-24T06:30:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.981+0000 7ff20dffb640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff1fc066470 0x7ff1fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.981+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff20811e7f0 con 0x7ff2180cd850 2023-11-24T06:30:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.981+0000 7ff21d4d1640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff1fc066470 0x7ff1fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.981+0000 7ff21d4d1640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff1fc066470 0x7ff1fc068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff214006aa0 tx=0x7ff214008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:04.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:04.985+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2080ebd10 con 0x7ff2180cd850 2023-11-24T06:30:05.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff21804e8c0 con 0x7ff2180cd850 2023-11-24T06:30:05.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff20dffb640 1 -- 172.21.15.143:0/955124285 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2080ef330 con 0x7ff2180cd850 2023-11-24T06:30:05.146 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:05.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff1fc066470 msgr2=0x7ff1fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff1fc066470 0x7ff1fc068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff214006aa0 tx=0x7ff214008040 comp rx=0 tx=0).stop 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 msgr2=0x7ff218154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff218154c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2080ac040 tx=0x7ff20801ad50 comp rx=0 tx=0).stop 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 shutdown_connections 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff1fc066470 0x7ff1fc068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2180ce250 0x7ff2181f9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2180cd850 0x7ff218154c80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 --2- 172.21.15.143:0/955124285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2180ae4a0 0x7ff218154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 >> 172.21.15.143:0/955124285 conn(0x7ff2180b0c80 msgr2=0x7ff2180af680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 shutdown_connections 2023-11-24T06:30:05.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.141+0000 7ff21f735640 1 -- 172.21.15.143:0/955124285 wait complete. 2023-11-24T06:30:05.167 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:05.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 Processor -- start 2023-11-24T06:30:05.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 -- start start 2023-11-24T06:30:05.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f446015d570 0x7f446006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44600d3020 0x7f44600d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600d39c0 con 0x7f44600ce8b0 2023-11-24T06:30:05.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44600d1cc0 con 0x7f446015d570 2023-11-24T06:30:05.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f4465994640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44600d1fa0 con 0x7f44600d3020 2023-11-24T06:30:05.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f44567fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44600d3020 0x7f44600d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f445effd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f446015d570 0x7f446006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f445f7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f44600ce8b0 0x7f44600ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:60278/0 (socket says 172.21.15.143:60278) 2023-11-24T06:30:05.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f445f7fe640 1 -- 172.21.15.143:0/2266218254 learned_addr learned my addr 172.21.15.143:0/2266218254 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:05.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f44567fc640 1 -- 172.21.15.143:0/2266218254 >> v2:172.21.15.146:3300/0 conn(0x7f446015d570 msgr2=0x7f446006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:05.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f44567fc640 1 --2- 172.21.15.143:0/2266218254 >> v2:172.21.15.146:3300/0 conn(0x7f446015d570 0x7f446006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f44567fc640 1 -- 172.21.15.143:0/2266218254 >> v1:172.21.15.146:6789/0 conn(0x7f44600ce8b0 legacy=0x7f44600ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.301+0000 7f44567fc640 1 -- 172.21.15.143:0/2266218254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600ce0b0 con 0x7f44600d3020 2023-11-24T06:30:05.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f44567fc640 1 --2- 172.21.15.143:0/2266218254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44600d3020 0x7f44600d3480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44500097c0 tx=0x7f445001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6577b5d396a779f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f445e7fc640 1 -- 172.21.15.143:0/2266218254 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500ac640 con 0x7f44600d3020 2023-11-24T06:30:05.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f445e7fc640 1 -- 172.21.15.143:0/2266218254 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500ac7a0 con 0x7f44600d3020 2023-11-24T06:30:05.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f445e7fc640 1 -- 172.21.15.143:0/2266218254 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500acb30 con 0x7f44600d3020 2023-11-24T06:30:05.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 -- 172.21.15.143:0/2266218254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44600d3020 msgr2=0x7f44600d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 --2- 172.21.15.143:0/2266218254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44600d3020 0x7f44600d3480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44500097c0 tx=0x7f445001c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 -- 172.21.15.143:0/2266218254 shutdown_connections 2023-11-24T06:30:05.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 --2- 172.21.15.143:0/2266218254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44600d3020 0x7f44600d3480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 --2- 172.21.15.143:0/2266218254 >> v2:172.21.15.146:3300/0 conn(0x7f446015d570 0x7f446006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 -- 172.21.15.143:0/2266218254 >> 172.21.15.143:0/2266218254 conn(0x7f446008ceb0 msgr2=0x7f446009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:05.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 -- 172.21.15.143:0/2266218254 shutdown_connections 2023-11-24T06:30:05.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.305+0000 7f4465994640 1 -- 172.21.15.143:0/2266218254 wait complete. 2023-11-24T06:30:05.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 Processor -- start 2023-11-24T06:30:05.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 -- start start 2023-11-24T06:30:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44600ce8b0 0x7f44601556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 0x7f44600b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f446015d570 0x7f44600b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600c9be0 con 0x7f44600d3020 2023-11-24T06:30:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4460155bf0 con 0x7f44600ce8b0 2023-11-24T06:30:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f4465994640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446015ca90 con 0x7f446015d570 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 0x7f44600b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 0x7f44600b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41248/0 (socket says 172.21.15.143:41248) 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 -- 172.21.15.143:0/1382669843 learned_addr learned my addr 172.21.15.143:0/1382669843 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f445effd640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44600ce8b0 0x7f44601556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f445f7fe640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f446015d570 0x7f44600b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 -- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f446015d570 msgr2=0x7f44600b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f446015d570 0x7f44600b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 -- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44600ce8b0 msgr2=0x7f44601556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44600ce8b0 0x7f44601556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 -- 172.21.15.143:0/1382669843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009420 con 0x7f44600d3020 2023-11-24T06:30:05.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.309+0000 7f44567fc640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 0x7f44600b1170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f44500af040 tx=0x7f445001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500b8650 con 0x7f44600d3020 2023-11-24T06:30:05.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500b87b0 con 0x7f44600d3020 2023-11-24T06:30:05.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500b8b60 con 0x7f44600d3020 2023-11-24T06:30:05.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44600c9560 con 0x7f44600d3020 2023-11-24T06:30:05.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44600c9800 con 0x7f44600d3020 2023-11-24T06:30:05.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44600c9d20 con 0x7f44600d3020 2023-11-24T06:30:05.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44500b8cc0 con 0x7f44600d3020 2023-11-24T06:30:05.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445cff9640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4440066470 0x7f4440068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f445011e920 con 0x7f44600d3020 2023-11-24T06:30:05.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.313+0000 7f445effd640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4440066470 0x7f4440068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.317+0000 7f445effd640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4440066470 0x7f4440068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4448009b60 tx=0x7f4448009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.317+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44500ebf60 con 0x7f44600d3020 2023-11-24T06:30:05.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.469+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4460067520 con 0x7f44600d3020 2023-11-24T06:30:05.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.469+0000 7f445cff9640 1 -- 172.21.15.143:0/1382669843 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f44500b1090 con 0x7f44600d3020 2023-11-24T06:30:05.474 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:05.475 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:05.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4440066470 msgr2=0x7f4440068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4440066470 0x7f4440068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4448009b60 tx=0x7f4448009190 comp rx=0 tx=0).stop 2023-11-24T06:30:05.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 msgr2=0x7f44600b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 0x7f44600b1170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f44500af040 tx=0x7f445001ac00 comp rx=0 tx=0).stop 2023-11-24T06:30:05.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 shutdown_connections 2023-11-24T06:30:05.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4440066470 0x7f4440068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f446015d570 0x7f44600b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44600d3020 0x7f44600b1170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 --2- 172.21.15.143:0/1382669843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44600ce8b0 0x7f44601556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 >> 172.21.15.143:0/1382669843 conn(0x7f446008ceb0 msgr2=0x7f44600d05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:05.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 shutdown_connections 2023-11-24T06:30:05.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.473+0000 7f4465994640 1 -- 172.21.15.143:0/1382669843 wait complete. 2023-11-24T06:30:05.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:05.497 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:05.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 Processor -- start 2023-11-24T06:30:05.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 -- start start 2023-11-24T06:30:05.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a541624f0 0x7f9a541628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9a540ccef0 0x7f9a54071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a540723c0 con 0x7f9a54071e40 2023-11-24T06:30:05.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a54072980 con 0x7f9a540ccef0 2023-11-24T06:30:05.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a59832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540726a0 con 0x7f9a541624f0 2023-11-24T06:30:05.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a537fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9a54071e40 0x7f9a540cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53556/0 (socket says 172.21.15.143:53556) 2023-11-24T06:30:05.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a537fe640 1 -- 172.21.15.143:0/3445226733 learned_addr learned my addr 172.21.15.143:0/3445226733 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:05.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a4bfff640 1 --2- 172.21.15.143:0/3445226733 >> v2:172.21.15.143:3300/0 conn(0x7f9a540ccef0 0x7f9a54071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a52ffd640 1 --2- 172.21.15.143:0/3445226733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a541624f0 0x7f9a541628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a527fc640 1 -- 172.21.15.143:0/3445226733 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143744668 0 0) 0x7f9a540723c0 con 0x7f9a54071e40 2023-11-24T06:30:05.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a4bfff640 1 -- 172.21.15.143:0/3445226733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a541624f0 msgr2=0x7f9a541628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:05.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a4bfff640 1 --2- 172.21.15.143:0/3445226733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a541624f0 0x7f9a541628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a4bfff640 1 -- 172.21.15.143:0/3445226733 >> v1:172.21.15.143:6789/0 conn(0x7f9a54071e40 legacy=0x7f9a540cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.633+0000 7f9a4bfff640 1 -- 172.21.15.143:0/3445226733 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5406c7e0 con 0x7f9a540ccef0 2023-11-24T06:30:05.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a4bfff640 1 --2- 172.21.15.143:0/3445226733 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54071900 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097c0 tx=0x7f9a3c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e958ebb0f45375a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a527fc640 1 -- 172.21.15.143:0/3445226733 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0ad660 con 0x7f9a540ccef0 2023-11-24T06:30:05.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a527fc640 1 -- 172.21.15.143:0/3445226733 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0ad7c0 con 0x7f9a540ccef0 2023-11-24T06:30:05.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a527fc640 1 -- 172.21.15.143:0/3445226733 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0adb50 con 0x7f9a540ccef0 2023-11-24T06:30:05.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 -- 172.21.15.143:0/3445226733 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 msgr2=0x7f9a54071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 --2- 172.21.15.143:0/3445226733 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54071900 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097c0 tx=0x7f9a3c01c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 -- 172.21.15.143:0/3445226733 shutdown_connections 2023-11-24T06:30:05.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 --2- 172.21.15.143:0/3445226733 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54071900 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 --2- 172.21.15.143:0/3445226733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a541624f0 0x7f9a541628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 -- 172.21.15.143:0/3445226733 >> 172.21.15.143:0/3445226733 conn(0x7f9a540b0c80 msgr2=0x7f9a540b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:05.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 -- 172.21.15.143:0/3445226733 shutdown_connections 2023-11-24T06:30:05.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.637+0000 7f9a59832640 1 -- 172.21.15.143:0/3445226733 wait complete. 2023-11-24T06:30:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 Processor -- start 2023-11-24T06:30:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 -- start start 2023-11-24T06:30:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a54071e40 0x7f9a5415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a541624f0 0x7f9a5415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5415de90 con 0x7f9a540ccef0 2023-11-24T06:30:05.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5409ca10 con 0x7f9a541624f0 2023-11-24T06:30:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5409ccf0 con 0x7f9a54071e40 2023-11-24T06:30:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41272/0 (socket says 172.21.15.143:41272) 2023-11-24T06:30:05.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 -- 172.21.15.143:0/2578400786 learned_addr learned my addr 172.21.15.143:0/2578400786 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a52ffd640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a54071e40 0x7f9a5415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a537fe640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a541624f0 0x7f9a5415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 -- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a54071e40 msgr2=0x7f9a5415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a54071e40 0x7f9a5415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 -- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a541624f0 msgr2=0x7f9a5415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a541624f0 0x7f9a5415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 -- 172.21.15.143:0/2578400786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c009420 con 0x7f9a540ccef0 2023-11-24T06:30:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a52ffd640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a54071e40 0x7f9a5415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a537fe640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a541624f0 0x7f9a5415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a4bfff640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54159140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0b0040 tx=0x7f9a3c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0b6610 con 0x7f9a540ccef0 2023-11-24T06:30:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0b6790 con 0x7f9a540ccef0 2023-11-24T06:30:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0b6b40 con 0x7f9a540ccef0 2023-11-24T06:30:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5409cfd0 con 0x7f9a540ccef0 2023-11-24T06:30:05.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.641+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a540b43f0 con 0x7f9a540ccef0 2023-11-24T06:30:05.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.645+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5415e000 con 0x7f9a540ccef0 2023-11-24T06:30:05.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.645+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a3c0b4040 con 0x7f9a540ccef0 2023-11-24T06:30:05.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.645+0000 7f9a50ff9640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a34066470 0x7f9a34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.645+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a3c11e3c0 con 0x7f9a540ccef0 2023-11-24T06:30:05.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.645+0000 7f9a52ffd640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a34066470 0x7f9a34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.645+0000 7f9a52ffd640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a34066470 0x7f9a34068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a54161b90 tx=0x7f9a44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.649+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a3c0eb8c0 con 0x7f9a540ccef0 2023-11-24T06:30:05.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.801+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a5404e8c0 con 0x7f9a540ccef0 2023-11-24T06:30:05.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.801+0000 7f9a50ff9640 1 -- 172.21.15.143:0/2578400786 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a3c0eeee0 con 0x7f9a540ccef0 2023-11-24T06:30:05.807 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a34066470 msgr2=0x7f9a34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a34066470 0x7f9a34068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a54161b90 tx=0x7f9a44008040 comp rx=0 tx=0).stop 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 msgr2=0x7f9a54159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54159140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0b0040 tx=0x7f9a3c019160 comp rx=0 tx=0).stop 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 shutdown_connections 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a34066470 0x7f9a34068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a541624f0 0x7f9a5415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a540ccef0 0x7f9a54159140 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 --2- 172.21.15.143:0/2578400786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a54071e40 0x7f9a5415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 >> 172.21.15.143:0/2578400786 conn(0x7f9a540b0c80 msgr2=0x7f9a540b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:05.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 shutdown_connections 2023-11-24T06:30:05.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.805+0000 7f9a59832640 1 -- 172.21.15.143:0/2578400786 wait complete. 2023-11-24T06:30:05.828 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:05.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 Processor -- start 2023-11-24T06:30:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 -- start start 2023-11-24T06:30:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff09815d7f0 0x7ff0980d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff09806cce0 0x7ff09806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0980d3c60 con 0x7ff0980d37e0 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09806b980 con 0x7ff09815d7f0 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09e394640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09806d670 con 0x7ff09806cce0 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff097fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff09815d7f0 0x7ff0980d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff0977fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff0980d37e0 0x7ff0980b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53566/0 (socket says 172.21.15.143:53566) 2023-11-24T06:30:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff0977fe640 1 -- 172.21.15.143:0/1992087317 learned_addr learned my addr 172.21.15.143:0/1992087317 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff097fff640 1 -- 172.21.15.143:0/1992087317 >> v2:172.21.15.146:3300/0 conn(0x7ff09806cce0 msgr2=0x7ff09806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09c931640 1 --2- 172.21.15.143:0/1992087317 >> v2:172.21.15.146:3300/0 conn(0x7ff09806cce0 0x7ff09806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff097fff640 1 --2- 172.21.15.143:0/1992087317 >> v2:172.21.15.146:3300/0 conn(0x7ff09806cce0 0x7ff09806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff097fff640 1 -- 172.21.15.143:0/1992087317 >> v1:172.21.15.143:6789/0 conn(0x7ff0980d37e0 legacy=0x7ff0980b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff097fff640 1 -- 172.21.15.143:0/1992087317 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0980b0090 con 0x7ff09815d7f0 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff096ffd640 1 -- 172.21.15.143:0/1992087317 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200254243 0 0) 0x7ff0980d3c60 con 0x7ff0980d37e0 2023-11-24T06:30:05.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.965+0000 7ff09c931640 1 --2- 172.21.15.143:0/1992087317 >> v2:172.21.15.146:3300/0 conn(0x7ff09806cce0 0x7ff09806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:05.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff097fff640 1 --2- 172.21.15.143:0/1992087317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09815d7f0 0x7ff0980d32a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff09808d6b0 tx=0x7ff08801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad8790de8867b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff096ffd640 1 -- 172.21.15.143:0/1992087317 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088004230 con 0x7ff09815d7f0 2023-11-24T06:30:05.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff096ffd640 1 -- 172.21.15.143:0/1992087317 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880a7050 con 0x7ff09815d7f0 2023-11-24T06:30:05.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff096ffd640 1 -- 172.21.15.143:0/1992087317 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088003620 con 0x7ff09815d7f0 2023-11-24T06:30:05.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 -- 172.21.15.143:0/1992087317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09815d7f0 msgr2=0x7ff0980d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 --2- 172.21.15.143:0/1992087317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09815d7f0 0x7ff0980d32a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff09808d6b0 tx=0x7ff08801c460 comp rx=0 tx=0).stop 2023-11-24T06:30:05.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 -- 172.21.15.143:0/1992087317 shutdown_connections 2023-11-24T06:30:05.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 --2- 172.21.15.143:0/1992087317 >> v2:172.21.15.146:3300/0 conn(0x7ff09806cce0 0x7ff09806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 --2- 172.21.15.143:0/1992087317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09815d7f0 0x7ff0980d32a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 -- 172.21.15.143:0/1992087317 >> 172.21.15.143:0/1992087317 conn(0x7ff09809c790 msgr2=0x7ff09808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:05.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 -- 172.21.15.143:0/1992087317 shutdown_connections 2023-11-24T06:30:05.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 -- 172.21.15.143:0/1992087317 wait complete. 2023-11-24T06:30:05.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.969+0000 7ff09e394640 1 Processor -- start 2023-11-24T06:30:05.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- start start 2023-11-24T06:30:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 0x7ff0980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980d37e0 0x7ff0980c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff09815d7f0 0x7ff09814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980b8f60 con 0x7ff09806cce0 2023-11-24T06:30:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09814d3f0 con 0x7ff0980d37e0 2023-11-24T06:30:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0981549a0 con 0x7ff09815d7f0 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 0x7ff0980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 0x7ff0980b8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41288/0 (socket says 172.21.15.143:41288) 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 -- 172.21.15.143:0/3727190504 learned_addr learned my addr 172.21.15.143:0/3727190504 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff0977fe640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980d37e0 0x7ff0980c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09c931640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff09815d7f0 0x7ff09814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 -- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff09815d7f0 msgr2=0x7ff09814f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff09815d7f0 0x7ff09814f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 -- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980d37e0 msgr2=0x7ff0980c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980d37e0 0x7ff0980c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:05.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 -- 172.21.15.143:0/3727190504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009420 con 0x7ff09806cce0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff0977fe640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980d37e0 0x7ff0980c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09c931640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff09815d7f0 0x7ff09814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff097fff640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 0x7ff0980b8a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff088019070 tx=0x7ff088019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088003c70 con 0x7ff09806cce0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff088003dd0 con 0x7ff09806cce0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880ab660 con 0x7ff09806cce0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09814d640 con 0x7ff09806cce0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0980c7240 con 0x7ff09806cce0 2023-11-24T06:30:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.973+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09814daf0 con 0x7ff09806cce0 2023-11-24T06:30:05.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.977+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0880b2040 con 0x7ff09806cce0 2023-11-24T06:30:05.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.977+0000 7ff094ff9640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff084066470 0x7ff084068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:05.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.977+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff08811def0 con 0x7ff09806cce0 2023-11-24T06:30:05.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.977+0000 7ff0977fe640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff084066470 0x7ff084068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:05.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.977+0000 7ff0977fe640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff084066470 0x7ff084068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0980c9870 tx=0x7ff08c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:05.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:05.981+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0880eb2d0 con 0x7ff09806cce0 2023-11-24T06:30:06.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff09804e8c0 con 0x7ff09806cce0 2023-11-24T06:30:06.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff094ff9640 1 -- 172.21.15.143:0/3727190504 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0880ee8f0 con 0x7ff09806cce0 2023-11-24T06:30:06.138 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff084066470 msgr2=0x7ff084068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff084066470 0x7ff084068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0980c9870 tx=0x7ff08c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 msgr2=0x7ff0980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 0x7ff0980b8a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff088019070 tx=0x7ff088019200 comp rx=0 tx=0).stop 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 shutdown_connections 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff084066470 0x7ff084068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff09815d7f0 0x7ff09814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980d37e0 0x7ff0980c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 --2- 172.21.15.143:0/3727190504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09806cce0 0x7ff0980b8a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 >> 172.21.15.143:0/3727190504 conn(0x7ff09809c790 msgr2=0x7ff0980cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:06.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 shutdown_connections 2023-11-24T06:30:06.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.133+0000 7ff09e394640 1 -- 172.21.15.143:0/3727190504 wait complete. 2023-11-24T06:30:06.159 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:06.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.293+0000 7f305f279640 1 Processor -- start 2023-11-24T06:30:06.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305f279640 1 -- start start 2023-11-24T06:30:06.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305f279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f305815a290 0x7f30580707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305f279640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3058071170 con 0x7f305815ec60 2023-11-24T06:30:06.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305f279640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580cb690 con 0x7f30580b1f80 2023-11-24T06:30:06.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305f279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580cb970 con 0x7f305815a290 2023-11-24T06:30:06.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305c814640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f305815ec60 0x7f30580cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53576/0 (socket says 172.21.15.143:53576) 2023-11-24T06:30:06.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305c814640 1 -- 172.21.15.143:0/1974993213 learned_addr learned my addr 172.21.15.143:0/1974993213 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:06.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305d015640 1 --2- 172.21.15.143:0/1974993213 >> v2:172.21.15.143:3300/0 conn(0x7f305815a290 0x7f30580707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305d015640 1 -- 172.21.15.143:0/1974993213 >> v1:172.21.15.146:6789/0 conn(0x7f30580b1f80 legacy=0x7f305806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f304ffff640 1 -- 172.21.15.143:0/1974993213 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433106769 0 0) 0x7f3058071170 con 0x7f305815ec60 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305d015640 1 -- 172.21.15.143:0/1974993213 >> v1:172.21.15.143:6789/0 conn(0x7f305815ec60 legacy=0x7f30580cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.297+0000 7f305d015640 1 -- 172.21.15.143:0/1974993213 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580cbc50 con 0x7f305815a290 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305d015640 1 --2- 172.21.15.143:0/1974993213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f305815a290 0x7f30580707f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30540097c0 tx=0x7f305401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96bcd5c23433229 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f304ffff640 1 -- 172.21.15.143:0/1974993213 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540ab610 con 0x7f305815a290 2023-11-24T06:30:06.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f304ffff640 1 -- 172.21.15.143:0/1974993213 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540ab770 con 0x7f305815a290 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f304ffff640 1 -- 172.21.15.143:0/1974993213 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540abb00 con 0x7f305815a290 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 -- 172.21.15.143:0/1974993213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f305815a290 msgr2=0x7f30580707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 --2- 172.21.15.143:0/1974993213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f305815a290 0x7f30580707f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30540097c0 tx=0x7f305401c3f0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 -- 172.21.15.143:0/1974993213 shutdown_connections 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 --2- 172.21.15.143:0/1974993213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f305815a290 0x7f30580707f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 -- 172.21.15.143:0/1974993213 >> 172.21.15.143:0/1974993213 conn(0x7f30580b0c80 msgr2=0x7f30580b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 -- 172.21.15.143:0/1974993213 shutdown_connections 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 -- 172.21.15.143:0/1974993213 wait complete. 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 Processor -- start 2023-11-24T06:30:06.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.301+0000 7f305f279640 1 -- start start 2023-11-24T06:30:06.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 0x7f3058154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305815a290 0x7f3058153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305815ec60 0x7f305814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058153aa0 con 0x7f30580b1f80 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058153cd0 con 0x7f305815ec60 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3058153fb0 con 0x7f305815a290 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 0x7f3058154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 0x7f3058154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41306/0 (socket says 172.21.15.143:41306) 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 -- 172.21.15.143:0/3305090237 learned_addr learned my addr 172.21.15.143:0/3305090237 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305c814640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305815a290 0x7f3058153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d816640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305815ec60 0x7f305814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 -- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305815a290 msgr2=0x7f3058153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305815a290 0x7f3058153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 -- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305815ec60 msgr2=0x7f305814f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305815ec60 0x7f305814f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 -- 172.21.15.143:0/3305090237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054009420 con 0x7f30580b1f80 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305d015640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 0x7f3058154f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f30540ad040 tx=0x7f305401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540b5810 con 0x7f30580b1f80 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540b59b0 con 0x7f30580b1f80 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540b5d60 con 0x7f30580b1f80 2023-11-24T06:30:06.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3058070f40 con 0x7f30580b1f80 2023-11-24T06:30:06.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058154570 con 0x7f30580b1f80 2023-11-24T06:30:06.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.305+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305804e8c0 con 0x7f30580b1f80 2023-11-24T06:30:06.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.309+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30540b4390 con 0x7f30580b1f80 2023-11-24T06:30:06.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.309+0000 7f304dffb640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f303c066470 0x7f303c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.309+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f305411ea00 con 0x7f30580b1f80 2023-11-24T06:30:06.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.309+0000 7f305c814640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f303c066470 0x7f303c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.309+0000 7f305c814640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f303c066470 0x7f303c068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3058067a00 tx=0x7f3048007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.313+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30540ebde0 con 0x7f30580b1f80 2023-11-24T06:30:06.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.461+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30580b18e0 con 0x7f30580b1f80 2023-11-24T06:30:06.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.461+0000 7f304dffb640 1 -- 172.21.15.143:0/3305090237 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30540ef400 con 0x7f30580b1f80 2023-11-24T06:30:06.468 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:06.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f303c066470 msgr2=0x7f303c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f303c066470 0x7f303c068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3058067a00 tx=0x7f3048007d10 comp rx=0 tx=0).stop 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 msgr2=0x7f3058154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 0x7f3058154f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f30540ad040 tx=0x7f305401ac30 comp rx=0 tx=0).stop 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 shutdown_connections 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f303c066470 0x7f303c068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305815ec60 0x7f305814f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305815a290 0x7f3058153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 --2- 172.21.15.143:0/3305090237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30580b1f80 0x7f3058154f90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 >> 172.21.15.143:0/3305090237 conn(0x7f30580b0c80 msgr2=0x7f3058073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 shutdown_connections 2023-11-24T06:30:06.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.465+0000 7f305f279640 1 -- 172.21.15.143:0/3305090237 wait complete. 2023-11-24T06:30:06.489 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:06.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3f832640 1 Processor -- start 2023-11-24T06:30:06.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3f832640 1 -- start start 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3f832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3f832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380cd7b0 con 0x7f6a38061430 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3f832640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380b2cc0 con 0x7f6a380b28e0 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3f832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3806ee20 con 0x7f6a38060fd0 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3ddcf640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6a38061430 0x7f6a3806d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53592/0 (socket says 172.21.15.143:53592) 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3ddcf640 1 -- 172.21.15.143:0/3770267090 learned_addr learned my addr 172.21.15.143:0/3770267090 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.621+0000 7f6a3cdcd640 1 --2- 172.21.15.143:0/3770267090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016614386 0 0) 0x7f6a380cd7b0 con 0x7f6a38061430 2023-11-24T06:30:06.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a24003530 con 0x7f6a38061430 2023-11-24T06:30:06.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422922633 0 0) 0x7f6a34001120 con 0x7f6a380b28e0 2023-11-24T06:30:06.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a380cd7b0 con 0x7f6a380b28e0 2023-11-24T06:30:06.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/3770267090 >> v1:172.21.15.146:6789/0 conn(0x7f6a380b28e0 legacy=0x7f6a3806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/3770267090 >> v1:172.21.15.143:6789/0 conn(0x7f6a38061430 legacy=0x7f6a3806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/3770267090 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3806cc20 con 0x7f6a38060fd0 2023-11-24T06:30:06.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a3cdcd640 1 --2- 172.21.15.143:0/3770267090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38070ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a280097f0 tx=0x7f6a2801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=356f36dddb3a3048 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28004230 con 0x7f6a38060fd0 2023-11-24T06:30:06.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a280a7050 con 0x7f6a38060fd0 2023-11-24T06:30:06.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.625+0000 7f6a2ffff640 1 -- 172.21.15.143:0/3770267090 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28003620 con 0x7f6a38060fd0 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- 172.21.15.143:0/3770267090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 msgr2=0x7f6a38070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 --2- 172.21.15.143:0/3770267090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38070ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a280097f0 tx=0x7f6a2801c4c0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- 172.21.15.143:0/3770267090 shutdown_connections 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 --2- 172.21.15.143:0/3770267090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38070ea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- 172.21.15.143:0/3770267090 >> 172.21.15.143:0/3770267090 conn(0x7f6a380cc330 msgr2=0x7f6a380cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- 172.21.15.143:0/3770267090 shutdown_connections 2023-11-24T06:30:06.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- 172.21.15.143:0/3770267090 wait complete. 2023-11-24T06:30:06.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 Processor -- start 2023-11-24T06:30:06.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- start start 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 0x7f6a380c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a380b28e0 0x7f6a381f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381448c0 con 0x7f6a38061430 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38155870 con 0x7f6a380b28e0 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3f832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380c4d90 con 0x7f6a38060fd0 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 0x7f6a380c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 0x7f6a380c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41322/0 (socket says 172.21.15.143:41322) 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/248995825 learned_addr learned my addr 172.21.15.143:0/248995825 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3ddcf640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a380b28e0 0x7f6a381f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3d5ce640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 msgr2=0x7f6a38144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38144380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a380b28e0 msgr2=0x7f6a381f65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.629+0000 7f6a3cdcd640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a380b28e0 0x7f6a381f65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a3cdcd640 1 -- 172.21.15.143:0/248995825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009420 con 0x7f6a38061430 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a3cdcd640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 0x7f6a380c4850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009740 tx=0x7f6a28019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28003a30 con 0x7f6a38061430 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28003b90 con 0x7f6a38061430 2023-11-24T06:30:06.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a280ab440 con 0x7f6a38061430 2023-11-24T06:30:06.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a381f7010 con 0x7f6a38061430 2023-11-24T06:30:06.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a381f75d0 con 0x7f6a38061430 2023-11-24T06:30:06.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a381f77c0 con 0x7f6a38061430 2023-11-24T06:30:06.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a280b2040 con 0x7f6a38061430 2023-11-24T06:30:06.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a2dffb640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a1c066470 0x7f6a1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a2811d980 con 0x7f6a38061430 2023-11-24T06:30:06.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.633+0000 7f6a3d5ce640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a1c066470 0x7f6a1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.637+0000 7f6a3d5ce640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a1c066470 0x7f6a1c068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a34001380 tx=0x7f6a34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.637+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a280eae10 con 0x7f6a38061430 2023-11-24T06:30:06.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.789+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a38067520 con 0x7f6a38061430 2023-11-24T06:30:06.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.789+0000 7f6a2dffb640 1 -- 172.21.15.143:0/248995825 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f6a280b0020 con 0x7f6a38061430 2023-11-24T06:30:06.795 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:06.795 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:06.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a1c066470 msgr2=0x7f6a1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a1c066470 0x7f6a1c068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a34001380 tx=0x7f6a34009040 comp rx=0 tx=0).stop 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 msgr2=0x7f6a380c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 0x7f6a380c4850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009740 tx=0x7f6a28019260 comp rx=0 tx=0).stop 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 shutdown_connections 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a1c066470 0x7f6a1c068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a380b28e0 0x7f6a381f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a38061430 0x7f6a380c4850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 --2- 172.21.15.143:0/248995825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a38060fd0 0x7f6a38144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 >> 172.21.15.143:0/248995825 conn(0x7f6a380cc330 msgr2=0x7f6a380b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:06.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 shutdown_connections 2023-11-24T06:30:06.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.793+0000 7f6a3f832640 1 -- 172.21.15.143:0/248995825 wait complete. 2023-11-24T06:30:06.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:06.817 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:06.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 Processor -- start 2023-11-24T06:30:06.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 -- start start 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600ae4a0 0x7f4d6015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d600ce420 0x7f4d6006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600b3510 con 0x7f4d600cd850 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600b37f0 con 0x7f4d600ce420 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d65ba1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600b3ad0 con 0x7f4d600ae4a0 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d57fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4d600cd850 0x7f4d600cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53602/0 (socket says 172.21.15.143:53602) 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d57fff640 1 -- 172.21.15.143:0/640687261 learned_addr learned my addr 172.21.15.143:0/640687261 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5f7fe640 1 --2- 172.21.15.143:0/640687261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600ae4a0 0x7f4d6015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5ffff640 1 --2- 172.21.15.143:0/640687261 >> v2:172.21.15.146:3300/0 conn(0x7f4d600ce420 0x7f4d6006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5effd640 1 -- 172.21.15.143:0/640687261 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696468073 0 0) 0x7f4d600b3510 con 0x7f4d600cd850 2023-11-24T06:30:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5effd640 1 -- 172.21.15.143:0/640687261 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d4c003530 con 0x7f4d600cd850 2023-11-24T06:30:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/640687261 >> v2:172.21.15.146:3300/0 conn(0x7f4d600ce420 msgr2=0x7f4d6006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5f7fe640 1 --2- 172.21.15.143:0/640687261 >> v2:172.21.15.146:3300/0 conn(0x7f4d600ce420 0x7f4d6006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/640687261 >> v1:172.21.15.143:6789/0 conn(0x7f4d600cd850 legacy=0x7f4d600cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.953+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/640687261 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600b3db0 con 0x7f4d600ae4a0 2023-11-24T06:30:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d5f7fe640 1 --2- 172.21.15.143:0/640687261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600ae4a0 0x7f4d6015ba00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d500097c0 tx=0x7f4d5001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322d478a2cb302a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d5effd640 1 -- 172.21.15.143:0/640687261 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500ab670 con 0x7f4d600ae4a0 2023-11-24T06:30:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d5effd640 1 -- 172.21.15.143:0/640687261 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d500ab7d0 con 0x7f4d600ae4a0 2023-11-24T06:30:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d5effd640 1 -- 172.21.15.143:0/640687261 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500abb60 con 0x7f4d600ae4a0 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 -- 172.21.15.143:0/640687261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600ae4a0 msgr2=0x7f4d6015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/640687261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600ae4a0 0x7f4d6015ba00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d500097c0 tx=0x7f4d5001c450 comp rx=0 tx=0).stop 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 -- 172.21.15.143:0/640687261 shutdown_connections 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/640687261 >> v2:172.21.15.146:3300/0 conn(0x7f4d600ce420 0x7f4d6006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/640687261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600ae4a0 0x7f4d6015ba00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 -- 172.21.15.143:0/640687261 >> 172.21.15.143:0/640687261 conn(0x7f4d600b0c80 msgr2=0x7f4d600b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 -- 172.21.15.143:0/640687261 shutdown_connections 2023-11-24T06:30:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.957+0000 7f4d65ba1640 1 -- 172.21.15.143:0/640687261 wait complete. 2023-11-24T06:30:06.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 Processor -- start 2023-11-24T06:30:06.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- start start 2023-11-24T06:30:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 0x7f4d600adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600cd850 0x7f4d60149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d600ce420 0x7f4d600afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600ae0d0 con 0x7f4d600ae4a0 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600abf60 con 0x7f4d600ce420 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600ac1b0 con 0x7f4d600cd850 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 0x7f4d600adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 0x7f4d600adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41328/0 (socket says 172.21.15.143:41328) 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/1065434793 learned_addr learned my addr 172.21.15.143:0/1065434793 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d57fff640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600cd850 0x7f4d60149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5ffff640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d600ce420 0x7f4d600afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600cd850 msgr2=0x7f4d60149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600cd850 0x7f4d60149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d600ce420 msgr2=0x7f4d600afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d600ce420 0x7f4d600afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 -- 172.21.15.143:0/1065434793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50009420 con 0x7f4d600ae4a0 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5f7fe640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 0x7f4d600adb90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d500ad040 tx=0x7f4d5001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500bf610 con 0x7f4d600ae4a0 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d500bf790 con 0x7f4d600ae4a0 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d600ac490 con 0x7f4d600ae4a0 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500bfb40 con 0x7f4d600ae4a0 2023-11-24T06:30:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d600aca50 con 0x7f4d600ae4a0 2023-11-24T06:30:06.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.961+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6004e8c0 con 0x7f4d600ae4a0 2023-11-24T06:30:06.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.965+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d500bfca0 con 0x7f4d600ae4a0 2023-11-24T06:30:06.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.965+0000 7f4d5cff9640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d40066470 0x7f4d40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:06.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.965+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d5011ea50 con 0x7f4d600ae4a0 2023-11-24T06:30:06.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.965+0000 7f4d57fff640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d40066470 0x7f4d40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:06.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.965+0000 7f4d57fff640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d40066470 0x7f4d40068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d60154c90 tx=0x7f4d48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:06.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:06.969+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d500ebed0 con 0x7f4d600ae4a0 2023-11-24T06:30:07.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d6014a260 con 0x7f4d600ae4a0 2023-11-24T06:30:07.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d5cff9640 1 -- 172.21.15.143:0/1065434793 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d500ef4f0 con 0x7f4d600ae4a0 2023-11-24T06:30:07.126 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d40066470 msgr2=0x7f4d40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d40066470 0x7f4d40068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d60154c90 tx=0x7f4d48009040 comp rx=0 tx=0).stop 2023-11-24T06:30:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 msgr2=0x7f4d600adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 0x7f4d600adb90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d500ad040 tx=0x7f4d5001ac90 comp rx=0 tx=0).stop 2023-11-24T06:30:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 shutdown_connections 2023-11-24T06:30:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d40066470 0x7f4d40068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d600ce420 0x7f4d600afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d600cd850 0x7f4d60149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 --2- 172.21.15.143:0/1065434793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d600ae4a0 0x7f4d600adb90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 >> 172.21.15.143:0/1065434793 conn(0x7f4d600b0c80 msgr2=0x7f4d601551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 shutdown_connections 2023-11-24T06:30:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.121+0000 7f4d65ba1640 1 -- 172.21.15.143:0/1065434793 wait complete. 2023-11-24T06:30:07.148 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:07.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 Processor -- start 2023-11-24T06:30:07.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 -- start start 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3c40cd850 0x7fc3c40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40b3510 con 0x7fc3c40ce250 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40ce6e0 con 0x7fc3c40cd850 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3cae79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40b37f0 con 0x7fc3c40ae4a0 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3c40cd850 0x7fc3c40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3c40cd850 0x7fc3c40cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41342/0 (socket says 172.21.15.143:41342) 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 -- 172.21.15.143:0/3346398095 learned_addr learned my addr 172.21.15.143:0/3346398095 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:07.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c8c15640 1 --2- 172.21.15.143:0/3346398095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 -- 172.21.15.143:0/3346398095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 msgr2=0x7fc3c415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:07.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 --2- 172.21.15.143:0/3346398095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 -- 172.21.15.143:0/3346398095 >> v1:172.21.15.146:6789/0 conn(0x7fc3c40ce250 legacy=0x7fc3c415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.285+0000 7fc3c3fff640 1 -- 172.21.15.143:0/3346398095 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40b3ad0 con 0x7fc3c40cd850 2023-11-24T06:30:07.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3c3fff640 1 --2- 172.21.15.143:0/3346398095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c40cdd10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009870 tx=0x7fc3b001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd830a815650eff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:07.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3c37fe640 1 -- 172.21.15.143:0/3346398095 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00aa670 con 0x7fc3c40cd850 2023-11-24T06:30:07.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3c37fe640 1 -- 172.21.15.143:0/3346398095 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00aa7d0 con 0x7fc3c40cd850 2023-11-24T06:30:07.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3c37fe640 1 -- 172.21.15.143:0/3346398095 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00aab60 con 0x7fc3c40cd850 2023-11-24T06:30:07.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 -- 172.21.15.143:0/3346398095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 msgr2=0x7fc3c40cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 --2- 172.21.15.143:0/3346398095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c40cdd10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009870 tx=0x7fc3b001c510 comp rx=0 tx=0).stop 2023-11-24T06:30:07.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 -- 172.21.15.143:0/3346398095 shutdown_connections 2023-11-24T06:30:07.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 --2- 172.21.15.143:0/3346398095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c40cdd10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 --2- 172.21.15.143:0/3346398095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 -- 172.21.15.143:0/3346398095 >> 172.21.15.143:0/3346398095 conn(0x7fc3c40b0c80 msgr2=0x7fc3c40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:07.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 -- 172.21.15.143:0/3346398095 shutdown_connections 2023-11-24T06:30:07.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 -- 172.21.15.143:0/3346398095 wait complete. 2023-11-24T06:30:07.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 Processor -- start 2023-11-24T06:30:07.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.289+0000 7fc3cae79640 1 -- start start 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c40ce250 0x7fc3c414bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4154510 con 0x7fc3c40cd850 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4148cd0 con 0x7fc3c40ce250 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41491c0 con 0x7fc3c40ae4a0 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c414b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41344/0 (socket says 172.21.15.143:41344) 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 -- 172.21.15.143:0/1595363720 learned_addr learned my addr 172.21.15.143:0/1595363720 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c9416640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c40ce250 0x7fc3c414bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c8c15640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 -- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 msgr2=0x7fc3c415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 -- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c40ce250 msgr2=0x7fc3c414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c40ce250 0x7fc3c414bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 -- 172.21.15.143:0/1595363720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00094d0 con 0x7fc3c40cd850 2023-11-24T06:30:07.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c3fff640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c414b5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00ac040 tx=0x7fc3b001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:07.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00b3800 con 0x7fc3c40cd850 2023-11-24T06:30:07.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00b3980 con 0x7fc3c40cd850 2023-11-24T06:30:07.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00b3d30 con 0x7fc3c40cd850 2023-11-24T06:30:07.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c4153e90 con 0x7fc3c40cd850 2023-11-24T06:30:07.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c4154130 con 0x7fc3c40cd850 2023-11-24T06:30:07.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.293+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c40991e0 con 0x7fc3c40cd850 2023-11-24T06:30:07.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.297+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3b00c6440 con 0x7fc3c40cd850 2023-11-24T06:30:07.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.297+0000 7fc3c17fa640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc3a80664a0 0x7fc3a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.297+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3b011eb60 con 0x7fc3c40cd850 2023-11-24T06:30:07.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.297+0000 7fc3c8c15640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc3a80664a0 0x7fc3a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.297+0000 7fc3c8c15640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc3a80664a0 0x7fc3a8068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009b60 tx=0x7fc3b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:07.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.301+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3c40991e0 con 0x7fc3c40cd850 2023-11-24T06:30:07.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.449+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3c40991e0 con 0x7fc3c40cd850 2023-11-24T06:30:07.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3c17fa640 1 -- 172.21.15.143:0/1595363720 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3c40991e0 con 0x7fc3c40cd850 2023-11-24T06:30:07.457 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:07.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc3a80664a0 msgr2=0x7fc3a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc3a80664a0 0x7fc3a8068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009b60 tx=0x7fc3b8009190 comp rx=0 tx=0).stop 2023-11-24T06:30:07.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 msgr2=0x7fc3c414b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c414b5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00ac040 tx=0x7fc3b001ad50 comp rx=0 tx=0).stop 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 shutdown_connections 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc3a80664a0 0x7fc3a8068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c40ce250 0x7fc3c414bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3c40cd850 0x7fc3c414b5d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 --2- 172.21.15.143:0/1595363720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3c40ae4a0 0x7fc3c415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 >> 172.21.15.143:0/1595363720 conn(0x7fc3c40b0c80 msgr2=0x7fc3c40cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 shutdown_connections 2023-11-24T06:30:07.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.453+0000 7fc3cae79640 1 -- 172.21.15.143:0/1595363720 wait complete. 2023-11-24T06:30:07.477 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:07.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6783832640 1 Processor -- start 2023-11-24T06:30:07.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6783832640 1 -- start start 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6783832640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f677c0ce420 0x7f677c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6783832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0b3510 con 0x7f677c0ae4a0 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6783832640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0b37f0 con 0x7f677c0cd850 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6783832640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c0b3ad0 con 0x7f677c0ce420 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f67815ce640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f677c0ae4a0 0x7f677c0cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56264/0 (socket says 172.21.15.143:56264) 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f67815ce640 1 -- 172.21.15.143:0/928262268 learned_addr learned my addr 172.21.15.143:0/928262268 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:07.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6780dcd640 1 --2- 172.21.15.143:0/928262268 >> v2:172.21.15.143:3300/0 conn(0x7f677c0ce420 0x7f677c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6773fff640 1 -- 172.21.15.143:0/928262268 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499840847 0 0) 0x7f677c0b3510 con 0x7f677c0ae4a0 2023-11-24T06:30:07.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6773fff640 1 -- 172.21.15.143:0/928262268 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6768003530 con 0x7f677c0ae4a0 2023-11-24T06:30:07.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6780dcd640 1 -- 172.21.15.143:0/928262268 >> v1:172.21.15.146:6789/0 conn(0x7f677c0cd850 legacy=0x7f677c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6780dcd640 1 -- 172.21.15.143:0/928262268 >> v1:172.21.15.143:6789/0 conn(0x7f677c0ae4a0 legacy=0x7f677c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.613+0000 7f6780dcd640 1 -- 172.21.15.143:0/928262268 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c0b3db0 con 0x7f677c0ce420 2023-11-24T06:30:07.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6780dcd640 1 --2- 172.21.15.143:0/928262268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c15ba00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf28bddfbb174b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:07.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6773fff640 1 -- 172.21.15.143:0/928262268 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0ab670 con 0x7f677c0ce420 2023-11-24T06:30:07.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6773fff640 1 -- 172.21.15.143:0/928262268 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c0ab7d0 con 0x7f677c0ce420 2023-11-24T06:30:07.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6773fff640 1 -- 172.21.15.143:0/928262268 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0abb60 con 0x7f677c0ce420 2023-11-24T06:30:07.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 -- 172.21.15.143:0/928262268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 msgr2=0x7f677c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 --2- 172.21.15.143:0/928262268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c15ba00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c01c450 comp rx=0 tx=0).stop 2023-11-24T06:30:07.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 -- 172.21.15.143:0/928262268 shutdown_connections 2023-11-24T06:30:07.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 --2- 172.21.15.143:0/928262268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c15ba00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 -- 172.21.15.143:0/928262268 >> 172.21.15.143:0/928262268 conn(0x7f677c0b0c80 msgr2=0x7f677c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:07.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 -- 172.21.15.143:0/928262268 shutdown_connections 2023-11-24T06:30:07.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.617+0000 7f6783832640 1 -- 172.21.15.143:0/928262268 wait complete. 2023-11-24T06:30:07.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 Processor -- start 2023-11-24T06:30:07.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 -- start start 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f677c0ae4a0 0x7f677c14e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f677c0cd850 0x7f677c09a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c14eb20 con 0x7f677c0ce420 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c155b00 con 0x7f677c0cd850 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0714c0 con 0x7f677c0ae4a0 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52818/0 (socket says 172.21.15.143:52818) 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 -- 172.21.15.143:0/1250740952 learned_addr learned my addr 172.21.15.143:0/1250740952 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6780dcd640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f677c0cd850 0x7f677c09a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f67815ce640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f677c0ae4a0 0x7f677c14e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 -- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f677c0ae4a0 msgr2=0x7f677c14e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f677c0ae4a0 0x7f677c14e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 -- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f677c0cd850 msgr2=0x7f677c09a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f677c0cd850 0x7f677c09a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 -- 172.21.15.143:0/1250740952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c009420 con 0x7f677c0ce420 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6780dcd640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f677c0cd850 0x7f677c09a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:07.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6781dcf640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c153620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f677400c7d0 tx=0x7f677400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:07.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774003b80 con 0x7f677c0ce420 2023-11-24T06:30:07.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774003ce0 con 0x7f677c0ce420 2023-11-24T06:30:07.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400aa30 con 0x7f677c0ce420 2023-11-24T06:30:07.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c071190 con 0x7f677c0ce420 2023-11-24T06:30:07.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.621+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c155820 con 0x7f677c0ce420 2023-11-24T06:30:07.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.625+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c070ff0 con 0x7f677c0ce420 2023-11-24T06:30:07.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.625+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f677400ab90 con 0x7f677c0ce420 2023-11-24T06:30:07.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.625+0000 7f6771ffb640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67600664a0 0x7f6760068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:07.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.625+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6774083b90 con 0x7f677c0ce420 2023-11-24T06:30:07.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.625+0000 7f67815ce640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67600664a0 0x7f6760068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:07.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.625+0000 7f67815ce640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67600664a0 0x7f6760068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67780011f0 tx=0x7f6778007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:07.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.629+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f677c070ff0 con 0x7f677c0ce420 2023-11-24T06:30:07.783 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.777+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f677c070ff0 con 0x7f677c0ce420 2023-11-24T06:30:07.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.777+0000 7f6771ffb640 1 -- 172.21.15.143:0/1250740952 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f677c070ff0 con 0x7f677c0ce420 2023-11-24T06:30:07.784 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67600664a0 msgr2=0x7f6760068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67600664a0 0x7f6760068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67780011f0 tx=0x7f6778007d40 comp rx=0 tx=0).stop 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 msgr2=0x7f677c153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c153620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f677400c7d0 tx=0x7f677400cc90 comp rx=0 tx=0).stop 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 shutdown_connections 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67600664a0 0x7f6760068960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0ce420 0x7f677c153620 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f677c0cd850 0x7f677c09a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 --2- 172.21.15.143:0/1250740952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f677c0ae4a0 0x7f677c14e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:07.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 >> 172.21.15.143:0/1250740952 conn(0x7f677c0b0c80 msgr2=0x7f677c15ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:07.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 shutdown_connections 2023-11-24T06:30:07.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:07.781+0000 7f6783832640 1 -- 172.21.15.143:0/1250740952 wait complete. 2023-11-24T06:30:07.871 INFO:tasks.cephfs_test_runner:Starting test: test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-11-24T06:30:07.871 INFO:tasks.cephfs_test_runner:test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-11-24T06:30:07.871 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-11-24T06:30:07.872 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-11-24T06:30:07.873 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:08.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 Processor -- start 2023-11-24T06:30:08.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 -- start start 2023-11-24T06:30:08.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f156815d570 0x7f156806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15680ce8b0 0x7f15680ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15680d1cc0 con 0x7f15680d3020 2023-11-24T06:30:08.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680d1fa0 con 0x7f156815d570 2023-11-24T06:30:08.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156fb2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15680ce0b0 con 0x7f15680ce8b0 2023-11-24T06:30:08.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f156815d570 0x7f156806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f156815d570 0x7f156806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52822/0 (socket says 172.21.15.143:52822) 2023-11-24T06:30:08.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 -- 172.21.15.143:0/3640241884 learned_addr learned my addr 172.21.15.143:0/3640241884 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:08.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156e0c7640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15680ce8b0 0x7f15680ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 -- 172.21.15.143:0/3640241884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15680ce8b0 msgr2=0x7f15680ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:08.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15680ce8b0 0x7f15680ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 -- 172.21.15.143:0/3640241884 >> v1:172.21.15.146:6789/0 conn(0x7f15680d3020 legacy=0x7f15680d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:08.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156d8c6640 1 -- 172.21.15.143:0/3640241884 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15680ce390 con 0x7f156815d570 2023-11-24T06:30:08.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.005+0000 7f156e0c7640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15680ce8b0 0x7f15680ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:08.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156d8c6640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f156815d570 0x7f156806b9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1564009870 tx=0x7f156401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d38773957574fef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156c8c4640 1 -- 172.21.15.143:0/3640241884 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640aa610 con 0x7f156815d570 2023-11-24T06:30:08.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156c8c4640 1 -- 172.21.15.143:0/3640241884 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15640a6040 con 0x7f156815d570 2023-11-24T06:30:08.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156c8c4640 1 -- 172.21.15.143:0/3640241884 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640aa990 con 0x7f156815d570 2023-11-24T06:30:08.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 -- 172.21.15.143:0/3640241884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f156815d570 msgr2=0x7f156806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f156815d570 0x7f156806b9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1564009870 tx=0x7f156401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 -- 172.21.15.143:0/3640241884 shutdown_connections 2023-11-24T06:30:08.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15680ce8b0 0x7f15680ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 --2- 172.21.15.143:0/3640241884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f156815d570 0x7f156806b9d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 -- 172.21.15.143:0/3640241884 >> 172.21.15.143:0/3640241884 conn(0x7f156808ceb0 msgr2=0x7f156809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:08.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 -- 172.21.15.143:0/3640241884 shutdown_connections 2023-11-24T06:30:08.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.009+0000 7f156fb2a640 1 -- 172.21.15.143:0/3640241884 wait complete. 2023-11-24T06:30:08.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 Processor -- start 2023-11-24T06:30:08.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 -- start start 2023-11-24T06:30:08.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15680ce8b0 0x7f15680b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 0x7f156815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f156815d570 0x7f156814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680cbde0 con 0x7f15680d3020 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156815c950 con 0x7f15680ce8b0 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156814c4c0 con 0x7f156815d570 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 0x7f156815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 0x7f156815c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52834/0 (socket says 172.21.15.143:52834) 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 -- 172.21.15.143:0/630490328 learned_addr learned my addr 172.21.15.143:0/630490328 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156e0c7640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f156815d570 0x7f156814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d8c6640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15680ce8b0 0x7f15680b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 -- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f156815d570 msgr2=0x7f156814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f156815d570 0x7f156814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 -- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15680ce8b0 msgr2=0x7f15680b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15680ce8b0 0x7f15680b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 -- 172.21.15.143:0/630490328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640094d0 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156d0c5640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 0x7f156815c410 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f155800c410 tx=0x7f155800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558011790 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15580118f0 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558011ca0 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15680ccc30 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.013+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15680cc5e0 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.017+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15680ccdc0 con 0x7f15680d3020 2023-11-24T06:30:08.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.017+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f155801c460 con 0x7f15680d3020 2023-11-24T06:30:08.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.017+0000 7f155e7fc640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f154c066470 0x7f154c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.017+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15580839e0 con 0x7f15680d3020 2023-11-24T06:30:08.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.017+0000 7f156d8c6640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f154c066470 0x7f154c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.017+0000 7f156d8c6640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f154c066470 0x7f154c068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15640ae000 tx=0x7f15640b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.021+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1558050f80 con 0x7f15680d3020 2023-11-24T06:30:08.172 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:30:08.176 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:30:08.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.173+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1568067520 con 0x7f15680d3020 2023-11-24T06:30:08.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f155e7fc640 1 -- 172.21.15.143:0/630490328 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f15580545a0 con 0x7f15680d3020 2023-11-24T06:30:08.181 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:08.181 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:08.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f154c066470 msgr2=0x7f154c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f154c066470 0x7f154c068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15640ae000 tx=0x7f15640b5040 comp rx=0 tx=0).stop 2023-11-24T06:30:08.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 msgr2=0x7f156815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 0x7f156815c410 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f155800c410 tx=0x7f155800c8d0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 shutdown_connections 2023-11-24T06:30:08.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f154c066470 0x7f154c068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f156815d570 0x7f156814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15680d3020 0x7f156815c410 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 --2- 172.21.15.143:0/630490328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15680ce8b0 0x7f15680b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 >> 172.21.15.143:0/630490328 conn(0x7f156808ceb0 msgr2=0x7f15680c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:08.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 shutdown_connections 2023-11-24T06:30:08.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.177+0000 7f156fb2a640 1 -- 172.21.15.143:0/630490328 wait complete. 2023-11-24T06:30:08.207 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:08.207 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:08.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.401+0000 7f556a8e3640 1 Processor -- start 2023-11-24T06:30:08.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.401+0000 7f556a8e3640 1 -- start start 2023-11-24T06:30:08.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.401+0000 7f556a8e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ae4a0 0x7f556415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.401+0000 7f556a8e3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55640cd850 0x7f55640cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f556a8e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55640b3510 con 0x7f55640ce250 2023-11-24T06:30:08.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f556a8e3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640ce6e0 con 0x7f55640cd850 2023-11-24T06:30:08.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f556a8e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640b37f0 con 0x7f55640ae4a0 2023-11-24T06:30:08.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5568e80640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f55640ce250 0x7f556415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56272/0 (socket says 172.21.15.143:56272) 2023-11-24T06:30:08.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5568e80640 1 -- 172.21.15.143:0/3995117010 learned_addr learned my addr 172.21.15.143:0/3995117010 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:08.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5563fff640 1 --2- 172.21.15.143:0/3995117010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ae4a0 0x7f556415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f55637fe640 1 --2- 172.21.15.143:0/3995117010 >> v2:172.21.15.146:3300/0 conn(0x7f55640cd850 0x7f55640cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5562ffd640 1 -- 172.21.15.143:0/3995117010 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818573758 0 0) 0x7f55640b3510 con 0x7f55640ce250 2023-11-24T06:30:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5562ffd640 1 -- 172.21.15.143:0/3995117010 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f554c003530 con 0x7f55640ce250 2023-11-24T06:30:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5563fff640 1 -- 172.21.15.143:0/3995117010 >> v2:172.21.15.146:3300/0 conn(0x7f55640cd850 msgr2=0x7f55640cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5563fff640 1 --2- 172.21.15.143:0/3995117010 >> v2:172.21.15.146:3300/0 conn(0x7f55640cd850 0x7f55640cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5563fff640 1 -- 172.21.15.143:0/3995117010 >> v1:172.21.15.143:6789/0 conn(0x7f55640ce250 legacy=0x7f556415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5563fff640 1 -- 172.21.15.143:0/3995117010 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640b3ad0 con 0x7f55640ae4a0 2023-11-24T06:30:08.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f55637fe640 1 --2- 172.21.15.143:0/3995117010 >> v2:172.21.15.146:3300/0 conn(0x7f55640cd850 0x7f55640cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:08.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.405+0000 7f5563fff640 1 --2- 172.21.15.143:0/3995117010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ae4a0 0x7f556415ba00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55540097c0 tx=0x7f555401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881f596de3d57af8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f5562ffd640 1 -- 172.21.15.143:0/3995117010 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540ab650 con 0x7f55640ae4a0 2023-11-24T06:30:08.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f5562ffd640 1 -- 172.21.15.143:0/3995117010 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55540ab7b0 con 0x7f55640ae4a0 2023-11-24T06:30:08.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f5562ffd640 1 -- 172.21.15.143:0/3995117010 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540abb40 con 0x7f55640ae4a0 2023-11-24T06:30:08.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- 172.21.15.143:0/3995117010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ae4a0 msgr2=0x7f556415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 --2- 172.21.15.143:0/3995117010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ae4a0 0x7f556415ba00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55540097c0 tx=0x7f555401c450 comp rx=0 tx=0).stop 2023-11-24T06:30:08.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- 172.21.15.143:0/3995117010 shutdown_connections 2023-11-24T06:30:08.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 --2- 172.21.15.143:0/3995117010 >> v2:172.21.15.146:3300/0 conn(0x7f55640cd850 0x7f55640cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 --2- 172.21.15.143:0/3995117010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ae4a0 0x7f556415ba00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- 172.21.15.143:0/3995117010 >> 172.21.15.143:0/3995117010 conn(0x7f55640b0c80 msgr2=0x7f55640b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:08.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- 172.21.15.143:0/3995117010 shutdown_connections 2023-11-24T06:30:08.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- 172.21.15.143:0/3995117010 wait complete. 2023-11-24T06:30:08.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 Processor -- start 2023-11-24T06:30:08.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- start start 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55640ae4a0 0x7f55641446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 0x7f5564154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ce250 0x7f5564154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564165fc0 con 0x7f55640cd850 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564144f50 con 0x7f55640ae4a0 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f556a8e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55641553a0 con 0x7f55640ce250 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.409+0000 7f55637fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 0x7f5564154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 0x7f5564154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52848/0 (socket says 172.21.15.143:52848) 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 -- 172.21.15.143:0/2129991454 learned_addr learned my addr 172.21.15.143:0/2129991454 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5563fff640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55640ae4a0 0x7f55641446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5568e80640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ce250 0x7f5564154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 -- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ce250 msgr2=0x7f5564154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ce250 0x7f5564154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 -- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55640ae4a0 msgr2=0x7f55641446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55640ae4a0 0x7f55641446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 -- 172.21.15.143:0/2129991454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009420 con 0x7f55640cd850 2023-11-24T06:30:08.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5568e80640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ce250 0x7f5564154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:08.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f55637fe640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 0x7f5564154920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f555800ebe0 tx=0x7f555800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800eee0 con 0x7f55640cd850 2023-11-24T06:30:08.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800cc30 con 0x7f55640cd850 2023-11-24T06:30:08.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5554009420 con 0x7f55640cd850 2023-11-24T06:30:08.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558013470 con 0x7f55640cd850 2023-11-24T06:30:08.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55641451a0 con 0x7f55640cd850 2023-11-24T06:30:08.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556404e8c0 con 0x7f55640cd850 2023-11-24T06:30:08.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55580135d0 con 0x7f55640cd850 2023-11-24T06:30:08.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5560ff9640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066470 0x7f5550068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5558084130 con 0x7f55640cd850 2023-11-24T06:30:08.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.413+0000 7f5563fff640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066470 0x7f5550068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.417+0000 7f5563fff640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066470 0x7f5550068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55540af000 tx=0x7f55540a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.417+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55580515c0 con 0x7f55640cd850 2023-11-24T06:30:08.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55640cc350 con 0x7f55640cd850 2023-11-24T06:30:08.574 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f5560ff9640 1 -- 172.21.15.143:0/2129991454 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5558054be0 con 0x7f55640cd850 2023-11-24T06:30:08.574 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066470 msgr2=0x7f5550068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066470 0x7f5550068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55540af000 tx=0x7f55540a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 msgr2=0x7f5564154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 0x7f5564154920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f555800ebe0 tx=0x7f555800c520 comp rx=0 tx=0).stop 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 shutdown_connections 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066470 0x7f5550068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55640ce250 0x7f5564154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55640cd850 0x7f5564154920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 --2- 172.21.15.143:0/2129991454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55640ae4a0 0x7f55641446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 >> 172.21.15.143:0/2129991454 conn(0x7f55640b0c80 msgr2=0x7f556415d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:08.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 shutdown_connections 2023-11-24T06:30:08.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.569+0000 7f556a8e3640 1 -- 172.21.15.143:0/2129991454 wait complete. 2023-11-24T06:30:08.595 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:08.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 Processor -- start 2023-11-24T06:30:08.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 -- start start 2023-11-24T06:30:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efcf815a290 0x7efcf80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efcf80b1f80 0x7efcf80b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf8071170 con 0x7efcf815ec60 2023-11-24T06:30:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80cb690 con 0x7efcf80b1f80 2023-11-24T06:30:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.729+0000 7efcfcb2a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80cb970 con 0x7efcf815a290 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf5d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efcf815ec60 0x7efcf80cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56274/0 (socket says 172.21.15.143:56274) 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efcf80b1f80 0x7efcf80b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf5d9b640 1 -- 172.21.15.143:0/4102624925 learned_addr learned my addr 172.21.15.143:0/4102624925 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf659c640 1 --2- 172.21.15.143:0/4102624925 >> v2:172.21.15.146:3300/0 conn(0x7efcf815a290 0x7efcf80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf6d9d640 1 -- 172.21.15.143:0/4102624925 >> v2:172.21.15.146:3300/0 conn(0x7efcf815a290 msgr2=0x7efcf80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf6d9d640 1 --2- 172.21.15.143:0/4102624925 >> v2:172.21.15.146:3300/0 conn(0x7efcf815a290 0x7efcf80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf6d9d640 1 -- 172.21.15.143:0/4102624925 >> v1:172.21.15.143:6789/0 conn(0x7efcf815ec60 legacy=0x7efcf80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf6d9d640 1 -- 172.21.15.143:0/4102624925 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80cbc50 con 0x7efcf80b1f80 2023-11-24T06:30:08.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf6d9d640 1 --2- 172.21.15.143:0/4102624925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf80b23f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efcf806c0d0 tx=0x7efcf001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2aa87b048f66e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf559a640 1 -- 172.21.15.143:0/4102624925 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00a5850 con 0x7efcf80b1f80 2023-11-24T06:30:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf559a640 1 -- 172.21.15.143:0/4102624925 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00a59b0 con 0x7efcf80b1f80 2023-11-24T06:30:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.733+0000 7efcf559a640 1 -- 172.21.15.143:0/4102624925 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00a5d40 con 0x7efcf80b1f80 2023-11-24T06:30:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- 172.21.15.143:0/4102624925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 msgr2=0x7efcf80b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/4102624925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf80b23f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efcf806c0d0 tx=0x7efcf001c880 comp rx=0 tx=0).stop 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- 172.21.15.143:0/4102624925 shutdown_connections 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/4102624925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf80b23f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/4102624925 >> v2:172.21.15.146:3300/0 conn(0x7efcf815a290 0x7efcf80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- 172.21.15.143:0/4102624925 >> 172.21.15.143:0/4102624925 conn(0x7efcf80b0c80 msgr2=0x7efcf80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- 172.21.15.143:0/4102624925 shutdown_connections 2023-11-24T06:30:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- 172.21.15.143:0/4102624925 wait complete. 2023-11-24T06:30:08.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 Processor -- start 2023-11-24T06:30:08.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- start start 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf8147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcf815a290 0x7efcf81645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf815ec60 0x7efcf81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8164b10 con 0x7efcf80b1f80 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8164200 con 0x7efcf815ec60 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcfcb2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80ace50 con 0x7efcf815a290 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf8147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf8147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52868/0 (socket says 172.21.15.143:52868) 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 -- 172.21.15.143:0/3371803452 learned_addr learned my addr 172.21.15.143:0/3371803452 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 -- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcf815a290 msgr2=0x7efcf81645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf6d9d640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf815ec60 0x7efcf81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf5d9b640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcf815a290 0x7efcf81645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcf815a290 0x7efcf81645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 -- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf815ec60 msgr2=0x7efcf81544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf815ec60 0x7efcf81544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf659c640 1 -- 172.21.15.143:0/3371803452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009a70 con 0x7efcf80b1f80 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf6d9d640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf815ec60 0x7efcf81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.737+0000 7efcf5d9b640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcf815a290 0x7efcf81645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efcf659c640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf8147590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efce800e930 tx=0x7efce800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8009690 con 0x7efcf80b1f80 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800ca00 con 0x7efcf80b1f80 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800cd70 con 0x7efcf80b1f80 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf8070f40 con 0x7efcf80b1f80 2023-11-24T06:30:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf80ac370 con 0x7efcf80b1f80 2023-11-24T06:30:08.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf804e8c0 con 0x7efcf80b1f80 2023-11-24T06:30:08.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efce8013470 con 0x7efcf80b1f80 2023-11-24T06:30:08.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efce6ffd640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcd8066470 0x7efcd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:08.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efce80840c0 con 0x7efcf80b1f80 2023-11-24T06:30:08.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.741+0000 7efcf5d9b640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcd8066470 0x7efcd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:08.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.745+0000 7efcf5d9b640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcd8066470 0x7efcd8068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efcec005890 tx=0x7efcec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:08.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.745+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efce80515f0 con 0x7efcf80b1f80 2023-11-24T06:30:08.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcf815df00 con 0x7efcf80b1f80 2023-11-24T06:30:08.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efce6ffd640 1 -- 172.21.15.143:0/3371803452 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efce8054c10 con 0x7efcf80b1f80 2023-11-24T06:30:08.902 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:08.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcd8066470 msgr2=0x7efcd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcd8066470 0x7efcd8068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efcec005890 tx=0x7efcec009040 comp rx=0 tx=0).stop 2023-11-24T06:30:08.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 msgr2=0x7efcf8147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:08.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf8147590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efce800e930 tx=0x7efce800edf0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 shutdown_connections 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcd8066470 0x7efcd8068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf815ec60 0x7efcf81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcf815a290 0x7efcf81645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 --2- 172.21.15.143:0/3371803452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcf80b1f80 0x7efcf8147590 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 >> 172.21.15.143:0/3371803452 conn(0x7efcf80b0c80 msgr2=0x7efcf8073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 shutdown_connections 2023-11-24T06:30:08.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:08.897+0000 7efcfcb2a640 1 -- 172.21.15.143:0/3371803452 wait complete. 2023-11-24T06:30:08.922 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:09.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.057+0000 7f251aa79640 1 Processor -- start 2023-11-24T06:30:09.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.057+0000 7f251aa79640 1 -- start start 2023-11-24T06:30:09.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f251aa79640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25140ccef0 0x7f251406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f251aa79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25140b1f80 0x7f251406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f251aa79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f251406ddb0 0x7f25140cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f251aa79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251415a050 con 0x7f251406ddb0 2023-11-24T06:30:09.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f251aa79640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25140722e0 con 0x7f25140ccef0 2023-11-24T06:30:09.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f251aa79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2514072860 con 0x7f25140b1f80 2023-11-24T06:30:09.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f251406ddb0 0x7f25140cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2518815640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25140ccef0 0x7f251406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f251406ddb0 0x7f25140cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52876/0 (socket says 172.21.15.143:52876) 2023-11-24T06:30:09.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2513fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25140b1f80 0x7f251406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 -- 172.21.15.143:0/26903438 learned_addr learned my addr 172.21.15.143:0/26903438 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:09.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 -- 172.21.15.143:0/26903438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25140b1f80 msgr2=0x7f251406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:09.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 --2- 172.21.15.143:0/26903438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25140b1f80 0x7f251406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 -- 172.21.15.143:0/26903438 >> v2:172.21.15.146:3300/0 conn(0x7f25140ccef0 msgr2=0x7f251406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:09.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 --2- 172.21.15.143:0/26903438 >> v2:172.21.15.146:3300/0 conn(0x7f25140ccef0 0x7f251406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 -- 172.21.15.143:0/26903438 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140705e0 con 0x7f251406ddb0 2023-11-24T06:30:09.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.061+0000 7f2519016640 1 --2- 172.21.15.143:0/26903438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f251406ddb0 0x7f25140cd2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2514072a90 tx=0x7f250c01dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2297fcd5c9d86d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:09.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f25137fe640 1 -- 172.21.15.143:0/26903438 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0a68b0 con 0x7f251406ddb0 2023-11-24T06:30:09.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f25137fe640 1 -- 172.21.15.143:0/26903438 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c0a6a10 con 0x7f251406ddb0 2023-11-24T06:30:09.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f25137fe640 1 -- 172.21.15.143:0/26903438 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0a6da0 con 0x7f251406ddb0 2023-11-24T06:30:09.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- 172.21.15.143:0/26903438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f251406ddb0 msgr2=0x7f25140cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- 172.21.15.143:0/26903438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f251406ddb0 0x7f25140cd2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2514072a90 tx=0x7f250c01dab0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- 172.21.15.143:0/26903438 shutdown_connections 2023-11-24T06:30:09.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- 172.21.15.143:0/26903438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f251406ddb0 0x7f25140cd2d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- 172.21.15.143:0/26903438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25140b1f80 0x7f251406d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- 172.21.15.143:0/26903438 >> v2:172.21.15.146:3300/0 conn(0x7f25140ccef0 0x7f251406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- 172.21.15.143:0/26903438 >> 172.21.15.143:0/26903438 conn(0x7f25140b0c80 msgr2=0x7f25140b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:09.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- 172.21.15.143:0/26903438 shutdown_connections 2023-11-24T06:30:09.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- 172.21.15.143:0/26903438 wait complete. 2023-11-24T06:30:09.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 Processor -- start 2023-11-24T06:30:09.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- start start 2023-11-24T06:30:09.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251406ddb0 0x7f2514153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25140b1f80 0x7f2514150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 0x7f251409c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2514151a20 con 0x7f25140ccef0 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25141fa0f0 con 0x7f25140b1f80 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f251aa79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25141fa580 con 0x7f251406ddb0 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f2519016640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 0x7f251409c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f2519016640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 0x7f251409c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52880/0 (socket says 172.21.15.143:52880) 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f2519016640 1 -- 172.21.15.143:0/295700341 learned_addr learned my addr 172.21.15.143:0/295700341 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f2518815640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251406ddb0 0x7f2514153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.065+0000 7f2513fff640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25140b1f80 0x7f2514150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2519016640 1 -- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251406ddb0 msgr2=0x7f2514153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2519016640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251406ddb0 0x7f2514153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2519016640 1 -- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25140b1f80 msgr2=0x7f2514150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2519016640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25140b1f80 0x7f2514150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2519016640 1 -- 172.21.15.143:0/295700341 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c00d040 con 0x7f25140ccef0 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2519016640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 0x7f251409c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f250c01c160 tx=0x7f250c01a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0b6610 con 0x7f25140ccef0 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c0b6790 con 0x7f25140ccef0 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2514151310 con 0x7f25140ccef0 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0b6b40 con 0x7f25140ccef0 2023-11-24T06:30:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25141f9aa0 con 0x7f25140ccef0 2023-11-24T06:30:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25141fa260 con 0x7f25140ccef0 2023-11-24T06:30:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f250c0b6ca0 con 0x7f25140ccef0 2023-11-24T06:30:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f25117fa640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24f8066470 0x7f24f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f250c11e7e0 con 0x7f25140ccef0 2023-11-24T06:30:09.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.069+0000 7f2518815640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24f8066470 0x7f24f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.073+0000 7f2518815640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24f8066470 0x7f24f8068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f251406dd20 tx=0x7f2508009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.073+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f250c0ebc70 con 0x7f25140ccef0 2023-11-24T06:30:09.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.225+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f251404e8c0 con 0x7f25140ccef0 2023-11-24T06:30:09.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.225+0000 7f25117fa640 1 -- 172.21.15.143:0/295700341 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f250c0ef290 con 0x7f25140ccef0 2023-11-24T06:30:09.232 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:09.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24f8066470 msgr2=0x7f24f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24f8066470 0x7f24f8068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f251406dd20 tx=0x7f2508009190 comp rx=0 tx=0).stop 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 msgr2=0x7f251409c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 0x7f251409c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f250c01c160 tx=0x7f250c01a850 comp rx=0 tx=0).stop 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 shutdown_connections 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24f8066470 0x7f24f8068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25140ccef0 0x7f251409c9d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25140b1f80 0x7f2514150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 --2- 172.21.15.143:0/295700341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251406ddb0 0x7f2514153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 >> 172.21.15.143:0/295700341 conn(0x7f25140b0c80 msgr2=0x7f25140b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 shutdown_connections 2023-11-24T06:30:09.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.229+0000 7f251aa79640 1 -- 172.21.15.143:0/295700341 wait complete. 2023-11-24T06:30:09.253 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2023-11-24T06:30:09.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.385+0000 7f72ede54640 1 Processor -- start 2023-11-24T06:30:09.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.385+0000 7f72ede54640 1 -- start start 2023-11-24T06:30:09.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72ede54640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72e806c650 0x7f72e809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72ede54640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f72e80709c0 0x7f72e8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72ede54640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e806d8b0 con 0x7f72e8144030 2023-11-24T06:30:09.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72ede54640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e8145020 con 0x7f72e80709c0 2023-11-24T06:30:09.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72ede54640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e8071370 con 0x7f72e806c650 2023-11-24T06:30:09.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e77fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f72e8144030 0x7f72e806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56286/0 (socket says 172.21.15.143:56286) 2023-11-24T06:30:09.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e77fe640 1 -- 172.21.15.143:0/767148283 learned_addr learned my addr 172.21.15.143:0/767148283 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:09.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e7fff640 1 --2- 172.21.15.143:0/767148283 >> v2:172.21.15.143:3300/0 conn(0x7f72e80709c0 0x7f72e8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e6ffd640 1 --2- 172.21.15.143:0/767148283 >> v2:172.21.15.146:3300/0 conn(0x7f72e806c650 0x7f72e809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e67fc640 1 -- 172.21.15.143:0/767148283 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522534071 0 0) 0x7f72e806d8b0 con 0x7f72e8144030 2023-11-24T06:30:09.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e67fc640 1 -- 172.21.15.143:0/767148283 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d0003530 con 0x7f72e8144030 2023-11-24T06:30:09.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e7fff640 1 -- 172.21.15.143:0/767148283 >> v2:172.21.15.146:3300/0 conn(0x7f72e806c650 msgr2=0x7f72e809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:09.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e7fff640 1 --2- 172.21.15.143:0/767148283 >> v2:172.21.15.146:3300/0 conn(0x7f72e806c650 0x7f72e809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e7fff640 1 -- 172.21.15.143:0/767148283 >> v1:172.21.15.143:6789/0 conn(0x7f72e8144030 legacy=0x7f72e806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e7fff640 1 -- 172.21.15.143:0/767148283 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e806cca0 con 0x7f72e80709c0 2023-11-24T06:30:09.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e6ffd640 1 --2- 172.21.15.143:0/767148283 >> v2:172.21.15.146:3300/0 conn(0x7f72e806c650 0x7f72e809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:09.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.389+0000 7f72e7fff640 1 --2- 172.21.15.143:0/767148283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e80709c0 0x7f72e8070e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72e80700a0 tx=0x7f72e001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2b5a56f1c3663e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:09.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72e67fc640 1 -- 172.21.15.143:0/767148283 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00a58c0 con 0x7f72e80709c0 2023-11-24T06:30:09.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72e67fc640 1 -- 172.21.15.143:0/767148283 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00a5a20 con 0x7f72e80709c0 2023-11-24T06:30:09.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72e67fc640 1 -- 172.21.15.143:0/767148283 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00a5db0 con 0x7f72e80709c0 2023-11-24T06:30:09.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- 172.21.15.143:0/767148283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e80709c0 msgr2=0x7f72e8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 --2- 172.21.15.143:0/767148283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e80709c0 0x7f72e8070e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72e80700a0 tx=0x7f72e001c910 comp rx=0 tx=0).stop 2023-11-24T06:30:09.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- 172.21.15.143:0/767148283 shutdown_connections 2023-11-24T06:30:09.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 --2- 172.21.15.143:0/767148283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e80709c0 0x7f72e8070e30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 --2- 172.21.15.143:0/767148283 >> v2:172.21.15.146:3300/0 conn(0x7f72e806c650 0x7f72e809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- 172.21.15.143:0/767148283 >> 172.21.15.143:0/767148283 conn(0x7f72e80b0bf0 msgr2=0x7f72e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:09.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- 172.21.15.143:0/767148283 shutdown_connections 2023-11-24T06:30:09.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- 172.21.15.143:0/767148283 wait complete. 2023-11-24T06:30:09.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 Processor -- start 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- start start 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 0x7f72e81f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e80709c0 0x7f72e80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8144030 0x7f72e80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80b3a00 con 0x7f72e806c650 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80b2aa0 con 0x7f72e80709c0 2023-11-24T06:30:09.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.393+0000 7f72ede54640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80ce530 con 0x7f72e8144030 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 0x7f72e81f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 0x7f72e81f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52902/0 (socket says 172.21.15.143:52902) 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 -- 172.21.15.143:0/2081141485 learned_addr learned my addr 172.21.15.143:0/2081141485 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e6ffd640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e80709c0 0x7f72e80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e7fff640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8144030 0x7f72e80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 -- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8144030 msgr2=0x7f72e80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8144030 0x7f72e80b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 -- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e80709c0 msgr2=0x7f72e80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:09.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e80709c0 0x7f72e80b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:09.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 -- 172.21.15.143:0/2081141485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009a70 con 0x7f72e806c650 2023-11-24T06:30:09.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e6ffd640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e80709c0 0x7f72e80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:09.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72e77fe640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 0x7f72e81f5e90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72d800c4d0 tx=0x7f72d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:09.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8005cf0 con 0x7f72e806c650 2023-11-24T06:30:09.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8005e50 con 0x7f72e806c650 2023-11-24T06:30:09.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e80af8d0 con 0x7f72e806c650 2023-11-24T06:30:09.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8007270 con 0x7f72e806c650 2023-11-24T06:30:09.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e80afe90 con 0x7f72e806c650 2023-11-24T06:30:09.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e80b2c60 con 0x7f72e806c650 2023-11-24T06:30:09.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72d80073d0 con 0x7f72e806c650 2023-11-24T06:30:09.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72cffff640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f72d4066470 0x7f72d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:09.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.397+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72d80833e0 con 0x7f72e806c650 2023-11-24T06:30:09.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.401+0000 7f72e6ffd640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f72d4066470 0x7f72d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:09.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.401+0000 7f72e6ffd640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f72d4066470 0x7f72d4068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f72e80b1980 tx=0x7f72dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:09.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.401+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72d8050870 con 0x7f72e806c650 2023-11-24T06:30:09.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:09.601+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) v1 -- 0x7f72e806e420 con 0x7f72e806c650 2023-11-24T06:30:10.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.037+0000 7f72cffff640 1 -- 172.21.15.143:0/2081141485 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v54) v1 ==== 184+0+0 (secure 0 0 0) 0x7f72d8053e90 con 0x7f72e806c650 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f72d4066470 msgr2=0x7f72d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f72d4066470 0x7f72d4068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f72e80b1980 tx=0x7f72dc008040 comp rx=0 tx=0).stop 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 msgr2=0x7f72e81f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 0x7f72e81f5e90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72d800c4d0 tx=0x7f72d800c990 comp rx=0 tx=0).stop 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 shutdown_connections 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f72d4066470 0x7f72d4068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8144030 0x7f72e80b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e80709c0 0x7f72e80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 --2- 172.21.15.143:0/2081141485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e806c650 0x7f72e81f5e90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 >> 172.21.15.143:0/2081141485 conn(0x7f72e80b0bf0 msgr2=0x7f72e80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:10.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 shutdown_connections 2023-11-24T06:30:10.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.041+0000 7f72ede54640 1 -- 172.21.15.143:0/2081141485 wait complete. 2023-11-24T06:30:10.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:30:10.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 Processor -- start 2023-11-24T06:30:10.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 -- start start 2023-11-24T06:30:10.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f437c0d37e0 0x7f437c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c0d3c60 con 0x7f437c0b1630 2023-11-24T06:30:10.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c06b980 con 0x7f437c0d37e0 2023-11-24T06:30:10.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f43842c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0b0090 con 0x7f437c15d7f0 2023-11-24T06:30:10.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f437c0d37e0 0x7f437c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f437c0d37e0 0x7f437c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52912/0 (socket says 172.21.15.143:52912) 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 -- 172.21.15.143:0/726731568 learned_addr learned my addr 172.21.15.143:0/726731568 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4382065640 1 --2- 172.21.15.143:0/726731568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 -- 172.21.15.143:0/726731568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 msgr2=0x7f437c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 --2- 172.21.15.143:0/726731568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 -- 172.21.15.143:0/726731568 >> v1:172.21.15.146:6789/0 conn(0x7f437c0b1630 legacy=0x7f437c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.201+0000 7f4381864640 1 -- 172.21.15.143:0/726731568 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c0b0330 con 0x7f437c0d37e0 2023-11-24T06:30:10.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f4381864640 1 --2- 172.21.15.143:0/726731568 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c0b10f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f436c009870 tx=0x7f436c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82515a3cccb35c34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:10.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f4381063640 1 -- 172.21.15.143:0/726731568 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0a7070 con 0x7f437c0d37e0 2023-11-24T06:30:10.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f4381063640 1 -- 172.21.15.143:0/726731568 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c0ab430 con 0x7f437c0d37e0 2023-11-24T06:30:10.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f4381063640 1 -- 172.21.15.143:0/726731568 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0ab7c0 con 0x7f437c0d37e0 2023-11-24T06:30:10.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 -- 172.21.15.143:0/726731568 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 msgr2=0x7f437c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 --2- 172.21.15.143:0/726731568 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c0b10f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f436c009870 tx=0x7f436c01c540 comp rx=0 tx=0).stop 2023-11-24T06:30:10.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 -- 172.21.15.143:0/726731568 shutdown_connections 2023-11-24T06:30:10.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 --2- 172.21.15.143:0/726731568 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c0b10f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 --2- 172.21.15.143:0/726731568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 -- 172.21.15.143:0/726731568 >> 172.21.15.143:0/726731568 conn(0x7f437c09c790 msgr2=0x7f437c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:10.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 -- 172.21.15.143:0/726731568 shutdown_connections 2023-11-24T06:30:10.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.205+0000 7f43842c9640 1 -- 172.21.15.143:0/726731568 wait complete. 2023-11-24T06:30:10.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 Processor -- start 2023-11-24T06:30:10.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 -- start start 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c0b1630 0x7f437c154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c150be0 con 0x7f437c0d37e0 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c156dc0 con 0x7f437c0b1630 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c1561f0 con 0x7f437c15d7f0 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52926/0 (socket says 172.21.15.143:52926) 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 -- 172.21.15.143:0/1927581142 learned_addr learned my addr 172.21.15.143:0/1927581142 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4382065640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c0b1630 0x7f437c154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4382866640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 -- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 msgr2=0x7f437c1505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c1505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 -- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c0b1630 msgr2=0x7f437c154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c0b1630 0x7f437c154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 -- 172.21.15.143:0/1927581142 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0094d0 con 0x7f437c0d37e0 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4381864640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c150070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f436c01a170 tx=0x7f436c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0b4620 con 0x7f437c0d37e0 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c0b4780 con 0x7f437c0d37e0 2023-11-24T06:30:10.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0b4b30 con 0x7f437c0d37e0 2023-11-24T06:30:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c156490 con 0x7f437c0d37e0 2023-11-24T06:30:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.209+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c156a50 con 0x7f437c0d37e0 2023-11-24T06:30:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.213+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437c0d3310 con 0x7f437c0d37e0 2023-11-24T06:30:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.213+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f436c0b4c90 con 0x7f437c0d37e0 2023-11-24T06:30:10.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.213+0000 7f4372ffd640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4360066470 0x7f4360068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.213+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f436c11e170 con 0x7f437c0d37e0 2023-11-24T06:30:10.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.213+0000 7f4382065640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4360066470 0x7f4360068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.213+0000 7f4382065640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4360066470 0x7f4360068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4378009ac0 tx=0x7f4378009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:10.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.217+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f436c0eb550 con 0x7f437c0d37e0 2023-11-24T06:30:10.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.369+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f437c04e8c0 con 0x7f437c0d37e0 2023-11-24T06:30:10.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f4372ffd640 1 -- 172.21.15.143:0/1927581142 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f436c0eeb70 con 0x7f437c0d37e0 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4360066470 msgr2=0x7f4360068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4360066470 0x7f4360068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4378009ac0 tx=0x7f4378009190 comp rx=0 tx=0).stop 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 msgr2=0x7f437c150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c150070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f436c01a170 tx=0x7f436c0192e0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 shutdown_connections 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4360066470 0x7f4360068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f437c15d7f0 0x7f437c1505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f437c0d37e0 0x7f437c150070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 --2- 172.21.15.143:0/1927581142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c0b1630 0x7f437c154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 >> 172.21.15.143:0/1927581142 conn(0x7f437c09c790 msgr2=0x7f437c15a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:10.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 shutdown_connections 2023-11-24T06:30:10.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.373+0000 7f43842c9640 1 -- 172.21.15.143:0/1927581142 wait complete. 2023-11-24T06:30:10.399 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:30:10.399 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:30:10.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:30:10.569 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:30:10.569 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:10.570 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:10.580 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:10.580 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:10.637 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:10.637 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:10.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:10.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 Processor -- start 2023-11-24T06:30:10.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 -- start start 2023-11-24T06:30:10.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f104406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f10440d3020 0x7f10440d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10440d39c0 con 0x7f10440ce8b0 2023-11-24T06:30:10.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10440d1cc0 con 0x7f10440d3020 2023-11-24T06:30:10.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10495df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10440d1fa0 con 0x7f104415d570 2023-11-24T06:30:10.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10437fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f10440ce8b0 0x7f10440ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56296/0 (socket says 172.21.15.143:56296) 2023-11-24T06:30:10.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10437fe640 1 -- 172.21.15.143:0/3619840685 learned_addr learned my addr 172.21.15.143:0/3619840685 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:10.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f103a7fc640 1 --2- 172.21.15.143:0/3619840685 >> v2:172.21.15.143:3300/0 conn(0x7f10440d3020 0x7f10440d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f1042ffd640 1 --2- 172.21.15.143:0/3619840685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f104406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f103a7fc640 1 -- 172.21.15.143:0/3619840685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 msgr2=0x7f104406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:10.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f103a7fc640 1 --2- 172.21.15.143:0/3619840685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f104406b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f103a7fc640 1 -- 172.21.15.143:0/3619840685 >> v1:172.21.15.143:6789/0 conn(0x7f10440ce8b0 legacy=0x7f10440ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f10427fc640 1 -- 172.21.15.143:0/3619840685 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404081223 0 0) 0x7f10440d39c0 con 0x7f10440ce8b0 2023-11-24T06:30:10.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.865+0000 7f103a7fc640 1 -- 172.21.15.143:0/3619840685 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440ce0b0 con 0x7f10440d3020 2023-11-24T06:30:10.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f103a7fc640 1 --2- 172.21.15.143:0/3619840685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440d3020 0x7f10440d3480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f102c009d90 tx=0x7f102c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc778612242c0e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:10.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10427fc640 1 -- 172.21.15.143:0/3619840685 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0a5970 con 0x7f10440d3020 2023-11-24T06:30:10.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10427fc640 1 -- 172.21.15.143:0/3619840685 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0a5ad0 con 0x7f10440d3020 2023-11-24T06:30:10.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10427fc640 1 -- 172.21.15.143:0/3619840685 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0a5e60 con 0x7f10440d3020 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 -- 172.21.15.143:0/3619840685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440d3020 msgr2=0x7f10440d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 --2- 172.21.15.143:0/3619840685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440d3020 0x7f10440d3480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f102c009d90 tx=0x7f102c01c890 comp rx=0 tx=0).stop 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 -- 172.21.15.143:0/3619840685 shutdown_connections 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 --2- 172.21.15.143:0/3619840685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440d3020 0x7f10440d3480 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 --2- 172.21.15.143:0/3619840685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f104406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 -- 172.21.15.143:0/3619840685 >> 172.21.15.143:0/3619840685 conn(0x7f104408ceb0 msgr2=0x7f104409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 -- 172.21.15.143:0/3619840685 shutdown_connections 2023-11-24T06:30:10.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.869+0000 7f10495df640 1 -- 172.21.15.143:0/3619840685 wait complete. 2023-11-24T06:30:10.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 Processor -- start 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 -- start start 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 0x7f104414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440d3020 0x7f10441565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f1044156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440cd2c0 con 0x7f10440ce8b0 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104415aef0 con 0x7f10440d3020 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104414cdd0 con 0x7f104415d570 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 0x7f104414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 0x7f104414c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52944/0 (socket says 172.21.15.143:52944) 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 -- 172.21.15.143:0/3758171448 learned_addr learned my addr 172.21.15.143:0/3758171448 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f103a7fc640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440d3020 0x7f10441565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10437fe640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f1044156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 -- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 msgr2=0x7f1044156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f1044156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 -- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440d3020 msgr2=0x7f10441565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440d3020 0x7f10441565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 -- 172.21.15.143:0/3758171448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c009a70 con 0x7f10440ce8b0 2023-11-24T06:30:10.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f1042ffd640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 0x7f104414c890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f103400d5f0 tx=0x7f103400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:10.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340125f0 con 0x7f10440ce8b0 2023-11-24T06:30:10.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034012750 con 0x7f10440ce8b0 2023-11-24T06:30:10.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034012ae0 con 0x7f10440ce8b0 2023-11-24T06:30:10.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10440ccfe0 con 0x7f10440ce8b0 2023-11-24T06:30:10.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.873+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104415ab80 con 0x7f10440ce8b0 2023-11-24T06:30:10.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.877+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104415a700 con 0x7f10440ce8b0 2023-11-24T06:30:10.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.877+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1034012c40 con 0x7f10440ce8b0 2023-11-24T06:30:10.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.877+0000 7f103bfff640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1024066470 0x7f1024068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:10.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.877+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1034084420 con 0x7f10440ce8b0 2023-11-24T06:30:10.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.877+0000 7f103a7fc640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1024066470 0x7f1024068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:10.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.877+0000 7f103a7fc640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1024066470 0x7f1024068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f102c0af000 tx=0x7f102c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:10.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:10.881+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f104415a700 con 0x7f10440ce8b0 2023-11-24T06:30:11.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.029+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f104415a700 con 0x7f10440ce8b0 2023-11-24T06:30:11.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f103bfff640 1 -- 172.21.15.143:0/3758171448 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f104415a700 con 0x7f10440ce8b0 2023-11-24T06:30:11.037 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:11.037 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:11.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1024066470 msgr2=0x7f1024068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1024066470 0x7f1024068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f102c0af000 tx=0x7f102c0a7070 comp rx=0 tx=0).stop 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 msgr2=0x7f104414c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 0x7f104414c890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f103400d5f0 tx=0x7f103400dab0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 shutdown_connections 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1024066470 0x7f1024068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f104415d570 0x7f1044156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440d3020 0x7f10441565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 --2- 172.21.15.143:0/3758171448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10440ce8b0 0x7f104414c890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 >> 172.21.15.143:0/3758171448 conn(0x7f104408ceb0 msgr2=0x7f10440b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 shutdown_connections 2023-11-24T06:30:11.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.033+0000 7f10495df640 1 -- 172.21.15.143:0/3758171448 wait complete. 2023-11-24T06:30:11.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:11.061 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:11.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 Processor -- start 2023-11-24T06:30:11.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 -- start start 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f02381624f0 0x7f02381628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f0238071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380723c0 con 0x7f02380cd380 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0238072980 con 0x7f02381624f0 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023f78d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380726a0 con 0x7f02380ccef0 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023d529640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f02381624f0 0x7f02381628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023dd2a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f02380cd380 0x7f02380cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56300/0 (socket says 172.21.15.143:56300) 2023-11-24T06:30:11.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023dd2a640 1 -- 172.21.15.143:0/4098749350 learned_addr learned my addr 172.21.15.143:0/4098749350 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:11.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023cd28640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f0238071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023d529640 1 -- 172.21.15.143:0/4098749350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 msgr2=0x7f0238071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:11.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023d529640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f0238071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023d529640 1 -- 172.21.15.143:0/4098749350 >> v1:172.21.15.143:6789/0 conn(0x7f02380cd380 legacy=0x7f02380cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023d529640 1 -- 172.21.15.143:0/4098749350 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023806c7e0 con 0x7f02381624f0 2023-11-24T06:30:11.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f022ffff640 1 -- 172.21.15.143:0/4098749350 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575006651 0 0) 0x7f02380723c0 con 0x7f02380cd380 2023-11-24T06:30:11.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.197+0000 7f023cd28640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f0238071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:11.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023d529640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f02381628d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02340097c0 tx=0x7f023401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc354f69af37021 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f022ffff640 1 -- 172.21.15.143:0/4098749350 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02340ad660 con 0x7f02381624f0 2023-11-24T06:30:11.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f022ffff640 1 -- 172.21.15.143:0/4098749350 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02340ad7c0 con 0x7f02381624f0 2023-11-24T06:30:11.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f022ffff640 1 -- 172.21.15.143:0/4098749350 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02340adb50 con 0x7f02381624f0 2023-11-24T06:30:11.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 -- 172.21.15.143:0/4098749350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 msgr2=0x7f02381628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f02381628d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02340097c0 tx=0x7f023401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 -- 172.21.15.143:0/4098749350 shutdown_connections 2023-11-24T06:30:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f0238071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 --2- 172.21.15.143:0/4098749350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f02381628d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 -- 172.21.15.143:0/4098749350 >> 172.21.15.143:0/4098749350 conn(0x7f02380b0c80 msgr2=0x7f02380b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 -- 172.21.15.143:0/4098749350 shutdown_connections 2023-11-24T06:30:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 -- 172.21.15.143:0/4098749350 wait complete. 2023-11-24T06:30:11.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.201+0000 7f023f78d640 1 Processor -- start 2023-11-24T06:30:11.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- start start 2023-11-24T06:30:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f023809a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02380cd380 0x7f02380b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f023815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238146290 con 0x7f02381624f0 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238146570 con 0x7f02380cd380 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0238146850 con 0x7f02380ccef0 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f023815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023d529640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f023809a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f023815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52962/0 (socket says 172.21.15.143:52962) 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 -- 172.21.15.143:0/292421018 learned_addr learned my addr 172.21.15.143:0/292421018 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:11.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023cd28640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02380cd380 0x7f02380b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 -- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 msgr2=0x7f023809a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f023809a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 -- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02380cd380 msgr2=0x7f02380b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02380cd380 0x7f02380b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 -- 172.21.15.143:0/292421018 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0234009420 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023dd2a640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f023815c770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0230001570 tx=0x7f023000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023000a640 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023000a7c0 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0238146b30 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023000ab70 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023809aa40 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.205+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023804e8c0 con 0x7f02381624f0 2023-11-24T06:30:11.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.209+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f023000acd0 con 0x7f02381624f0 2023-11-24T06:30:11.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.209+0000 7f022dffb640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f021c066470 0x7f021c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.209+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0230083440 con 0x7f02381624f0 2023-11-24T06:30:11.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.209+0000 7f023d529640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f021c066470 0x7f021c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.209+0000 7f023d529640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f021c066470 0x7f021c068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02340af000 tx=0x7f02340a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.213+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02300508d0 con 0x7f02381624f0 2023-11-24T06:30:11.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0238146fe0 con 0x7f02381624f0 2023-11-24T06:30:11.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f022dffb640 1 -- 172.21.15.143:0/292421018 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02300180a0 con 0x7f02381624f0 2023-11-24T06:30:11.370 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:11.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f021c066470 msgr2=0x7f021c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f023f78d640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f021c066470 0x7f021c068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02340af000 tx=0x7f02340a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 msgr2=0x7f023815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f023f78d640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f023815c770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0230001570 tx=0x7f023000cca0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.365+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 shutdown_connections 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f021c066470 0x7f021c068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02381624f0 0x7f023815c770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02380cd380 0x7f02380b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 --2- 172.21.15.143:0/292421018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02380ccef0 0x7f023809a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 >> 172.21.15.143:0/292421018 conn(0x7f02380b0c80 msgr2=0x7f0238164700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 shutdown_connections 2023-11-24T06:30:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.369+0000 7f023f78d640 1 -- 172.21.15.143:0/292421018 wait complete. 2023-11-24T06:30:11.392 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:11.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.525+0000 7f5e0c72a640 1 Processor -- start 2023-11-24T06:30:11.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.525+0000 7f5e0c72a640 1 -- start start 2023-11-24T06:30:11.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e0c72a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5e040ae4a0 0x7f5e0415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e0c72a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5e040cd850 0x7f5e040cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e0c72a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040b3510 con 0x7f5e040ce250 2023-11-24T06:30:11.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e0c72a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e040ce700 con 0x7f5e040cd850 2023-11-24T06:30:11.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e0c72a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e040b37f0 con 0x7f5e040ae4a0 2023-11-24T06:30:11.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5e040cd850 0x7f5e040cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5e040cd850 0x7f5e040cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52968/0 (socket says 172.21.15.143:52968) 2023-11-24T06:30:11.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2943499920 learned_addr learned my addr 172.21.15.143:0/2943499920 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:11.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e0acc7640 1 --1- 172.21.15.143:0/2943499920 >> v1:172.21.15.143:6789/0 conn(0x7f5e040ce250 0x7f5e0415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56310/0 (socket says 172.21.15.143:56310) 2023-11-24T06:30:11.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2943499920 >> v2:172.21.15.146:3300/0 conn(0x7f5e040ae4a0 msgr2=0x7f5e0415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:11.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 --2- 172.21.15.143:0/2943499920 >> v2:172.21.15.146:3300/0 conn(0x7f5e040ae4a0 0x7f5e0415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2943499920 >> v1:172.21.15.143:6789/0 conn(0x7f5e040ce250 legacy=0x7f5e0415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2943499920 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040b3ad0 con 0x7f5e040cd850 2023-11-24T06:30:11.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.529+0000 7f5e09cc5640 1 --2- 172.21.15.143:0/2943499920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e040cdd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e040ccdc0 tx=0x7f5df401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7762524952892873 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e094c4640 1 -- 172.21.15.143:0/2943499920 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40aa430 con 0x7f5e040cd850 2023-11-24T06:30:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e094c4640 1 -- 172.21.15.143:0/2943499920 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40aa590 con 0x7f5e040cd850 2023-11-24T06:30:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e094c4640 1 -- 172.21.15.143:0/2943499920 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40aa920 con 0x7f5e040cd850 2023-11-24T06:30:11.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2943499920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 msgr2=0x7f5e040cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2943499920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e040cdd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e040ccdc0 tx=0x7f5df401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2943499920 shutdown_connections 2023-11-24T06:30:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2943499920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e040cdd10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2943499920 >> v2:172.21.15.146:3300/0 conn(0x7f5e040ae4a0 0x7f5e0415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2943499920 >> 172.21.15.143:0/2943499920 conn(0x7f5e040b0c80 msgr2=0x7f5e040b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2943499920 shutdown_connections 2023-11-24T06:30:11.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2943499920 wait complete. 2023-11-24T06:30:11.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 Processor -- start 2023-11-24T06:30:11.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- start start 2023-11-24T06:30:11.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e040ae4a0 0x7f5e041f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e04156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e040ce250 0x7f5e04154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0409bef0 con 0x7f5e040cd850 2023-11-24T06:30:11.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e041563d0 con 0x7f5e040ce250 2023-11-24T06:30:11.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0c72a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0409b830 con 0x7f5e040ae4a0 2023-11-24T06:30:11.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e09cc5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e04156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e09cc5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e04156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52974/0 (socket says 172.21.15.143:52974) 2023-11-24T06:30:11.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2932154126 learned_addr learned my addr 172.21.15.143:0/2932154126 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:11.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0a4c6640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e040ae4a0 0x7f5e041f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.533+0000 7f5e0acc7640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e040ce250 0x7f5e04154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e040ae4a0 msgr2=0x7f5e041f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e09cc5640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e040ae4a0 0x7f5e041f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e040ce250 msgr2=0x7f5e04154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e09cc5640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e040ce250 0x7f5e04154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e09cc5640 1 -- 172.21.15.143:0/2932154126 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40094d0 con 0x7f5e040cd850 2023-11-24T06:30:11.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e0acc7640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e040ce250 0x7f5e04154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e09cc5640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e04156b40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5df40190e0 tx=0x7f5df401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40b38c0 con 0x7f5e040cd850 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40b3a20 con 0x7f5e040cd850 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40b3dd0 con 0x7f5e040cd850 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0409bb10 con 0x7f5e040cd850 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e04156060 con 0x7f5e040cd850 2023-11-24T06:30:11.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0404e8c0 con 0x7f5e040cd850 2023-11-24T06:30:11.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5df40b2380 con 0x7f5e040cd850 2023-11-24T06:30:11.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5dfaffd640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5de8066470 0x7f5de8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5df411e560 con 0x7f5e040cd850 2023-11-24T06:30:11.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.537+0000 7f5e0a4c6640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5de8066470 0x7f5de8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.541+0000 7f5e0a4c6640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5de8066470 0x7f5de8068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e00006fd0 tx=0x7f5e00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.541+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5df40eb960 con 0x7f5e040cd850 2023-11-24T06:30:11.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.693+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e0406e8e0 con 0x7f5e040cd850 2023-11-24T06:30:11.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.693+0000 7f5dfaffd640 1 -- 172.21.15.143:0/2932154126 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5df40eef80 con 0x7f5e040cd850 2023-11-24T06:30:11.699 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.693+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5de8066470 msgr2=0x7f5de8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.693+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5de8066470 0x7f5de8068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e00006fd0 tx=0x7f5e00008040 comp rx=0 tx=0).stop 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.693+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 msgr2=0x7f5e04156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.693+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e04156b40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5df40190e0 tx=0x7f5df401ad10 comp rx=0 tx=0).stop 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 shutdown_connections 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5de8066470 0x7f5de8068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e040ce250 0x7f5e04154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e040cd850 0x7f5e04156b40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 --2- 172.21.15.143:0/2932154126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e040ae4a0 0x7f5e041f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 >> 172.21.15.143:0/2932154126 conn(0x7f5e040b0c80 msgr2=0x7f5e0415c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 shutdown_connections 2023-11-24T06:30:11.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.697+0000 7f5e0c72a640 1 -- 172.21.15.143:0/2932154126 wait complete. 2023-11-24T06:30:11.719 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:11.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.853+0000 7f4d75157640 1 Processor -- start 2023-11-24T06:30:11.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.853+0000 7f4d75157640 1 -- start start 2023-11-24T06:30:11.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d75157640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d700ccef0 0x7f4d7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d75157640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7015a050 con 0x7f4d700ce2e0 2023-11-24T06:30:11.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d75157640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700722e0 con 0x7f4d700b1f80 2023-11-24T06:30:11.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d75157640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d70072860 con 0x7f4d700ccef0 2023-11-24T06:30:11.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4d700ce2e0 0x7f4d70163730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56322/0 (socket says 172.21.15.143:56322) 2023-11-24T06:30:11.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 -- 172.21.15.143:0/1091510092 learned_addr learned my addr 172.21.15.143:0/1091510092 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:11.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6ed9d640 1 --2- 172.21.15.143:0/1091510092 >> v2:172.21.15.146:3300/0 conn(0x7f4d700ccef0 0x7f4d7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79046040 0 0) 0x7f4d7015a050 con 0x7f4d700ce2e0 2023-11-24T06:30:11.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c003530 con 0x7f4d700ce2e0 2023-11-24T06:30:11.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601746875 0 0) 0x7f4d5c003530 con 0x7f4d700ce2e0 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 >> v2:172.21.15.146:3300/0 conn(0x7f4d700ccef0 msgr2=0x7f4d7006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 --2- 172.21.15.143:0/1091510092 >> v2:172.21.15.146:3300/0 conn(0x7f4d700ccef0 0x7f4d7006d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 >> v1:172.21.15.146:6789/0 conn(0x7f4d700b1f80 legacy=0x7f4d7006d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700705e0 con 0x7f4d700ce2e0 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f4d68001a00 con 0x7f4d700ce2e0 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 >> v1:172.21.15.143:6789/0 conn(0x7f4d700ce2e0 legacy=0x7f4d70163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c003980 0x7f4d5c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c0047d0 0x7f4d5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c005190 0x7f4d5c00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70072860 con 0x7f4d5c005190 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c00d0f0 con 0x7f4d5c0047d0 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0059e0 con 0x7f4d5c003980 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c005190 0x7f4d5c00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6ed9d640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c003980 0x7f4d5c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d67fff640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c0047d0 0x7f4d5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 -- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c003980 msgr2=0x7f4d5c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:11.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c003980 0x7f4d5c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 -- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c0047d0 msgr2=0x7f4d5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:11.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c0047d0 0x7f4d5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.857+0000 7f4d6f59e640 1 -- 172.21.15.143:0/1091510092 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c003530 con 0x7f4d5c005190 2023-11-24T06:30:11.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d6f59e640 1 -- 172.21.15.143:0/1091510092 reap_dead start 2023-11-24T06:30:11.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d6f59e640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c005190 0x7f4d5c00caa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800a770 tx=0x7f4d6801f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a002774783c2c27d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680b0070 con 0x7f4d5c005190 2023-11-24T06:30:11.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d680ac470 con 0x7f4d5c005190 2023-11-24T06:30:11.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d6e59c640 1 -- 172.21.15.143:0/1091510092 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680ac820 con 0x7f4d5c005190 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 -- 172.21.15.143:0/1091510092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c005190 msgr2=0x7f4d5c00caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c005190 0x7f4d5c00caa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800a770 tx=0x7f4d6801f9c0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 -- 172.21.15.143:0/1091510092 shutdown_connections 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 --2- 172.21.15.143:0/1091510092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c005190 0x7f4d5c00caa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 -- 172.21.15.143:0/1091510092 >> 172.21.15.143:0/1091510092 conn(0x7f4d700b0c80 msgr2=0x7f4d700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 -- 172.21.15.143:0/1091510092 shutdown_connections 2023-11-24T06:30:11.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 -- 172.21.15.143:0/1091510092 wait complete. 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.861+0000 7f4d75157640 1 Processor -- start 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- start start 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c005190 0x7f4d7014b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 0x7f4d7014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d701e2380 0x7f4d7014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7015d010 con 0x7f4d7015c8a0 2023-11-24T06:30:11.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7015cd30 con 0x7f4d5c005190 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700ac250 con 0x7f4d701e2380 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 0x7f4d7014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 0x7f4d7014bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52994/0 (socket says 172.21.15.143:52994) 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 -- 172.21.15.143:0/3077627152 learned_addr learned my addr 172.21.15.143:0/3077627152 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d6ed9d640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c005190 0x7f4d7014b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d6f59e640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d701e2380 0x7f4d7014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 -- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d701e2380 msgr2=0x7f4d7014c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d701e2380 0x7f4d7014c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 -- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c005190 msgr2=0x7f4d7014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c005190 0x7f4d7014b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 -- 172.21.15.143:0/3077627152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700ac530 con 0x7f4d7015c8a0 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d67fff640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 0x7f4d7014bde0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800f7c0 tx=0x7f4d5800fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580050d0 con 0x7f4d7015c8a0 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58005250 con 0x7f4d7015c8a0 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d700ac810 con 0x7f4d7015c8a0 2023-11-24T06:30:11.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800d730 con 0x7f4d7015c8a0 2023-11-24T06:30:11.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7014b8b0 con 0x7f4d7015c8a0 2023-11-24T06:30:11.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.865+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7014ba70 con 0x7f4d7015c8a0 2023-11-24T06:30:11.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.869+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d5800d890 con 0x7f4d7015c8a0 2023-11-24T06:30:11.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.869+0000 7f4d677fe640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:11.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.869+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d58083d90 con 0x7f4d7015c8a0 2023-11-24T06:30:11.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.869+0000 7f4d6ed9d640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:11.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.869+0000 7f4d6ed9d640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d50066470 0x7f4d50068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009b60 tx=0x7f4d60009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:11.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:11.873+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d58051200 con 0x7f4d7015c8a0 2023-11-24T06:30:12.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d7004e8c0 con 0x7f4d7015c8a0 2023-11-24T06:30:12.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d677fe640 1 -- 172.21.15.143:0/3077627152 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d58054820 con 0x7f4d7015c8a0 2023-11-24T06:30:12.027 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:12.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d50066470 msgr2=0x7f4d50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d50066470 0x7f4d50068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009b60 tx=0x7f4d60009190 comp rx=0 tx=0).stop 2023-11-24T06:30:12.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 msgr2=0x7f4d7014bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 0x7f4d7014bde0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800f7c0 tx=0x7f4d5800fbc0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 shutdown_connections 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d701e2380 0x7f4d7014c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d7015c8a0 0x7f4d7014bde0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 --2- 172.21.15.143:0/3077627152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c005190 0x7f4d7014b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 >> 172.21.15.143:0/3077627152 conn(0x7f4d700b0c80 msgr2=0x7f4d7006ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 shutdown_connections 2023-11-24T06:30:12.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.021+0000 7f4d75157640 1 -- 172.21.15.143:0/3077627152 wait complete. 2023-11-24T06:30:12.048 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:30:12.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.181+0000 7f94de616640 1 Processor -- start 2023-11-24T06:30:12.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.181+0000 7f94de616640 1 -- start start 2023-11-24T06:30:12.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.181+0000 7f94de616640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b220 0x7f94d80cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.181+0000 7f94de616640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80abed0 con 0x7f94d815b600 2023-11-24T06:30:12.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.181+0000 7f94de616640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d8072370 con 0x7f94d80c9650 2023-11-24T06:30:12.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.181+0000 7f94de616640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8072710 con 0x7f94d815b220 2023-11-24T06:30:12.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d77fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f94d815b600 0x7f94d806d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56338/0 (socket says 172.21.15.143:56338) 2023-11-24T06:30:12.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d77fe640 1 -- 172.21.15.143:0/2735563985 learned_addr learned my addr 172.21.15.143:0/2735563985 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:12.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d7fff640 1 --2- 172.21.15.143:0/2735563985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b220 0x7f94d80cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d6ffd640 1 -- 172.21.15.143:0/2735563985 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085301756 0 0) 0x7f94d80abed0 con 0x7f94d815b600 2023-11-24T06:30:12.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d6ffd640 1 -- 172.21.15.143:0/2735563985 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c0003530 con 0x7f94d815b600 2023-11-24T06:30:12.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d6ffd640 1 -- 172.21.15.143:0/2735563985 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638108603 0 0) 0x7f94d8072370 con 0x7f94d80c9650 2023-11-24T06:30:12.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d7fff640 1 -- 172.21.15.143:0/2735563985 >> v1:172.21.15.146:6789/0 conn(0x7f94d80c9650 legacy=0x7f94d80cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d7fff640 1 -- 172.21.15.143:0/2735563985 >> v1:172.21.15.143:6789/0 conn(0x7f94d815b600 legacy=0x7f94d806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d7fff640 1 -- 172.21.15.143:0/2735563985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8070670 con 0x7f94d815b220 2023-11-24T06:30:12.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.185+0000 7f94d7fff640 1 --2- 172.21.15.143:0/2735563985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b220 0x7f94d80cada0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f94c80097f0 tx=0x7f94c801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225b65eeb3956ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94d6ffd640 1 -- 172.21.15.143:0/2735563985 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80ab600 con 0x7f94d815b220 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94d6ffd640 1 -- 172.21.15.143:0/2735563985 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80a7050 con 0x7f94d815b220 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94d6ffd640 1 -- 172.21.15.143:0/2735563985 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80ab980 con 0x7f94d815b220 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- 172.21.15.143:0/2735563985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b220 msgr2=0x7f94d80cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 --2- 172.21.15.143:0/2735563985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b220 0x7f94d80cada0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f94c80097f0 tx=0x7f94c801c490 comp rx=0 tx=0).stop 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- 172.21.15.143:0/2735563985 shutdown_connections 2023-11-24T06:30:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 --2- 172.21.15.143:0/2735563985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b220 0x7f94d80cada0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- 172.21.15.143:0/2735563985 >> 172.21.15.143:0/2735563985 conn(0x7f94d80b0bf0 msgr2=0x7f94d80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:12.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- 172.21.15.143:0/2735563985 shutdown_connections 2023-11-24T06:30:12.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- 172.21.15.143:0/2735563985 wait complete. 2023-11-24T06:30:12.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 Processor -- start 2023-11-24T06:30:12.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- start start 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d80c9650 0x7f94d8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 0x7f94d81535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b600 0x7f94d80b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c6c10 con 0x7f94d815b220 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c6ef0 con 0x7f94d80c9650 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94de616640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c71d0 con 0x7f94d815b600 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.189+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 0x7f94d81535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 0x7f94d81535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53010/0 (socket says 172.21.15.143:53010) 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 -- 172.21.15.143:0/4159620451 learned_addr learned my addr 172.21.15.143:0/4159620451 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94dcbb3640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b600 0x7f94d80b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d7fff640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d80c9650 0x7f94d8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 -- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b600 msgr2=0x7f94d80b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b600 0x7f94d80b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 -- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d80c9650 msgr2=0x7f94d8152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d80c9650 0x7f94d8152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 -- 172.21.15.143:0/4159620451 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8009420 con 0x7f94d815b220 2023-11-24T06:30:12.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d77fe640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 0x7f94d81535b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00c390 tx=0x7f94cc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc005cf0 con 0x7f94d815b220 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc005e70 con 0x7f94d815b220 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80c74b0 con 0x7f94d815b220 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0072f0 con 0x7f94d815b220 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d80c8630 con 0x7f94d815b220 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d809d250 con 0x7f94d815b220 2023-11-24T06:30:12.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94cc007450 con 0x7f94d815b220 2023-11-24T06:30:12.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d4ff9640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f94c4066470 0x7f94c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.193+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94cc0833c0 con 0x7f94d815b220 2023-11-24T06:30:12.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.197+0000 7f94d7fff640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f94c4066470 0x7f94c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.197+0000 7f94d7fff640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f94c4066470 0x7f94c4068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94c80ad000 tx=0x7f94c80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:12.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.201+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94cc0509a0 con 0x7f94d815b220 2023-11-24T06:30:12.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94d80c7960 con 0x7f94d815b220 2023-11-24T06:30:12.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94d4ff9640 1 -- 172.21.15.143:0/4159620451 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f94cc053fc0 con 0x7f94d815b220 2023-11-24T06:30:12.370 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:30:12.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f94c4066470 msgr2=0x7f94c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f94c4066470 0x7f94c4068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94c80ad000 tx=0x7f94c80a6000 comp rx=0 tx=0).stop 2023-11-24T06:30:12.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 msgr2=0x7f94d81535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 0x7f94d81535b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00c390 tx=0x7f94cc00c850 comp rx=0 tx=0).stop 2023-11-24T06:30:12.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 shutdown_connections 2023-11-24T06:30:12.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f94c4066470 0x7f94c4068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d815b600 0x7f94d80b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94d815b220 0x7f94d81535b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 --2- 172.21.15.143:0/4159620451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d80c9650 0x7f94d8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 >> 172.21.15.143:0/4159620451 conn(0x7f94d80b0bf0 msgr2=0x7f94d809a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:12.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 shutdown_connections 2023-11-24T06:30:12.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.365+0000 7f94de616640 1 -- 172.21.15.143:0/4159620451 wait complete. 2023-11-24T06:30:12.391 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:30:12.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:12.391 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-24T06:30:12.424 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:30:12.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:12.424 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:30:12.487 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:12.487 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:12.497 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:12.497 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:12.550 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:12.550 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:12.606 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:12.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.737+0000 7f8374980640 1 Processor -- start 2023-11-24T06:30:12.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.737+0000 7f8374980640 1 -- start start 2023-11-24T06:30:12.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8374980640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8374980640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f837009cc20 0x7f837006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8374980640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f837006e280 0x7f83700709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8374980640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8370145020 con 0x7f837006e280 2023-11-24T06:30:12.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8374980640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837006d8b0 con 0x7f837009cc20 2023-11-24T06:30:12.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8374980640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837009d0a0 con 0x7f8370144030 2023-11-24T06:30:12.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f837006e280 0x7f83700709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f837006e280 0x7f83700709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53024/0 (socket says 172.21.15.143:53024) 2023-11-24T06:30:12.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 -- 172.21.15.143:0/3962515930 learned_addr learned my addr 172.21.15.143:0/3962515930 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836e59c640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f8365d9b640 1 --2- 172.21.15.143:0/3962515930 >> v2:172.21.15.146:3300/0 conn(0x7f837009cc20 0x7f837006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 -- 172.21.15.143:0/3962515930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 msgr2=0x7f837006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 -- 172.21.15.143:0/3962515930 >> v2:172.21.15.146:3300/0 conn(0x7f837009cc20 msgr2=0x7f837006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 --2- 172.21.15.143:0/3962515930 >> v2:172.21.15.146:3300/0 conn(0x7f837009cc20 0x7f837006dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836ed9d640 1 -- 172.21.15.143:0/3962515930 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837006cca0 con 0x7f837006e280 2023-11-24T06:30:12.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.741+0000 7f836e59c640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f836ed9d640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837006e280 0x7f83700709c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f837006bf90 tx=0x7f836801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a473eceadbd8873 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f836dd9b640 1 -- 172.21.15.143:0/3962515930 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680a5820 con 0x7f837006e280 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f836dd9b640 1 -- 172.21.15.143:0/3962515930 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680a5980 con 0x7f837006e280 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f836dd9b640 1 -- 172.21.15.143:0/3962515930 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680a5d10 con 0x7f837006e280 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 -- 172.21.15.143:0/3962515930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837006e280 msgr2=0x7f83700709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837006e280 0x7f83700709c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f837006bf90 tx=0x7f836801c9a0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 -- 172.21.15.143:0/3962515930 shutdown_connections 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837006e280 0x7f83700709c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 --2- 172.21.15.143:0/3962515930 >> v2:172.21.15.146:3300/0 conn(0x7f837009cc20 0x7f837006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 --2- 172.21.15.143:0/3962515930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 -- 172.21.15.143:0/3962515930 >> 172.21.15.143:0/3962515930 conn(0x7f83700b0bf0 msgr2=0x7f83700b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 -- 172.21.15.143:0/3962515930 shutdown_connections 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 -- 172.21.15.143:0/3962515930 wait complete. 2023-11-24T06:30:12.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 Processor -- start 2023-11-24T06:30:12.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.745+0000 7f8374980640 1 -- start start 2023-11-24T06:30:12.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837006e280 0x7f8370138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 0x7f83700b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837009b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700cbb40 con 0x7f837009cc20 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370139050 con 0x7f837006e280 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700cbde0 con 0x7f8370144030 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 0x7f83700b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 0x7f83700b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53038/0 (socket says 172.21.15.143:53038) 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 -- 172.21.15.143:0/981335167 learned_addr learned my addr 172.21.15.143:0/981335167 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f836e59c640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837006e280 0x7f8370138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f836ed9d640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837009b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 -- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 msgr2=0x7f837009b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837009b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 -- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837006e280 msgr2=0x7f8370138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837006e280 0x7f8370138b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 -- 172.21.15.143:0/981335167 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009b30 con 0x7f837009cc20 2023-11-24T06:30:12.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8365d9b640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 0x7f83700b2f60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f835800c7f0 tx=0x7f835800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:12.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358004220 con 0x7f837009cc20 2023-11-24T06:30:12.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83580043a0 con 0x7f837009cc20 2023-11-24T06:30:12.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83700cc0c0 con 0x7f837009cc20 2023-11-24T06:30:12.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358004510 con 0x7f837009cc20 2023-11-24T06:30:12.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83700cc680 con 0x7f837009cc20 2023-11-24T06:30:12.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83700cc8a0 con 0x7f837009cc20 2023-11-24T06:30:12.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.749+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8358003a70 con 0x7f837009cc20 2023-11-24T06:30:12.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.753+0000 7f83677fe640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f83500664a0 0x7f8350068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:12.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.753+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8358083df0 con 0x7f837009cc20 2023-11-24T06:30:12.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.753+0000 7f836e59c640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f83500664a0 0x7f8350068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:12.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.753+0000 7f836e59c640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f83500664a0 0x7f8350068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8360006fd0 tx=0x7f8360008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:12.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.757+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8358051280 con 0x7f837009cc20 2023-11-24T06:30:12.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.905+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8370067520 con 0x7f837009cc20 2023-11-24T06:30:12.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.905+0000 7f83677fe640 1 -- 172.21.15.143:0/981335167 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f835801e090 con 0x7f837009cc20 2023-11-24T06:30:12.911 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:12.911 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:12.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f83500664a0 msgr2=0x7f8350068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f83500664a0 0x7f8350068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8360006fd0 tx=0x7f8360008040 comp rx=0 tx=0).stop 2023-11-24T06:30:12.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 msgr2=0x7f83700b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:12.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 0x7f83700b2f60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f835800c7f0 tx=0x7f835800ccb0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 shutdown_connections 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f83500664a0 0x7f8350068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8370144030 0x7f837009b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f837009cc20 0x7f83700b2f60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 --2- 172.21.15.143:0/981335167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837006e280 0x7f8370138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 >> 172.21.15.143:0/981335167 conn(0x7f83700b0bf0 msgr2=0x7f83700abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 shutdown_connections 2023-11-24T06:30:12.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:12.909+0000 7f8374980640 1 -- 172.21.15.143:0/981335167 wait complete. 2023-11-24T06:30:12.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:12.933 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:13.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 Processor -- start 2023-11-24T06:30:13.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 -- start start 2023-11-24T06:30:13.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc81415d450 0x7fc814161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc81406d8f0 0x7fc8140ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81406dd80 con 0x7fc81415d450 2023-11-24T06:30:13.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81406b460 con 0x7fc81406d8f0 2023-11-24T06:30:13.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81c09c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81406a5b0 con 0x7fc81406b8f0 2023-11-24T06:30:13.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc81415d450 0x7fc814161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc81415d450 0x7fc814161af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53044/0 (socket says 172.21.15.143:53044) 2023-11-24T06:30:13.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 -- 172.21.15.143:0/2842440340 learned_addr learned my addr 172.21.15.143:0/2842440340 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819637640 1 --2- 172.21.15.143:0/2842440340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81a639640 1 --2- 172.21.15.143:0/2842440340 >> v2:172.21.15.146:3300/0 conn(0x7fc81406d8f0 0x7fc8140ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 -- 172.21.15.143:0/2842440340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 msgr2=0x7fc81406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 --2- 172.21.15.143:0/2842440340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81406d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 -- 172.21.15.143:0/2842440340 >> v2:172.21.15.146:3300/0 conn(0x7fc81406d8f0 msgr2=0x7fc8140ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 --2- 172.21.15.143:0/2842440340 >> v2:172.21.15.146:3300/0 conn(0x7fc81406d8f0 0x7fc8140ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc819e38640 1 -- 172.21.15.143:0/2842440340 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814162030 con 0x7fc81415d450 2023-11-24T06:30:13.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.077+0000 7fc81a639640 1 --2- 172.21.15.143:0/2842440340 >> v2:172.21.15.146:3300/0 conn(0x7fc81406d8f0 0x7fc8140ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:13.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc819e38640 1 --2- 172.21.15.143:0/2842440340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc814161af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc81406b3d0 tx=0x7fc81001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a5ecf81e3cc4f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc818e36640 1 -- 172.21.15.143:0/2842440340 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100aa5f0 con 0x7fc81415d450 2023-11-24T06:30:13.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc818e36640 1 -- 172.21.15.143:0/2842440340 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8100aa750 con 0x7fc81415d450 2023-11-24T06:30:13.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc818e36640 1 -- 172.21.15.143:0/2842440340 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100aaae0 con 0x7fc81415d450 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 -- 172.21.15.143:0/2842440340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 msgr2=0x7fc814161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 --2- 172.21.15.143:0/2842440340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc814161af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc81406b3d0 tx=0x7fc81001c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 -- 172.21.15.143:0/2842440340 shutdown_connections 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 --2- 172.21.15.143:0/2842440340 >> v2:172.21.15.146:3300/0 conn(0x7fc81406d8f0 0x7fc8140ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 --2- 172.21.15.143:0/2842440340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 --2- 172.21.15.143:0/2842440340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc814161af0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 -- 172.21.15.143:0/2842440340 >> 172.21.15.143:0/2842440340 conn(0x7fc8140cf8f0 msgr2=0x7fc8140cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:13.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 -- 172.21.15.143:0/2842440340 shutdown_connections 2023-11-24T06:30:13.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.081+0000 7fc81c09c640 1 -- 172.21.15.143:0/2842440340 wait complete. 2023-11-24T06:30:13.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 Processor -- start 2023-11-24T06:30:13.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- start start 2023-11-24T06:30:13.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81406d8f0 0x7fc8141f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc81415c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81414bc10 con 0x7fc81415d450 2023-11-24T06:30:13.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81414c4b0 con 0x7fc81406d8f0 2023-11-24T06:30:13.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81414ce80 con 0x7fc81406b8f0 2023-11-24T06:30:13.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc81415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc81415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53054/0 (socket says 172.21.15.143:53054) 2023-11-24T06:30:13.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 -- 172.21.15.143:0/1830526418 learned_addr learned my addr 172.21.15.143:0/1830526418 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:13.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc819e38640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc819637640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81406d8f0 0x7fc8141f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 -- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 msgr2=0x7fc81414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 -- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81406d8f0 msgr2=0x7fc8141f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81406d8f0 0x7fc8141f9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 -- 172.21.15.143:0/1830526418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100094d0 con 0x7fc81415d450 2023-11-24T06:30:13.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc819e38640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:13.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81a639640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc81415c070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc80c007f20 tx=0x7fc80c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00dee0 con 0x7fc81415d450 2023-11-24T06:30:13.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c00f040 con 0x7fc81415d450 2023-11-24T06:30:13.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c003de0 con 0x7fc81415d450 2023-11-24T06:30:13.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81415ca50 con 0x7fc81415d450 2023-11-24T06:30:13.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81414c140 con 0x7fc81415d450 2023-11-24T06:30:13.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.085+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81414c660 con 0x7fc81415d450 2023-11-24T06:30:13.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.089+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc80c004030 con 0x7fc81415d450 2023-11-24T06:30:13.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.089+0000 7fc80a7fc640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7f8066470 0x7fc7f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.089+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc80c084210 con 0x7fc81415d450 2023-11-24T06:30:13.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.089+0000 7fc819e38640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7f8066470 0x7fc7f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.089+0000 7fc819e38640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7f8066470 0x7fc7f8068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc8100ae000 tx=0x7fc8100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.093+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc81414c660 con 0x7fc81415d450 2023-11-24T06:30:13.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc81414c660 con 0x7fc81415d450 2023-11-24T06:30:13.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc80a7fc640 1 -- 172.21.15.143:0/1830526418 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc81414c660 con 0x7fc81415d450 2023-11-24T06:30:13.249 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:13.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7f8066470 msgr2=0x7fc7f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7f8066470 0x7fc7f8068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc8100ae000 tx=0x7fc8100a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:13.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 msgr2=0x7fc81415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc81415c070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc80c007f20 tx=0x7fc80c00d560 comp rx=0 tx=0).stop 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 shutdown_connections 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7f8066470 0x7fc7f8068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415d450 0x7fc81415c070 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81406d8f0 0x7fc8141f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 --2- 172.21.15.143:0/1830526418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81406b8f0 0x7fc81414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 >> 172.21.15.143:0/1830526418 conn(0x7fc8140cf8f0 msgr2=0x7fc8140b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 shutdown_connections 2023-11-24T06:30:13.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.245+0000 7fc81c09c640 1 -- 172.21.15.143:0/1830526418 wait complete. 2023-11-24T06:30:13.270 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:13.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 Processor -- start 2023-11-24T06:30:13.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 -- start start 2023-11-24T06:30:13.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4480ae4a0 0x7fe44815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480ce420 0x7fe44806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4480b3510 con 0x7fe4480cd850 2023-11-24T06:30:13.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480b37f0 con 0x7fe4480ae4a0 2023-11-24T06:30:13.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.405+0000 7fe44dd8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480b3ad0 con 0x7fe4480ce420 2023-11-24T06:30:13.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe4477fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4480ae4a0 0x7fe44815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe43ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe4480cd850 0x7fe4480cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56346/0 (socket says 172.21.15.143:56346) 2023-11-24T06:30:13.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe43ffff640 1 -- 172.21.15.143:0/4079026216 learned_addr learned my addr 172.21.15.143:0/4079026216 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:13.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe447fff640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480ce420 0x7fe44806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe4477fe640 1 -- 172.21.15.143:0/4079026216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480ce420 msgr2=0x7fe44806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:13.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe4477fe640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480ce420 0x7fe44806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe4477fe640 1 -- 172.21.15.143:0/4079026216 >> v1:172.21.15.143:6789/0 conn(0x7fe4480cd850 legacy=0x7fe4480cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe4477fe640 1 -- 172.21.15.143:0/4079026216 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480b3db0 con 0x7fe4480ae4a0 2023-11-24T06:30:13.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe447fff640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480ce420 0x7fe44806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:13.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe446ffd640 1 -- 172.21.15.143:0/4079026216 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413326680 0 0) 0x7fe4480b3510 con 0x7fe4480cd850 2023-11-24T06:30:13.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe4477fe640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe44815ba00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097c0 tx=0x7fe43801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8ebe3e589eaf1d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe446ffd640 1 -- 172.21.15.143:0/4079026216 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4380ab670 con 0x7fe4480ae4a0 2023-11-24T06:30:13.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe446ffd640 1 -- 172.21.15.143:0/4079026216 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4380ab7d0 con 0x7fe4480ae4a0 2023-11-24T06:30:13.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.409+0000 7fe446ffd640 1 -- 172.21.15.143:0/4079026216 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4380abb60 con 0x7fe4480ae4a0 2023-11-24T06:30:13.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4079026216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 msgr2=0x7fe44815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe44815ba00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097c0 tx=0x7fe43801c450 comp rx=0 tx=0).stop 2023-11-24T06:30:13.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4079026216 shutdown_connections 2023-11-24T06:30:13.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480ce420 0x7fe44806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4079026216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe44815ba00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4079026216 >> 172.21.15.143:0/4079026216 conn(0x7fe4480b0c80 msgr2=0x7fe4480b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:13.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4079026216 shutdown_connections 2023-11-24T06:30:13.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4079026216 wait complete. 2023-11-24T06:30:13.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 Processor -- start 2023-11-24T06:30:13.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- start start 2023-11-24T06:30:13.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe4481f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480cd850 0x7fe4480afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4480ce420 0x7fe4480b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480ac000 con 0x7fe4480ae4a0 2023-11-24T06:30:13.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480ac2e0 con 0x7fe4480ce420 2023-11-24T06:30:13.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe44dd8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480ac5c0 con 0x7fe4480cd850 2023-11-24T06:30:13.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe4481f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe4481f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53084/0 (socket says 172.21.15.143:53084) 2023-11-24T06:30:13.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 -- 172.21.15.143:0/4066109851 learned_addr learned my addr 172.21.15.143:0/4066109851 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:13.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe43ffff640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480cd850 0x7fe4480afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 -- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480cd850 msgr2=0x7fe4480afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe447fff640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4480ce420 0x7fe4480b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480cd850 0x7fe4480afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 -- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4480ce420 msgr2=0x7fe4480b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4480ce420 0x7fe4480b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe4477fe640 1 -- 172.21.15.143:0/4066109851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe438009420 con 0x7fe4480ae4a0 2023-11-24T06:30:13.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe43ffff640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480cd850 0x7fe4480afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:13.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.413+0000 7fe447fff640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4480ce420 0x7fe4480b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:13.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe4477fe640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe4481f5410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4380ad040 tx=0x7fe43801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4380b5810 con 0x7fe4480ae4a0 2023-11-24T06:30:13.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4380b5990 con 0x7fe4480ae4a0 2023-11-24T06:30:13.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4380b5d40 con 0x7fe4480ae4a0 2023-11-24T06:30:13.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4480ac8a0 con 0x7fe4480ae4a0 2023-11-24T06:30:13.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4481f5950 con 0x7fe4480ae4a0 2023-11-24T06:30:13.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44804e8c0 con 0x7fe4480ae4a0 2023-11-24T06:30:13.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4380bf410 con 0x7fe4480ae4a0 2023-11-24T06:30:13.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe444ff9640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe4280664a0 0x7fe428068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe43811e980 con 0x7fe4480ae4a0 2023-11-24T06:30:13.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe43ffff640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe4280664a0 0x7fe428068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.417+0000 7fe43ffff640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe4280664a0 0x7fe428068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe44814dbc0 tx=0x7fe430009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.421+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4380ebd60 con 0x7fe4480ae4a0 2023-11-24T06:30:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.569+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4480ac700 con 0x7fe4480ae4a0 2023-11-24T06:30:13.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe444ff9640 1 -- 172.21.15.143:0/4066109851 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4480ac700 con 0x7fe4480ae4a0 2023-11-24T06:30:13.577 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe4280664a0 msgr2=0x7fe428068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe4280664a0 0x7fe428068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe44814dbc0 tx=0x7fe430009040 comp rx=0 tx=0).stop 2023-11-24T06:30:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 msgr2=0x7fe4481f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe4481f5410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4380ad040 tx=0x7fe43801ac90 comp rx=0 tx=0).stop 2023-11-24T06:30:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 shutdown_connections 2023-11-24T06:30:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe4280664a0 0x7fe428068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4480ce420 0x7fe4480b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4480cd850 0x7fe4480afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 --2- 172.21.15.143:0/4066109851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4480ae4a0 0x7fe4481f5410 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 >> 172.21.15.143:0/4066109851 conn(0x7fe4480b0c80 msgr2=0x7fe4480705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 shutdown_connections 2023-11-24T06:30:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.573+0000 7fe44dd8d640 1 -- 172.21.15.143:0/4066109851 wait complete. 2023-11-24T06:30:13.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:13.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 Processor -- start 2023-11-24T06:30:13.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 -- start start 2023-11-24T06:30:13.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 0x7fc22c071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc22c071e40 0x7fc22c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0cd400 con 0x7fc22c15d540 2023-11-24T06:30:13.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c072860 con 0x7fc22c071e40 2023-11-24T06:30:13.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc231232640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c06dc30 con 0x7fc22c06d760 2023-11-24T06:30:13.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc22b59e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc22c071e40 0x7fc22c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc223fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 0x7fc22c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc22ad9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc22c15d540 0x7fc22c06d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:53372/0 (socket says 172.21.15.143:53372) 2023-11-24T06:30:13.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc22b59e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc22c071e40 0x7fc22c0cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47520/0 (socket says 172.21.15.143:47520) 2023-11-24T06:30:13.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc22ad9d640 1 -- 172.21.15.143:0/94316695 learned_addr learned my addr 172.21.15.143:0/94316695 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:13.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.733+0000 7fc223fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 0x7fc22c071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:36420/0 (socket says 172.21.15.143:36420) 2023-11-24T06:30:13.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22b59e640 1 -- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 msgr2=0x7fc22c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:13.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22b59e640 1 --2- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 0x7fc22c071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22b59e640 1 -- 172.21.15.143:0/94316695 >> v1:172.21.15.146:6789/0 conn(0x7fc22c15d540 legacy=0x7fc22c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22b59e640 1 -- 172.21.15.143:0/94316695 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c06df10 con 0x7fc22c071e40 2023-11-24T06:30:13.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc223fff640 1 --2- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 0x7fc22c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:13.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22b59e640 1 --2- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c071e40 0x7fc22c0cd890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc224009d90 tx=0x7fc22401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da987b90375219fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22a59c640 1 -- 172.21.15.143:0/94316695 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240a5890 con 0x7fc22c071e40 2023-11-24T06:30:13.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22a59c640 1 -- 172.21.15.143:0/94316695 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2240a59f0 con 0x7fc22c071e40 2023-11-24T06:30:13.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.737+0000 7fc22a59c640 1 -- 172.21.15.143:0/94316695 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240a5d80 con 0x7fc22c071e40 2023-11-24T06:30:13.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c071e40 msgr2=0x7fc22c0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 --2- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c071e40 0x7fc22c0cd890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc224009d90 tx=0x7fc22401c950 comp rx=0 tx=0).stop 2023-11-24T06:30:13.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- 172.21.15.143:0/94316695 shutdown_connections 2023-11-24T06:30:13.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 --2- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c071e40 0x7fc22c0cd890 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 --2- 172.21.15.143:0/94316695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c06d760 0x7fc22c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- 172.21.15.143:0/94316695 >> 172.21.15.143:0/94316695 conn(0x7fc22c0b0c80 msgr2=0x7fc22c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:13.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- 172.21.15.143:0/94316695 shutdown_connections 2023-11-24T06:30:13.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- 172.21.15.143:0/94316695 wait complete. 2023-11-24T06:30:13.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 Processor -- start 2023-11-24T06:30:13.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- start start 2023-11-24T06:30:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c06d760 0x7fc22c098780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c071e40 0x7fc22c0ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 0x7fc22c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0adc10 con 0x7fc22c15d540 2023-11-24T06:30:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0adef0 con 0x7fc22c06d760 2023-11-24T06:30:13.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc231232640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0ae1d0 con 0x7fc22c071e40 2023-11-24T06:30:13.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc22b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 0x7fc22c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc22b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 0x7fc22c0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53086/0 (socket says 172.21.15.143:53086) 2023-11-24T06:30:13.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc22b59e640 1 -- 172.21.15.143:0/4108990453 learned_addr learned my addr 172.21.15.143:0/4108990453 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:13.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc22ad9d640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c06d760 0x7fc22c098780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.741+0000 7fc223fff640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c071e40 0x7fc22c0ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc22b59e640 1 -- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c071e40 msgr2=0x7fc22c0ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc22b59e640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c071e40 0x7fc22c0ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc22b59e640 1 -- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c06d760 msgr2=0x7fc22c098780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc22b59e640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c06d760 0x7fc22c098780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc22b59e640 1 -- 172.21.15.143:0/4108990453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009420 con 0x7fc22c15d540 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc22b59e640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 0x7fc22c0afbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc2240b0040 tx=0x7fc2240196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240b9860 con 0x7fc22c15d540 2023-11-24T06:30:13.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2240b99c0 con 0x7fc22c15d540 2023-11-24T06:30:13.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240b9d70 con 0x7fc22c15d540 2023-11-24T06:30:13.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc224009a70 con 0x7fc22c15d540 2023-11-24T06:30:13.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c14d820 con 0x7fc22c15d540 2023-11-24T06:30:13.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c04e8c0 con 0x7fc22c15d540 2023-11-24T06:30:13.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.745+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2240c4460 con 0x7fc22c15d540 2023-11-24T06:30:13.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.749+0000 7fc2237fe640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc20c066470 0x7fc20c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:13.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.749+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc22411f100 con 0x7fc22c15d540 2023-11-24T06:30:13.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.749+0000 7fc22ad9d640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc20c066470 0x7fc20c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:13.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.749+0000 7fc22ad9d640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc20c066470 0x7fc20c068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc21c005890 tx=0x7fc21c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:13.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.753+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2240ec6c0 con 0x7fc22c15d540 2023-11-24T06:30:13.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc22c0cc890 con 0x7fc22c15d540 2023-11-24T06:30:13.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc2237fe640 1 -- 172.21.15.143:0/4108990453 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2240efce0 con 0x7fc22c15d540 2023-11-24T06:30:13.906 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:13.908 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc20c066470 msgr2=0x7fc20c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.908 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc20c066470 0x7fc20c068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc21c005890 tx=0x7fc21c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 msgr2=0x7fc22c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 0x7fc22c0afbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc2240b0040 tx=0x7fc2240196f0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 shutdown_connections 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc20c066470 0x7fc20c068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc22c15d540 0x7fc22c0afbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc22c071e40 0x7fc22c0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 --2- 172.21.15.143:0/4108990453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c06d760 0x7fc22c098780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:13.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 >> 172.21.15.143:0/4108990453 conn(0x7fc22c0b0c80 msgr2=0x7fc22c152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:13.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.901+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 shutdown_connections 2023-11-24T06:30:13.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:13.905+0000 7fc231232640 1 -- 172.21.15.143:0/4108990453 wait complete. 2023-11-24T06:30:13.927 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:30:14.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3eed813640 1 Processor -- start 2023-11-24T06:30:14.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3eed813640 1 -- start start 2023-11-24T06:30:14.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3eed813640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3ee80d1da0 0x7f3ee80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3eed813640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee80aff80 con 0x7f3ee815d440 2023-11-24T06:30:14.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3eed813640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee80b0b00 con 0x7f3ee80b4490 2023-11-24T06:30:14.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3eed813640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee80cdc40 con 0x7f3ee80d1da0 2023-11-24T06:30:14.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3ee6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3ee815d440 0x7f3ee80d1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56360/0 (socket says 172.21.15.143:56360) 2023-11-24T06:30:14.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3ee6ffd640 1 -- 172.21.15.143:0/2659359896 learned_addr learned my addr 172.21.15.143:0/2659359896 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:14.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3ee67fc640 1 --2- 172.21.15.143:0/2659359896 >> v2:172.21.15.143:3300/0 conn(0x7f3ee80d1da0 0x7f3ee80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3ee67fc640 1 -- 172.21.15.143:0/2659359896 >> v1:172.21.15.146:6789/0 conn(0x7f3ee80b4490 legacy=0x7f3ee80b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3ee67fc640 1 -- 172.21.15.143:0/2659359896 >> v1:172.21.15.143:6789/0 conn(0x7f3ee815d440 legacy=0x7f3ee80d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.061+0000 7f3ee67fc640 1 -- 172.21.15.143:0/2659359896 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80b01d0 con 0x7f3ee80d1da0 2023-11-24T06:30:14.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3ee67fc640 1 --2- 172.21.15.143:0/2659359896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80d1da0 0x7f3ee80b3f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0097c0 tx=0x7f3edc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96a7844d4558273 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:14.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3ee5ffb640 1 -- 172.21.15.143:0/2659359896 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0a8970 con 0x7f3ee80d1da0 2023-11-24T06:30:14.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3ee5ffb640 1 -- 172.21.15.143:0/2659359896 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc0a8ad0 con 0x7f3ee80d1da0 2023-11-24T06:30:14.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3ee5ffb640 1 -- 172.21.15.143:0/2659359896 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0a8e60 con 0x7f3ee80d1da0 2023-11-24T06:30:14.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 -- 172.21.15.143:0/2659359896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80d1da0 msgr2=0x7f3ee80b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 --2- 172.21.15.143:0/2659359896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80d1da0 0x7f3ee80b3f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0097c0 tx=0x7f3edc01ec70 comp rx=0 tx=0).stop 2023-11-24T06:30:14.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 -- 172.21.15.143:0/2659359896 shutdown_connections 2023-11-24T06:30:14.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 --2- 172.21.15.143:0/2659359896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80d1da0 0x7f3ee80b3f50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 -- 172.21.15.143:0/2659359896 >> 172.21.15.143:0/2659359896 conn(0x7f3ee808cd00 msgr2=0x7f3ee809c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:14.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 -- 172.21.15.143:0/2659359896 shutdown_connections 2023-11-24T06:30:14.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.065+0000 7f3eed813640 1 -- 172.21.15.143:0/2659359896 wait complete. 2023-11-24T06:30:14.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 Processor -- start 2023-11-24T06:30:14.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 -- start start 2023-11-24T06:30:14.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 0x7f3ee81518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ee80d1da0 0x7f3ee80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee815d440 0x7f3ee815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80cb660 con 0x7f3ee80b4490 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80c9550 con 0x7f3ee815d440 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80c9830 con 0x7f3ee80d1da0 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 0x7f3ee81518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 0x7f3ee81518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53116/0 (socket says 172.21.15.143:53116) 2023-11-24T06:30:14.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 -- 172.21.15.143:0/3828564103 learned_addr learned my addr 172.21.15.143:0/3828564103 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee77fe640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee815d440 0x7f3ee815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee67fc640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ee80d1da0 0x7f3ee80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 -- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ee80d1da0 msgr2=0x7f3ee80c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ee80d1da0 0x7f3ee80c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 -- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee815d440 msgr2=0x7f3ee815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee815d440 0x7f3ee815e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 -- 172.21.15.143:0/3828564103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009420 con 0x7f3ee80b4490 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee67fc640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ee80d1da0 0x7f3ee80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ee6ffd640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 0x7f3ee81518d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c500 tx=0x7f3ed800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8005cf0 con 0x7f3ee80b4490 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8005e50 con 0x7f3ee80b4490 2023-11-24T06:30:14.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee80c7850 con 0x7f3ee80b4490 2023-11-24T06:30:14.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80072f0 con 0x7f3ee80b4490 2023-11-24T06:30:14.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.069+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee80c9b10 con 0x7f3ee80b4490 2023-11-24T06:30:14.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.073+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee80c7d70 con 0x7f3ee80b4490 2023-11-24T06:30:14.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.073+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ed8007450 con 0x7f3ee80b4490 2023-11-24T06:30:14.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.073+0000 7f3ecffff640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3ed4066470 0x7f3ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.073+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ed8083450 con 0x7f3ee80b4490 2023-11-24T06:30:14.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.073+0000 7f3ee67fc640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3ed4066470 0x7f3ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.073+0000 7f3ee67fc640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3ed4066470 0x7f3ed4068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0b2000 tx=0x7f3edc0aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:14.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.077+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ee80c7d70 con 0x7f3ee80b4490 2023-11-24T06:30:14.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.237+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ee80c7d70 con 0x7f3ee80b4490 2023-11-24T06:30:14.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.237+0000 7f3ecffff640 1 -- 172.21.15.143:0/3828564103 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ed80508f0 con 0x7f3ee80b4490 2023-11-24T06:30:14.244 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:30:14.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3ed4066470 msgr2=0x7f3ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3ed4066470 0x7f3ed4068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0b2000 tx=0x7f3edc0aa070 comp rx=0 tx=0).stop 2023-11-24T06:30:14.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 msgr2=0x7f3ee81518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 0x7f3ee81518d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c500 tx=0x7f3ed800c9c0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 shutdown_connections 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3ed4066470 0x7f3ed4068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee815d440 0x7f3ee815e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ee80d1da0 0x7f3ee80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 --2- 172.21.15.143:0/3828564103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ee80b4490 0x7f3ee81518d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 >> 172.21.15.143:0/3828564103 conn(0x7f3ee808cd00 msgr2=0x7f3ee80b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 shutdown_connections 2023-11-24T06:30:14.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.241+0000 7f3eed813640 1 -- 172.21.15.143:0/3828564103 wait complete. 2023-11-24T06:30:14.265 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:30:14.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:14.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-24T06:30:14.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:30:14.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:14.302 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:30:14.367 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:14.368 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:14.376 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:14.377 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:14.428 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:14.428 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:14.484 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:14.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 Processor -- start 2023-11-24T06:30:14.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 -- start start 2023-11-24T06:30:14.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6000cadd0 0x7fc6000cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60015e4e0 0x7fc60013fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6001411c0 con 0x7fc60006c660 2023-11-24T06:30:14.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6000cb6f0 con 0x7fc6000cadd0 2023-11-24T06:30:14.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc605aba640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60015e990 con 0x7fc60015e4e0 2023-11-24T06:30:14.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6000cadd0 0x7fc6000cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6000cadd0 0x7fc6000cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47552/0 (socket says 172.21.15.143:47552) 2023-11-24T06:30:14.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 -- 172.21.15.143:0/541734352 learned_addr learned my addr 172.21.15.143:0/541734352 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:14.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc6052b9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60015e4e0 0x7fc60013fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 -- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60015e4e0 msgr2=0x7fc60013fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:14.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 --2- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60015e4e0 0x7fc60013fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 -- 172.21.15.143:0/541734352 >> v1:172.21.15.146:6789/0 conn(0x7fc60006c660 legacy=0x7fc600140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc604ab8640 1 -- 172.21.15.143:0/541734352 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60006cb40 con 0x7fc6000cadd0 2023-11-24T06:30:14.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.665+0000 7fc6052b9640 1 --2- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60015e4e0 0x7fc60013fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:14.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc604ab8640 1 --2- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc6000cb1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40098a0 tx=0x7fc5f401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d1de777b817b035 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:14.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc5ff7fe640 1 -- 172.21.15.143:0/541734352 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ab600 con 0x7fc6000cadd0 2023-11-24T06:30:14.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc5ff7fe640 1 -- 172.21.15.143:0/541734352 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40ab760 con 0x7fc6000cadd0 2023-11-24T06:30:14.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc5ff7fe640 1 -- 172.21.15.143:0/541734352 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40abaf0 con 0x7fc6000cadd0 2023-11-24T06:30:14.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 -- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 msgr2=0x7fc6000cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 --2- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc6000cb1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40098a0 tx=0x7fc5f401c4f0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 -- 172.21.15.143:0/541734352 shutdown_connections 2023-11-24T06:30:14.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 --2- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60015e4e0 0x7fc60013fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 --2- 172.21.15.143:0/541734352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc6000cb1b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 -- 172.21.15.143:0/541734352 >> 172.21.15.143:0/541734352 conn(0x7fc6000cb840 msgr2=0x7fc6000cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:14.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 -- 172.21.15.143:0/541734352 shutdown_connections 2023-11-24T06:30:14.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.669+0000 7fc605aba640 1 -- 172.21.15.143:0/541734352 wait complete. 2023-11-24T06:30:14.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 Processor -- start 2023-11-24T06:30:14.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 -- start start 2023-11-24T06:30:14.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60006c660 0x7fc60013fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc60013dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 0x7fc600070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600137f30 con 0x7fc60015e4e0 2023-11-24T06:30:14.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600137010 con 0x7fc6000cadd0 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001372b0 con 0x7fc60006c660 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 0x7fc600070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 0x7fc600070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53130/0 (socket says 172.21.15.143:53130) 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 -- 172.21.15.143:0/2165958529 learned_addr learned my addr 172.21.15.143:0/2165958529 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc604ab8640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60006c660 0x7fc60013fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc5fffff640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc60013dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 -- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60006c660 msgr2=0x7fc60013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60006c660 0x7fc60013fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 -- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 msgr2=0x7fc60013dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc60013dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 -- 172.21.15.143:0/2165958529 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009a70 con 0x7fc60015e4e0 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc604ab8640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60006c660 0x7fc60013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc6052b9640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 0x7fc600070b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800efc0 tx=0x7fc5f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8009d70 con 0x7fc60015e4e0 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800f040 con 0x7fc60015e4e0 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f40094d0 con 0x7fc60015e4e0 2023-11-24T06:30:14.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80039a0 con 0x7fc60015e4e0 2023-11-24T06:30:14.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.673+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600137870 con 0x7fc60015e4e0 2023-11-24T06:30:14.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.677+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60004e850 con 0x7fc60015e4e0 2023-11-24T06:30:14.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.677+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5f80144a0 con 0x7fc60015e4e0 2023-11-24T06:30:14.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.677+0000 7fc5fd7fa640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc5e4066470 0x7fc5e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:14.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.677+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5f8084be0 con 0x7fc60015e4e0 2023-11-24T06:30:14.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.677+0000 7fc604ab8640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc5e4066470 0x7fc5e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:14.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.677+0000 7fc604ab8640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc5e4066470 0x7fc5e4068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40af000 tx=0x7fc5f40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:14.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.681+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5f8051fe0 con 0x7fc60015e4e0 2023-11-24T06:30:14.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.829+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6001691d0 con 0x7fc60015e4e0 2023-11-24T06:30:14.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc5fd7fa640 1 -- 172.21.15.143:0/2165958529 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fc5f8055600 con 0x7fc60015e4e0 2023-11-24T06:30:14.837 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:14.837 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:14.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc5e4066470 msgr2=0x7fc5e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc5e4066470 0x7fc5e4068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40af000 tx=0x7fc5f40a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 msgr2=0x7fc600070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 0x7fc600070b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800efc0 tx=0x7fc5f8009f90 comp rx=0 tx=0).stop 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 shutdown_connections 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc5e4066470 0x7fc5e4068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc60015e4e0 0x7fc600070b80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6000cadd0 0x7fc60013dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 --2- 172.21.15.143:0/2165958529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60006c660 0x7fc60013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 >> 172.21.15.143:0/2165958529 conn(0x7fc6000cb840 msgr2=0x7fc6000af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:14.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 shutdown_connections 2023-11-24T06:30:14.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.833+0000 7fc605aba640 1 -- 172.21.15.143:0/2165958529 wait complete. 2023-11-24T06:30:14.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:14.859 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:14.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.993+0000 7ffb08831640 1 Processor -- start 2023-11-24T06:30:15.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.993+0000 7ffb08831640 1 -- start start 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb08831640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb040ae3a0 0x7ffb040b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb08831640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb040b1090 0x7ffb0406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb08831640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0415b8a0 con 0x7ffb0406e2f0 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb08831640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0415c520 con 0x7ffb040b1090 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb08831640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0415fd90 con 0x7ffb040ae3a0 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0259c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb040b1090 0x7ffb0406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0359e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ffb0406e2f0 0x7ffb040ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56374/0 (socket says 172.21.15.143:56374) 2023-11-24T06:30:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0359e640 1 -- 172.21.15.143:0/3614576126 learned_addr learned my addr 172.21.15.143:0/3614576126 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb02d9d640 1 --2- 172.21.15.143:0/3614576126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb040ae3a0 0x7ffb040b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb01d9b640 1 -- 172.21.15.143:0/3614576126 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256345962 0 0) 0x7ffb0415b8a0 con 0x7ffb0406e2f0 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb01d9b640 1 -- 172.21.15.143:0/3614576126 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaec003530 con 0x7ffb0406e2f0 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0259c640 1 -- 172.21.15.143:0/3614576126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb040ae3a0 msgr2=0x7ffb040b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0259c640 1 --2- 172.21.15.143:0/3614576126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb040ae3a0 0x7ffb040b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0259c640 1 -- 172.21.15.143:0/3614576126 >> v1:172.21.15.143:6789/0 conn(0x7ffb0406e2f0 legacy=0x7ffb040ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:14.997+0000 7ffb0259c640 1 -- 172.21.15.143:0/3614576126 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0406d670 con 0x7ffb040b1090 2023-11-24T06:30:15.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb0259c640 1 --2- 172.21.15.143:0/3614576126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb0406ddb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80097c0 tx=0x7ffaf801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72075e43bb5fc8de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb01d9b640 1 -- 172.21.15.143:0/3614576126 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80ab600 con 0x7ffb040b1090 2023-11-24T06:30:15.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb01d9b640 1 -- 172.21.15.143:0/3614576126 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf80a7050 con 0x7ffb040b1090 2023-11-24T06:30:15.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb01d9b640 1 -- 172.21.15.143:0/3614576126 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80ab980 con 0x7ffb040b1090 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 -- 172.21.15.143:0/3614576126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 msgr2=0x7ffb0406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 --2- 172.21.15.143:0/3614576126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb0406ddb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80097c0 tx=0x7ffaf801c480 comp rx=0 tx=0).stop 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 -- 172.21.15.143:0/3614576126 shutdown_connections 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 --2- 172.21.15.143:0/3614576126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb0406ddb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 --2- 172.21.15.143:0/3614576126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb040ae3a0 0x7ffb040b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 -- 172.21.15.143:0/3614576126 >> 172.21.15.143:0/3614576126 conn(0x7ffb040cbb50 msgr2=0x7ffb040cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 -- 172.21.15.143:0/3614576126 shutdown_connections 2023-11-24T06:30:15.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 -- 172.21.15.143:0/3614576126 wait complete. 2023-11-24T06:30:15.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 Processor -- start 2023-11-24T06:30:15.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.001+0000 7ffb08831640 1 -- start start 2023-11-24T06:30:15.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0406e2f0 0x7ffb040c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb040ae3a0 0x7ffb040c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb040999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c90f0 con 0x7ffb040b1090 2023-11-24T06:30:15.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040afc00 con 0x7ffb040ae3a0 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb041f3f10 con 0x7ffb0406e2f0 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb040999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb040999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53144/0 (socket says 172.21.15.143:53144) 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 -- 172.21.15.143:0/2041452047 learned_addr learned my addr 172.21.15.143:0/2041452047 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0259c640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb040ae3a0 0x7ffb040c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb02d9d640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0406e2f0 0x7ffb040c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 -- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0406e2f0 msgr2=0x7ffb040c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0406e2f0 0x7ffb040c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 -- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb040ae3a0 msgr2=0x7ffb040c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb040ae3a0 0x7ffb040c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 -- 172.21.15.143:0/2041452047 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf8009420 con 0x7ffb040b1090 2023-11-24T06:30:15.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb0359e640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb040999e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00cb40 tx=0x7ffafc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00aca0 con 0x7ffb040b1090 2023-11-24T06:30:15.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00ae00 con 0x7ffb040b1090 2023-11-24T06:30:15.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc012620 con 0x7ffb040b1090 2023-11-24T06:30:15.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb040afe50 con 0x7ffb040b1090 2023-11-24T06:30:15.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb040b0410 con 0x7ffb040b1090 2023-11-24T06:30:15.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.005+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb041f40d0 con 0x7ffb040b1090 2023-11-24T06:30:15.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.009+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffafc007070 con 0x7ffb040b1090 2023-11-24T06:30:15.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.009+0000 7ffaeb7fe640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffaf0066470 0x7ffaf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.009+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffafc083e70 con 0x7ffb040b1090 2023-11-24T06:30:15.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.009+0000 7ffb02d9d640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffaf0066470 0x7ffaf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.009+0000 7ffb02d9d640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffaf0066470 0x7ffaf0068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009b60 tx=0x7ffaf4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.013+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffafc051380 con 0x7ffb040b1090 2023-11-24T06:30:15.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.165+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb0404e850 con 0x7ffb040b1090 2023-11-24T06:30:15.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffaeb7fe640 1 -- 172.21.15.143:0/2041452047 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffafc0170a0 con 0x7ffb040b1090 2023-11-24T06:30:15.173 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffaf0066470 msgr2=0x7ffaf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffaf0066470 0x7ffaf0068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009b60 tx=0x7ffaf4009190 comp rx=0 tx=0).stop 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 msgr2=0x7ffb040999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb040999e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00cb40 tx=0x7ffafc00a060 comp rx=0 tx=0).stop 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 shutdown_connections 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffaf0066470 0x7ffaf0068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb040b1090 0x7ffb040999e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb040ae3a0 0x7ffb040c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 --2- 172.21.15.143:0/2041452047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0406e2f0 0x7ffb040c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 >> 172.21.15.143:0/2041452047 conn(0x7ffb040cbb50 msgr2=0x7ffb0406ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:15.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 shutdown_connections 2023-11-24T06:30:15.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.169+0000 7ffb08831640 1 -- 172.21.15.143:0/2041452047 wait complete. 2023-11-24T06:30:15.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:15.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.329+0000 7f463133e640 1 Processor -- start 2023-11-24T06:30:15.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f463133e640 1 -- start start 2023-11-24T06:30:15.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f463133e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c15d7f0 0x7f462c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f463133e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f462c0d37e0 0x7f462c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f463133e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c0d3c60 con 0x7f462c0b1630 2023-11-24T06:30:15.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f463133e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c06b980 con 0x7f462c0d37e0 2023-11-24T06:30:15.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f463133e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b0090 con 0x7f462c15d7f0 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f4623fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f462c0d37e0 0x7f462c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f462affd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c15d7f0 0x7f462c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f4623fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f462c0d37e0 0x7f462c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:47586/0 (socket says 172.21.15.143:47586) 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f4623fff640 1 -- 172.21.15.143:0/1764216306 learned_addr learned my addr 172.21.15.143:0/1764216306 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f462affd640 1 -- 172.21.15.143:0/1764216306 >> v2:172.21.15.146:3300/0 conn(0x7f462c0d37e0 msgr2=0x7f462c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f462affd640 1 --2- 172.21.15.143:0/1764216306 >> v2:172.21.15.146:3300/0 conn(0x7f462c0d37e0 0x7f462c0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f462affd640 1 -- 172.21.15.143:0/1764216306 >> v1:172.21.15.146:6789/0 conn(0x7f462c0b1630 legacy=0x7f462c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.333+0000 7f462affd640 1 -- 172.21.15.143:0/1764216306 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0b0330 con 0x7f462c15d7f0 2023-11-24T06:30:15.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f462affd640 1 --2- 172.21.15.143:0/1764216306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c15d7f0 0x7f462c0d32a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097c0 tx=0x7f461c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d782bc6232344986 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f462a7fc640 1 -- 172.21.15.143:0/1764216306 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0ab600 con 0x7f462c15d7f0 2023-11-24T06:30:15.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f462a7fc640 1 -- 172.21.15.143:0/1764216306 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c0a7050 con 0x7f462c15d7f0 2023-11-24T06:30:15.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f462a7fc640 1 -- 172.21.15.143:0/1764216306 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0ab980 con 0x7f462c15d7f0 2023-11-24T06:30:15.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 -- 172.21.15.143:0/1764216306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c15d7f0 msgr2=0x7f462c0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 --2- 172.21.15.143:0/1764216306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c15d7f0 0x7f462c0d32a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097c0 tx=0x7f461c01c480 comp rx=0 tx=0).stop 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 -- 172.21.15.143:0/1764216306 shutdown_connections 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 --2- 172.21.15.143:0/1764216306 >> v2:172.21.15.146:3300/0 conn(0x7f462c0d37e0 0x7f462c0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 --2- 172.21.15.143:0/1764216306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c15d7f0 0x7f462c0d32a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 -- 172.21.15.143:0/1764216306 >> 172.21.15.143:0/1764216306 conn(0x7f462c09c790 msgr2=0x7f462c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 -- 172.21.15.143:0/1764216306 shutdown_connections 2023-11-24T06:30:15.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 -- 172.21.15.143:0/1764216306 wait complete. 2023-11-24T06:30:15.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.337+0000 7f463133e640 1 Processor -- start 2023-11-24T06:30:15.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- start start 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c0b1630 0x7f462c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 0x7f462c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c15d7f0 0x7f462c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b41c0 con 0x7f462c0d37e0 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b35b0 con 0x7f462c15d7f0 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b3890 con 0x7f462c0b1630 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 0x7f462c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f462affd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c0b1630 0x7f462c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 0x7f462c0b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53156/0 (socket says 172.21.15.143:53156) 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 -- 172.21.15.143:0/3781306637 learned_addr learned my addr 172.21.15.143:0/3781306637 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:15.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f462b7fe640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c15d7f0 0x7f462c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 -- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c0b1630 msgr2=0x7f462c0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c0b1630 0x7f462c0b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 -- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c15d7f0 msgr2=0x7f462c14f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c15d7f0 0x7f462c14f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 -- 172.21.15.143:0/3781306637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c009420 con 0x7f462c0d37e0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f4623fff640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 0x7f462c0b55d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f461400e890 tx=0x7f461400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614009620 con 0x7f462c0d37e0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400c940 con 0x7f462c0d37e0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400ccf0 con 0x7f462c0d37e0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c0b3b70 con 0x7f462c0d37e0 2023-11-24T06:30:15.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c0b32a0 con 0x7f462c0d37e0 2023-11-24T06:30:15.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.341+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c0b2aa0 con 0x7f462c0d37e0 2023-11-24T06:30:15.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.345+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4614013470 con 0x7f462c0d37e0 2023-11-24T06:30:15.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.345+0000 7f46237fe640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f460c066470 0x7f460c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.345+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4614083ff0 con 0x7f462c0d37e0 2023-11-24T06:30:15.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.345+0000 7f462affd640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f460c066470 0x7f460c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.345+0000 7f462affd640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f460c066470 0x7f460c068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ad000 tx=0x7f461c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.349+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46140514e0 con 0x7f462c0d37e0 2023-11-24T06:30:15.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.497+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f462c04e8c0 con 0x7f462c0d37e0 2023-11-24T06:30:15.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.497+0000 7f46237fe640 1 -- 172.21.15.143:0/3781306637 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4614054b00 con 0x7f462c0d37e0 2023-11-24T06:30:15.504 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f460c066470 msgr2=0x7f460c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f460c066470 0x7f460c068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ad000 tx=0x7f461c0a6000 comp rx=0 tx=0).stop 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 msgr2=0x7f462c0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 0x7f462c0b55d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f461400e890 tx=0x7f461400ed50 comp rx=0 tx=0).stop 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 shutdown_connections 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f460c066470 0x7f460c068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c15d7f0 0x7f462c14f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f462c0d37e0 0x7f462c0b55d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 --2- 172.21.15.143:0/3781306637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f462c0b1630 0x7f462c0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 >> 172.21.15.143:0/3781306637 conn(0x7f462c09c790 msgr2=0x7f462c0ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:15.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 shutdown_connections 2023-11-24T06:30:15.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.501+0000 7f463133e640 1 -- 172.21.15.143:0/3781306637 wait complete. 2023-11-24T06:30:15.525 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:15.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 Processor -- start 2023-11-24T06:30:15.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 -- start start 2023-11-24T06:30:15.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ff80ae4a0 0x7f3ff815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80ce420 0x7f3ff806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff80b3510 con 0x7f3ff80cd850 2023-11-24T06:30:15.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff80b37f0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ffd05a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80b3ad0 con 0x7f3ff80ce420 2023-11-24T06:30:15.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3fee59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3ff80cd850 0x7f3ff80cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56386/0 (socket says 172.21.15.143:56386) 2023-11-24T06:30:15.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3fee59c640 1 -- 172.21.15.143:0/1470550666 learned_addr learned my addr 172.21.15.143:0/1470550666 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff6d9d640 1 --2- 172.21.15.143:0/1470550666 >> v2:172.21.15.146:3300/0 conn(0x7f3ff80ae4a0 0x7f3ff815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff759e640 1 --2- 172.21.15.143:0/1470550666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80ce420 0x7f3ff806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff659c640 1 -- 172.21.15.143:0/1470550666 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985829967 0 0) 0x7f3ff80b3510 con 0x7f3ff80cd850 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff659c640 1 -- 172.21.15.143:0/1470550666 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe4003530 con 0x7f3ff80cd850 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff659c640 1 -- 172.21.15.143:0/1470550666 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454854294 0 0) 0x7f3fe4003530 con 0x7f3ff80cd850 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff759e640 1 -- 172.21.15.143:0/1470550666 >> v2:172.21.15.146:3300/0 conn(0x7f3ff80ae4a0 msgr2=0x7f3ff815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:15.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff759e640 1 --2- 172.21.15.143:0/1470550666 >> v2:172.21.15.146:3300/0 conn(0x7f3ff80ae4a0 0x7f3ff815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff759e640 1 -- 172.21.15.143:0/1470550666 >> v1:172.21.15.143:6789/0 conn(0x7f3ff80cd850 legacy=0x7f3ff80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff759e640 1 -- 172.21.15.143:0/1470550666 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80b3db0 con 0x7f3ff80ce420 2023-11-24T06:30:15.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.661+0000 7f3ff6d9d640 1 --2- 172.21.15.143:0/1470550666 >> v2:172.21.15.146:3300/0 conn(0x7f3ff80ae4a0 0x7f3ff815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:15.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ff759e640 1 --2- 172.21.15.143:0/1470550666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80ce420 0x7f3ff806c640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009d90 tx=0x7f3ff001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf2e78dcab4b2a3e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ff659c640 1 -- 172.21.15.143:0/1470550666 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0001680 con 0x7f3ff80ce420 2023-11-24T06:30:15.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ff659c640 1 -- 172.21.15.143:0/1470550666 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff00a5660 con 0x7f3ff80ce420 2023-11-24T06:30:15.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ff659c640 1 -- 172.21.15.143:0/1470550666 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff00a59f0 con 0x7f3ff80ce420 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 -- 172.21.15.143:0/1470550666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80ce420 msgr2=0x7f3ff806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/1470550666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80ce420 0x7f3ff806c640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009d90 tx=0x7f3ff001c840 comp rx=0 tx=0).stop 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 -- 172.21.15.143:0/1470550666 shutdown_connections 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/1470550666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80ce420 0x7f3ff806c640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/1470550666 >> v2:172.21.15.146:3300/0 conn(0x7f3ff80ae4a0 0x7f3ff815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 -- 172.21.15.143:0/1470550666 >> 172.21.15.143:0/1470550666 conn(0x7f3ff80b0c80 msgr2=0x7f3ff80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 -- 172.21.15.143:0/1470550666 shutdown_connections 2023-11-24T06:30:15.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.665+0000 7f3ffd05a640 1 -- 172.21.15.143:0/1470550666 wait complete. 2023-11-24T06:30:15.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 Processor -- start 2023-11-24T06:30:15.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 -- start start 2023-11-24T06:30:15.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 0x7f3ff814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80cd850 0x7f3ff8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff80ce420 0x7f3ff81541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8099610 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff81531a0 con 0x7f3ff80ce420 2023-11-24T06:30:15.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8153480 con 0x7f3ff80cd850 2023-11-24T06:30:15.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 0x7f3ff814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 0x7f3ff814b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53164/0 (socket says 172.21.15.143:53164) 2023-11-24T06:30:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 -- 172.21.15.143:0/4266197026 learned_addr learned my addr 172.21.15.143:0/4266197026 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3fee59c640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80cd850 0x7f3ff8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff759e640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff80ce420 0x7f3ff81541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 -- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80cd850 msgr2=0x7f3ff8153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80cd850 0x7f3ff8153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 -- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff80ce420 msgr2=0x7f3ff81541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff80ce420 0x7f3ff81541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 -- 172.21.15.143:0/4266197026 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009420 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ff6d9d640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 0x7f3ff814b6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800ebe0 tx=0x7f3fe800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800eee0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe800cc30 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8013470 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff0009a70 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.669+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff80998f0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.673+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff804e8c0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.673+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3fe80135d0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.673+0000 7f3feffff640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3fd8066470 0x7f3fd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.673+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fe80841f0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.673+0000 7f3fee59c640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3fd8066470 0x7f3fd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.673+0000 7f3fee59c640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3fd8066470 0x7f3fd8068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ff806e750 tx=0x7f3fe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:15.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.677+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fe8051660 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.825+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ff80adac0 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.825+0000 7f3feffff640 1 -- 172.21.15.143:0/4266197026 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fe8054c80 con 0x7f3ff80ae4a0 2023-11-24T06:30:15.832 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:15.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3fd8066470 msgr2=0x7f3fd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3fd8066470 0x7f3fd8068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ff806e750 tx=0x7f3fe0009040 comp rx=0 tx=0).stop 2023-11-24T06:30:15.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 msgr2=0x7f3ff814b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:15.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 0x7f3ff814b6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800ebe0 tx=0x7f3fe800c520 comp rx=0 tx=0).stop 2023-11-24T06:30:15.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 shutdown_connections 2023-11-24T06:30:15.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3fd8066470 0x7f3fd8068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff80ce420 0x7f3ff81541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ff80cd850 0x7f3ff8153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 --2- 172.21.15.143:0/4266197026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ff80ae4a0 0x7f3ff814b6c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:15.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 >> 172.21.15.143:0/4266197026 conn(0x7f3ff80b0c80 msgr2=0x7f3ff80ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:15.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 shutdown_connections 2023-11-24T06:30:15.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.829+0000 7f3ffd05a640 1 -- 172.21.15.143:0/4266197026 wait complete. 2023-11-24T06:30:15.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:30:15.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 Processor -- start 2023-11-24T06:30:15.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 -- start start 2023-11-24T06:30:15.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4b0c0ceba0 0x7f4b0c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b0c0d0780 0x7f4b0c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:15.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0cf1a0 con 0x7f4b0c160aa0 2023-11-24T06:30:15.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0d1570 con 0x7f4b0c0ceba0 2023-11-24T06:30:15.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b131d0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0cf480 con 0x7f4b0c0d0780 2023-11-24T06:30:15.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b119cd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4b0c0ceba0 0x7f4b0c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b121ce640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4b0c160aa0 0x7f4b0c0d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56392/0 (socket says 172.21.15.143:56392) 2023-11-24T06:30:15.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b121ce640 1 -- 172.21.15.143:0/1338726606 learned_addr learned my addr 172.21.15.143:0/1338726606 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:15.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b119cd640 1 -- 172.21.15.143:0/1338726606 >> v2:172.21.15.146:3300/0 conn(0x7f4b0c0d0780 msgr2=0x7f4b0c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:15.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b129cf640 1 --2- 172.21.15.143:0/1338726606 >> v2:172.21.15.146:3300/0 conn(0x7f4b0c0d0780 0x7f4b0c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:15.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b111cc640 1 -- 172.21.15.143:0/1338726606 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380685786 0 0) 0x7f4b0c0cf1a0 con 0x7f4b0c160aa0 2023-11-24T06:30:16.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b119cd640 1 --2- 172.21.15.143:0/1338726606 >> v2:172.21.15.146:3300/0 conn(0x7f4b0c0d0780 0x7f4b0c0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b119cd640 1 -- 172.21.15.143:0/1338726606 >> v1:172.21.15.143:6789/0 conn(0x7f4b0c160aa0 legacy=0x7f4b0c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b119cd640 1 -- 172.21.15.143:0/1338726606 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0cf760 con 0x7f4b0c0ceba0 2023-11-24T06:30:16.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.989+0000 7f4b129cf640 1 --2- 172.21.15.143:0/1338726606 >> v2:172.21.15.146:3300/0 conn(0x7f4b0c0d0780 0x7f4b0c0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:16.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b119cd640 1 --2- 172.21.15.143:0/1338726606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c0d0240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c08d9f0 tx=0x7f4afc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a4ea0d0370a9b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b111cc640 1 -- 172.21.15.143:0/1338726606 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0ab600 con 0x7f4b0c0ceba0 2023-11-24T06:30:16.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b111cc640 1 -- 172.21.15.143:0/1338726606 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0a7050 con 0x7f4b0c0ceba0 2023-11-24T06:30:16.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b111cc640 1 -- 172.21.15.143:0/1338726606 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0ab980 con 0x7f4b0c0ceba0 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 -- 172.21.15.143:0/1338726606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0ceba0 msgr2=0x7f4b0c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1338726606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c0d0240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c08d9f0 tx=0x7f4afc01c3d0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 -- 172.21.15.143:0/1338726606 shutdown_connections 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1338726606 >> v2:172.21.15.146:3300/0 conn(0x7f4b0c0d0780 0x7f4b0c0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1338726606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c0d0240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 -- 172.21.15.143:0/1338726606 >> 172.21.15.143:0/1338726606 conn(0x7f4b0c08cca0 msgr2=0x7f4b0c09c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 -- 172.21.15.143:0/1338726606 shutdown_connections 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.993+0000 7f4b131d0640 1 -- 172.21.15.143:0/1338726606 wait complete. 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 Processor -- start 2023-11-24T06:30:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- start start 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 0x7f4b0c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0c160aa0 0x7f4b0c0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15d750 con 0x7f4b0c0d0780 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c156e20 con 0x7f4b0c0ceba0 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b2db0 con 0x7f4b0c160aa0 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 0x7f4b0c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 0x7f4b0c0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53182/0 (socket says 172.21.15.143:53182) 2023-11-24T06:30:16.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 -- 172.21.15.143:0/1411423759 learned_addr learned my addr 172.21.15.143:0/1411423759 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:16.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b129cf640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0c160aa0 0x7f4b0c0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 -- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0c160aa0 msgr2=0x7f4b0c0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b121ce640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0c160aa0 0x7f4b0c0b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 -- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0c0ceba0 msgr2=0x7f4b0c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 -- 172.21.15.143:0/1411423759 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc009420 con 0x7f4b0c0d0780 2023-11-24T06:30:16.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b129cf640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0c160aa0 0x7f4b0c0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:16.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b121ce640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:16.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b119cd640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 0x7f4b0c0b2870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0ae040 tx=0x7f4afc019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0b4610 con 0x7f4b0c0d0780 2023-11-24T06:30:16.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0abe90 con 0x7f4b0c0d0780 2023-11-24T06:30:16.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c15d470 con 0x7f4b0c0d0780 2023-11-24T06:30:16.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0b4970 con 0x7f4b0c0d0780 2023-11-24T06:30:16.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c159000 con 0x7f4b0c0d0780 2023-11-24T06:30:16.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:15.997+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c04e850 con 0x7f4b0c0d0780 2023-11-24T06:30:16.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.001+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4afc0b2040 con 0x7f4b0c0d0780 2023-11-24T06:30:16.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.001+0000 7f4b02ffd640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4af0066470 0x7f4af0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.001+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4afc11dfd0 con 0x7f4b0c0d0780 2023-11-24T06:30:16.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.001+0000 7f4b121ce640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4af0066470 0x7f4af0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.001+0000 7f4b121ce640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4af0066470 0x7f4af0068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b08007fd0 tx=0x7f4b08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.005+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4afc0eb3b0 con 0x7f4b0c0d0780 2023-11-24T06:30:16.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b0c15eb50 con 0x7f4b0c0d0780 2023-11-24T06:30:16.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b02ffd640 1 -- 172.21.15.143:0/1411423759 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4afc0b0080 con 0x7f4b0c0d0780 2023-11-24T06:30:16.173 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4af0066470 msgr2=0x7f4af0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4af0066470 0x7f4af0068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b08007fd0 tx=0x7f4b08009040 comp rx=0 tx=0).stop 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 msgr2=0x7f4b0c0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 0x7f4b0c0b2870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0ae040 tx=0x7f4afc019170 comp rx=0 tx=0).stop 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 shutdown_connections 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4af0066470 0x7f4af0068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0c160aa0 0x7f4b0c0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0c0d0780 0x7f4b0c0b2870 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 --2- 172.21.15.143:0/1411423759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0c0ceba0 0x7f4b0c1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 >> 172.21.15.143:0/1411423759 conn(0x7f4b0c08cca0 msgr2=0x7f4b0c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:16.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 shutdown_connections 2023-11-24T06:30:16.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.169+0000 7f4b131d0640 1 -- 172.21.15.143:0/1411423759 wait complete. 2023-11-24T06:30:16.194 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-24T06:30:16.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:16.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-24T06:30:16.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:30:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:16.219 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:30:16.269 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:16.269 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:16.279 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:16.280 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:16.334 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:16.334 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:16.389 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:16.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 Processor -- start 2023-11-24T06:30:16.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 -- start start 2023-11-24T06:30:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faffc15d570 0x7faffc06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faffc0d3020 0x7faffc0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc0d39f0 con 0x7faffc0ce8b0 2023-11-24T06:30:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc0d1cc0 con 0x7faffc15d570 2023-11-24T06:30:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb002365640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc0d1fa0 con 0x7faffc0d3020 2023-11-24T06:30:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffbfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faffc15d570 0x7faffc06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb000902640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7faffc0ce8b0 0x7faffc0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56398/0 (socket says 172.21.15.143:56398) 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7fb000902640 1 -- 172.21.15.143:0/1702621868 learned_addr learned my addr 172.21.15.143:0/1702621868 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffb7fe640 1 --2- 172.21.15.143:0/1702621868 >> v2:172.21.15.146:3300/0 conn(0x7faffc0d3020 0x7faffc0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffbfff640 1 -- 172.21.15.143:0/1702621868 >> v2:172.21.15.146:3300/0 conn(0x7faffc0d3020 msgr2=0x7faffc0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffbfff640 1 --2- 172.21.15.143:0/1702621868 >> v2:172.21.15.146:3300/0 conn(0x7faffc0d3020 0x7faffc0d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffbfff640 1 -- 172.21.15.143:0/1702621868 >> v1:172.21.15.143:6789/0 conn(0x7faffc0ce8b0 legacy=0x7faffc0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffbfff640 1 -- 172.21.15.143:0/1702621868 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc0ce0b0 con 0x7faffc15d570 2023-11-24T06:30:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.521+0000 7faffaffd640 1 -- 172.21.15.143:0/1702621868 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131998798 0 0) 0x7faffc0d39f0 con 0x7faffc0ce8b0 2023-11-24T06:30:16.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7faffbfff640 1 --2- 172.21.15.143:0/1702621868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc06b9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faffc0b5f00 tx=0x7fafec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d5ddae4c43ccf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7faffaffd640 1 -- 172.21.15.143:0/1702621868 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0ab650 con 0x7faffc15d570 2023-11-24T06:30:16.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7faffaffd640 1 -- 172.21.15.143:0/1702621868 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec0ab7b0 con 0x7faffc15d570 2023-11-24T06:30:16.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7faffaffd640 1 -- 172.21.15.143:0/1702621868 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0abb40 con 0x7faffc15d570 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 -- 172.21.15.143:0/1702621868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 msgr2=0x7faffc06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 --2- 172.21.15.143:0/1702621868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc06b9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faffc0b5f00 tx=0x7fafec01c430 comp rx=0 tx=0).stop 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 -- 172.21.15.143:0/1702621868 shutdown_connections 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 --2- 172.21.15.143:0/1702621868 >> v2:172.21.15.146:3300/0 conn(0x7faffc0d3020 0x7faffc0d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 --2- 172.21.15.143:0/1702621868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc06b9d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 -- 172.21.15.143:0/1702621868 >> 172.21.15.143:0/1702621868 conn(0x7faffc08ceb0 msgr2=0x7faffc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:16.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 -- 172.21.15.143:0/1702621868 shutdown_connections 2023-11-24T06:30:16.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.525+0000 7fb002365640 1 -- 172.21.15.143:0/1702621868 wait complete. 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 Processor -- start 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 -- start start 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faffc0ce8b0 0x7faffc15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faffc0d3020 0x7faffc152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc153150 con 0x7faffc15d570 2023-11-24T06:30:16.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0c9d50 con 0x7faffc0ce8b0 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0cd1b0 con 0x7faffc0d3020 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc0c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53204/0 (socket says 172.21.15.143:53204) 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 -- 172.21.15.143:0/3463499009 learned_addr learned my addr 172.21.15.143:0/3463499009 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7faffbfff640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faffc0ce8b0 0x7faffc15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7faffb7fe640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faffc0d3020 0x7faffc152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 -- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faffc0d3020 msgr2=0x7faffc152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faffc0d3020 0x7faffc152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 -- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faffc0ce8b0 msgr2=0x7faffc15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faffc0ce8b0 0x7faffc15db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 -- 172.21.15.143:0/3463499009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009420 con 0x7faffc15d570 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb000902640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc0c9810 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faff4001570 tx=0x7faff400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400cea0 con 0x7faffc15d570 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff400a5e0 con 0x7faffc15d570 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc0c7260 con 0x7faffc15d570 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400a990 con 0x7faffc15d570 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.529+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0c7820 con 0x7faffc15d570 2023-11-24T06:30:16.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.533+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc0c70c0 con 0x7faffc15d570 2023-11-24T06:30:16.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.533+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faff400aaf0 con 0x7faffc15d570 2023-11-24T06:30:16.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.533+0000 7faff8ff9640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafe8066470 0x7fafe8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.533+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faff4083360 con 0x7faffc15d570 2023-11-24T06:30:16.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.533+0000 7faffbfff640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafe8066470 0x7fafe8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.533+0000 7faffbfff640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafe8066470 0x7fafe8068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fafec0af000 tx=0x7fafec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.537+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faffc0c70c0 con 0x7faffc15d570 2023-11-24T06:30:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.689+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faffc0c70c0 con 0x7faffc15d570 2023-11-24T06:30:16.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.689+0000 7faff8ff9640 1 -- 172.21.15.143:0/3463499009 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7faffc0c70c0 con 0x7faffc15d570 2023-11-24T06:30:16.695 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:16.695 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafe8066470 msgr2=0x7fafe8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafe8066470 0x7fafe8068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fafec0af000 tx=0x7fafec0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 msgr2=0x7faffc0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc0c9810 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faff4001570 tx=0x7faff400cc50 comp rx=0 tx=0).stop 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 shutdown_connections 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafe8066470 0x7fafe8068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc15d570 0x7faffc0c9810 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faffc0d3020 0x7faffc152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 --2- 172.21.15.143:0/3463499009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faffc0ce8b0 0x7faffc15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 >> 172.21.15.143:0/3463499009 conn(0x7faffc08ceb0 msgr2=0x7faffc0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:16.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 shutdown_connections 2023-11-24T06:30:16.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.693+0000 7fb002365640 1 -- 172.21.15.143:0/3463499009 wait complete. 2023-11-24T06:30:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:16.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:16.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 Processor -- start 2023-11-24T06:30:16.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 -- start start 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ad900 0x7f5c6815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c680adce0 0x7f5c68070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680b23a0 con 0x7f5c680ac850 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6815e490 con 0x7f5c680adce0 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c6ee5a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6815e770 con 0x7f5c680ad900 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c5ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c680adce0 0x7f5c68070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c5ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c680adce0 0x7f5c68070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53218/0 (socket says 172.21.15.143:53218) 2023-11-24T06:30:16.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.853+0000 7f5c5ffff640 1 -- 172.21.15.143:0/1573675377 learned_addr learned my addr 172.21.15.143:0/1573675377 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:16.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c6cbf6640 1 --2- 172.21.15.143:0/1573675377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ad900 0x7f5c6815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5ffff640 1 -- 172.21.15.143:0/1573675377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ad900 msgr2=0x7f5c6815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:16.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5ffff640 1 --2- 172.21.15.143:0/1573675377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ad900 0x7f5c6815dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5ffff640 1 -- 172.21.15.143:0/1573675377 >> v1:172.21.15.146:6789/0 conn(0x7f5c680ac850 legacy=0x7f5c681611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5ffff640 1 -- 172.21.15.143:0/1573675377 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6815ea50 con 0x7f5c680adce0 2023-11-24T06:30:16.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5ffff640 1 --2- 172.21.15.143:0/1573675377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68070a70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009870 tx=0x7f5c5801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313c5a991dcf3107 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5f7fe640 1 -- 172.21.15.143:0/1573675377 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580a95f0 con 0x7f5c680adce0 2023-11-24T06:30:16.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5f7fe640 1 -- 172.21.15.143:0/1573675377 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580a9750 con 0x7f5c680adce0 2023-11-24T06:30:16.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c5f7fe640 1 -- 172.21.15.143:0/1573675377 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580a9ae0 con 0x7f5c680adce0 2023-11-24T06:30:16.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1573675377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 msgr2=0x7f5c68070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.857+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1573675377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68070a70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009870 tx=0x7f5c5801c510 comp rx=0 tx=0).stop 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1573675377 shutdown_connections 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1573675377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68070a70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1573675377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ad900 0x7f5c6815dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1573675377 >> 172.21.15.143:0/1573675377 conn(0x7f5c680cf410 msgr2=0x7f5c680cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1573675377 shutdown_connections 2023-11-24T06:30:16.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1573675377 wait complete. 2023-11-24T06:30:16.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 Processor -- start 2023-11-24T06:30:16.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- start start 2023-11-24T06:30:16.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ac850 0x7f5c680ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c680ad900 0x7f5c68153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680ce7b0 con 0x7f5c680adce0 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680cd2c0 con 0x7f5c680ad900 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6ee5a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680ce550 con 0x7f5c680ac850 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53224/0 (socket says 172.21.15.143:53224) 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 -- 172.21.15.143:0/1481765596 learned_addr learned my addr 172.21.15.143:0/1481765596 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c5ffff640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c680ad900 0x7f5c68153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6cbf6640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ac850 0x7f5c680ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 -- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ac850 msgr2=0x7f5c680ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ac850 0x7f5c680ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 -- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c680ad900 msgr2=0x7f5c68153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c680ad900 0x7f5c68153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 -- 172.21.15.143:0/1481765596 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c580094d0 con 0x7f5c680adce0 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.861+0000 7f5c6d3f7640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68153960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000c6c0 tx=0x7f5c6000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60003b80 con 0x7f5c680adce0 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60003ce0 con 0x7f5c680adce0 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600052f0 con 0x7f5c680adce0 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c680af770 con 0x7f5c680adce0 2023-11-24T06:30:16.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c680af490 con 0x7f5c680adce0 2023-11-24T06:30:16.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c680cd400 con 0x7f5c680adce0 2023-11-24T06:30:16.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c60005450 con 0x7f5c680adce0 2023-11-24T06:30:16.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c5d7fa640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c54066470 0x7f5c54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:16.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c60083ad0 con 0x7f5c680adce0 2023-11-24T06:30:16.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c6cbf6640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c54066470 0x7f5c54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:16.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.865+0000 7f5c6cbf6640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c54066470 0x7f5c54068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006aa0 tx=0x7f5c64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:16.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:16.869+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c680cd400 con 0x7f5c680adce0 2023-11-24T06:30:17.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.021+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c680cd400 con 0x7f5c680adce0 2023-11-24T06:30:17.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.021+0000 7f5c5d7fa640 1 -- 172.21.15.143:0/1481765596 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c680cd400 con 0x7f5c680adce0 2023-11-24T06:30:17.028 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:17.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c54066470 msgr2=0x7f5c54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c54066470 0x7f5c54068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006aa0 tx=0x7f5c64008040 comp rx=0 tx=0).stop 2023-11-24T06:30:17.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 msgr2=0x7f5c68153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68153960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000c6c0 tx=0x7f5c6000cb80 comp rx=0 tx=0).stop 2023-11-24T06:30:17.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 shutdown_connections 2023-11-24T06:30:17.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c54066470 0x7f5c54068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c680adce0 0x7f5c68153960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c680ad900 0x7f5c68153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 --2- 172.21.15.143:0/1481765596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c680ac850 0x7f5c680ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 >> 172.21.15.143:0/1481765596 conn(0x7f5c680cf410 msgr2=0x7f5c680b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:17.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 shutdown_connections 2023-11-24T06:30:17.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.025+0000 7f5c6ee5a640 1 -- 172.21.15.143:0/1481765596 wait complete. 2023-11-24T06:30:17.049 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:17.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.185+0000 7f0419fb8640 1 Processor -- start 2023-11-24T06:30:17.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.185+0000 7f0419fb8640 1 -- start start 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0419fb8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04140b1f80 0x7f04140b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0419fb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0414070f00 con 0x7f041415ec60 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0419fb8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0414071170 con 0x7f041415a290 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0419fb8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140cb690 con 0x7f04140b1f80 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0413fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04140b1f80 0x7f04140b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0412ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f041415ec60 0x7f04140cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56402/0 (socket says 172.21.15.143:56402) 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0412ffd640 1 -- 172.21.15.143:0/584151177 learned_addr learned my addr 172.21.15.143:0/584151177 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0413fff640 1 -- 172.21.15.143:0/584151177 >> v1:172.21.15.146:6789/0 conn(0x7f041415a290 legacy=0x7f04140707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0413fff640 1 -- 172.21.15.143:0/584151177 >> v1:172.21.15.143:6789/0 conn(0x7f041415ec60 legacy=0x7f04140cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f04127fc640 1 -- 172.21.15.143:0/584151177 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844068325 0 0) 0x7f0414070f00 con 0x7f041415ec60 2023-11-24T06:30:17.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.189+0000 7f0413fff640 1 -- 172.21.15.143:0/584151177 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140cb970 con 0x7f04140b1f80 2023-11-24T06:30:17.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0413fff640 1 --2- 172.21.15.143:0/584151177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04140b1f80 0x7f04140b23f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f040c009d90 tx=0x7f040c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e872178d931ef20 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f04127fc640 1 -- 172.21.15.143:0/584151177 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0a5890 con 0x7f04140b1f80 2023-11-24T06:30:17.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f04127fc640 1 -- 172.21.15.143:0/584151177 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0a59f0 con 0x7f04140b1f80 2023-11-24T06:30:17.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f04127fc640 1 -- 172.21.15.143:0/584151177 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0a5d80 con 0x7f04140b1f80 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 -- 172.21.15.143:0/584151177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04140b1f80 msgr2=0x7f04140b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 --2- 172.21.15.143:0/584151177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04140b1f80 0x7f04140b23f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f040c009d90 tx=0x7f040c01c8c0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 -- 172.21.15.143:0/584151177 shutdown_connections 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 --2- 172.21.15.143:0/584151177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04140b1f80 0x7f04140b23f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 -- 172.21.15.143:0/584151177 >> 172.21.15.143:0/584151177 conn(0x7f04140b0c80 msgr2=0x7f04140b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 -- 172.21.15.143:0/584151177 shutdown_connections 2023-11-24T06:30:17.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 -- 172.21.15.143:0/584151177 wait complete. 2023-11-24T06:30:17.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 Processor -- start 2023-11-24T06:30:17.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.193+0000 7f0419fb8640 1 -- start start 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04140b1f80 0x7f04140b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f041415a290 0x7f0414159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 0x7f0414164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414159a90 con 0x7f041415ec60 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140ac000 con 0x7f041415a290 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140ac2e0 con 0x7f04140b1f80 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 0x7f0414164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 0x7f0414164ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53234/0 (socket says 172.21.15.143:53234) 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 -- 172.21.15.143:0/1137449672 learned_addr learned my addr 172.21.15.143:0/1137449672 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f04137fe640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04140b1f80 0x7f04140b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0412ffd640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f041415a290 0x7f0414159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 -- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04140b1f80 msgr2=0x7f04140b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04140b1f80 0x7f04140b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 -- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f041415a290 msgr2=0x7f0414159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f041415a290 0x7f0414159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 -- 172.21.15.143:0/1137449672 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c009a70 con 0x7f041415ec60 2023-11-24T06:30:17.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0413fff640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 0x7f0414164ff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f040c0b0040 tx=0x7f040c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0b9860 con 0x7f041415ec60 2023-11-24T06:30:17.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0b99c0 con 0x7f041415ec60 2023-11-24T06:30:17.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04140ac5c0 con 0x7f041415ec60 2023-11-24T06:30:17.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0b9d70 con 0x7f041415ec60 2023-11-24T06:30:17.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04140acb80 con 0x7f041415ec60 2023-11-24T06:30:17.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041404e8c0 con 0x7f041415ec60 2023-11-24T06:30:17.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.197+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f040c0c4460 con 0x7f041415ec60 2023-11-24T06:30:17.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.201+0000 7f03fbfff640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0400066470 0x7f0400068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.201+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f040c11f210 con 0x7f041415ec60 2023-11-24T06:30:17.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.201+0000 7f04137fe640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0400066470 0x7f0400068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.201+0000 7f04137fe640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0400066470 0x7f0400068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04141f9a60 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.205+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f040c0ec760 con 0x7f041415ec60 2023-11-24T06:30:17.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.353+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04140b18e0 con 0x7f041415ec60 2023-11-24T06:30:17.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.353+0000 7f03fbfff640 1 -- 172.21.15.143:0/1137449672 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f040c0efd80 con 0x7f041415ec60 2023-11-24T06:30:17.359 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:17.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0400066470 msgr2=0x7f0400068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0400066470 0x7f0400068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04141f9a60 tx=0x7f0404009040 comp rx=0 tx=0).stop 2023-11-24T06:30:17.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 msgr2=0x7f0414164ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 0x7f0414164ff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f040c0b0040 tx=0x7f040c019660 comp rx=0 tx=0).stop 2023-11-24T06:30:17.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 shutdown_connections 2023-11-24T06:30:17.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0400066470 0x7f0400068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f041415ec60 0x7f0414164ff0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f041415a290 0x7f0414159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 --2- 172.21.15.143:0/1137449672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04140b1f80 0x7f04140b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 >> 172.21.15.143:0/1137449672 conn(0x7f04140b0c80 msgr2=0x7f0414152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:17.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 shutdown_connections 2023-11-24T06:30:17.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.357+0000 7f0419fb8640 1 -- 172.21.15.143:0/1137449672 wait complete. 2023-11-24T06:30:17.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:17.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.513+0000 7f835b5df640 1 Processor -- start 2023-11-24T06:30:17.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.513+0000 7f835b5df640 1 -- start start 2023-11-24T06:30:17.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.513+0000 7f835b5df640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83540ccef0 0x7f8354071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.513+0000 7f835b5df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540cd380 0x7f83540cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.513+0000 7f835b5df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83540723c0 con 0x7f83541624f0 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f835b5df640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8354072980 con 0x7f83540ccef0 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f835b5df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83540726a0 con 0x7f83540cd380 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f835937b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f83541624f0 0x7f83541628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34794/0 (socket says 172.21.15.143:34794) 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f835937b640 1 -- 172.21.15.143:0/1567827657 learned_addr learned my addr 172.21.15.143:0/1567827657 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8359b7c640 1 --2- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540cd380 0x7f83540cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8358b7a640 1 --2- 172.21.15.143:0/1567827657 >> v2:172.21.15.146:3300/0 conn(0x7f83540ccef0 0x7f8354071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f834bfff640 1 -- 172.21.15.143:0/1567827657 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335403490 0 0) 0x7f83540723c0 con 0x7f83541624f0 2023-11-24T06:30:17.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f834bfff640 1 -- 172.21.15.143:0/1567827657 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8340003530 con 0x7f83541624f0 2023-11-24T06:30:17.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8358b7a640 1 -- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540cd380 msgr2=0x7f83540cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:17.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8358b7a640 1 --2- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540cd380 0x7f83540cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8358b7a640 1 -- 172.21.15.143:0/1567827657 >> v1:172.21.15.143:6789/0 conn(0x7f83541624f0 legacy=0x7f83541628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8358b7a640 1 -- 172.21.15.143:0/1567827657 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835406c7e0 con 0x7f83540ccef0 2023-11-24T06:30:17.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.517+0000 7f8358b7a640 1 --2- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83540ccef0 0x7f8354071900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83440097c0 tx=0x7f834401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60636d68bdf0987 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f834bfff640 1 -- 172.21.15.143:0/1567827657 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440ac640 con 0x7f83540ccef0 2023-11-24T06:30:17.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f834bfff640 1 -- 172.21.15.143:0/1567827657 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83440ac7a0 con 0x7f83540ccef0 2023-11-24T06:30:17.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f834bfff640 1 -- 172.21.15.143:0/1567827657 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440acb30 con 0x7f83540ccef0 2023-11-24T06:30:17.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83540ccef0 msgr2=0x7f8354071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 --2- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83540ccef0 0x7f8354071900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83440097c0 tx=0x7f834401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- 172.21.15.143:0/1567827657 shutdown_connections 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 --2- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540cd380 0x7f83540cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 --2- 172.21.15.143:0/1567827657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83540ccef0 0x7f8354071900 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- 172.21.15.143:0/1567827657 >> 172.21.15.143:0/1567827657 conn(0x7f83540b0c80 msgr2=0x7f83540b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- 172.21.15.143:0/1567827657 shutdown_connections 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- 172.21.15.143:0/1567827657 wait complete. 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 Processor -- start 2023-11-24T06:30:17.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- start start 2023-11-24T06:30:17.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540ccef0 0x7f8354158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 0x7f8354160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83541624f0 0x7f8354160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8354164fe0 con 0x7f83540cd380 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8354158ba0 con 0x7f83541624f0 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f835b5df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83540b3df0 con 0x7f83540ccef0 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f8358b7a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 0x7f8354160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f8358b7a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 0x7f8354160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53152/0 (socket says 172.21.15.143:53152) 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.521+0000 7f8358b7a640 1 -- 172.21.15.143:0/816338226 learned_addr learned my addr 172.21.15.143:0/816338226 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f835937b640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540ccef0 0x7f8354158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8359b7c640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83541624f0 0x7f8354160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8358b7a640 1 -- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540ccef0 msgr2=0x7f8354158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8358b7a640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540ccef0 0x7f8354158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8358b7a640 1 -- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83541624f0 msgr2=0x7f8354160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8358b7a640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83541624f0 0x7f8354160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8358b7a640 1 -- 172.21.15.143:0/816338226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8344009420 con 0x7f83540cd380 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8358b7a640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 0x7f8354160740 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83440097c0 tx=0x7f8344019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440b5610 con 0x7f83540cd380 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83440b5790 con 0x7f83540cd380 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440b5b40 con 0x7f83540cd380 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8354164a20 con 0x7f83540cd380 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83540b2030 con 0x7f83540cd380 2023-11-24T06:30:17.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835404e8c0 con 0x7f83540cd380 2023-11-24T06:30:17.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.525+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83440b3040 con 0x7f83540cd380 2023-11-24T06:30:17.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.529+0000 7f8349ffb640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8338066470 0x7f8338068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.529+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f834411e220 con 0x7f83540cd380 2023-11-24T06:30:17.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.529+0000 7f835937b640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8338066470 0x7f8338068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.529+0000 7f835937b640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8338066470 0x7f8338068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83500011f0 tx=0x7f8350009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.533+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83440eb730 con 0x7f83540cd380 2023-11-24T06:30:17.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.681+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83540cc890 con 0x7f83540cd380 2023-11-24T06:30:17.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.681+0000 7f8349ffb640 1 -- 172.21.15.143:0/816338226 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83440eed50 con 0x7f83540cd380 2023-11-24T06:30:17.688 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:17.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8338066470 msgr2=0x7f8338068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8338066470 0x7f8338068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83500011f0 tx=0x7f8350009040 comp rx=0 tx=0).stop 2023-11-24T06:30:17.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 msgr2=0x7f8354160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 0x7f8354160740 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83440097c0 tx=0x7f8344019160 comp rx=0 tx=0).stop 2023-11-24T06:30:17.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 shutdown_connections 2023-11-24T06:30:17.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8338066470 0x7f8338068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83541624f0 0x7f8354160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83540cd380 0x7f8354160740 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 --2- 172.21.15.143:0/816338226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83540ccef0 0x7f8354158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 >> 172.21.15.143:0/816338226 conn(0x7f83540b0c80 msgr2=0x7f835415b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:17.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 shutdown_connections 2023-11-24T06:30:17.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.685+0000 7f835b5df640 1 -- 172.21.15.143:0/816338226 wait complete. 2023-11-24T06:30:17.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:30:17.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.841+0000 7fe398c68640 1 Processor -- start 2023-11-24T06:30:17.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.841+0000 7fe398c68640 1 -- start start 2023-11-24T06:30:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe398c68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe3940cad20 0x7fe3940c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe398c68640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39415a8b0 con 0x7fe39415a4d0 2023-11-24T06:30:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe398c68640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3940c9c30 con 0x7fe39406d740 2023-11-24T06:30:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe398c68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940c9f60 con 0x7fe3940cad20 2023-11-24T06:30:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe389d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe3940cad20 0x7fe3940c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe39259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe39415a4d0 0x7fe39415e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34804/0 (socket says 172.21.15.143:34804) 2023-11-24T06:30:17.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe39259c640 1 -- 172.21.15.143:0/3137338045 learned_addr learned my addr 172.21.15.143:0/3137338045 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:17.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe389d9b640 1 -- 172.21.15.143:0/3137338045 >> v1:172.21.15.146:6789/0 conn(0x7fe39406d740 legacy=0x7fe39406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:17.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe389d9b640 1 -- 172.21.15.143:0/3137338045 >> v1:172.21.15.143:6789/0 conn(0x7fe39415a4d0 legacy=0x7fe39415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe389d9b640 1 -- 172.21.15.143:0/3137338045 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3940ca240 con 0x7fe3940cad20 2023-11-24T06:30:17.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe391d9b640 1 -- 172.21.15.143:0/3137338045 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726765639 0 0) 0x7fe39415a8b0 con 0x7fe39415a4d0 2023-11-24T06:30:17.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.845+0000 7fe389d9b640 1 --2- 172.21.15.143:0/3137338045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3940cad20 0x7fe3940c9650 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3840097c0 tx=0x7fe38401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdb8ef847a39d48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe391d9b640 1 -- 172.21.15.143:0/3137338045 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3840ad680 con 0x7fe3940cad20 2023-11-24T06:30:17.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe391d9b640 1 -- 172.21.15.143:0/3137338045 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3840ad7e0 con 0x7fe3940cad20 2023-11-24T06:30:17.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe391d9b640 1 -- 172.21.15.143:0/3137338045 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3840adb70 con 0x7fe3940cad20 2023-11-24T06:30:17.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 -- 172.21.15.143:0/3137338045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3940cad20 msgr2=0x7fe3940c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 --2- 172.21.15.143:0/3137338045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3940cad20 0x7fe3940c9650 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3840097c0 tx=0x7fe38401c380 comp rx=0 tx=0).stop 2023-11-24T06:30:17.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 -- 172.21.15.143:0/3137338045 shutdown_connections 2023-11-24T06:30:17.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 --2- 172.21.15.143:0/3137338045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3940cad20 0x7fe3940c9650 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 -- 172.21.15.143:0/3137338045 >> 172.21.15.143:0/3137338045 conn(0x7fe3940b0bf0 msgr2=0x7fe3940b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:17.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 -- 172.21.15.143:0/3137338045 shutdown_connections 2023-11-24T06:30:17.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 -- 172.21.15.143:0/3137338045 wait complete. 2023-11-24T06:30:17.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 Processor -- start 2023-11-24T06:30:17.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 -- start start 2023-11-24T06:30:17.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.849+0000 7fe398c68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 0x7fe39414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3940cad20 0x7fe394153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe39415a4d0 0x7fe394153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940acbc0 con 0x7fe39406d740 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940acea0 con 0x7fe39415a4d0 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940ad180 con 0x7fe3940cad20 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 0x7fe39414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 0x7fe39414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53174/0 (socket says 172.21.15.143:53174) 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 -- 172.21.15.143:0/3899293467 learned_addr learned my addr 172.21.15.143:0/3899293467 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 -- 172.21.15.143:0/3899293467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3940cad20 msgr2=0x7fe394153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3940cad20 0x7fe394153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 -- 172.21.15.143:0/3899293467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe39415a4d0 msgr2=0x7fe394153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:17.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe39415a4d0 0x7fe394153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 -- 172.21.15.143:0/3899293467 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe384009420 con 0x7fe39406d740 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe39259c640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 0x7fe39414fe00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00c480 tx=0x7fe37c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c0074e0 con 0x7fe39406d740 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c007660 con 0x7fe39406d740 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c004a30 con 0x7fe39406d740 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3940ad460 con 0x7fe39406d740 2023-11-24T06:30:17.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3940adc60 con 0x7fe39406d740 2023-11-24T06:30:17.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39409d250 con 0x7fe39406d740 2023-11-24T06:30:17.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe37c004b90 con 0x7fe39406d740 2023-11-24T06:30:17.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe38b7fe640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe374066470 0x7fe374068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:17.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.853+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe37c083030 con 0x7fe39406d740 2023-11-24T06:30:17.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.857+0000 7fe389d9b640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe374066470 0x7fe374068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:17.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.857+0000 7fe389d9b640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe374066470 0x7fe374068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe3840af000 tx=0x7fe384004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:17.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:17.857+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe37c050540 con 0x7fe39406d740 2023-11-24T06:30:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3940ad910 con 0x7fe39406d740 2023-11-24T06:30:18.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe38b7fe640 1 -- 172.21.15.143:0/3899293467 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe37c053b60 con 0x7fe39406d740 2023-11-24T06:30:18.026 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:30:18.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe374066470 msgr2=0x7fe374068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe374066470 0x7fe374068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe3840af000 tx=0x7fe384004740 comp rx=0 tx=0).stop 2023-11-24T06:30:18.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 msgr2=0x7fe39414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 0x7fe39414fe00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00c480 tx=0x7fe37c00c940 comp rx=0 tx=0).stop 2023-11-24T06:30:18.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 shutdown_connections 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe374066470 0x7fe374068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe39415a4d0 0x7fe394153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3940cad20 0x7fe394153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 --2- 172.21.15.143:0/3899293467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39406d740 0x7fe39414fe00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 >> 172.21.15.143:0/3899293467 conn(0x7fe3940b0bf0 msgr2=0x7fe394071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 shutdown_connections 2023-11-24T06:30:18.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.021+0000 7fe398c68640 1 -- 172.21.15.143:0/3899293467 wait complete. 2023-11-24T06:30:18.047 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-24T06:30:18.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:18.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-24T06:30:18.075 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:30:18.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:18.075 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:30:18.131 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:30:18.131 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:18.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f329a29a640 1 Processor -- start 2023-11-24T06:30:18.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f329a29a640 1 -- start start 2023-11-24T06:30:18.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f329a29a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32940710d0 0x7f329409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f329a29a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329406d8b0 con 0x7f329406c650 2023-11-24T06:30:18.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f329a29a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329406cca0 con 0x7f3294144030 2023-11-24T06:30:18.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f329a29a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3294145020 con 0x7f32940710d0 2023-11-24T06:30:18.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f32937fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f329406c650 0x7f32940709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34820/0 (socket says 172.21.15.143:34820) 2023-11-24T06:30:18.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f32937fe640 1 -- 172.21.15.143:0/4244823968 learned_addr learned my addr 172.21.15.143:0/4244823968 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:18.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.265+0000 7f3298837640 1 --2- 172.21.15.143:0/4244823968 >> v2:172.21.15.146:3300/0 conn(0x7f32940710d0 0x7f329409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897498673 0 0) 0x7f329406d8b0 con 0x7f329406c650 2023-11-24T06:30:18.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f327c003530 con 0x7f329406c650 2023-11-24T06:30:18.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785607407 0 0) 0x7f327c003530 con 0x7f329406c650 2023-11-24T06:30:18.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 >> v2:172.21.15.146:3300/0 conn(0x7f32940710d0 msgr2=0x7f329409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 --2- 172.21.15.143:0/4244823968 >> v2:172.21.15.146:3300/0 conn(0x7f32940710d0 0x7f329409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 >> v1:172.21.15.146:6789/0 conn(0x7f3294144030 legacy=0x7f329406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329406cf80 con 0x7f329406c650 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f3288001680 con 0x7f329406c650 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 >> v1:172.21.15.143:6789/0 conn(0x7f329406c650 legacy=0x7f32940709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f327c003980 0x7f327c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c0047d0 0x7f327c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c005190 0x7f327c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00c000 con 0x7f327c003980 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00c170 con 0x7f327c005190 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00c330 con 0x7f327c0047d0 2023-11-24T06:30:18.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3293fff640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f327c003980 0x7f327c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f32937fe640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c0047d0 0x7f327c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3298837640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c005190 0x7f327c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3293fff640 1 -- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c0047d0 msgr2=0x7f327c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3293fff640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c0047d0 0x7f327c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3293fff640 1 -- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c005190 msgr2=0x7f327c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3293fff640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c005190 0x7f327c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3293fff640 1 -- 172.21.15.143:0/4244823968 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c003530 con 0x7f327c003980 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f3298837640 1 -- 172.21.15.143:0/4244823968 reap_dead start 2023-11-24T06:30:18.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.269+0000 7f32937fe640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c0047d0 0x7f327c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:18.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f3293fff640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f327c003980 0x7f327c003da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3284001780 tx=0x7f328401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6065ed46061f56c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840052d0 con 0x7f327c003980 2023-11-24T06:30:18.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32840a7050 con 0x7f327c003980 2023-11-24T06:30:18.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f3292ffd640 1 -- 172.21.15.143:0/4244823968 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284003600 con 0x7f327c003980 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 -- 172.21.15.143:0/4244823968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f327c003980 msgr2=0x7f327c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f327c003980 0x7f327c003da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3284001780 tx=0x7f328401c3e0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 -- 172.21.15.143:0/4244823968 shutdown_connections 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 --2- 172.21.15.143:0/4244823968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f327c003980 0x7f327c003da0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 -- 172.21.15.143:0/4244823968 >> 172.21.15.143:0/4244823968 conn(0x7f32940b0bf0 msgr2=0x7f32940b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 -- 172.21.15.143:0/4244823968 shutdown_connections 2023-11-24T06:30:18.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 -- 172.21.15.143:0/4244823968 wait complete. 2023-11-24T06:30:18.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 Processor -- start 2023-11-24T06:30:18.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.273+0000 7f329a29a640 1 -- start start 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c003980 0x7f329413b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 0x7f32941f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32941f62b0 0x7f32941f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32941f6ca0 con 0x7f32941384a0 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329415b0c0 con 0x7f327c003980 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3294139820 con 0x7f32941f62b0 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 0x7f32941f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 0x7f32941f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53194/0 (socket says 172.21.15.143:53194) 2023-11-24T06:30:18.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 -- 172.21.15.143:0/1482152133 learned_addr learned my addr 172.21.15.143:0/1482152133 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3293fff640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c003980 0x7f329413b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3298837640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32941f62b0 0x7f32941f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 -- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32941f62b0 msgr2=0x7f32941f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32941f62b0 0x7f32941f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 -- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c003980 msgr2=0x7f329413b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c003980 0x7f329413b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 -- 172.21.15.143:0/1482152133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294138c10 con 0x7f32941384a0 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3293fff640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c003980 0x7f329413b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3298837640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32941f62b0 0x7f32941f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f32937fe640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 0x7f32941f5d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3288000fc0 tx=0x7f328800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800c6c0 con 0x7f32941384a0 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800c840 con 0x7f32941384a0 2023-11-24T06:30:18.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294138ef0 con 0x7f32941384a0 2023-11-24T06:30:18.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800cbf0 con 0x7f32941384a0 2023-11-24T06:30:18.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32941394b0 con 0x7f32941384a0 2023-11-24T06:30:18.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3294067520 con 0x7f32941384a0 2023-11-24T06:30:18.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.277+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f328800cd50 con 0x7f32941384a0 2023-11-24T06:30:18.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.281+0000 7f3290ff9640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32800664a0 0x7f3280068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.281+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3288083e00 con 0x7f32941384a0 2023-11-24T06:30:18.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.281+0000 7f3293fff640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32800664a0 0x7f3280068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.281+0000 7f3293fff640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32800664a0 0x7f3280068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3284001750 tx=0x7f32840011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.285+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32880511e0 con 0x7f32941384a0 2023-11-24T06:30:18.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.461+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3294139670 con 0x7f32941384a0 2023-11-24T06:30:18.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.461+0000 7f3290ff9640 1 -- 172.21.15.143:0/1482152133 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f3288054800 con 0x7f32941384a0 2023-11-24T06:30:18.468 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:18.469 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:30:18.469 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:30:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32800664a0 msgr2=0x7f3280068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32800664a0 0x7f3280068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3284001750 tx=0x7f32840011a0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 msgr2=0x7f32941f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 0x7f32941f5d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3288000fc0 tx=0x7f328800ec10 comp rx=0 tx=0).stop 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 shutdown_connections 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32800664a0 0x7f3280068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32941f62b0 0x7f32941f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32941384a0 0x7f32941f5d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 --2- 172.21.15.143:0/1482152133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c003980 0x7f329413b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 >> 172.21.15.143:0/1482152133 conn(0x7f32940b0bf0 msgr2=0x7f32940b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 shutdown_connections 2023-11-24T06:30:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.465+0000 7f329a29a640 1 -- 172.21.15.143:0/1482152133 wait complete. 2023-11-24T06:30:18.490 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:18.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.621+0000 7fc6a8cd6640 1 Processor -- start 2023-11-24T06:30:18.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.621+0000 7fc6a8cd6640 1 -- start start 2023-11-24T06:30:18.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a8cd6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6a40b36c0 0x7fc6a40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a8cd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a4070da0 0x7fc6a415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a8cd6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a415a700 con 0x7fc6a415a320 2023-11-24T06:30:18.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a8cd6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40b2430 con 0x7fc6a40b36c0 2023-11-24T06:30:18.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a8cd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40b2620 con 0x7fc6a4070da0 2023-11-24T06:30:18.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc699d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6a40b36c0 0x7fc6a40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc6a415a320 0x7fc6a4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34826/0 (socket says 172.21.15.143:34826) 2023-11-24T06:30:18.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a259c640 1 -- 172.21.15.143:0/1676598912 learned_addr learned my addr 172.21.15.143:0/1676598912 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:18.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc6a2d9d640 1 --2- 172.21.15.143:0/1676598912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a4070da0 0x7fc6a415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc699d9b640 1 -- 172.21.15.143:0/1676598912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a4070da0 msgr2=0x7fc6a415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:18.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc699d9b640 1 --2- 172.21.15.143:0/1676598912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a4070da0 0x7fc6a415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc699d9b640 1 -- 172.21.15.143:0/1676598912 >> v1:172.21.15.143:6789/0 conn(0x7fc6a415a320 legacy=0x7fc6a4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc699d9b640 1 -- 172.21.15.143:0/1676598912 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40b2900 con 0x7fc6a40b36c0 2023-11-24T06:30:18.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.625+0000 7fc699d9b640 1 --2- 172.21.15.143:0/1676598912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a40b36c0 0x7fc6a40b1ef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009d90 tx=0x7fc68c01c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb55c3d10a015ac3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a1d9b640 1 -- 172.21.15.143:0/1676598912 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0a66d0 con 0x7fc6a40b36c0 2023-11-24T06:30:18.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a1d9b640 1 -- 172.21.15.143:0/1676598912 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c0a6830 con 0x7fc6a40b36c0 2023-11-24T06:30:18.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a1d9b640 1 -- 172.21.15.143:0/1676598912 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0a6bc0 con 0x7fc6a40b36c0 2023-11-24T06:30:18.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1676598912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a40b36c0 msgr2=0x7fc6a40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1676598912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a40b36c0 0x7fc6a40b1ef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009d90 tx=0x7fc68c01c7b0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1676598912 shutdown_connections 2023-11-24T06:30:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1676598912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a4070da0 0x7fc6a415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1676598912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a40b36c0 0x7fc6a40b1ef0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1676598912 >> 172.21.15.143:0/1676598912 conn(0x7fc6a40b0bf0 msgr2=0x7fc6a40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1676598912 shutdown_connections 2023-11-24T06:30:18.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1676598912 wait complete. 2023-11-24T06:30:18.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 Processor -- start 2023-11-24T06:30:18.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- start start 2023-11-24T06:30:18.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 0x7fc6a4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a40b36c0 0x7fc6a415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415a320 0x7fc6a415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a415ad60 con 0x7fc6a4070da0 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41552f0 con 0x7fc6a415a320 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a8cd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4155590 con 0x7fc6a40b36c0 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.629+0000 7fc6a259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 0x7fc6a4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 0x7fc6a4154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53216/0 (socket says 172.21.15.143:53216) 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 -- 172.21.15.143:0/1294889803 learned_addr learned my addr 172.21.15.143:0/1294889803 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc699d9b640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a40b36c0 0x7fc6a415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a2d9d640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415a320 0x7fc6a415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 -- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a40b36c0 msgr2=0x7fc6a415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a40b36c0 0x7fc6a415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 -- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415a320 msgr2=0x7fc6a415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415a320 0x7fc6a415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 -- 172.21.15.143:0/1294889803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c009a70 con 0x7fc6a4070da0 2023-11-24T06:30:18.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a259c640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 0x7fc6a4154db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c780 tx=0x7fc69400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940072d0 con 0x7fc6a4070da0 2023-11-24T06:30:18.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694007430 con 0x7fc6a4070da0 2023-11-24T06:30:18.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940047f0 con 0x7fc6a4070da0 2023-11-24T06:30:18.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4155870 con 0x7fc6a4070da0 2023-11-24T06:30:18.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a415af70 con 0x7fc6a4070da0 2023-11-24T06:30:18.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4067520 con 0x7fc6a4070da0 2023-11-24T06:30:18.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc694004950 con 0x7fc6a4070da0 2023-11-24T06:30:18.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.633+0000 7fc69b7fe640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc684066470 0x7fc684068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.637+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc694083280 con 0x7fc6a4070da0 2023-11-24T06:30:18.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.637+0000 7fc699d9b640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc684066470 0x7fc684068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.637+0000 7fc699d9b640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc684066470 0x7fc684068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0af000 tx=0x7fc68c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.637+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc694050710 con 0x7fc6a4070da0 2023-11-24T06:30:18.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.789+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a415ab40 con 0x7fc6a4070da0 2023-11-24T06:30:18.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc69b7fe640 1 -- 172.21.15.143:0/1294889803 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fc694018090 con 0x7fc6a4070da0 2023-11-24T06:30:18.797 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc684066470 msgr2=0x7fc684068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc684066470 0x7fc684068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0af000 tx=0x7fc68c0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 msgr2=0x7fc6a4154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 0x7fc6a4154db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c780 tx=0x7fc69400cc40 comp rx=0 tx=0).stop 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 shutdown_connections 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc684066470 0x7fc684068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415a320 0x7fc6a415b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6a40b36c0 0x7fc6a415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 --2- 172.21.15.143:0/1294889803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6a4070da0 0x7fc6a4154db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 >> 172.21.15.143:0/1294889803 conn(0x7fc6a40b0bf0 msgr2=0x7fc6a40adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 shutdown_connections 2023-11-24T06:30:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.793+0000 7fc6a8cd6640 1 -- 172.21.15.143:0/1294889803 wait complete. 2023-11-24T06:30:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:29:38.405887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:29:39.741276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:18.821 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:18.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d59b4640 1 Processor -- start 2023-11-24T06:30:18.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d59b4640 1 -- start start 2023-11-24T06:30:18.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d59b4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd5d0072490 0x7fd5d006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d59b4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00ce090 con 0x7fd5d006cdb0 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d59b4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00cb8d0 con 0x7fd5d00cb4f0 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d59b4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d0159f50 con 0x7fd5d0072490 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd5d0072490 0x7fd5d006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd5d0072490 0x7fd5d006c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53228/0 (socket says 172.21.15.143:53228) 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5d51b3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd5d006cdb0 0x7fd5d00c9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34840/0 (socket says 172.21.15.143:34840) 2023-11-24T06:30:18.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c7fff640 1 -- 172.21.15.143:0/2092131992 learned_addr learned my addr 172.21.15.143:0/2092131992 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:18.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c7fff640 1 -- 172.21.15.143:0/2092131992 >> v1:172.21.15.146:6789/0 conn(0x7fd5d00cb4f0 legacy=0x7fd5d00ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:18.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c7fff640 1 -- 172.21.15.143:0/2092131992 >> v1:172.21.15.143:6789/0 conn(0x7fd5d006cdb0 legacy=0x7fd5d00c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c7fff640 1 -- 172.21.15.143:0/2092131992 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d006d1d0 con 0x7fd5d0072490 2023-11-24T06:30:18.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.957+0000 7fd5c77fe640 1 -- 172.21.15.143:0/2092131992 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998103894 0 0) 0x7fd5d00ce090 con 0x7fd5d006cdb0 2023-11-24T06:30:18.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5c7fff640 1 --2- 172.21.15.143:0/2092131992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d0072490 0x7fd5d006c870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000aa10 tx=0x7fd5c00200c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf39da10e1528d41 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5c77fe640 1 -- 172.21.15.143:0/2092131992 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00b1440 con 0x7fd5d0072490 2023-11-24T06:30:18.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5c77fe640 1 -- 172.21.15.143:0/2092131992 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00b15a0 con 0x7fd5d0072490 2023-11-24T06:30:18.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5c77fe640 1 -- 172.21.15.143:0/2092131992 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00b1930 con 0x7fd5d0072490 2023-11-24T06:30:18.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 -- 172.21.15.143:0/2092131992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d0072490 msgr2=0x7fd5d006c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/2092131992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d0072490 0x7fd5d006c870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000aa10 tx=0x7fd5c00200c0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 -- 172.21.15.143:0/2092131992 shutdown_connections 2023-11-24T06:30:18.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/2092131992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d0072490 0x7fd5d006c870 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 -- 172.21.15.143:0/2092131992 >> 172.21.15.143:0/2092131992 conn(0x7fd5d00cbb50 msgr2=0x7fd5d00cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:18.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 -- 172.21.15.143:0/2092131992 shutdown_connections 2023-11-24T06:30:18.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.961+0000 7fd5d59b4640 1 -- 172.21.15.143:0/2092131992 wait complete. 2023-11-24T06:30:18.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 Processor -- start 2023-11-24T06:30:18.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 -- start start 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 0x7fd5d0143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d0072490 0x7fd5d00b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5d00cb4f0 0x7fd5d01f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0143fb0 con 0x7fd5d006cdb0 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0140f60 con 0x7fd5d0072490 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00b3ef0 con 0x7fd5d00cb4f0 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 0x7fd5d0143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 0x7fd5d0143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53240/0 (socket says 172.21.15.143:53240) 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 -- 172.21.15.143:0/3340661738 learned_addr learned my addr 172.21.15.143:0/3340661738 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5c7fff640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d0072490 0x7fd5d00b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d51b3640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5d00cb4f0 0x7fd5d01f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 -- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5d00cb4f0 msgr2=0x7fd5d01f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5d00cb4f0 0x7fd5d01f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 -- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d0072490 msgr2=0x7fd5d00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d0072490 0x7fd5d00b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:18.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 -- 172.21.15.143:0/3340661738 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c000a670 con 0x7fd5d006cdb0 2023-11-24T06:30:18.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d49b2640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 0x7fd5d0143a70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00b440 tx=0x7fd5cc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011830 con 0x7fd5d006cdb0 2023-11-24T06:30:18.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc011990 con 0x7fd5d006cdb0 2023-11-24T06:30:18.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d00b4140 con 0x7fd5d006cdb0 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011d40 con 0x7fd5d006cdb0 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.965+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d00b4700 con 0x7fd5d006cdb0 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.969+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d0141110 con 0x7fd5d006cdb0 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.969+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5cc01a400 con 0x7fd5d006cdb0 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.969+0000 7fd5c57fa640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5bc0664a0 0x7fd5bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.969+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5cc083be0 con 0x7fd5d006cdb0 2023-11-24T06:30:18.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.969+0000 7fd5c7fff640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5bc0664a0 0x7fd5bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:18.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.969+0000 7fd5c7fff640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5bc0664a0 0x7fd5bc068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00b3000 tx=0x7fd5c00ab070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:18.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:18.973+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5d0141110 con 0x7fd5d006cdb0 2023-11-24T06:30:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5d0141110 con 0x7fd5d006cdb0 2023-11-24T06:30:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5c57fa640 1 -- 172.21.15.143:0/3340661738 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5d0141110 con 0x7fd5d006cdb0 2023-11-24T06:30:19.139 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5bc0664a0 msgr2=0x7fd5bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5bc0664a0 0x7fd5bc068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00b3000 tx=0x7fd5c00ab070 comp rx=0 tx=0).stop 2023-11-24T06:30:19.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 msgr2=0x7fd5d0143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 0x7fd5d0143a70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00b440 tx=0x7fd5cc00b900 comp rx=0 tx=0).stop 2023-11-24T06:30:19.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 shutdown_connections 2023-11-24T06:30:19.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5bc0664a0 0x7fd5bc068960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5d00cb4f0 0x7fd5d01f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d0072490 0x7fd5d00b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 --2- 172.21.15.143:0/3340661738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5d006cdb0 0x7fd5d0143a70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 >> 172.21.15.143:0/3340661738 conn(0x7fd5d00cbb50 msgr2=0x7fd5d0073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:19.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 shutdown_connections 2023-11-24T06:30:19.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.133+0000 7fd5d59b4640 1 -- 172.21.15.143:0/3340661738 wait complete. 2023-11-24T06:30:19.160 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 Processor -- start 2023-11-24T06:30:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 -- start start 2023-11-24T06:30:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe01415d450 0x7fe014161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 0x7fe0140ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01406b460 con 0x7fe01406b8f0 2023-11-24T06:30:19.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01406a5b0 con 0x7fe01415d450 2023-11-24T06:30:19.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0194bb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe014162030 con 0x7fe01406dac0 2023-11-24T06:30:19.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe00a7fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe01406b8f0 0x7fe01406d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34852/0 (socket says 172.21.15.143:34852) 2023-11-24T06:30:19.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe00a7fc640 1 -- 172.21.15.143:0/3069609399 learned_addr learned my addr 172.21.15.143:0/3069609399 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:19.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3069609399 >> v2:172.21.15.146:3300/0 conn(0x7fe01415d450 0x7fe014161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499895590 0 0) 0x7fe01406b460 con 0x7fe01406b8f0 2023-11-24T06:30:19.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0137fe640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 0x7fe0140ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000003530 con 0x7fe01406b8f0 2023-11-24T06:30:19.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3995144367 0 0) 0x7fe000003530 con 0x7fe01406b8f0 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 msgr2=0x7fe0140ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 0x7fe0140ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 >> v2:172.21.15.146:3300/0 conn(0x7fe01415d450 msgr2=0x7fe014161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 --2- 172.21.15.143:0/3069609399 >> v2:172.21.15.146:3300/0 conn(0x7fe01415d450 0x7fe014161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01406a850 con 0x7fe01406b8f0 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fdffc001680 con 0x7fe01406b8f0 2023-11-24T06:30:19.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3069609399 >> v2:172.21.15.146:3300/0 conn(0x7fe01415d450 0x7fe014161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 >> v1:172.21.15.143:6789/0 conn(0x7fe01406b8f0 legacy=0x7fe01406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe000003980 0x7fe000003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 0x7fe0000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01406a5b0 con 0x7fe000003980 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014162030 con 0x7fe000004d10 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00000b990 con 0x7fe01406dac0 2023-11-24T06:30:19.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe000003980 0x7fe000003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0137fe640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe00a7fc640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 0x7fe0000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 -- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 msgr2=0x7fe0000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01406dac0 0x7fe0000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 -- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe000004d10 msgr2=0x7fe000005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe012ffd640 1 -- 172.21.15.143:0/3069609399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000003530 con 0x7fe000003980 2023-11-24T06:30:19.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.297+0000 7fe0137fe640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe000004d10 0x7fe000005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:19.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe000003980 0x7fe000003da0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe004009ce0 tx=0x7fe00401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f13855378e0b35a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040a58c0 con 0x7fe000003980 2023-11-24T06:30:19.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040a5a20 con 0x7fe000003980 2023-11-24T06:30:19.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0127fc640 1 -- 172.21.15.143:0/3069609399 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040a5dd0 con 0x7fe000003980 2023-11-24T06:30:19.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0194bb640 1 -- 172.21.15.143:0/3069609399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe000003980 msgr2=0x7fe000003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3069609399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe000003980 0x7fe000003da0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe004009ce0 tx=0x7fe00401cc20 comp rx=0 tx=0).stop 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0137fe640 1 -- 172.21.15.143:0/3069609399 reap_dead start 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0194bb640 1 -- 172.21.15.143:0/3069609399 shutdown_connections 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0194bb640 1 -- 172.21.15.143:0/3069609399 >> 172.21.15.143:0/3069609399 conn(0x7fe0140cf8f0 msgr2=0x7fe0140cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0194bb640 1 -- 172.21.15.143:0/3069609399 shutdown_connections 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.301+0000 7fe0194bb640 1 -- 172.21.15.143:0/3069609399 wait complete. 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 Processor -- start 2023-11-24T06:30:19.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 -- start start 2023-11-24T06:30:19.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe000003980 0x7fe014151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 0x7fe01415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0141618d0 0x7fe01415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01414f580 con 0x7fe014161450 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01414f860 con 0x7fe0141618d0 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01414ece0 con 0x7fe000003980 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 0x7fe01415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 0x7fe01415ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53256/0 (socket says 172.21.15.143:53256) 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 -- 172.21.15.143:0/3077530175 learned_addr learned my addr 172.21.15.143:0/3077530175 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:19.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0137fe640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0141618d0 0x7fe01415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe000003980 0x7fe014151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 -- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe000003980 msgr2=0x7fe014151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe000003980 0x7fe014151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 -- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0141618d0 msgr2=0x7fe01415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0141618d0 0x7fe01415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 -- 172.21.15.143:0/3077530175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01414efc0 con 0x7fe014161450 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00a7fc640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 0x7fe01415ebb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdffc001060 tx=0x7fdffc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00ee80 con 0x7fe014161450 2023-11-24T06:30:19.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00c8d0 con 0x7fe014161450 2023-11-24T06:30:19.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.305+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0140cf470 con 0x7fe014161450 2023-11-24T06:30:19.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00cc60 con 0x7fe014161450 2023-11-24T06:30:19.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01415f800 con 0x7fe014161450 2023-11-24T06:30:19.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01414eb40 con 0x7fe014161450 2023-11-24T06:30:19.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdffc01d460 con 0x7fe014161450 2023-11-24T06:30:19.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe00bfff640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdff40664a0 0x7fdff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdffc083eb0 con 0x7fe014161450 2023-11-24T06:30:19.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.309+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdff40664a0 0x7fdff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.313+0000 7fe012ffd640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdff40664a0 0x7fdff4068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe0040af000 tx=0x7fe0040046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.313+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe01414eb40 con 0x7fe014161450 2023-11-24T06:30:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.461+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe01414f200 con 0x7fe014161450 2023-11-24T06:30:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe00bfff640 1 -- 172.21.15.143:0/3077530175 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe01414f200 con 0x7fe014161450 2023-11-24T06:30:19.468 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdff40664a0 msgr2=0x7fdff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdff40664a0 0x7fdff4068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe0040af000 tx=0x7fe0040046d0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 msgr2=0x7fe01415ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 0x7fe01415ebb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdffc001060 tx=0x7fdffc00ec30 comp rx=0 tx=0).stop 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 shutdown_connections 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdff40664a0 0x7fdff4068960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0141618d0 0x7fe01415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe014161450 0x7fe01415ebb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 --2- 172.21.15.143:0/3077530175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe000003980 0x7fe014151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 >> 172.21.15.143:0/3077530175 conn(0x7fe0140cf8f0 msgr2=0x7fe0140b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 shutdown_connections 2023-11-24T06:30:19.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.465+0000 7fe0194bb640 1 -- 172.21.15.143:0/3077530175 wait complete. 2023-11-24T06:30:19.489 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:19.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8082594640 1 Processor -- start 2023-11-24T06:30:19.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8082594640 1 -- start start 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8082594640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f807c0b1f80 0x7f807c0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8082594640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c070f00 con 0x7f807c15a290 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8082594640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c071170 con 0x7f807c15ec60 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8082594640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c0cb690 con 0x7f807c0b1f80 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f807bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f807c15a290 0x7f807c0707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34862/0 (socket says 172.21.15.143:34862) 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f807bfff640 1 -- 172.21.15.143:0/3909288700 learned_addr learned my addr 172.21.15.143:0/3909288700 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8080b31640 1 --2- 172.21.15.143:0/3909288700 >> v2:172.21.15.143:3300/0 conn(0x7f807c0b1f80 0x7f807c0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f807affd640 1 -- 172.21.15.143:0/3909288700 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128233109 0 0) 0x7f807c070f00 con 0x7f807c15a290 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f807affd640 1 -- 172.21.15.143:0/3909288700 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8064005740 con 0x7f807c15a290 2023-11-24T06:30:19.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8080b31640 1 -- 172.21.15.143:0/3909288700 >> v1:172.21.15.146:6789/0 conn(0x7f807c15ec60 legacy=0x7f807c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8080b31640 1 -- 172.21.15.143:0/3909288700 >> v1:172.21.15.143:6789/0 conn(0x7f807c15a290 legacy=0x7f807c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.625+0000 7f8080b31640 1 -- 172.21.15.143:0/3909288700 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0cb970 con 0x7f807c0b1f80 2023-11-24T06:30:19.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8080b31640 1 --2- 172.21.15.143:0/3909288700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c0b23f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8074009d90 tx=0x7f807401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c176bc382ea6671f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f807affd640 1 -- 172.21.15.143:0/3909288700 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740a5890 con 0x7f807c0b1f80 2023-11-24T06:30:19.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f807affd640 1 -- 172.21.15.143:0/3909288700 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80740a59f0 con 0x7f807c0b1f80 2023-11-24T06:30:19.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f807affd640 1 -- 172.21.15.143:0/3909288700 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740a5d80 con 0x7f807c0b1f80 2023-11-24T06:30:19.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 -- 172.21.15.143:0/3909288700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 msgr2=0x7f807c0b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 --2- 172.21.15.143:0/3909288700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c0b23f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8074009d90 tx=0x7f807401c8c0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 -- 172.21.15.143:0/3909288700 shutdown_connections 2023-11-24T06:30:19.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 --2- 172.21.15.143:0/3909288700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c0b23f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 -- 172.21.15.143:0/3909288700 >> 172.21.15.143:0/3909288700 conn(0x7f807c0b0c80 msgr2=0x7f807c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:19.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 -- 172.21.15.143:0/3909288700 shutdown_connections 2023-11-24T06:30:19.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.629+0000 7f8082594640 1 -- 172.21.15.143:0/3909288700 wait complete. 2023-11-24T06:30:19.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 Processor -- start 2023-11-24T06:30:19.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- start start 2023-11-24T06:30:19.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c15a290 0x7f807c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c15ec60 0x7f807c164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c165470 con 0x7f807c0b1f80 2023-11-24T06:30:19.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c165190 con 0x7f807c15a290 2023-11-24T06:30:19.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c1551f0 con 0x7f807c15ec60 2023-11-24T06:30:19.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53268/0 (socket says 172.21.15.143:53268) 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 -- 172.21.15.143:0/870254966 learned_addr learned my addr 172.21.15.143:0/870254966 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807b7fe640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c15a290 0x7f807c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8080b31640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c15ec60 0x7f807c164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 -- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c15ec60 msgr2=0x7f807c164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c15ec60 0x7f807c164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 -- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c15a290 msgr2=0x7f807c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c15a290 0x7f807c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 -- 172.21.15.143:0/870254966 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074009a70 con 0x7f807c0b1f80 2023-11-24T06:30:19.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f807bfff640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c152b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c4d0 tx=0x7f806c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c005cf0 con 0x7f807c0b1f80 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c005e50 con 0x7f807c0b1f80 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c1554d0 con 0x7f807c0b1f80 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c007270 con 0x7f807c0b1f80 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c164d60 con 0x7f807c0b1f80 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.633+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c164f50 con 0x7f807c0b1f80 2023-11-24T06:30:19.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.637+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f806c0073d0 con 0x7f807c0b1f80 2023-11-24T06:30:19.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.637+0000 7f8078ff9640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8068066470 0x7f8068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.637+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f806c0833d0 con 0x7f807c0b1f80 2023-11-24T06:30:19.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.637+0000 7f807b7fe640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8068066470 0x7f8068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.637+0000 7f807b7fe640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8068066470 0x7f8068068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f807c15db30 tx=0x7f8070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.641+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f807c164f50 con 0x7f807c0b1f80 2023-11-24T06:30:19.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.789+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f807c164f50 con 0x7f807c0b1f80 2023-11-24T06:30:19.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8078ff9640 1 -- 172.21.15.143:0/870254966 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f807c164f50 con 0x7f807c0b1f80 2023-11-24T06:30:19.797 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8068066470 msgr2=0x7f8068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8068066470 0x7f8068068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f807c15db30 tx=0x7f8070009040 comp rx=0 tx=0).stop 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 msgr2=0x7f807c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c152b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c4d0 tx=0x7f806c00c990 comp rx=0 tx=0).stop 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 shutdown_connections 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8068066470 0x7f8068068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c15ec60 0x7f807c164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c15a290 0x7f807c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 --2- 172.21.15.143:0/870254966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f807c0b1f80 0x7f807c152b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 >> 172.21.15.143:0/870254966 conn(0x7f807c0b0c80 msgr2=0x7f807c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:19.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 shutdown_connections 2023-11-24T06:30:19.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.793+0000 7f8082594640 1 -- 172.21.15.143:0/870254966 wait complete. 2023-11-24T06:30:19.818 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:19.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.949+0000 7f90ebcd6640 1 Processor -- start 2023-11-24T06:30:19.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.949+0000 7f90ebcd6640 1 -- start start 2023-11-24T06:30:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ebcd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e4158a50 0x7f90e406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ebcd6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f90e406cb90 0x7f90e40b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ebcd6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e406dc20 con 0x7f90e406e340 2023-11-24T06:30:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ebcd6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e406e0b0 con 0x7f90e406cb90 2023-11-24T06:30:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ebcd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40b3620 con 0x7f90e4158a50 2023-11-24T06:30:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ea273640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f90e406cb90 0x7f90e40b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90e9271640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f90e406e340 0x7f90e40707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34870/0 (socket says 172.21.15.143:34870) 2023-11-24T06:30:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90e9271640 1 -- 172.21.15.143:0/3438310159 learned_addr learned my addr 172.21.15.143:0/3438310159 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90e9a72640 1 --2- 172.21.15.143:0/3438310159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e4158a50 0x7f90e406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ea273640 1 -- 172.21.15.143:0/3438310159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e4158a50 msgr2=0x7f90e406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ea273640 1 --2- 172.21.15.143:0/3438310159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e4158a50 0x7f90e406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ea273640 1 -- 172.21.15.143:0/3438310159 >> v1:172.21.15.143:6789/0 conn(0x7f90e406e340 legacy=0x7f90e40707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.953+0000 7f90ea273640 1 -- 172.21.15.143:0/3438310159 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4158e30 con 0x7f90e406cb90 2023-11-24T06:30:19.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ea273640 1 --2- 172.21.15.143:0/3438310159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e406cb90 0x7f90e40b24c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009d90 tx=0x7f90dc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159603ef81610986 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90e8a70640 1 -- 172.21.15.143:0/3438310159 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a59e0 con 0x7f90e406cb90 2023-11-24T06:30:19.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90e8a70640 1 -- 172.21.15.143:0/3438310159 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0a5b40 con 0x7f90e406cb90 2023-11-24T06:30:19.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90e8a70640 1 -- 172.21.15.143:0/3438310159 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0ad440 con 0x7f90e406cb90 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 -- 172.21.15.143:0/3438310159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e406cb90 msgr2=0x7f90e40b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/3438310159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e406cb90 0x7f90e40b24c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009d90 tx=0x7f90dc01c920 comp rx=0 tx=0).stop 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 -- 172.21.15.143:0/3438310159 shutdown_connections 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/3438310159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e406cb90 0x7f90e40b24c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/3438310159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e4158a50 0x7f90e406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 -- 172.21.15.143:0/3438310159 >> 172.21.15.143:0/3438310159 conn(0x7f90e40b0bf0 msgr2=0x7f90e40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 -- 172.21.15.143:0/3438310159 shutdown_connections 2023-11-24T06:30:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 -- 172.21.15.143:0/3438310159 wait complete. 2023-11-24T06:30:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 Processor -- start 2023-11-24T06:30:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.957+0000 7f90ebcd6640 1 -- start start 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e406cb90 0x7f90e4151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e406e340 0x7f90e4157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 0x7f90e4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e41585a0 con 0x7f90e4158a50 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e409bb90 con 0x7f90e406e340 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e409b260 con 0x7f90e406cb90 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 0x7f90e4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 0x7f90e4151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53280/0 (socket says 172.21.15.143:53280) 2023-11-24T06:30:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 -- 172.21.15.143:0/351266258 learned_addr learned my addr 172.21.15.143:0/351266258 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:19.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90e9a72640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e406cb90 0x7f90e4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90e9271640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e406e340 0x7f90e4157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 -- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e406cb90 msgr2=0x7f90e4151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e406cb90 0x7f90e4151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 -- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e406e340 msgr2=0x7f90e4157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e406e340 0x7f90e4157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 -- 172.21.15.143:0/351266258 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc009a70 con 0x7f90e4158a50 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90e9a72640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e406cb90 0x7f90e4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90e9271640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e406e340 0x7f90e4157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ea273640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 0x7f90e4151ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90dc01afd0 tx=0x7f90dc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0addc0 con 0x7f90e4158a50 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc009450 con 0x7f90e4158a50 2023-11-24T06:30:19.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e409b540 con 0x7f90e4158a50 2023-11-24T06:30:19.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b9650 con 0x7f90e4158a50 2023-11-24T06:30:19.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e4157110 con 0x7f90e4158a50 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e409bd00 con 0x7f90e4158a50 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.961+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90dc0b97b0 con 0x7f90e4158a50 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.965+0000 7f90da7fc640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f90c8066470 0x7f90c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.965+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90dc11f660 con 0x7f90e4158a50 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.965+0000 7f90e9a72640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f90c8066470 0x7f90c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.965+0000 7f90e9a72640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f90c8066470 0x7f90c8068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90e0007a70 tx=0x7f90e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:19.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:19.969+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90dc0ecad0 con 0x7f90e4158a50 2023-11-24T06:30:20.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.149+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90e4067520 con 0x7f90e4158a50 2023-11-24T06:30:20.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90da7fc640 1 -- 172.21.15.143:0/351266258 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f90dc0f00f0 con 0x7f90e4158a50 2023-11-24T06:30:20.157 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:20.157 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:30:20.158 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:30:20.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f90c8066470 msgr2=0x7f90c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f90c8066470 0x7f90c8068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90e0007a70 tx=0x7f90e0008040 comp rx=0 tx=0).stop 2023-11-24T06:30:20.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 msgr2=0x7f90e4151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 0x7f90e4151ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90dc01afd0 tx=0x7f90dc0196c0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 shutdown_connections 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f90c8066470 0x7f90c8068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90e4158a50 0x7f90e4151ec0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e406e340 0x7f90e4157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 --2- 172.21.15.143:0/351266258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e406cb90 0x7f90e4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 >> 172.21.15.143:0/351266258 conn(0x7f90e40b0bf0 msgr2=0x7f90e40afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 shutdown_connections 2023-11-24T06:30:20.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.153+0000 7f90ebcd6640 1 -- 172.21.15.143:0/351266258 wait complete. 2023-11-24T06:30:20.178 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:20.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 Processor -- start 2023-11-24T06:30:20.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 -- start start 2023-11-24T06:30:20.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92bc144030 0x7f92bc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f92bc09cc20 0x7f92bc06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc06d8b0 con 0x7f92bc06e280 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc145020 con 0x7f92bc09cc20 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92c0db8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc09d0a0 con 0x7f92bc144030 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f92bc09cc20 0x7f92bc06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f92bc09cc20 0x7f92bc06dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53282/0 (socket says 172.21.15.143:53282) 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 -- 172.21.15.143:0/2181678034 learned_addr learned my addr 172.21.15.143:0/2181678034 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:20.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92ba59c640 1 --2- 172.21.15.143:0/2181678034 >> v2:172.21.15.146:3300/0 conn(0x7f92bc144030 0x7f92bc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 -- 172.21.15.143:0/2181678034 >> v2:172.21.15.146:3300/0 conn(0x7f92bc144030 msgr2=0x7f92bc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:20.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 --2- 172.21.15.143:0/2181678034 >> v2:172.21.15.146:3300/0 conn(0x7f92bc144030 0x7f92bc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 -- 172.21.15.143:0/2181678034 >> v1:172.21.15.146:6789/0 conn(0x7f92bc06e280 legacy=0x7f92bc0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.313+0000 7f92b1d9b640 1 -- 172.21.15.143:0/2181678034 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc06cca0 con 0x7f92bc09cc20 2023-11-24T06:30:20.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92b1d9b640 1 --2- 172.21.15.143:0/2181678034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc09cc20 0x7f92bc06dd40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f92bc06c2f0 tx=0x7f92a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3965bf29a83c7e51 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:20.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92b9d9b640 1 -- 172.21.15.143:0/2181678034 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40aa430 con 0x7f92bc09cc20 2023-11-24T06:30:20.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92b9d9b640 1 -- 172.21.15.143:0/2181678034 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a40aa590 con 0x7f92bc09cc20 2023-11-24T06:30:20.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92b9d9b640 1 -- 172.21.15.143:0/2181678034 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40aa920 con 0x7f92bc09cc20 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 -- 172.21.15.143:0/2181678034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc09cc20 msgr2=0x7f92bc06dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 --2- 172.21.15.143:0/2181678034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc09cc20 0x7f92bc06dd40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f92bc06c2f0 tx=0x7f92a401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 -- 172.21.15.143:0/2181678034 shutdown_connections 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 --2- 172.21.15.143:0/2181678034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc09cc20 0x7f92bc06dd40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 --2- 172.21.15.143:0/2181678034 >> v2:172.21.15.146:3300/0 conn(0x7f92bc144030 0x7f92bc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 -- 172.21.15.143:0/2181678034 >> 172.21.15.143:0/2181678034 conn(0x7f92bc0b0bf0 msgr2=0x7f92bc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 -- 172.21.15.143:0/2181678034 shutdown_connections 2023-11-24T06:30:20.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.317+0000 7f92c0db8640 1 -- 172.21.15.143:0/2181678034 wait complete. 2023-11-24T06:30:20.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 Processor -- start 2023-11-24T06:30:20.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 -- start start 2023-11-24T06:30:20.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc06e280 0x7f92bc13b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92bc09cc20 0x7f92bc09b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 0x7f92bc0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc13b810 con 0x7f92bc144030 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc13a530 con 0x7f92bc06e280 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0cd690 con 0x7f92bc09cc20 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 0x7f92bc0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 0x7f92bc0ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53292/0 (socket says 172.21.15.143:53292) 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 -- 172.21.15.143:0/537608440 learned_addr learned my addr 172.21.15.143:0/537608440 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92b1d9b640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92bc09cc20 0x7f92bc09b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92ba59c640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc06e280 0x7f92bc13b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 -- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92bc09cc20 msgr2=0x7f92bc09b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92bc09cc20 0x7f92bc09b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 -- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc06e280 msgr2=0x7f92bc13b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc06e280 0x7f92bc13b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 -- 172.21.15.143:0/537608440 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40094d0 con 0x7f92bc144030 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92bad9d640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 0x7f92bc0ccbb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c7a0 tx=0x7f92b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4003b80 con 0x7f92bc144030 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4003ce0 con 0x7f92bc144030 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400aa30 con 0x7f92bc144030 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc13a7f0 con 0x7f92bc144030 2023-11-24T06:30:20.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.321+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc13adb0 con 0x7f92bc144030 2023-11-24T06:30:20.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.325+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc13afa0 con 0x7f92bc144030 2023-11-24T06:30:20.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.325+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92b400ab90 con 0x7f92bc144030 2023-11-24T06:30:20.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.325+0000 7f92b37fe640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f929c0664a0 0x7f929c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.325+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92b4083d90 con 0x7f92bc144030 2023-11-24T06:30:20.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.325+0000 7f92ba59c640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f929c0664a0 0x7f929c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.325+0000 7f92ba59c640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f929c0664a0 0x7f929c068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009a50 tx=0x7f92ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:20.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.329+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92b4051170 con 0x7f92bc144030 2023-11-24T06:30:20.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.481+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92bc067520 con 0x7f92bc144030 2023-11-24T06:30:20.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92b37fe640 1 -- 172.21.15.143:0/537608440 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f92b4054790 con 0x7f92bc144030 2023-11-24T06:30:20.490 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:20.490 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:29:42.003250+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:20.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f929c0664a0 msgr2=0x7f929c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f929c0664a0 0x7f929c068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009a50 tx=0x7f92ac008040 comp rx=0 tx=0).stop 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 msgr2=0x7f92bc0ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 0x7f92bc0ccbb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c7a0 tx=0x7f92b400cc60 comp rx=0 tx=0).stop 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 shutdown_connections 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f929c0664a0 0x7f929c068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92bc144030 0x7f92bc0ccbb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92bc09cc20 0x7f92bc09b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 --2- 172.21.15.143:0/537608440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc06e280 0x7f92bc13b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 >> 172.21.15.143:0/537608440 conn(0x7f92bc0b0bf0 msgr2=0x7f92bc139400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 shutdown_connections 2023-11-24T06:30:20.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.485+0000 7f92c0db8640 1 -- 172.21.15.143:0/537608440 wait complete. 2023-11-24T06:30:20.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:30:20.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:20.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 Processor -- start 2023-11-24T06:30:20.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 -- start start 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff7f00b1190 0x7ff7f006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144a10 0x7ff7f00ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f0144800 con 0x7ff7f0144420 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00ceb80 con 0x7ff7f00b1190 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7f4e74640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f006ccf0 con 0x7ff7f0144a10 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff7f00b1190 0x7ff7f006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff7f00b1190 0x7ff7f006c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53304/0 (socket says 172.21.15.143:53304) 2023-11-24T06:30:20.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 -- 172.21.15.143:0/1411607011 learned_addr learned my addr 172.21.15.143:0/1411607011 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:20.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7effff640 1 --2- 172.21.15.143:0/1411607011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144a10 0x7ff7f00ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 -- 172.21.15.143:0/1411607011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144a10 msgr2=0x7ff7f00ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:20.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 --2- 172.21.15.143:0/1411607011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144a10 0x7ff7f00ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 -- 172.21.15.143:0/1411607011 >> v1:172.21.15.146:6789/0 conn(0x7ff7f0144420 legacy=0x7ff7f00b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.645+0000 7ff7eeffd640 1 -- 172.21.15.143:0/1411607011 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f006cfd0 con 0x7ff7f00b1190 2023-11-24T06:30:20.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7eeffd640 1 --2- 172.21.15.143:0/1411607011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f00b1190 0x7ff7f006c660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009870 tx=0x7ff7e401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f5cee319efb088 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:20.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7ee7fc640 1 -- 172.21.15.143:0/1411607011 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40a7070 con 0x7ff7f00b1190 2023-11-24T06:30:20.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7ee7fc640 1 -- 172.21.15.143:0/1411607011 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40ab430 con 0x7ff7f00b1190 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7ee7fc640 1 -- 172.21.15.143:0/1411607011 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40ab7c0 con 0x7ff7f00b1190 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1411607011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f00b1190 msgr2=0x7ff7f006c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1411607011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f00b1190 0x7ff7f006c660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009870 tx=0x7ff7e401c540 comp rx=0 tx=0).stop 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1411607011 shutdown_connections 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1411607011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144a10 0x7ff7f00ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1411607011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f00b1190 0x7ff7f006c660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1411607011 >> 172.21.15.143:0/1411607011 conn(0x7ff7f00cb840 msgr2=0x7ff7f00cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1411607011 shutdown_connections 2023-11-24T06:30:20.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1411607011 wait complete. 2023-11-24T06:30:20.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.649+0000 7ff7f4e74640 1 Processor -- start 2023-11-24T06:30:20.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- start start 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f00b1190 0x7ff7f013ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144420 0x7ff7f0164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 0x7ff7f0164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c47a0 con 0x7ff7f0144a10 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c3e00 con 0x7ff7f00b1190 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c40e0 con 0x7ff7f0144420 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 0x7ff7f0164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 0x7ff7f0164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53308/0 (socket says 172.21.15.143:53308) 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 -- 172.21.15.143:0/1608165860 learned_addr learned my addr 172.21.15.143:0/1608165860 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7ef7fe640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f00b1190 0x7ff7f013ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7eeffd640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144420 0x7ff7f0164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 -- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144420 msgr2=0x7ff7f0164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144420 0x7ff7f0164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 -- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f00b1190 msgr2=0x7ff7f013ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f00b1190 0x7ff7f013ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 -- 172.21.15.143:0/1608165860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40094d0 con 0x7ff7f0144a10 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7effff640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 0x7ff7f0164bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8007e60 tx=0x7ff7e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8014420 con 0x7ff7f0144a10 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e80145a0 con 0x7ff7f0144a10 2023-11-24T06:30:20.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f00c43c0 con 0x7ff7f0144a10 2023-11-24T06:30:20.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8014950 con 0x7ff7f0144a10 2023-11-24T06:30:20.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f00c68e0 con 0x7ff7f0144a10 2023-11-24T06:30:20.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.653+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f004e850 con 0x7ff7f0144a10 2023-11-24T06:30:20.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.657+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7e8014ab0 con 0x7ff7f0144a10 2023-11-24T06:30:20.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.657+0000 7ff7d7fff640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff7dc066470 0x7ff7dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:20.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.657+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7e8084620 con 0x7ff7f0144a10 2023-11-24T06:30:20.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.657+0000 7ff7ef7fe640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff7dc066470 0x7ff7dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:20.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.657+0000 7ff7ef7fe640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff7dc066470 0x7ff7dc068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00cda50 tx=0x7ff7e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:20.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.661+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7e8051b30 con 0x7ff7f0144a10 2023-11-24T06:30:20.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.841+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f0141120 con 0x7ff7f0144a10 2023-11-24T06:30:20.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.841+0000 7ff7d7fff640 1 -- 172.21.15.143:0/1608165860 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7ff7e8055150 con 0x7ff7f0144a10 2023-11-24T06:30:20.850 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:20.851 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff7dc066470 msgr2=0x7ff7dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff7dc066470 0x7ff7dc068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00cda50 tx=0x7ff7e0009040 comp rx=0 tx=0).stop 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 msgr2=0x7ff7f0164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 0x7ff7f0164bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8007e60 tx=0x7ff7e800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 shutdown_connections 2023-11-24T06:30:20.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff7dc066470 0x7ff7dc068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7f0144a10 0x7ff7f0164bc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f0144420 0x7ff7f0164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 --2- 172.21.15.143:0/1608165860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f00b1190 0x7ff7f013ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:20.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 >> 172.21.15.143:0/1608165860 conn(0x7ff7f00cb840 msgr2=0x7ff7f0143780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:20.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 shutdown_connections 2023-11-24T06:30:20.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:20.845+0000 7ff7f4e74640 1 -- 172.21.15.143:0/1608165860 wait complete. 2023-11-24T06:30:20.869 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:21.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a82f7640 1 Processor -- start 2023-11-24T06:30:21.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a82f7640 1 -- start start 2023-11-24T06:30:21.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a82f7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f02a006c650 0x7f02a009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a82f7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a006d8b0 con 0x7f02a00709c0 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a82f7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a006cca0 con 0x7f02a0144030 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a82f7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a0145020 con 0x7f02a006c650 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a5892640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f02a006c650 0x7f02a009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a6894640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f02a00709c0 0x7f02a0070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34878/0 (socket says 172.21.15.143:34878) 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a6894640 1 -- 172.21.15.143:0/3089563410 learned_addr learned my addr 172.21.15.143:0/3089563410 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:21.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a5892640 1 -- 172.21.15.143:0/3089563410 >> v1:172.21.15.146:6789/0 conn(0x7f02a0144030 legacy=0x7f02a006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:21.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.001+0000 7f02a5892640 1 -- 172.21.15.143:0/3089563410 >> v1:172.21.15.143:6789/0 conn(0x7f02a00709c0 legacy=0x7f02a0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a5892640 1 -- 172.21.15.143:0/3089563410 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a006cf80 con 0x7f02a006c650 2023-11-24T06:30:21.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a5892640 1 --2- 172.21.15.143:0/3089563410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a006c650 0x7f02a009cc20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f02900097c0 tx=0x7f029001c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65dd24739bd2e04 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a5091640 1 -- 172.21.15.143:0/3089563410 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900ab600 con 0x7f02a006c650 2023-11-24T06:30:21.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a5091640 1 -- 172.21.15.143:0/3089563410 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900a7050 con 0x7f02a006c650 2023-11-24T06:30:21.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a5091640 1 -- 172.21.15.143:0/3089563410 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900ab980 con 0x7f02a006c650 2023-11-24T06:30:21.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 -- 172.21.15.143:0/3089563410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a006c650 msgr2=0x7f02a009cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3089563410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a006c650 0x7f02a009cc20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f02900097c0 tx=0x7f029001c2d0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 -- 172.21.15.143:0/3089563410 shutdown_connections 2023-11-24T06:30:21.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3089563410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a006c650 0x7f02a009cc20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 -- 172.21.15.143:0/3089563410 >> 172.21.15.143:0/3089563410 conn(0x7f02a00b0bf0 msgr2=0x7f02a00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:21.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 -- 172.21.15.143:0/3089563410 shutdown_connections 2023-11-24T06:30:21.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.005+0000 7f02a82f7640 1 -- 172.21.15.143:0/3089563410 wait complete. 2023-11-24T06:30:21.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 Processor -- start 2023-11-24T06:30:21.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 -- start start 2023-11-24T06:30:21.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a006c650 0x7f02a0141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 0x7f02a00c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02a0144030 0x7f02a015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00cad30 con 0x7f02a00709c0 2023-11-24T06:30:21.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0141a70 con 0x7f02a006c650 2023-11-24T06:30:21.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0141d50 con 0x7f02a0144030 2023-11-24T06:30:21.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 0x7f02a00c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 0x7f02a00c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53326/0 (socket says 172.21.15.143:53326) 2023-11-24T06:30:21.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 -- 172.21.15.143:0/3410675579 learned_addr learned my addr 172.21.15.143:0/3410675579 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:21.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a6093640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a006c650 0x7f02a0141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a6894640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02a0144030 0x7f02a015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 -- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02a0144030 msgr2=0x7f02a015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02a0144030 0x7f02a015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 -- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a006c650 msgr2=0x7f02a0141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a006c650 0x7f02a0141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 -- 172.21.15.143:0/3410675579 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290009420 con 0x7f02a00709c0 2023-11-24T06:30:21.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a6894640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02a0144030 0x7f02a015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:21.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a5892640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 0x7f02a00c9010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02900ae040 tx=0x7f029001ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900aa8b0 con 0x7f02a00709c0 2023-11-24T06:30:21.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900aaa10 con 0x7f02a00709c0 2023-11-24T06:30:21.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900aadc0 con 0x7f02a00709c0 2023-11-24T06:30:21.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.009+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0142030 con 0x7f02a00709c0 2023-11-24T06:30:21.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a01425f0 con 0x7f02a00709c0 2023-11-24T06:30:21.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a01427e0 con 0x7f02a00709c0 2023-11-24T06:30:21.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02900c2460 con 0x7f02a00709c0 2023-11-24T06:30:21.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f0296ffd640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0284066470 0x7f0284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f029011ead0 con 0x7f02a00709c0 2023-11-24T06:30:21.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f02a6093640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0284066470 0x7f0284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.013+0000 7f02a6093640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0284066470 0x7f0284068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f029c0098e0 tx=0x7f029c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.017+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02900ebf50 con 0x7f02a00709c0 2023-11-24T06:30:21.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02a01427e0 con 0x7f02a00709c0 2023-11-24T06:30:21.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f0296ffd640 1 -- 172.21.15.143:0/3410675579 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f02900b0020 con 0x7f02a00709c0 2023-11-24T06:30:21.213 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:21.213 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2477255058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2477255058},{"type":"v1","addr":"172.21.15.146:6834","nonce":2477255058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3221369109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3221369109},{"type":"v1","addr":"172.21.15.143:6836","nonce":3221369109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/2012716873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":2012716873},{"type":"v1","addr":"172.21.15.143:6837","nonce":2012716873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:29:40.691608+0000","modified":"2023-11-24T06:29:43.703911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3721537838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3721537838},{"type":"v1","addr":"172.21.15.146:6835","nonce":3721537838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:30:21.214 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 8 2023-11-24T06:30:21.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0284066470 msgr2=0x7f0284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0284066470 0x7f0284068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f029c0098e0 tx=0x7f029c009060 comp rx=0 tx=0).stop 2023-11-24T06:30:21.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 msgr2=0x7f02a00c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 0x7f02a00c9010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02900ae040 tx=0x7f029001ab10 comp rx=0 tx=0).stop 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 shutdown_connections 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0284066470 0x7f0284068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02a0144030 0x7f02a015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02a00709c0 0x7f02a00c9010 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 --2- 172.21.15.143:0/3410675579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a006c650 0x7f02a0141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 >> 172.21.15.143:0/3410675579 conn(0x7f02a00b0bf0 msgr2=0x7f02a00b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 shutdown_connections 2023-11-24T06:30:21.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.209+0000 7f02a82f7640 1 -- 172.21.15.143:0/3410675579 wait complete. 2023-11-24T06:30:21.235 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:21.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 Processor -- start 2023-11-24T06:30:21.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 -- start start 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb880d2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb880d2d80 0x7feb880b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880b8a90 con 0x7feb8815d3e0 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880d3550 con 0x7feb880d2d80 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb8d3d1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880d3830 con 0x7feb880d0980 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb86ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7feb8815d3e0 0x7feb880d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34890/0 (socket says 172.21.15.143:34890) 2023-11-24T06:30:21.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb86ffd640 1 -- 172.21.15.143:0/3097227524 learned_addr learned my addr 172.21.15.143:0/3097227524 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:21.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb867fc640 1 --2- 172.21.15.143:0/3097227524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb880d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb877fe640 1 --2- 172.21.15.143:0/3097227524 >> v2:172.21.15.146:3300/0 conn(0x7feb880d2d80 0x7feb880b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb85ffb640 1 -- 172.21.15.143:0/3097227524 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056888094 0 0) 0x7feb78001120 con 0x7feb8815d3e0 2023-11-24T06:30:21.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb85ffb640 1 -- 172.21.15.143:0/3097227524 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb70003530 con 0x7feb8815d3e0 2023-11-24T06:30:21.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb867fc640 1 -- 172.21.15.143:0/3097227524 >> v2:172.21.15.146:3300/0 conn(0x7feb880d2d80 msgr2=0x7feb880b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:21.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb867fc640 1 --2- 172.21.15.143:0/3097227524 >> v2:172.21.15.146:3300/0 conn(0x7feb880d2d80 0x7feb880b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb867fc640 1 -- 172.21.15.143:0/3097227524 >> v1:172.21.15.143:6789/0 conn(0x7feb8815d3e0 legacy=0x7feb880d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb867fc640 1 -- 172.21.15.143:0/3097227524 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880d3b10 con 0x7feb880d0980 2023-11-24T06:30:21.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.369+0000 7feb877fe640 1 --2- 172.21.15.143:0/3097227524 >> v2:172.21.15.146:3300/0 conn(0x7feb880d2d80 0x7feb880b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:21.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb867fc640 1 --2- 172.21.15.143:0/3097227524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb880d2840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0097c0 tx=0x7feb7c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68feaa2aaaea8b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb85ffb640 1 -- 172.21.15.143:0/3097227524 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0ab650 con 0x7feb880d0980 2023-11-24T06:30:21.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb85ffb640 1 -- 172.21.15.143:0/3097227524 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0ab7b0 con 0x7feb880d0980 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb85ffb640 1 -- 172.21.15.143:0/3097227524 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0abb20 con 0x7feb880d0980 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 -- 172.21.15.143:0/3097227524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 msgr2=0x7feb880d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/3097227524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb880d2840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0097c0 tx=0x7feb7c01c450 comp rx=0 tx=0).stop 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 -- 172.21.15.143:0/3097227524 shutdown_connections 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/3097227524 >> v2:172.21.15.146:3300/0 conn(0x7feb880d2d80 0x7feb880b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/3097227524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb880d2840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 -- 172.21.15.143:0/3097227524 >> 172.21.15.143:0/3097227524 conn(0x7feb880613d0 msgr2=0x7feb880617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 -- 172.21.15.143:0/3097227524 shutdown_connections 2023-11-24T06:30:21.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.373+0000 7feb8d3d1640 1 -- 172.21.15.143:0/3097227524 wait complete. 2023-11-24T06:30:21.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 Processor -- start 2023-11-24T06:30:21.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- start start 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb8815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 0x7feb880c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8815d3e0 0x7feb88155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880c7d90 con 0x7feb880d2d80 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8815b790 con 0x7feb8815d3e0 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8815ba70 con 0x7feb880d0980 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 0x7feb880c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 0x7feb880c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53328/0 (socket says 172.21.15.143:53328) 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 -- 172.21.15.143:0/1968231138 learned_addr learned my addr 172.21.15.143:0/1968231138 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb86ffd640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb8815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb877fe640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8815d3e0 0x7feb88155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 -- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 msgr2=0x7feb8815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb8815b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 -- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8815d3e0 msgr2=0x7feb88155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8815d3e0 0x7feb88155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 -- 172.21.15.143:0/1968231138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80009a70 con 0x7feb880d2d80 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb877fe640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8815d3e0 0x7feb88155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb867fc640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 0x7feb880c7850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0ad040 tx=0x7feb7c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c004450 con 0x7feb880d2d80 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0ab920 con 0x7feb880d2d80 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0abcb0 con 0x7feb880d2d80 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c009420 con 0x7feb880d2d80 2023-11-24T06:30:21.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8815c030 con 0x7feb880d2d80 2023-11-24T06:30:21.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.377+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8804e850 con 0x7feb880d2d80 2023-11-24T06:30:21.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.381+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb7c003620 con 0x7feb880d2d80 2023-11-24T06:30:21.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.381+0000 7feb6f7fe640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7feb74066470 0x7feb74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.381+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feb7c11e1f0 con 0x7feb880d2d80 2023-11-24T06:30:21.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.381+0000 7feb86ffd640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7feb74066470 0x7feb74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.381+0000 7feb86ffd640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7feb74066470 0x7feb74068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feb78005890 tx=0x7feb78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.385+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb7c0eb5e0 con 0x7feb880d2d80 2023-11-24T06:30:21.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.533+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb8815bbb0 con 0x7feb880d2d80 2023-11-24T06:30:21.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.533+0000 7feb6f7fe640 1 -- 172.21.15.143:0/1968231138 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16802 (secure 0 0 0) 0x7feb8815bbb0 con 0x7feb880d2d80 2023-11-24T06:30:21.558 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:21.558 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":21,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:21.087564+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:29:38.405887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:29:39.741276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:21.559 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7feb74066470 msgr2=0x7feb74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.559 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7feb74066470 0x7feb74068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feb78005890 tx=0x7feb78009040 comp rx=0 tx=0).stop 2023-11-24T06:30:21.559 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 msgr2=0x7feb880c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 0x7feb880c7850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0ad040 tx=0x7feb7c0191f0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 shutdown_connections 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7feb74066470 0x7feb74068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8815d3e0 0x7feb88155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb880d2d80 0x7feb880c7850 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 --2- 172.21.15.143:0/1968231138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb880d0980 0x7feb8815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 >> 172.21.15.143:0/1968231138 conn(0x7feb880613d0 msgr2=0x7feb8815ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 shutdown_connections 2023-11-24T06:30:21.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.537+0000 7feb8d3d1640 1 -- 172.21.15.143:0/1968231138 wait complete. 2023-11-24T06:30:21.561 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:30:21.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 Processor -- start 2023-11-24T06:30:21.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 -- start start 2023-11-24T06:30:21.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1a00cad20 0x7fb1a00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb1a006d740 0x7fb1a006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a015a8b0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00c9c30 con 0x7fb1a006d740 2023-11-24T06:30:21.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a77aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a006e090 con 0x7fb1a00cad20 2023-11-24T06:30:21.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.693+0000 7fb1a5d47640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb1a006d740 0x7fb1a006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb1a006d740 0x7fb1a006db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53344/0 (socket says 172.21.15.143:53344) 2023-11-24T06:30:21.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 -- 172.21.15.143:0/1624895579 learned_addr learned my addr 172.21.15.143:0/1624895579 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:21.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a4d45640 1 --2- 172.21.15.143:0/1624895579 >> v2:172.21.15.146:3300/0 conn(0x7fb1a00cad20 0x7fb1a00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 -- 172.21.15.143:0/1624895579 >> v2:172.21.15.146:3300/0 conn(0x7fb1a00cad20 msgr2=0x7fb1a00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:21.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 --2- 172.21.15.143:0/1624895579 >> v2:172.21.15.146:3300/0 conn(0x7fb1a00cad20 0x7fb1a00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 -- 172.21.15.143:0/1624895579 >> v1:172.21.15.146:6789/0 conn(0x7fb1a015a4d0 legacy=0x7fb1a015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 -- 172.21.15.143:0/1624895579 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00c9f60 con 0x7fb1a006d740 2023-11-24T06:30:21.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb1a5d47640 1 --2- 172.21.15.143:0/1624895579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a006d740 0x7fb1a006db50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00cb9a0 tx=0x7fb19801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ef39b89fb2c2e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb197fff640 1 -- 172.21.15.143:0/1624895579 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980a57d0 con 0x7fb1a006d740 2023-11-24T06:30:21.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb197fff640 1 -- 172.21.15.143:0/1624895579 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1980a5930 con 0x7fb1a006d740 2023-11-24T06:30:21.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.697+0000 7fb197fff640 1 -- 172.21.15.143:0/1624895579 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980a5cc0 con 0x7fb1a006d740 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- 172.21.15.143:0/1624895579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a006d740 msgr2=0x7fb1a006db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/1624895579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a006d740 0x7fb1a006db50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00cb9a0 tx=0x7fb19801c910 comp rx=0 tx=0).stop 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- 172.21.15.143:0/1624895579 shutdown_connections 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/1624895579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a006d740 0x7fb1a006db50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/1624895579 >> v2:172.21.15.146:3300/0 conn(0x7fb1a00cad20 0x7fb1a00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- 172.21.15.143:0/1624895579 >> 172.21.15.143:0/1624895579 conn(0x7fb1a00b0bf0 msgr2=0x7fb1a00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- 172.21.15.143:0/1624895579 shutdown_connections 2023-11-24T06:30:21.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- 172.21.15.143:0/1624895579 wait complete. 2023-11-24T06:30:21.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 Processor -- start 2023-11-24T06:30:21.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- start start 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a006d740 0x7fb1a0166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00cad20 0x7fb1a0159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 0x7fb1a00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c3db0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c4090 con 0x7fb1a00cad20 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a77aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00b3800 con 0x7fb1a006d740 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 0x7fb1a00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 0x7fb1a00b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53350/0 (socket says 172.21.15.143:53350) 2023-11-24T06:30:21.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 -- 172.21.15.143:0/508447039 learned_addr learned my addr 172.21.15.143:0/508447039 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5546640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a006d740 0x7fb1a0166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a4d45640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00cad20 0x7fb1a0159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 -- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a006d740 msgr2=0x7fb1a0166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a006d740 0x7fb1a0166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 -- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00cad20 msgr2=0x7fb1a0159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.701+0000 7fb1a5d47640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00cad20 0x7fb1a0159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb1a5d47640 1 -- 172.21.15.143:0/508447039 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009b30 con 0x7fb1a015a4d0 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb1a5d47640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 0x7fb1a00b4000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb198019520 tx=0x7fb1980196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980b8670 con 0x7fb1a015a4d0 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1980b87d0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980b8b60 con 0x7fb1a015a4d0 2023-11-24T06:30:21.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a00b3ae0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a00b48b0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a009d250 con 0x7fb1a015a4d0 2023-11-24T06:30:21.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.705+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1980b8cc0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.709+0000 7fb195ffb640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb184066470 0x7fb184068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:21.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.709+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb19811f4e0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.709+0000 7fb1a5546640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb184066470 0x7fb184068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:21.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.709+0000 7fb1a5546640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb184066470 0x7fb184068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00ad500 tx=0x7fb19c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:21.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.713+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1980ecaa0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.893+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb1a004e930 con 0x7fb1a015a4d0 2023-11-24T06:30:21.899 INFO:tasks.ceph.mon.a.smithi143.stderr:2023-11-24T06:30:21.893+0000 7f12a8d9d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:30:21.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb195ffb640 1 -- 172.21.15.143:0/508447039 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb1980f00c0 con 0x7fb1a015a4d0 2023-11-24T06:30:21.901 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:30:21.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb184066470 msgr2=0x7fb184068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb184066470 0x7fb184068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00ad500 tx=0x7fb19c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:21.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 msgr2=0x7fb1a00b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:21.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 0x7fb1a00b4000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb198019520 tx=0x7fb1980196b0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 shutdown_connections 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb184066470 0x7fb184068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1a015a4d0 0x7fb1a00b4000 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a00cad20 0x7fb1a0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 --2- 172.21.15.143:0/508447039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a006d740 0x7fb1a0166f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 >> 172.21.15.143:0/508447039 conn(0x7fb1a00b0bf0 msgr2=0x7fb1a006c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 shutdown_connections 2023-11-24T06:30:21.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:21.897+0000 7fb1a77aa640 1 -- 172.21.15.143:0/508447039 wait complete. 2023-11-24T06:30:21.916 INFO:tasks.ceph.mds.b.smithi146.stderr: -6655> 2023-11-24T06:29:44.775+0000 7f8efd5f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:30:21.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:30:21.969 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:30:22.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 Processor -- start 2023-11-24T06:30:22.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 -- start start 2023-11-24T06:30:22.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a3815a290 0x7f5a380707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:22.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a380b1f80 0x7f5a380b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:22.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a380b28c0 con 0x7f5a3815ec60 2023-11-24T06:30:22.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a38071170 con 0x7f5a380b1f80 2023-11-24T06:30:22.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ec79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380cb690 con 0x7f5a3815a290 2023-11-24T06:30:22.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3d216640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a380b1f80 0x7f5a380b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:22.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a2ffff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5a3815ec60 0x7f5a380cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45452/0 (socket says 172.21.15.143:45452) 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a2ffff640 1 -- 172.21.15.143:0/1928005740 learned_addr learned my addr 172.21.15.143:0/1928005740 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a3ca15640 1 --2- 172.21.15.143:0/1928005740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a3815a290 0x7f5a380707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.061+0000 7f5a2f7fe640 1 -- 172.21.15.143:0/1928005740 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390632484 0 0) 0x7f5a28001120 con 0x7f5a3815ec60 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a2f7fe640 1 -- 172.21.15.143:0/1928005740 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a20005740 con 0x7f5a3815ec60 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ca15640 1 -- 172.21.15.143:0/1928005740 >> v2:172.21.15.146:3300/0 conn(0x7f5a380b1f80 msgr2=0x7f5a380b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ca15640 1 --2- 172.21.15.143:0/1928005740 >> v2:172.21.15.146:3300/0 conn(0x7f5a380b1f80 0x7f5a380b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ca15640 1 -- 172.21.15.143:0/1928005740 >> v1:172.21.15.146:6789/0 conn(0x7f5a3815ec60 legacy=0x7f5a380cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ca15640 1 -- 172.21.15.143:0/1928005740 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380cb970 con 0x7f5a3815a290 2023-11-24T06:30:22.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3d216640 1 --2- 172.21.15.143:0/1928005740 >> v2:172.21.15.146:3300/0 conn(0x7f5a380b1f80 0x7f5a380b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:22.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ca15640 1 --2- 172.21.15.143:0/1928005740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a3815a290 0x7f5a380707f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e834eed7b589111d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:22.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a2f7fe640 1 -- 172.21.15.143:0/1928005740 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340ac640 con 0x7f5a3815a290 2023-11-24T06:30:22.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a2f7fe640 1 -- 172.21.15.143:0/1928005740 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340ac7a0 con 0x7f5a3815a290 2023-11-24T06:30:22.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a2f7fe640 1 -- 172.21.15.143:0/1928005740 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340acb30 con 0x7f5a3815a290 2023-11-24T06:30:22.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ec79640 1 -- 172.21.15.143:0/1928005740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a3815a290 msgr2=0x7f5a380707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/1928005740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a3815a290 0x7f5a380707f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.065+0000 7f5a3ec79640 1 -- 172.21.15.143:0/1928005740 shutdown_connections 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/1928005740 >> v2:172.21.15.146:3300/0 conn(0x7f5a380b1f80 0x7f5a380b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/1928005740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a3815a290 0x7f5a380707f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- 172.21.15.143:0/1928005740 >> 172.21.15.143:0/1928005740 conn(0x7f5a380b0c80 msgr2=0x7f5a380b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- 172.21.15.143:0/1928005740 shutdown_connections 2023-11-24T06:30:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- 172.21.15.143:0/1928005740 wait complete. 2023-11-24T06:30:22.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 Processor -- start 2023-11-24T06:30:22.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- start start 2023-11-24T06:30:22.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a380b1f80 0x7f5a380b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 0x7f5a381587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3815ec60 0x7f5a38153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381f6430 con 0x7f5a3815a290 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381591c0 con 0x7f5a3815ec60 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ec79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3815bc20 con 0x7f5a380b1f80 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 0x7f5a381587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 0x7f5a381587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53360/0 (socket says 172.21.15.143:53360) 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 -- 172.21.15.143:0/2611991430 learned_addr learned my addr 172.21.15.143:0/2611991430 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3ca15640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a380b1f80 0x7f5a380b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:22.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a3d216640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3815ec60 0x7f5a38153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 -- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a380b1f80 msgr2=0x7f5a380b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a380b1f80 0x7f5a380b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 -- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3815ec60 msgr2=0x7f5a38153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3815ec60 0x7f5a38153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.069+0000 7f5a2ffff640 1 -- 172.21.15.143:0/2611991430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009a70 con 0x7f5a3815a290 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2ffff640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 0x7f5a381587e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c730 tx=0x7f5a2800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28005ac0 con 0x7f5a3815a290 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28005c20 con 0x7f5a3815a290 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800ce70 con 0x7f5a3815a290 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a34009420 con 0x7f5a3815a290 2023-11-24T06:30:22.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3815c1e0 con 0x7f5a3815a290 2023-11-24T06:30:22.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3815c3d0 con 0x7f5a3815a290 2023-11-24T06:30:22.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a28007070 con 0x7f5a3815a290 2023-11-24T06:30:22.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2d7fa640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:22.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f5a28083210 con 0x7f5a3815a290 2023-11-24T06:30:22.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.073+0000 7f5a3ca15640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:22.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.077+0000 7f5a3ca15640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a24066470 0x7f5a24068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a340ae000 tx=0x7f5a34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:22.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.077+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a28050670 con 0x7f5a3815a290 2023-11-24T06:30:22.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.265+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5a380b2890 con 0x7f5a3815a290 2023-11-24T06:30:22.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.897+0000 7f5a2d7fa640 1 -- 172.21.15.143:0/2611991430 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5a28053c90 con 0x7f5a3815a290 2023-11-24T06:30:22.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a24066470 msgr2=0x7f5a24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:22.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a24066470 0x7f5a24068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a340ae000 tx=0x7f5a34008040 comp rx=0 tx=0).stop 2023-11-24T06:30:22.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 msgr2=0x7f5a381587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:22.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 0x7f5a381587e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c730 tx=0x7f5a2800cb30 comp rx=0 tx=0).stop 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 shutdown_connections 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3815ec60 0x7f5a38153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3815a290 0x7f5a381587e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 --2- 172.21.15.143:0/2611991430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a380b1f80 0x7f5a380b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 >> 172.21.15.143:0/2611991430 conn(0x7f5a380b0c80 msgr2=0x7f5a3806ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 shutdown_connections 2023-11-24T06:30:22.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:22.901+0000 7f5a3ec79640 1 -- 172.21.15.143:0/2611991430 wait complete. 2023-11-24T06:30:22.926 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:30:23.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.061+0000 7f4322d65640 1 Processor -- start 2023-11-24T06:30:23.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.061+0000 7f4322d65640 1 -- start start 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4322d65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f431c144030 0x7f431c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4322d65640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f431c09cc20 0x7f431c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4322d65640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431c06d8b0 con 0x7f431c06e280 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4322d65640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431c145020 con 0x7f431c144030 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4322d65640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431c09d0a0 con 0x7f431c09cc20 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4320b01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f431c144030 0x7f431c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:23.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4321302640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f431c06e280 0x7f431c0709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34906/0 (socket says 172.21.15.143:34906) 2023-11-24T06:30:23.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4321302640 1 -- 172.21.15.143:0/3858511310 learned_addr learned my addr 172.21.15.143:0/3858511310 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:23.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4313fff640 1 --2- 172.21.15.143:0/3858511310 >> v2:172.21.15.146:3300/0 conn(0x7f431c09cc20 0x7f431c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:23.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4320b01640 1 -- 172.21.15.143:0/3858511310 >> v2:172.21.15.146:3300/0 conn(0x7f431c09cc20 msgr2=0x7f431c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:23.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4320b01640 1 --2- 172.21.15.143:0/3858511310 >> v2:172.21.15.146:3300/0 conn(0x7f431c09cc20 0x7f431c06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:23.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4320b01640 1 -- 172.21.15.143:0/3858511310 >> v1:172.21.15.143:6789/0 conn(0x7f431c06e280 legacy=0x7f431c0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:23.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4320b01640 1 -- 172.21.15.143:0/3858511310 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c06cca0 con 0x7f431c144030 2023-11-24T06:30:23.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.065+0000 7f4313fff640 1 --2- 172.21.15.143:0/3858511310 >> v2:172.21.15.146:3300/0 conn(0x7f431c09cc20 0x7f431c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:23.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4320b01640 1 --2- 172.21.15.143:0/3858511310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c144030 0x7f431c06c650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f431c0700a0 tx=0x7f431801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff027ee6fdacbb7c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:23.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f43137fe640 1 -- 172.21.15.143:0/3858511310 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180a7070 con 0x7f431c144030 2023-11-24T06:30:23.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f43137fe640 1 -- 172.21.15.143:0/3858511310 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43180ab430 con 0x7f431c144030 2023-11-24T06:30:23.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f43137fe640 1 -- 172.21.15.143:0/3858511310 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180ab7c0 con 0x7f431c144030 2023-11-24T06:30:23.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 -- 172.21.15.143:0/3858511310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c144030 msgr2=0x7f431c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:23.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 --2- 172.21.15.143:0/3858511310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c144030 0x7f431c06c650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f431c0700a0 tx=0x7f431801c430 comp rx=0 tx=0).stop 2023-11-24T06:30:23.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 -- 172.21.15.143:0/3858511310 shutdown_connections 2023-11-24T06:30:23.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 --2- 172.21.15.143:0/3858511310 >> v2:172.21.15.146:3300/0 conn(0x7f431c09cc20 0x7f431c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:23.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 --2- 172.21.15.143:0/3858511310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c144030 0x7f431c06c650 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:23.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 -- 172.21.15.143:0/3858511310 >> 172.21.15.143:0/3858511310 conn(0x7f431c0b0bf0 msgr2=0x7f431c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:23.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 -- 172.21.15.143:0/3858511310 shutdown_connections 2023-11-24T06:30:23.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 -- 172.21.15.143:0/3858511310 wait complete. 2023-11-24T06:30:23.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 Processor -- start 2023-11-24T06:30:23.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 -- start start 2023-11-24T06:30:23.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.069+0000 7f4322d65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 0x7f431c138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:23.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f431c09cc20 0x7f431c137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:23.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f431c144030 0x7f431c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:23.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c15b080 con 0x7f431c06e280 2023-11-24T06:30:23.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c15b340 con 0x7f431c144030 2023-11-24T06:30:23.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431c0b1ff0 con 0x7f431c09cc20 2023-11-24T06:30:23.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 0x7f431c138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:23.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 0x7f431c138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53378/0 (socket says 172.21.15.143:53378) 2023-11-24T06:30:23.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 -- 172.21.15.143:0/2687897707 learned_addr learned my addr 172.21.15.143:0/2687897707 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:23.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 -- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f431c09cc20 msgr2=0x7f431c137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:23.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4313fff640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f431c09cc20 0x7f431c137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:23.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f431c09cc20 0x7f431c137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:23.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 -- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f431c144030 msgr2=0x7f431c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:23.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4321302640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f431c144030 0x7f431c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f431c144030 0x7f431c1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 -- 172.21.15.143:0/2687897707 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318009420 con 0x7f431c06e280 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4313fff640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f431c09cc20 0x7f431c137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4321302640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f431c144030 0x7f431c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4320b01640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 0x7f431c138a60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f43180ad040 tx=0x7f431801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180b5810 con 0x7f431c06e280 2023-11-24T06:30:23.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43180b5990 con 0x7f431c06e280 2023-11-24T06:30:23.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180b5d40 con 0x7f431c06e280 2023-11-24T06:30:23.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431c0b22d0 con 0x7f431c06e280 2023-11-24T06:30:23.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431c0b2890 con 0x7f431c06e280 2023-11-24T06:30:23.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431c0b2130 con 0x7f431c06e280 2023-11-24T06:30:23.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.073+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43180b4390 con 0x7f431c06e280 2023-11-24T06:30:23.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.077+0000 7f43117fa640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4308066470 0x7f4308068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:23.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.077+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f431811e7a0 con 0x7f431c06e280 2023-11-24T06:30:23.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.077+0000 7f4313fff640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4308066470 0x7f4308068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:23.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.077+0000 7f4313fff640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4308066470 0x7f4308068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f431c155b10 tx=0x7f430c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:23.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.081+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f431c0b2130 con 0x7f431c06e280 2023-11-24T06:30:23.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:23.233+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f431c0b2130 con 0x7f431c06e280 2023-11-24T06:30:24.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.101+0000 7f43117fa640 1 -- 172.21.15.143:0/2687897707 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f431c0b2130 con 0x7f431c06e280 2023-11-24T06:30:24.108 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:30:24.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4308066470 msgr2=0x7f4308068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:24.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4308066470 0x7f4308068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f431c155b10 tx=0x7f430c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:24.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 msgr2=0x7f431c138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:24.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 0x7f431c138a60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f43180ad040 tx=0x7f431801ac70 comp rx=0 tx=0).stop 2023-11-24T06:30:24.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 shutdown_connections 2023-11-24T06:30:24.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4308066470 0x7f4308068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f431c144030 0x7f431c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f431c09cc20 0x7f431c137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 --2- 172.21.15.143:0/2687897707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f431c06e280 0x7f431c138a60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.105+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 >> 172.21.15.143:0/2687897707 conn(0x7f431c0b0bf0 msgr2=0x7f431c09a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:24.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.109+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 shutdown_connections 2023-11-24T06:30:24.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.109+0000 7f4322d65640 1 -- 172.21.15.143:0/2687897707 wait complete. 2023-11-24T06:30:24.144 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:30:24.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 Processor -- start 2023-11-24T06:30:24.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 -- start start 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcd8c15d440 0x7fcd8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c0b20e0 con 0x7fcd8c0b3bb0 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c0714f0 con 0x7fcd8c15d440 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd91279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0708e0 con 0x7fcd8c070400 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcd8c15d440 0x7fcd8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcd8c15d440 0x7fcd8c06c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53380/0 (socket says 172.21.15.143:53380) 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8a7fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fcd8c0b3bb0 0x7fcd8c161030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34920/0 (socket says 172.21.15.143:34920) 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 -- 172.21.15.143:0/1657069819 learned_addr learned my addr 172.21.15.143:0/1657069819 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:24.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8b7fe640 1 --2- 172.21.15.143:0/1657069819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:24.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 -- 172.21.15.143:0/1657069819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 msgr2=0x7fcd8c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:24.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 --2- 172.21.15.143:0/1657069819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c06cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 -- 172.21.15.143:0/1657069819 >> v1:172.21.15.143:6789/0 conn(0x7fcd8c0b3bb0 legacy=0x7fcd8c161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:24.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.285+0000 7fcd8affd640 1 -- 172.21.15.143:0/1657069819 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c070bc0 con 0x7fcd8c15d440 2023-11-24T06:30:24.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd8affd640 1 --2- 172.21.15.143:0/1657069819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d440 0x7fcd8c06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009870 tx=0x7fcd7c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e40ea9c76df5b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:24.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd89ffb640 1 -- 172.21.15.143:0/1657069819 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a8a30 con 0x7fcd8c15d440 2023-11-24T06:30:24.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd89ffb640 1 -- 172.21.15.143:0/1657069819 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c0a8b90 con 0x7fcd8c15d440 2023-11-24T06:30:24.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd89ffb640 1 -- 172.21.15.143:0/1657069819 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0b0440 con 0x7fcd8c15d440 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 -- 172.21.15.143:0/1657069819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d440 msgr2=0x7fcd8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 --2- 172.21.15.143:0/1657069819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d440 0x7fcd8c06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009870 tx=0x7fcd7c01ed30 comp rx=0 tx=0).stop 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 -- 172.21.15.143:0/1657069819 shutdown_connections 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 --2- 172.21.15.143:0/1657069819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 --2- 172.21.15.143:0/1657069819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d440 0x7fcd8c06c5a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 -- 172.21.15.143:0/1657069819 >> 172.21.15.143:0/1657069819 conn(0x7fcd8c06dcc0 msgr2=0x7fcd8c06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 -- 172.21.15.143:0/1657069819 shutdown_connections 2023-11-24T06:30:24.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.289+0000 7fcd91279640 1 -- 172.21.15.143:0/1657069819 wait complete. 2023-11-24T06:30:24.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 Processor -- start 2023-11-24T06:30:24.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- start start 2023-11-24T06:30:24.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:24.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c15d440 0x7fcd8c1417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:24.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 0x7fcd8c141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c153850 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0ce090 con 0x7fcd8c15d440 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c142550 con 0x7fcd8c070400 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 0x7fcd8c141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 0x7fcd8c141d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53384/0 (socket says 172.21.15.143:53384) 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 -- 172.21.15.143:0/372592392 learned_addr learned my addr 172.21.15.143:0/372592392 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8affd640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8a7fc640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c15d440 0x7fcd8c1417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 -- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 msgr2=0x7fcd8c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 -- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c15d440 msgr2=0x7fcd8c1417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:24.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c15d440 0x7fcd8c1417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 -- 172.21.15.143:0/372592392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0094d0 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd8b7fe640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 0x7fcd8c141d20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd84007e30 tx=0x7fcd8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84014620 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400ee90 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840149c0 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c152f20 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c1534e0 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.293+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c153a00 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.297+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcd84014b20 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.297+0000 7fcd737fe640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcd78066470 0x7fcd78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:24.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.297+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fcd84084780 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.297+0000 7fcd8affd640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcd78066470 0x7fcd78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:24.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.297+0000 7fcd8affd640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcd78066470 0x7fcd78068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0b2000 tx=0x7fcd7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:24.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.301+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd8c153a00 con 0x7fcd8c15d9a0 2023-11-24T06:30:24.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:24.449+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcd8c04e850 con 0x7fcd8c15d9a0 2023-11-24T06:30:25.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.109+0000 7fcd737fe640 1 -- 172.21.15.143:0/372592392 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcd84051c50 con 0x7fcd8c15d9a0 2023-11-24T06:30:25.114 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2023-11-24T06:30:25.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcd78066470 msgr2=0x7fcd78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:25.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcd78066470 0x7fcd78068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0b2000 tx=0x7fcd7c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:25.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 msgr2=0x7fcd8c141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:25.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 0x7fcd8c141d20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd84007e30 tx=0x7fcd8400e4b0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 shutdown_connections 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcd78066470 0x7fcd78068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd8c15d9a0 0x7fcd8c141d20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c15d440 0x7fcd8c1417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 --2- 172.21.15.143:0/372592392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c070400 0x7fcd8c0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 >> 172.21.15.143:0/372592392 conn(0x7fcd8c06dcc0 msgr2=0x7fcd8c0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 shutdown_connections 2023-11-24T06:30:25.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.113+0000 7fcd91279640 1 -- 172.21.15.143:0/372592392 wait complete. 2023-11-24T06:30:25.157 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:30:25.157 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:30:25.157 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:30:25.157 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:25.157 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:30:25.158 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:30:25.158 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:30:25.158 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:25.158 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:30:25.159 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:30:25.159 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:30:25.159 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:25.159 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:30:25.159 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:30:25.160 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:30:25.160 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:25.174 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:30:25.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:30:25.175 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:30:25.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:30:25.176 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:30:25.177 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:30:25.177 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:30:25.177 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:30:25.221 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:30:25.221 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:25.223 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:30:25.223 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:25.227 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:30:25.228 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:25.229 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:30:25.229 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:25.230 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:30:25.311 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:30:25.312 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-11-24T06:30:25.316 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:30:25.317 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:30:25.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 Processor -- start 2023-11-24T06:30:25.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 -- start start 2023-11-24T06:30:25.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b9c15a4d0 0x7f3b9c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:25.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3b9c06d740 0x7f3b9c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:25.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c15a8b0 con 0x7f3b9c0cad20 2023-11-24T06:30:25.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c9c30 con 0x7f3b9c06d740 2023-11-24T06:30:25.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3ba1e79640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c06e090 con 0x7f3b9c15a4d0 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9affd640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3b9c0cad20 0x7f3b9c15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45470/0 (socket says 172.21.15.143:45470) 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9affd640 1 -- 172.21.15.143:0/2037810034 learned_addr learned my addr 172.21.15.143:0/2037810034 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9b7fe640 1 --2- 172.21.15.143:0/2037810034 >> v2:172.21.15.146:3300/0 conn(0x7f3b9c15a4d0 0x7f3b9c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3b9c06d740 0x7f3b9c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9a7fc640 1 -- 172.21.15.143:0/2037810034 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810931429 0 0) 0x7f3b9c15a8b0 con 0x7f3b9c0cad20 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9a7fc640 1 -- 172.21.15.143:0/2037810034 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b84003530 con 0x7f3b9c0cad20 2023-11-24T06:30:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9b7fe640 1 -- 172.21.15.143:0/2037810034 >> v2:172.21.15.143:3300/0 conn(0x7f3b9c06d740 msgr2=0x7f3b9c06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9b7fe640 1 --2- 172.21.15.143:0/2037810034 >> v2:172.21.15.143:3300/0 conn(0x7f3b9c06d740 0x7f3b9c06db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9b7fe640 1 -- 172.21.15.143:0/2037810034 >> v1:172.21.15.146:6789/0 conn(0x7f3b9c0cad20 legacy=0x7f3b9c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9b7fe640 1 -- 172.21.15.143:0/2037810034 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0c9f60 con 0x7f3b9c15a4d0 2023-11-24T06:30:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.373+0000 7f3b9bfff640 1 --2- 172.21.15.143:0/2037810034 >> v2:172.21.15.143:3300/0 conn(0x7f3b9c06d740 0x7f3b9c06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:25.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3b9b7fe640 1 --2- 172.21.15.143:0/2037810034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c0c9650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c06e7d0 tx=0x7f3b8c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db48de382cca9741 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:25.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3b9a7fc640 1 -- 172.21.15.143:0/2037810034 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0ac600 con 0x7f3b9c15a4d0 2023-11-24T06:30:25.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3b9a7fc640 1 -- 172.21.15.143:0/2037810034 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c0a8050 con 0x7f3b9c15a4d0 2023-11-24T06:30:25.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3b9a7fc640 1 -- 172.21.15.143:0/2037810034 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0ac980 con 0x7f3b9c15a4d0 2023-11-24T06:30:25.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2037810034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 msgr2=0x7f3b9c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:25.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2037810034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c0c9650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c06e7d0 tx=0x7f3b8c01c3a0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2037810034 shutdown_connections 2023-11-24T06:30:25.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2037810034 >> v2:172.21.15.143:3300/0 conn(0x7f3b9c06d740 0x7f3b9c06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2037810034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c0c9650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2037810034 >> 172.21.15.143:0/2037810034 conn(0x7f3b9c0b0bf0 msgr2=0x7f3b9c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2037810034 shutdown_connections 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.377+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2037810034 wait complete. 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 Processor -- start 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- start start 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c06d740 0x7f3b9c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:25.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 0x7f3b9c165c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1661b0 con 0x7f3b9c0cad20 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c162a50 con 0x7f3b9c15a4d0 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1663a0 con 0x7f3b9c06d740 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 0x7f3b9c165c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 0x7f3b9c165c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53438/0 (socket says 172.21.15.143:53438) 2023-11-24T06:30:25.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 -- 172.21.15.143:0/2198173638 learned_addr learned my addr 172.21.15.143:0/2198173638 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c06d740 0x7f3b9c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9bfff640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 -- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c06d740 msgr2=0x7f3b9c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c06d740 0x7f3b9c071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 -- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 msgr2=0x7f3b9c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 -- 172.21.15.143:0/2198173638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94009a70 con 0x7f3b9c0cad20 2023-11-24T06:30:25.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9b7fe640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c06d740 0x7f3b9c071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:25.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b9affd640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 0x7f3b9c165c70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c4d0 tx=0x7f3b9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:25.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90005cf0 con 0x7f3b9c0cad20 2023-11-24T06:30:25.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90005e50 con 0x7f3b9c0cad20 2023-11-24T06:30:25.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c009420 con 0x7f3b9c0cad20 2023-11-24T06:30:25.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900072d0 con 0x7f3b9c0cad20 2023-11-24T06:30:25.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c166960 con 0x7f3b9c0cad20 2023-11-24T06:30:25.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.381+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c162c10 con 0x7f3b9c0cad20 2023-11-24T06:30:25.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.385+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b90007430 con 0x7f3b9c0cad20 2023-11-24T06:30:25.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.385+0000 7f3b83fff640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3b88066470 0x7f3b88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:25.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.385+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b900831b0 con 0x7f3b9c0cad20 2023-11-24T06:30:25.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.385+0000 7f3b9b7fe640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3b88066470 0x7f3b88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:25.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.385+0000 7f3b9b7fe640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3b88066470 0x7f3b88068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0ae000 tx=0x7f3b8c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:25.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.389+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b90050940 con 0x7f3b9c0cad20 2023-11-24T06:30:25.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:25.561+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3b9c09d250 con 0x7f3b9c0cad20 2023-11-24T06:30:26.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.121+0000 7f3b83fff640 1 -- 172.21.15.143:0/2198173638 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3b90053f60 con 0x7f3b9c0cad20 2023-11-24T06:30:26.125 INFO:teuthology.orchestra.run.smithi143.stderr: removed all blocklist entries 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3b88066470 msgr2=0x7f3b88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3b88066470 0x7f3b88068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0ae000 tx=0x7f3b8c0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 msgr2=0x7f3b9c165c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 0x7f3b9c165c70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c4d0 tx=0x7f3b9000c8d0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 shutdown_connections 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3b88066470 0x7f3b88068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c15a4d0 0x7f3b9c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b9c0cad20 0x7f3b9c165c70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 --2- 172.21.15.143:0/2198173638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c06d740 0x7f3b9c071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 >> 172.21.15.143:0/2198173638 conn(0x7f3b9c0b0bf0 msgr2=0x7f3b9c0afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:26.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 shutdown_connections 2023-11-24T06:30:26.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.125+0000 7f3ba1e79640 1 -- 172.21.15.143:0/2198173638 wait complete. 2023-11-24T06:30:26.156 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:30:26.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.288+0000 7f1fbe535640 1 Processor -- start 2023-11-24T06:30:26.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbe535640 1 -- start start 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbe535640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fb80ce710 0x7f1fb8070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbe535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb80713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbe535640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb806acc0 con 0x7f1fb815d4f0 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbe535640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb806bba0 con 0x7f1fb80ce710 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbe535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb806af20 con 0x7f1fb806dd30 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbcad2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb80713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fb77fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fb80ce710 0x7f1fb8070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fb7fff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1fb815d4f0 0x7f1fb806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45482/0 (socket says 172.21.15.143:45482) 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fb7fff640 1 -- 172.21.15.143:0/2896679029 learned_addr learned my addr 172.21.15.143:0/2896679029 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fb6ffd640 1 -- 172.21.15.143:0/2896679029 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004152688 0 0) 0x7f1fb806acc0 con 0x7f1fb815d4f0 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbcad2640 1 -- 172.21.15.143:0/2896679029 >> v2:172.21.15.146:3300/0 conn(0x7f1fb80ce710 msgr2=0x7f1fb8070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbcad2640 1 --2- 172.21.15.143:0/2896679029 >> v2:172.21.15.146:3300/0 conn(0x7f1fb80ce710 0x7f1fb8070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbcad2640 1 -- 172.21.15.143:0/2896679029 >> v1:172.21.15.146:6789/0 conn(0x7f1fb815d4f0 legacy=0x7f1fb806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fbcad2640 1 -- 172.21.15.143:0/2896679029 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb806b200 con 0x7f1fb806dd30 2023-11-24T06:30:26.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.292+0000 7f1fb77fe640 1 --2- 172.21.15.143:0/2896679029 >> v2:172.21.15.146:3300/0 conn(0x7f1fb80ce710 0x7f1fb8070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:26.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbcad2640 1 --2- 172.21.15.143:0/2896679029 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb80713e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009d90 tx=0x7f1fb001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e763fca90fc17 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:26.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fb6ffd640 1 -- 172.21.15.143:0/2896679029 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00a59e0 con 0x7f1fb806dd30 2023-11-24T06:30:26.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fb6ffd640 1 -- 172.21.15.143:0/2896679029 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb00a5b40 con 0x7f1fb806dd30 2023-11-24T06:30:26.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fb6ffd640 1 -- 172.21.15.143:0/2896679029 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00ad440 con 0x7f1fb806dd30 2023-11-24T06:30:26.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 -- 172.21.15.143:0/2896679029 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 msgr2=0x7f1fb80713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 --2- 172.21.15.143:0/2896679029 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb80713e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009d90 tx=0x7f1fb001c920 comp rx=0 tx=0).stop 2023-11-24T06:30:26.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 -- 172.21.15.143:0/2896679029 shutdown_connections 2023-11-24T06:30:26.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 --2- 172.21.15.143:0/2896679029 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb80713e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 --2- 172.21.15.143:0/2896679029 >> v2:172.21.15.146:3300/0 conn(0x7f1fb80ce710 0x7f1fb8070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 -- 172.21.15.143:0/2896679029 >> 172.21.15.143:0/2896679029 conn(0x7f1fb80cc330 msgr2=0x7f1fb80cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:26.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 -- 172.21.15.143:0/2896679029 shutdown_connections 2023-11-24T06:30:26.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.296+0000 7f1fbe535640 1 -- 172.21.15.143:0/2896679029 wait complete. 2023-11-24T06:30:26.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 Processor -- start 2023-11-24T06:30:26.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- start start 2023-11-24T06:30:26.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb8159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 0x7f1fb81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb815d4f0 0x7f1fb813f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8155060 con 0x7f1fb80ce710 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8154450 con 0x7f1fb815d4f0 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8154730 con 0x7f1fb806dd30 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 0x7f1fb81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 0x7f1fb81574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53440/0 (socket says 172.21.15.143:53440) 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 -- 172.21.15.143:0/1008263042 learned_addr learned my addr 172.21.15.143:0/1008263042 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbcad2640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb815d4f0 0x7f1fb813f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb7fff640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb8159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 -- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 msgr2=0x7f1fb8159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb8159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 -- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb815d4f0 msgr2=0x7f1fb813f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb815d4f0 0x7f1fb813f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 -- 172.21.15.143:0/1008263042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009420 con 0x7f1fb80ce710 2023-11-24T06:30:26.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb77fe640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 0x7f1fb81574b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00ebe0 tx=0x7f1fac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:26.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00eee0 con 0x7f1fb80ce710 2023-11-24T06:30:26.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac00cc30 con 0x7f1fb80ce710 2023-11-24T06:30:26.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac013470 con 0x7f1fb80ce710 2023-11-24T06:30:26.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb0009a70 con 0x7f1fb80ce710 2023-11-24T06:30:26.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb8154cf0 con 0x7f1fb80ce710 2023-11-24T06:30:26.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.300+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8067520 con 0x7f1fb80ce710 2023-11-24T06:30:26.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.304+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1fac0135d0 con 0x7f1fb80ce710 2023-11-24T06:30:26.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.304+0000 7f1fb4ff9640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1fa4066470 0x7f1fa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.304+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1fac083eb0 con 0x7f1fb80ce710 2023-11-24T06:30:26.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.304+0000 7f1fb7fff640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1fa4066470 0x7f1fa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.304+0000 7f1fb7fff640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1fa4066470 0x7f1fa4068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f70 tx=0x7f1fa8007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:26.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.308+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fac051600 con 0x7f1fb80ce710 2023-11-24T06:30:26.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.504+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1fb806aae0 con 0x7f1fb80ce710 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fb4ff9640 1 -- 172.21.15.143:0/1008263042 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1fac017090 con 0x7f1fb80ce710 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stdout: "auth_dump": [ 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.a", 2023-11-24T06:30:26.513 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA==", 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.b", 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA==", 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.514 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.c", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg==", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:30:26.515 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.d", 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ==", 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.0", 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg==", 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.1", 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg==", 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.517 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.2", 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA==", 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.3", 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw==", 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.4", 2023-11-24T06:30:26.519 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew==", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.5", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ==", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.520 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.6", 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ==", 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.521 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.7", 2023-11-24T06:30:26.522 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA==", 2023-11-24T06:30:26.522 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.522 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:30:26.522 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.0", 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA==", 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:30:26.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.1", 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w==", 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.524 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.2", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw==", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.3", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw==", 2023-11-24T06:30:26.525 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.526 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.admin", 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlFbv3BRAAPWkl+V8uDy+7+/Qdzjn9Fw==", 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.527 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-mds", 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC7QmBlCQnkCxAAysmeqbWkv6domTfKhD36EA==", 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC7QmBl2xPkCxAA57U4ltSPH1CNrF8qaPgA3g==", 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-osd", 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC7QmBldhzkCxAAOK4CXfp/8gbsAhLEvfk8vg==", 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC7QmBliyTkCxAAIF/JxZQNQ1prhY6SA6NDHw==", 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC7QmBlFi3kCxAAAntuQ5eLAG+vE/0r4NtjmA==", 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC7QmBlqTXkCxAAV0SM6JqtfD4rKmJviHtcnw==", 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T06:30:26.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.x", 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ==", 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.y", 2023-11-24T06:30:26.531 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw==", 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2023-11-24T06:30:26.532 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:30:26.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1fa4066470 msgr2=0x7f1fa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1fa4066470 0x7f1fa4068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f70 tx=0x7f1fa8007240 comp rx=0 tx=0).stop 2023-11-24T06:30:26.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 msgr2=0x7f1fb81574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 0x7f1fb81574b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00ebe0 tx=0x7f1fac00c520 comp rx=0 tx=0).stop 2023-11-24T06:30:26.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 shutdown_connections 2023-11-24T06:30:26.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1fa4066470 0x7f1fa4068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fb815d4f0 0x7f1fb813f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fb80ce710 0x7f1fb81574b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 --2- 172.21.15.143:0/1008263042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fb806dd30 0x7f1fb8159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 >> 172.21.15.143:0/1008263042 conn(0x7f1fb80cc330 msgr2=0x7f1fb8155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:26.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 shutdown_connections 2023-11-24T06:30:26.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.508+0000 7f1fbe535640 1 -- 172.21.15.143:0/1008263042 wait complete. 2023-11-24T06:30:26.536 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T06:30:26.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.668+0000 7f84bc5ec640 1 Processor -- start 2023-11-24T06:30:26.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.668+0000 7f84bc5ec640 1 -- start start 2023-11-24T06:30:26.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bc5ec640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84b40725f0 0x7f84b406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bc5ec640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40c98f0 0x7f84b40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bc5ec640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b40ca270 con 0x7f84b40cd0d0 2023-11-24T06:30:26.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bc5ec640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40ca770 con 0x7f84b40725f0 2023-11-24T06:30:26.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bc5ec640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40729d0 con 0x7f84b40c98f0 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84ba388640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84b40725f0 0x7f84b406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84b9b87640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40c98f0 0x7f84b40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bab89640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f84b40cd0d0 0x7f84b40cd560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:45492/0 (socket says 172.21.15.143:45492) 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84ba388640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84b40725f0 0x7f84b406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:51432/0 (socket says 172.21.15.143:51432) 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84b9b87640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40c98f0 0x7f84b40c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:52774/0 (socket says 172.21.15.143:52774) 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84bab89640 1 -- 172.21.15.143:0/2733711159 learned_addr learned my addr 172.21.15.143:0/2733711159 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84ba388640 1 -- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40c98f0 msgr2=0x7f84b40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:26.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84ba388640 1 --2- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40c98f0 0x7f84b40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84ba388640 1 -- 172.21.15.143:0/2733711159 >> v1:172.21.15.146:6789/0 conn(0x7f84b40cd0d0 legacy=0x7f84b40cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.672+0000 7f84ba388640 1 -- 172.21.15.143:0/2733711159 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b406cb70 con 0x7f84b40725f0 2023-11-24T06:30:26.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84ba388640 1 --2- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40725f0 0x7f84b406c630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84b00097f0 tx=0x7f84b001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f859473f795ae1c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:26.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84b9386640 1 -- 172.21.15.143:0/2733711159 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00a8970 con 0x7f84b40725f0 2023-11-24T06:30:26.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84b9386640 1 -- 172.21.15.143:0/2733711159 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00a8ad0 con 0x7f84b40725f0 2023-11-24T06:30:26.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84b9386640 1 -- 172.21.15.143:0/2733711159 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00a8e60 con 0x7f84b40725f0 2023-11-24T06:30:26.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 -- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40725f0 msgr2=0x7f84b406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40725f0 0x7f84b406c630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84b00097f0 tx=0x7f84b001ec70 comp rx=0 tx=0).stop 2023-11-24T06:30:26.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 -- 172.21.15.143:0/2733711159 shutdown_connections 2023-11-24T06:30:26.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40c98f0 0x7f84b40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/2733711159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40725f0 0x7f84b406c630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 -- 172.21.15.143:0/2733711159 >> 172.21.15.143:0/2733711159 conn(0x7f84b40b0bf0 msgr2=0x7f84b40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:26.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 -- 172.21.15.143:0/2733711159 shutdown_connections 2023-11-24T06:30:26.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 -- 172.21.15.143:0/2733711159 wait complete. 2023-11-24T06:30:26.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 Processor -- start 2023-11-24T06:30:26.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.676+0000 7f84bc5ec640 1 -- start start 2023-11-24T06:30:26.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 0x7f84b409c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40c98f0 0x7f84b40b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40cd0d0 0x7f84b40b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b2820 con 0x7f84b40725f0 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b2b00 con 0x7f84b40c98f0 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b2de0 con 0x7f84b40cd0d0 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 0x7f84b409c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 0x7f84b409c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53456/0 (socket says 172.21.15.143:53456) 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 -- 172.21.15.143:0/3903130436 learned_addr learned my addr 172.21.15.143:0/3903130436 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84b9b87640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40c98f0 0x7f84b40b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bab89640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40cd0d0 0x7f84b40b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 -- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40cd0d0 msgr2=0x7f84b40b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40cd0d0 0x7f84b40b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 -- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40c98f0 msgr2=0x7f84b40b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40c98f0 0x7f84b40b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 -- 172.21.15.143:0/3903130436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0009420 con 0x7f84b40725f0 2023-11-24T06:30:26.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84ba388640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 0x7f84b409c1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84b001c8a0 tx=0x7f84b001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:26.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b0e30 con 0x7f84b40725f0 2023-11-24T06:30:26.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00b9410 con 0x7f84b40725f0 2023-11-24T06:30:26.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b97c0 con 0x7f84b40725f0 2023-11-24T06:30:26.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b40b30c0 con 0x7f84b40725f0 2023-11-24T06:30:26.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b40b4ab0 con 0x7f84b40725f0 2023-11-24T06:30:26.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b40b3570 con 0x7f84b40725f0 2023-11-24T06:30:26.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.680+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84b00b7040 con 0x7f84b40725f0 2023-11-24T06:30:26.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.684+0000 7f84aaffd640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8498066470 0x7f8498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:26.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.684+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84b0121790 con 0x7f84b40725f0 2023-11-24T06:30:26.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.684+0000 7f84b9b87640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8498066470 0x7f8498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:26.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.684+0000 7f84b9b87640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8498066470 0x7f8498068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84b4159be0 tx=0x7f84a400b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:26.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.684+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84b00eefe0 con 0x7f84b40725f0 2023-11-24T06:30:26.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.888+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f84b404e930 con 0x7f84b40725f0 2023-11-24T06:30:26.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84aaffd640 1 -- 172.21.15.143:0/3903130436 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f84b00b50a0 con 0x7f84b40725f0 2023-11-24T06:30:26.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8498066470 msgr2=0x7f8498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8498066470 0x7f8498068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84b4159be0 tx=0x7f84a400b3a0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 msgr2=0x7f84b409c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 0x7f84b409c1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84b001c8a0 tx=0x7f84b001ba10 comp rx=0 tx=0).stop 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 shutdown_connections 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8498066470 0x7f8498068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84b40cd0d0 0x7f84b40b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b40c98f0 0x7f84b40b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 --2- 172.21.15.143:0/3903130436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84b40725f0 0x7f84b409c1a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 >> 172.21.15.143:0/3903130436 conn(0x7f84b40b0bf0 msgr2=0x7f84b40ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:26.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 shutdown_connections 2023-11-24T06:30:26.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:26.892+0000 7f84bc5ec640 1 -- 172.21.15.143:0/3903130436 wait complete. 2023-11-24T06:30:26.919 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T06:30:27.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 Processor -- start 2023-11-24T06:30:27.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 -- start start 2023-11-24T06:30:27.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5134161c00 0x7f51340cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f51340abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51340cc360 con 0x7f513415d600 2023-11-24T06:30:27.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5134162080 con 0x7f5134161c00 2023-11-24T06:30:27.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.052+0000 7f513b413640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51340c99f0 con 0x7f51340cbed0 2023-11-24T06:30:27.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51391af640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f513415d600 0x7f513415e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34926/0 (socket says 172.21.15.143:34926) 2023-11-24T06:30:27.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51391af640 1 -- 172.21.15.143:0/4217376930 learned_addr learned my addr 172.21.15.143:0/4217376930 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:27.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51399b0640 1 --2- 172.21.15.143:0/4217376930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f51340abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51389ae640 1 --2- 172.21.15.143:0/4217376930 >> v2:172.21.15.143:3300/0 conn(0x7f5134161c00 0x7f51340cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f512bfff640 1 -- 172.21.15.143:0/4217376930 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443116740 0 0) 0x7f51340cc360 con 0x7f513415d600 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51399b0640 1 -- 172.21.15.143:0/4217376930 >> v2:172.21.15.143:3300/0 conn(0x7f5134161c00 msgr2=0x7f51340cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51399b0640 1 --2- 172.21.15.143:0/4217376930 >> v2:172.21.15.143:3300/0 conn(0x7f5134161c00 0x7f51340cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51399b0640 1 -- 172.21.15.143:0/4217376930 >> v1:172.21.15.143:6789/0 conn(0x7f513415d600 legacy=0x7f513415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51399b0640 1 -- 172.21.15.143:0/4217376930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134161120 con 0x7f51340cbed0 2023-11-24T06:30:27.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51389ae640 1 --2- 172.21.15.143:0/4217376930 >> v2:172.21.15.143:3300/0 conn(0x7f5134161c00 0x7f51340cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:27.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f51399b0640 1 --2- 172.21.15.143:0/4217376930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f51340abed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f512c009d90 tx=0x7f512c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff955b7fcf02cb4d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f512bfff640 1 -- 172.21.15.143:0/4217376930 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0a5a10 con 0x7f51340cbed0 2023-11-24T06:30:27.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f512bfff640 1 -- 172.21.15.143:0/4217376930 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c0a5b70 con 0x7f51340cbed0 2023-11-24T06:30:27.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.056+0000 7f512bfff640 1 -- 172.21.15.143:0/4217376930 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0ad440 con 0x7f51340cbed0 2023-11-24T06:30:27.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- 172.21.15.143:0/4217376930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 msgr2=0x7f51340abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 --2- 172.21.15.143:0/4217376930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f51340abed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f512c009d90 tx=0x7f512c01c950 comp rx=0 tx=0).stop 2023-11-24T06:30:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- 172.21.15.143:0/4217376930 shutdown_connections 2023-11-24T06:30:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 --2- 172.21.15.143:0/4217376930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f51340abed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 --2- 172.21.15.143:0/4217376930 >> v2:172.21.15.143:3300/0 conn(0x7f5134161c00 0x7f51340cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- 172.21.15.143:0/4217376930 >> 172.21.15.143:0/4217376930 conn(0x7f51340b0bf0 msgr2=0x7f51340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- 172.21.15.143:0/4217376930 shutdown_connections 2023-11-24T06:30:27.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- 172.21.15.143:0/4217376930 wait complete. 2023-11-24T06:30:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 Processor -- start 2023-11-24T06:30:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- start start 2023-11-24T06:30:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f513409c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 0x7f51340c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5134161c00 0x7f51340c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513409c910 con 0x7f513415d600 2023-11-24T06:30:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513415ef50 con 0x7f5134161c00 2023-11-24T06:30:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f513b413640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513415f230 con 0x7f51340cbed0 2023-11-24T06:30:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f51389ae640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 0x7f51340c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f51389ae640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 0x7f51340c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53480/0 (socket says 172.21.15.143:53480) 2023-11-24T06:30:27.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f51389ae640 1 -- 172.21.15.143:0/3744640533 learned_addr learned my addr 172.21.15.143:0/3744640533 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:27.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f51399b0640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5134161c00 0x7f51340c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f51391af640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f513409c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.060+0000 7f51389ae640 1 -- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 msgr2=0x7f513409c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51389ae640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f513409c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51389ae640 1 -- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5134161c00 msgr2=0x7f51340c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51389ae640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5134161c00 0x7f51340c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51389ae640 1 -- 172.21.15.143:0/3744640533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124009420 con 0x7f513415d600 2023-11-24T06:30:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51399b0640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5134161c00 0x7f51340c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51391af640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f513409c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51389ae640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 0x7f51340c62e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f512400ebe0 tx=0x7f512400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512400eee0 con 0x7f513415d600 2023-11-24T06:30:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512400cc30 con 0x7f513415d600 2023-11-24T06:30:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c009a70 con 0x7f513415d600 2023-11-24T06:30:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124013470 con 0x7f513415d600 2023-11-24T06:30:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513415f7f0 con 0x7f513415d600 2023-11-24T06:30:27.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51340cff40 con 0x7f513415d600 2023-11-24T06:30:27.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51240135d0 con 0x7f513415d600 2023-11-24T06:30:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f5129ffb640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51180664a0 0x7f5118068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5124083fa0 con 0x7f513415d600 2023-11-24T06:30:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.064+0000 7f51391af640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51180664a0 0x7f5118068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.068+0000 7f51391af640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51180664a0 0x7f5118068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5130007fd0 tx=0x7f5130009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.068+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51240515c0 con 0x7f513415d600 2023-11-24T06:30:27.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.276+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f513409d250 con 0x7f513415d600 2023-11-24T06:30:27.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f5129ffb640 1 -- 172.21.15.143:0/3744640533 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5124054be0 con 0x7f513415d600 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51180664a0 msgr2=0x7f5118068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51180664a0 0x7f5118068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5130007fd0 tx=0x7f5130009040 comp rx=0 tx=0).stop 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 msgr2=0x7f51340c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 0x7f51340c62e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f512400ebe0 tx=0x7f512400c520 comp rx=0 tx=0).stop 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 shutdown_connections 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51180664a0 0x7f5118068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5134161c00 0x7f51340c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f513415d600 0x7f51340c62e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 --2- 172.21.15.143:0/3744640533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51340cbed0 0x7f513409c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 >> 172.21.15.143:0/3744640533 conn(0x7f51340b0bf0 msgr2=0x7f5134072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:27.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 shutdown_connections 2023-11-24T06:30:27.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.284+0000 7f513b413640 1 -- 172.21.15.143:0/3744640533 wait complete. 2023-11-24T06:30:27.310 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T06:30:27.449 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f371a4e3640 1 Processor -- start 2023-11-24T06:30:27.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f371a4e3640 1 -- start start 2023-11-24T06:30:27.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f371a4e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 0x7f37140cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f371a4e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140abed0 con 0x7f371415b220 2023-11-24T06:30:27.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f371a4e3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3714072370 con 0x7f371415b600 2023-11-24T06:30:27.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f371a4e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3714072710 con 0x7f37140c9d60 2023-11-24T06:30:27.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3713fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f371415b220 0x7f371406d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55036/0 (socket says 172.21.15.143:55036) 2023-11-24T06:30:27.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3713fff640 1 -- 172.21.15.143:0/2760605819 learned_addr learned my addr 172.21.15.143:0/2760605819 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 0x7f37140cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041579605 0 0) 0x7f37140abed0 con 0x7f371415b220 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc003530 con 0x7f371415b220 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596343321 0 0) 0x7f3714072370 con 0x7f371415b600 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37140abed0 con 0x7f371415b600 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691291301 0 0) 0x7f36fc003530 con 0x7f371415b220 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 msgr2=0x7f37140cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 0x7f37140cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 >> v1:172.21.15.146:6789/0 conn(0x7f371415b600 legacy=0x7f37140c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714070670 con 0x7f371415b220 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f3704001680 con 0x7f371415b220 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 >> v1:172.21.15.143:6789/0 conn(0x7f371415b220 legacy=0x7f371406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36fc003b40 0x7f36fc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 0x7f36fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f36fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714072710 con 0x7f36fc004d10 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc00ba40 con 0x7f36fc003b40 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc00bc00 con 0x7f37140c9d60 2023-11-24T06:30:27.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f36fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f37137fe640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 0x7f36fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3713fff640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36fc003b40 0x7f36fc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 -- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 msgr2=0x7f36fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37140c9d60 0x7f36fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 -- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36fc003b40 msgr2=0x7f36fc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36fc003b40 0x7f36fc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.444+0000 7f3718a80640 1 -- 172.21.15.143:0/2760605819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc003530 con 0x7f36fc004d10 2023-11-24T06:30:27.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f3718a80640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f36fc005190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f370c009f90 tx=0x7f370c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6356b816176cdf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0a5c30 con 0x7f36fc004d10 2023-11-24T06:30:27.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c00f040 con 0x7f36fc004d10 2023-11-24T06:30:27.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f3712ffd640 1 -- 172.21.15.143:0/2760605819 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0ad440 con 0x7f36fc004d10 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f371a4e3640 1 -- 172.21.15.143:0/2760605819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 msgr2=0x7f36fc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2760605819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f36fc005190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f370c009f90 tx=0x7f370c01cc20 comp rx=0 tx=0).stop 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f3718a80640 1 -- 172.21.15.143:0/2760605819 reap_dead start 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f371a4e3640 1 -- 172.21.15.143:0/2760605819 shutdown_connections 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f371a4e3640 1 -- 172.21.15.143:0/2760605819 >> 172.21.15.143:0/2760605819 conn(0x7f37140b0bf0 msgr2=0x7f37140b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f371a4e3640 1 -- 172.21.15.143:0/2760605819 shutdown_connections 2023-11-24T06:30:27.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.448+0000 7f371a4e3640 1 -- 172.21.15.143:0/2760605819 wait complete. 2023-11-24T06:30:27.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 Processor -- start 2023-11-24T06:30:27.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 -- start start 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f37140b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f371415a450 0x7f371415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141f3340 0x7f37141f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140b31b0 con 0x7f36fc004d10 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140b3490 con 0x7f37141f3340 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37140b3770 con 0x7f371415a450 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f37140b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f37140b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48168/0 (socket says 172.21.15.143:48168) 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 -- 172.21.15.143:0/2521762435 learned_addr learned my addr 172.21.15.143:0/2521762435 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f37137fe640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f371415a450 0x7f371415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3718a80640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141f3340 0x7f37141f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 -- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f371415a450 msgr2=0x7f371415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f371415a450 0x7f371415c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 -- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141f3340 msgr2=0x7f37141f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141f3340 0x7f37141f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 -- 172.21.15.143:0/2521762435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140b3a50 con 0x7f36fc004d10 2023-11-24T06:30:27.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f37137fe640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f371415a450 0x7f371415c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:27.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3718a80640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141f3340 0x7f37141f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:27.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3713fff640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f37140b2640 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f37040124f0 tx=0x7f37040129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040148d0 con 0x7f36fc004d10 2023-11-24T06:30:27.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704014a70 con 0x7f36fc004d10 2023-11-24T06:30:27.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704014e20 con 0x7f36fc004d10 2023-11-24T06:30:27.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140b3d30 con 0x7f36fc004d10 2023-11-24T06:30:27.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.452+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371415cc90 con 0x7f36fc004d10 2023-11-24T06:30:27.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.456+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37140b3f50 con 0x7f36fc004d10 2023-11-24T06:30:27.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.456+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3704016480 con 0x7f36fc004d10 2023-11-24T06:30:27.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.456+0000 7f3710ff9640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3700066470 0x7f3700068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.456+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3704087100 con 0x7f36fc004d10 2023-11-24T06:30:27.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.456+0000 7f37137fe640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3700066470 0x7f3700068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.456+0000 7f37137fe640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3700066470 0x7f3700068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f371415a850 tx=0x7f3708009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.460+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3704054840 con 0x7f36fc004d10 2023-11-24T06:30:27.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.660+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f371415ceb0 con 0x7f36fc004d10 2023-11-24T06:30:27.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.664+0000 7f3710ff9640 1 -- 172.21.15.143:0/2521762435 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3704057e60 con 0x7f36fc004d10 2023-11-24T06:30:27.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3700066470 msgr2=0x7f3700068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3700066470 0x7f3700068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f371415a850 tx=0x7f3708009040 comp rx=0 tx=0).stop 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 msgr2=0x7f37140b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f37140b2640 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f37040124f0 tx=0x7f37040129b0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 shutdown_connections 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3700066470 0x7f3700068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141f3340 0x7f37141f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f371415a450 0x7f371415c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 --2- 172.21.15.143:0/2521762435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36fc004d10 0x7f37140b2640 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 >> 172.21.15.143:0/2521762435 conn(0x7f37140b0bf0 msgr2=0x7f37140cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 shutdown_connections 2023-11-24T06:30:27.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.668+0000 7f371a4e3640 1 -- 172.21.15.143:0/2521762435 wait complete. 2023-11-24T06:30:27.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T06:30:27.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 Processor -- start 2023-11-24T06:30:27.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 -- start start 2023-11-24T06:30:27.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f382015b600 0x7f38200cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f38200c9650 0x7f38200c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200abed0 con 0x7f382015b220 2023-11-24T06:30:27.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3820072710 con 0x7f38200c9650 2023-11-24T06:30:27.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f382651d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200c9fa0 con 0x7f382015b600 2023-11-24T06:30:27.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f38200c9650 0x7f38200c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f38200c9650 0x7f38200c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48180/0 (socket says 172.21.15.143:48180) 2023-11-24T06:30:27.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 -- 172.21.15.143:0/2775512605 learned_addr learned my addr 172.21.15.143:0/2775512605 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:27.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f381f7fe640 1 --2- 172.21.15.143:0/2775512605 >> v2:172.21.15.146:3300/0 conn(0x7f382015b600 0x7f38200cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 -- 172.21.15.143:0/2775512605 >> v2:172.21.15.146:3300/0 conn(0x7f382015b600 msgr2=0x7f38200cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:27.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 --2- 172.21.15.143:0/2775512605 >> v2:172.21.15.146:3300/0 conn(0x7f382015b600 0x7f38200cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 -- 172.21.15.143:0/2775512605 >> v1:172.21.15.146:6789/0 conn(0x7f382015b220 legacy=0x7f382006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.828+0000 7f3824aba640 1 -- 172.21.15.143:0/2775512605 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820072370 con 0x7f38200c9650 2023-11-24T06:30:27.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f3824aba640 1 --2- 172.21.15.143:0/2775512605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38200c9a60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f382006e320 tx=0x7f381801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ec6ff2b1a41da6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f381effd640 1 -- 172.21.15.143:0/2775512605 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180a5860 con 0x7f38200c9650 2023-11-24T06:30:27.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f381effd640 1 -- 172.21.15.143:0/2775512605 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180a59c0 con 0x7f38200c9650 2023-11-24T06:30:27.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f381effd640 1 -- 172.21.15.143:0/2775512605 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180a5d50 con 0x7f38200c9650 2023-11-24T06:30:27.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 -- 172.21.15.143:0/2775512605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 msgr2=0x7f38200c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 --2- 172.21.15.143:0/2775512605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38200c9a60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f382006e320 tx=0x7f381801c9a0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 -- 172.21.15.143:0/2775512605 shutdown_connections 2023-11-24T06:30:27.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 --2- 172.21.15.143:0/2775512605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38200c9a60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 --2- 172.21.15.143:0/2775512605 >> v2:172.21.15.146:3300/0 conn(0x7f382015b600 0x7f38200cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 -- 172.21.15.143:0/2775512605 >> 172.21.15.143:0/2775512605 conn(0x7f38200b0bf0 msgr2=0x7f38200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:27.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 -- 172.21.15.143:0/2775512605 shutdown_connections 2023-11-24T06:30:27.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.832+0000 7f382651d640 1 -- 172.21.15.143:0/2775512605 wait complete. 2023-11-24T06:30:27.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 Processor -- start 2023-11-24T06:30:27.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- start start 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38201644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382015b220 0x7f3820152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382015b600 0x7f38200cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820152b90 con 0x7f38200c9650 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201657d0 con 0x7f382015b220 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200ce150 con 0x7f382015b600 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38201644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38201644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48194/0 (socket says 172.21.15.143:48194) 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 -- 172.21.15.143:0/3963701736 learned_addr learned my addr 172.21.15.143:0/3963701736 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381f7fe640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382015b220 0x7f3820152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f3824aba640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382015b600 0x7f38200cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 -- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382015b600 msgr2=0x7f38200cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382015b600 0x7f38200cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 -- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382015b220 msgr2=0x7f3820152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382015b220 0x7f3820152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 -- 172.21.15.143:0/3963701736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009b30 con 0x7f38200c9650 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381ffff640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38201644c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f381000c530 tx=0x7f381000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810005220 con 0x7f38200c9650 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810005380 con 0x7f38200c9650 2023-11-24T06:30:27.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820164bc0 con 0x7f38200c9650 2023-11-24T06:30:27.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810007270 con 0x7f38200c9650 2023-11-24T06:30:27.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820165180 con 0x7f38200c9650 2023-11-24T06:30:27.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.836+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382009d250 con 0x7f38200c9650 2023-11-24T06:30:27.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.840+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f38100073d0 con 0x7f38200c9650 2023-11-24T06:30:27.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.840+0000 7f381cff9640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f380c0664a0 0x7f380c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:27.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.840+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3810083330 con 0x7f38200c9650 2023-11-24T06:30:27.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.840+0000 7f381f7fe640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f380c0664a0 0x7f380c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:27.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.840+0000 7f381f7fe640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f380c0664a0 0x7f380c068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38200b4f40 tx=0x7f3814008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:27.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:27.844+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3810050ba0 con 0x7f38200c9650 2023-11-24T06:30:28.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.044+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f382004e930 con 0x7f38200c9650 2023-11-24T06:30:28.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.048+0000 7f381cff9640 1 -- 172.21.15.143:0/3963701736 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f38100541c0 con 0x7f38200c9650 2023-11-24T06:30:28.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f380c0664a0 msgr2=0x7f380c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f380c0664a0 0x7f380c068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38200b4f40 tx=0x7f3814008040 comp rx=0 tx=0).stop 2023-11-24T06:30:28.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 msgr2=0x7f38201644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38201644c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f381000c530 tx=0x7f381000c9f0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 shutdown_connections 2023-11-24T06:30:28.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f380c0664a0 0x7f380c068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382015b600 0x7f38200cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382015b220 0x7f3820152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 --2- 172.21.15.143:0/3963701736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38200c9650 0x7f38201644c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 >> 172.21.15.143:0/3963701736 conn(0x7f38200b0bf0 msgr2=0x7f38200b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:28.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 shutdown_connections 2023-11-24T06:30:28.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.052+0000 7f382651d640 1 -- 172.21.15.143:0/3963701736 wait complete. 2023-11-24T06:30:28.076 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T06:30:28.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.208+0000 7f5afcdc1640 1 Processor -- start 2023-11-24T06:30:28.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.208+0000 7f5afcdc1640 1 -- start start 2023-11-24T06:30:28.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5afcdc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5af80cad20 0x7f5af80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5afcdc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af815a8b0 con 0x7f5af806d740 2023-11-24T06:30:28.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5afcdc1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80c9c30 con 0x7f5af815a4d0 2023-11-24T06:30:28.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5afcdc1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80c9f60 con 0x7f5af80cad20 2023-11-24T06:30:28.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af6d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5af806d740 0x7f5af806db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55046/0 (socket says 172.21.15.143:55046) 2023-11-24T06:30:28.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af5d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5af80cad20 0x7f5af80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af6d9d640 1 -- 172.21.15.143:0/3004358367 learned_addr learned my addr 172.21.15.143:0/3004358367 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:28.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af5d9b640 1 -- 172.21.15.143:0/3004358367 >> v1:172.21.15.146:6789/0 conn(0x7f5af815a4d0 legacy=0x7f5af815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af5d9b640 1 -- 172.21.15.143:0/3004358367 >> v1:172.21.15.143:6789/0 conn(0x7f5af806d740 legacy=0x7f5af806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af559a640 1 -- 172.21.15.143:0/3004358367 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683266888 0 0) 0x7f5af815a8b0 con 0x7f5af806d740 2023-11-24T06:30:28.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.212+0000 7f5af5d9b640 1 -- 172.21.15.143:0/3004358367 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80ca240 con 0x7f5af80cad20 2023-11-24T06:30:28.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5af5d9b640 1 --2- 172.21.15.143:0/3004358367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af80cad20 0x7f5af80c9650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0097c0 tx=0x7f5aec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e2c653970d6601 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5af559a640 1 -- 172.21.15.143:0/3004358367 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0ac620 con 0x7f5af80cad20 2023-11-24T06:30:28.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5af559a640 1 -- 172.21.15.143:0/3004358367 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec0ac780 con 0x7f5af80cad20 2023-11-24T06:30:28.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5af559a640 1 -- 172.21.15.143:0/3004358367 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0acb10 con 0x7f5af80cad20 2023-11-24T06:30:28.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 -- 172.21.15.143:0/3004358367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af80cad20 msgr2=0x7f5af80c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/3004358367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af80cad20 0x7f5af80c9650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0097c0 tx=0x7f5aec01c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 -- 172.21.15.143:0/3004358367 shutdown_connections 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/3004358367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af80cad20 0x7f5af80c9650 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 -- 172.21.15.143:0/3004358367 >> 172.21.15.143:0/3004358367 conn(0x7f5af80b0bf0 msgr2=0x7f5af80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 -- 172.21.15.143:0/3004358367 shutdown_connections 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 -- 172.21.15.143:0/3004358367 wait complete. 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 Processor -- start 2023-11-24T06:30:28.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.216+0000 7f5afcdc1640 1 -- start start 2023-11-24T06:30:28.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 0x7f5af8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af80cad20 0x7f5af80c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5af815a4d0 0x7f5af80c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8155bd0 con 0x7f5af806d740 2023-11-24T06:30:28.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c6170 con 0x7f5af80cad20 2023-11-24T06:30:28.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c6450 con 0x7f5af815a4d0 2023-11-24T06:30:28.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 0x7f5af8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 0x7f5af8155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48206/0 (socket says 172.21.15.143:48206) 2023-11-24T06:30:28.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 -- 172.21.15.143:0/2905001955 learned_addr learned my addr 172.21.15.143:0/2905001955 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:28.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af5d9b640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af80cad20 0x7f5af80c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af6d9d640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5af815a4d0 0x7f5af80c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 -- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5af815a4d0 msgr2=0x7f5af80c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5af815a4d0 0x7f5af80c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 -- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af80cad20 msgr2=0x7f5af80c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af80cad20 0x7f5af80c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 -- 172.21.15.143:0/2905001955 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009420 con 0x7f5af806d740 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af6d9d640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5af815a4d0 0x7f5af80c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:28.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5af659c640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 0x7f5af8155080 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c3c0 tx=0x7f5ae800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80052d0 con 0x7f5af806d740 2023-11-24T06:30:28.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8005430 con 0x7f5af806d740 2023-11-24T06:30:28.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8003840 con 0x7f5af806d740 2023-11-24T06:30:28.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80c6730 con 0x7f5af806d740 2023-11-24T06:30:28.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80c8220 con 0x7f5af806d740 2023-11-24T06:30:28.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af809d250 con 0x7f5af806d740 2023-11-24T06:30:28.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.220+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ae80039a0 con 0x7f5af806d740 2023-11-24T06:30:28.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.224+0000 7f5ae6ffd640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ad8066470 0x7f5ad8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.224+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ae8083070 con 0x7f5af806d740 2023-11-24T06:30:28.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.224+0000 7f5af5d9b640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ad8066470 0x7f5ad8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.224+0000 7f5af5d9b640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ad8066470 0x7f5ad8068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0ae000 tx=0x7f5aec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.224+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ae80b4280 con 0x7f5af806d740 2023-11-24T06:30:28.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.432+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5af80c2910 con 0x7f5af806d740 2023-11-24T06:30:28.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5ae6ffd640 1 -- 172.21.15.143:0/2905001955 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ae80170a0 con 0x7f5af806d740 2023-11-24T06:30:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ad8066470 msgr2=0x7f5ad8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ad8066470 0x7f5ad8068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0ae000 tx=0x7f5aec0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 msgr2=0x7f5af8155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 0x7f5af8155080 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c3c0 tx=0x7f5ae800c880 comp rx=0 tx=0).stop 2023-11-24T06:30:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 shutdown_connections 2023-11-24T06:30:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ad8066470 0x7f5ad8068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5af815a4d0 0x7f5af80c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af80cad20 0x7f5af80c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 --2- 172.21.15.143:0/2905001955 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5af806d740 0x7f5af8155080 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 >> 172.21.15.143:0/2905001955 conn(0x7f5af80b0bf0 msgr2=0x7f5af806c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 shutdown_connections 2023-11-24T06:30:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.436+0000 7f5afcdc1640 1 -- 172.21.15.143:0/2905001955 wait complete. 2023-11-24T06:30:28.462 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T06:30:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.592+0000 7f0dbed72640 1 Processor -- start 2023-11-24T06:30:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.592+0000 7f0dbed72640 1 -- start start 2023-11-24T06:30:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0dbed72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0db80cad20 0x7f0db80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0dbed72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db815a8b0 con 0x7f0db815a4d0 2023-11-24T06:30:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0dbed72640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80c9c30 con 0x7f0db806d740 2023-11-24T06:30:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0dbed72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80c9f60 con 0x7f0db80cad20 2023-11-24T06:30:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0db7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0db80cad20 0x7f0db80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0dbcb0e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0db815a4d0 0x7f0db815e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55052/0 (socket says 172.21.15.143:55052) 2023-11-24T06:30:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0dbcb0e640 1 -- 172.21.15.143:0/1758073445 learned_addr learned my addr 172.21.15.143:0/1758073445 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0db7fff640 1 -- 172.21.15.143:0/1758073445 >> v1:172.21.15.146:6789/0 conn(0x7f0db806d740 legacy=0x7f0db806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0db7fff640 1 -- 172.21.15.143:0/1758073445 >> v1:172.21.15.143:6789/0 conn(0x7f0db815a4d0 legacy=0x7f0db815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0db7fff640 1 -- 172.21.15.143:0/1758073445 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80ca240 con 0x7f0db80cad20 2023-11-24T06:30:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.596+0000 7f0db77fe640 1 -- 172.21.15.143:0/1758073445 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748535958 0 0) 0x7f0db815a8b0 con 0x7f0db815a4d0 2023-11-24T06:30:28.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0db7fff640 1 --2- 172.21.15.143:0/1758073445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c9650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009740 tx=0x7f0da401c1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfe518baf41589c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0db77fe640 1 -- 172.21.15.143:0/1758073445 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40ab600 con 0x7f0db80cad20 2023-11-24T06:30:28.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0db77fe640 1 -- 172.21.15.143:0/1758073445 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40a7050 con 0x7f0db80cad20 2023-11-24T06:30:28.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0db77fe640 1 -- 172.21.15.143:0/1758073445 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40ab980 con 0x7f0db80cad20 2023-11-24T06:30:28.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- 172.21.15.143:0/1758073445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 msgr2=0x7f0db80c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1758073445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c9650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009740 tx=0x7f0da401c1f0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- 172.21.15.143:0/1758073445 shutdown_connections 2023-11-24T06:30:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1758073445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c9650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- 172.21.15.143:0/1758073445 >> 172.21.15.143:0/1758073445 conn(0x7f0db80b0bf0 msgr2=0x7f0db80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- 172.21.15.143:0/1758073445 shutdown_connections 2023-11-24T06:30:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- 172.21.15.143:0/1758073445 wait complete. 2023-11-24T06:30:28.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 Processor -- start 2023-11-24T06:30:28.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- start start 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0db806d740 0x7f0db81582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db815a4d0 0x7f0db8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.600+0000 7f0dbed72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db809be40 con 0x7f0db80cad20 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbed72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80c3bd0 con 0x7f0db815a4d0 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbed72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80c3eb0 con 0x7f0db806d740 2023-11-24T06:30:28.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48218/0 (socket says 172.21.15.143:48218) 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 -- 172.21.15.143:0/1569755926 learned_addr learned my addr 172.21.15.143:0/1569755926 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbd30f640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db815a4d0 0x7f0db8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbcb0e640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0db806d740 0x7f0db81582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 -- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0db806d740 msgr2=0x7f0db81582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0db806d740 0x7f0db81582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 -- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db815a4d0 msgr2=0x7f0db8158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db815a4d0 0x7f0db8158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 -- 172.21.15.143:0/1569755926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009420 con 0x7f0db80cad20 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbd30f640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db815a4d0 0x7f0db8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:28.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbcb0e640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0db806d740 0x7f0db81582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db7fff640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c4c70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0da4019e20 tx=0x7f0da4018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4004220 con 0x7f0db80cad20 2023-11-24T06:30:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da4004380 con 0x7f0db80cad20 2023-11-24T06:30:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db80c4190 con 0x7f0db80cad20 2023-11-24T06:30:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4003820 con 0x7f0db80cad20 2023-11-24T06:30:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db80c4750 con 0x7f0db80cad20 2023-11-24T06:30:28.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80c4940 con 0x7f0db80cad20 2023-11-24T06:30:28.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0da40b2040 con 0x7f0db80cad20 2023-11-24T06:30:28.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.604+0000 7f0db57fa640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d9c066470 0x7f0d9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.608+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0da411dbf0 con 0x7f0db80cad20 2023-11-24T06:30:28.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.608+0000 7f0dbcb0e640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d9c066470 0x7f0d9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.608+0000 7f0dbcb0e640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d9c066470 0x7f0d9c068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dac000f70 tx=0x7f0dac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.608+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0da40eb3c0 con 0x7f0db80cad20 2023-11-24T06:30:28.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.812+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f0db809d250 con 0x7f0db80cad20 2023-11-24T06:30:28.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.812+0000 7f0db57fa640 1 -- 172.21.15.143:0/1569755926 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0da40b00a0 con 0x7f0db80cad20 2023-11-24T06:30:28.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d9c066470 msgr2=0x7f0d9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d9c066470 0x7f0d9c068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dac000f70 tx=0x7f0dac009040 comp rx=0 tx=0).stop 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 msgr2=0x7f0db80c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c4c70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0da4019e20 tx=0x7f0da4018f90 comp rx=0 tx=0).stop 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 shutdown_connections 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d9c066470 0x7f0d9c068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db815a4d0 0x7f0db8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0db80cad20 0x7f0db80c4c70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 --2- 172.21.15.143:0/1569755926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0db806d740 0x7f0db81582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 >> 172.21.15.143:0/1569755926 conn(0x7f0db80b0bf0 msgr2=0x7f0db80aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:28.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 shutdown_connections 2023-11-24T06:30:28.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.816+0000 7f0dbed72640 1 -- 172.21.15.143:0/1569755926 wait complete. 2023-11-24T06:30:28.842 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:28.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.972+0000 7fd1ce357640 1 Processor -- start 2023-11-24T06:30:28.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.972+0000 7fd1ce357640 1 -- start start 2023-11-24T06:30:28.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1ce357640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80d3020 0x7fd1c80d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1ce357640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1c80ce8b0 0x7fd1c80ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1ce357640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c806c0e0 con 0x7fd1c815d570 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1ce357640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80d39c0 con 0x7fd1c80ce8b0 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1ce357640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80d1cc0 con 0x7fd1c80d3020 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c7fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd1c815d570 0x7fd1c806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55054/0 (socket says 172.21.15.143:55054) 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c7fff640 1 -- 172.21.15.143:0/4131783192 learned_addr learned my addr 172.21.15.143:0/4131783192 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1cc8f4640 1 --2- 172.21.15.143:0/4131783192 >> v2:172.21.15.146:3300/0 conn(0x7fd1c80ce8b0 0x7fd1c80ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c77fe640 1 --2- 172.21.15.143:0/4131783192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80d3020 0x7fd1c80d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c6ffd640 1 -- 172.21.15.143:0/4131783192 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326290608 0 0) 0x7fd1c806c0e0 con 0x7fd1c815d570 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c6ffd640 1 -- 172.21.15.143:0/4131783192 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b0003530 con 0x7fd1c815d570 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c77fe640 1 -- 172.21.15.143:0/4131783192 >> v2:172.21.15.146:3300/0 conn(0x7fd1c80ce8b0 msgr2=0x7fd1c80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c77fe640 1 --2- 172.21.15.143:0/4131783192 >> v2:172.21.15.146:3300/0 conn(0x7fd1c80ce8b0 0x7fd1c80ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c77fe640 1 -- 172.21.15.143:0/4131783192 >> v1:172.21.15.143:6789/0 conn(0x7fd1c815d570 legacy=0x7fd1c806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1c77fe640 1 -- 172.21.15.143:0/4131783192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80d1fa0 con 0x7fd1c80d3020 2023-11-24T06:30:28.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.976+0000 7fd1cc8f4640 1 --2- 172.21.15.143:0/4131783192 >> v2:172.21.15.146:3300/0 conn(0x7fd1c80ce8b0 0x7fd1c80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:28.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1c77fe640 1 --2- 172.21.15.143:0/4131783192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80d3020 0x7fd1c80d3480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0097c0 tx=0x7fd1bc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60ccfa12df6711d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1c6ffd640 1 -- 172.21.15.143:0/4131783192 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0ab650 con 0x7fd1c80d3020 2023-11-24T06:30:28.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1c6ffd640 1 -- 172.21.15.143:0/4131783192 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0ab7b0 con 0x7fd1c80d3020 2023-11-24T06:30:28.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1c6ffd640 1 -- 172.21.15.143:0/4131783192 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0abb20 con 0x7fd1c80d3020 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 -- 172.21.15.143:0/4131783192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80d3020 msgr2=0x7fd1c80d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 --2- 172.21.15.143:0/4131783192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80d3020 0x7fd1c80d3480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0097c0 tx=0x7fd1bc01c450 comp rx=0 tx=0).stop 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 -- 172.21.15.143:0/4131783192 shutdown_connections 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 --2- 172.21.15.143:0/4131783192 >> v2:172.21.15.146:3300/0 conn(0x7fd1c80ce8b0 0x7fd1c80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 --2- 172.21.15.143:0/4131783192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80d3020 0x7fd1c80d3480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 -- 172.21.15.143:0/4131783192 >> 172.21.15.143:0/4131783192 conn(0x7fd1c808ceb0 msgr2=0x7fd1c809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 -- 172.21.15.143:0/4131783192 shutdown_connections 2023-11-24T06:30:28.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 -- 172.21.15.143:0/4131783192 wait complete. 2023-11-24T06:30:28.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 Processor -- start 2023-11-24T06:30:28.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.980+0000 7fd1ce357640 1 -- start start 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80ce8b0 0x7fd1c814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 0x7fd1c8160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1c815d570 0x7fd1c80b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c814f9d0 con 0x7fd1c80d3020 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80cb950 con 0x7fd1c815d570 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80cbc30 con 0x7fd1c80ce8b0 2023-11-24T06:30:28.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 0x7fd1c8160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 0x7fd1c8160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48226/0 (socket says 172.21.15.143:48226) 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 -- 172.21.15.143:0/1545166656 learned_addr learned my addr 172.21.15.143:0/1545166656 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c7fff640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80ce8b0 0x7fd1c814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1cc8f4640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1c815d570 0x7fd1c80b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 -- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80ce8b0 msgr2=0x7fd1c814f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80ce8b0 0x7fd1c814f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 -- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1c815d570 msgr2=0x7fd1c80b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1c815d570 0x7fd1c80b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 -- 172.21.15.143:0/1545166656 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0009a70 con 0x7fd1c80d3020 2023-11-24T06:30:28.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c7fff640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80ce8b0 0x7fd1c814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:28.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1cc8f4640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1c815d570 0x7fd1c80b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:28.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c77fe640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 0x7fd1c8160570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc01ccf0 tx=0x7fd1bc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0b5600 con 0x7fd1c80d3020 2023-11-24T06:30:28.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0b5760 con 0x7fd1c80d3020 2023-11-24T06:30:28.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0b5ad0 con 0x7fd1c80d3020 2023-11-24T06:30:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc009420 con 0x7fd1c80d3020 2023-11-24T06:30:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c80cc1f0 con 0x7fd1c80d3020 2023-11-24T06:30:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c8067520 con 0x7fd1c80d3020 2023-11-24T06:30:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.984+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1bc0b5c30 con 0x7fd1c80d3020 2023-11-24T06:30:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.988+0000 7fd1c4ff9640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1b40664a0 0x7fd1b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.988+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1bc11e6a0 con 0x7fd1c80d3020 2023-11-24T06:30:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.988+0000 7fd1c7fff640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1b40664a0 0x7fd1b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.988+0000 7fd1c7fff640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1b40664a0 0x7fd1b4068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8005890 tx=0x7fd1b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:28.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:28.992+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1bc0ebea0 con 0x7fd1c80d3020 2023-11-24T06:30:29.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.148+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1c806b7b0 con 0x7fd1c80d3020 2023-11-24T06:30:29.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.148+0000 7fd1c4ff9640 1 -- 172.21.15.143:0/1545166656 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12905 (secure 0 0 0) 0x7fd1bc0c4090 con 0x7fd1c80d3020 2023-11-24T06:30:29.155 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:29.156 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":28,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:26.134916+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1b40664a0 msgr2=0x7fd1b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1b40664a0 0x7fd1b4068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8005890 tx=0x7fd1b8009040 comp rx=0 tx=0).stop 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 msgr2=0x7fd1c8160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 0x7fd1c8160570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc01ccf0 tx=0x7fd1bc01ac90 comp rx=0 tx=0).stop 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 shutdown_connections 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1b40664a0 0x7fd1b4068960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1c815d570 0x7fd1c80b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1c80d3020 0x7fd1c8160570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 --2- 172.21.15.143:0/1545166656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1c80ce8b0 0x7fd1c814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 >> 172.21.15.143:0/1545166656 conn(0x7fd1c808ceb0 msgr2=0x7fd1c815c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:29.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 shutdown_connections 2023-11-24T06:30:29.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.152+0000 7fd1ce357640 1 -- 172.21.15.143:0/1545166656 wait complete. 2023-11-24T06:30:29.177 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:29.177 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:29.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 Processor -- start 2023-11-24T06:30:29.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 -- start start 2023-11-24T06:30:29.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700ae4a0 0x7fc57015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc5700cd850 0x7fc5700cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700b3510 con 0x7fc5700ce250 2023-11-24T06:30:29.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5700ce6e0 con 0x7fc5700cd850 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc5760c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700b37f0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc5700cd850 0x7fc5700cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc5700cd850 0x7fc5700cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48232/0 (socket says 172.21.15.143:48232) 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700ae4a0 0x7fc57015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 -- 172.21.15.143:0/1974007965 learned_addr learned my addr 172.21.15.143:0/1974007965 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 -- 172.21.15.143:0/1974007965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700ae4a0 msgr2=0x7fc57015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 --2- 172.21.15.143:0/1974007965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700ae4a0 0x7fc57015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 -- 172.21.15.143:0/1974007965 >> v1:172.21.15.146:6789/0 conn(0x7fc5700ce250 legacy=0x7fc57015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.312+0000 7fc56effd640 1 -- 172.21.15.143:0/1974007965 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700b3ad0 con 0x7fc5700cd850 2023-11-24T06:30:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc56effd640 1 --2- 172.21.15.143:0/1974007965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700cd850 0x7fc5700cdd10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc564009870 tx=0x7fc56401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5067ca7e5ad6b90 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc56e7fc640 1 -- 172.21.15.143:0/1974007965 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640aa670 con 0x7fc5700cd850 2023-11-24T06:30:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc56e7fc640 1 -- 172.21.15.143:0/1974007965 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640aa7d0 con 0x7fc5700cd850 2023-11-24T06:30:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc56e7fc640 1 -- 172.21.15.143:0/1974007965 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640aab60 con 0x7fc5700cd850 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 -- 172.21.15.143:0/1974007965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700cd850 msgr2=0x7fc5700cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 --2- 172.21.15.143:0/1974007965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700cd850 0x7fc5700cdd10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc564009870 tx=0x7fc56401c510 comp rx=0 tx=0).stop 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 -- 172.21.15.143:0/1974007965 shutdown_connections 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 --2- 172.21.15.143:0/1974007965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700cd850 0x7fc5700cdd10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 --2- 172.21.15.143:0/1974007965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700ae4a0 0x7fc57015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 -- 172.21.15.143:0/1974007965 >> 172.21.15.143:0/1974007965 conn(0x7fc5700b0c80 msgr2=0x7fc5700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 -- 172.21.15.143:0/1974007965 shutdown_connections 2023-11-24T06:30:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.316+0000 7fc5760c9640 1 -- 172.21.15.143:0/1974007965 wait complete. 2023-11-24T06:30:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 Processor -- start 2023-11-24T06:30:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 -- start start 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 0x7fc57014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700cd850 0x7fc57014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5700ce250 0x7fc570150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57009d0f0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc570151010 con 0x7fc5700ce250 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701512b0 con 0x7fc5700cd850 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 0x7fc57014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 0x7fc57014d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48236/0 (socket says 172.21.15.143:48236) 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 -- 172.21.15.143:0/4028153077 learned_addr learned my addr 172.21.15.143:0/4028153077 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56effd640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700cd850 0x7fc57014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 -- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700cd850 msgr2=0x7fc57014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700cd850 0x7fc57014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56ffff640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5700ce250 0x7fc570150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 -- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5700ce250 msgr2=0x7fc570150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5700ce250 0x7fc570150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 -- 172.21.15.143:0/4028153077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640094d0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56effd640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700cd850 0x7fc57014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56ffff640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5700ce250 0x7fc570150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc56f7fe640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 0x7fc57014d410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc56000e930 tx=0x7fc56000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560009690 con 0x7fc5700ae4a0 2023-11-24T06:30:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000ca00 con 0x7fc5700ae4a0 2023-11-24T06:30:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000cd70 con 0x7fc5700ae4a0 2023-11-24T06:30:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc570151590 con 0x7fc5700ae4a0 2023-11-24T06:30:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.320+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57014c2f0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.324+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5700b26a0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.324+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc560013470 con 0x7fc5700ae4a0 2023-11-24T06:30:29.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.324+0000 7fc557fff640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc55c066470 0x7fc55c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.324+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc560083d90 con 0x7fc5700ae4a0 2023-11-24T06:30:29.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.324+0000 7fc56effd640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc55c066470 0x7fc55c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.324+0000 7fc56effd640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc55c066470 0x7fc55c068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5640ae000 tx=0x7fc564008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.328+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc560051610 con 0x7fc5700ae4a0 2023-11-24T06:30:29.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc57004e8c0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc557fff640 1 -- 172.21.15.143:0/4028153077 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5600170a0 con 0x7fc5700ae4a0 2023-11-24T06:30:29.486 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc55c066470 msgr2=0x7fc55c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc55c066470 0x7fc55c068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5640ae000 tx=0x7fc564008040 comp rx=0 tx=0).stop 2023-11-24T06:30:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 msgr2=0x7fc57014d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 0x7fc57014d410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc56000e930 tx=0x7fc56000edf0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 shutdown_connections 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc55c066470 0x7fc55c068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5700ce250 0x7fc570150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5700cd850 0x7fc57014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 --2- 172.21.15.143:0/4028153077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5700ae4a0 0x7fc57014d410 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 >> 172.21.15.143:0/4028153077 conn(0x7fc5700b0c80 msgr2=0x7fc57015dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 shutdown_connections 2023-11-24T06:30:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.480+0000 7fc5760c9640 1 -- 172.21.15.143:0/4028153077 wait complete. 2023-11-24T06:30:29.507 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:30:29.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.636+0000 7fb18de79640 1 Processor -- start 2023-11-24T06:30:29.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb18de79640 1 -- start start 2023-11-24T06:30:29.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb18de79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb1880b36c0 0x7fb1880b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb18de79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18815a700 con 0x7fb18815a320 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb18de79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1880b2620 con 0x7fb188070da0 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb18de79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1880b2430 con 0x7fb1880b36c0 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb186ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb1880b36c0 0x7fb1880b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb1877fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb18815a320 0x7fb188070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55060/0 (socket says 172.21.15.143:55060) 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb1877fe640 1 -- 172.21.15.143:0/2866894463 learned_addr learned my addr 172.21.15.143:0/2866894463 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb186ffd640 1 -- 172.21.15.143:0/2866894463 >> v1:172.21.15.146:6789/0 conn(0x7fb188070da0 legacy=0x7fb18815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb186ffd640 1 -- 172.21.15.143:0/2866894463 >> v1:172.21.15.143:6789/0 conn(0x7fb18815a320 legacy=0x7fb188070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.640+0000 7fb186ffd640 1 -- 172.21.15.143:0/2866894463 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880b2900 con 0x7fb1880b36c0 2023-11-24T06:30:29.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb186ffd640 1 --2- 172.21.15.143:0/2866894463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1880b36c0 0x7fb1880b1ef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0097c0 tx=0x7fb17c01e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6856ebfaa415dfa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb1867fc640 1 -- 172.21.15.143:0/2866894463 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0af680 con 0x7fb1880b36c0 2023-11-24T06:30:29.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb1867fc640 1 -- 172.21.15.143:0/2866894463 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c0af7e0 con 0x7fb1880b36c0 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb1867fc640 1 -- 172.21.15.143:0/2866894463 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0afb70 con 0x7fb1880b36c0 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 -- 172.21.15.143:0/2866894463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1880b36c0 msgr2=0x7fb1880b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 --2- 172.21.15.143:0/2866894463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1880b36c0 0x7fb1880b1ef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0097c0 tx=0x7fb17c01e4f0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 -- 172.21.15.143:0/2866894463 shutdown_connections 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 --2- 172.21.15.143:0/2866894463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1880b36c0 0x7fb1880b1ef0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 -- 172.21.15.143:0/2866894463 >> 172.21.15.143:0/2866894463 conn(0x7fb1880b0bf0 msgr2=0x7fb1880b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 -- 172.21.15.143:0/2866894463 shutdown_connections 2023-11-24T06:30:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 -- 172.21.15.143:0/2866894463 wait complete. 2023-11-24T06:30:29.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 Processor -- start 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.644+0000 7fb18de79640 1 -- start start 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 0x7fb188159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1880b36c0 0x7fb18814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb18815a320 0x7fb188146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18814c3a0 con 0x7fb188070da0 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18814b4f0 con 0x7fb18815a320 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18814b720 con 0x7fb1880b36c0 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 0x7fb188159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 0x7fb188159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48264/0 (socket says 172.21.15.143:48264) 2023-11-24T06:30:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 -- 172.21.15.143:0/2175928856 learned_addr learned my addr 172.21.15.143:0/2175928856 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb186ffd640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1880b36c0 0x7fb18814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb187fff640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb18815a320 0x7fb188146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 -- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1880b36c0 msgr2=0x7fb18814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1880b36c0 0x7fb18814afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 -- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb18815a320 msgr2=0x7fb188146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb18815a320 0x7fb188146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 -- 172.21.15.143:0/2175928856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009420 con 0x7fb188070da0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb1877fe640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 0x7fb188159700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c7b0 tx=0x7fb17800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780072d0 con 0x7fb188070da0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb178007430 con 0x7fb188070da0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780047f0 con 0x7fb188070da0 2023-11-24T06:30:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18814ba00 con 0x7fb188070da0 2023-11-24T06:30:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18814bfc0 con 0x7fb188070da0 2023-11-24T06:30:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb188067520 con 0x7fb188070da0 2023-11-24T06:30:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.648+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb178004950 con 0x7fb188070da0 2023-11-24T06:30:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.652+0000 7fb16ffff640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb174066470 0x7fb174068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.652+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb178082f70 con 0x7fb188070da0 2023-11-24T06:30:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.652+0000 7fb186ffd640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb174066470 0x7fb174068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.652+0000 7fb186ffd640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb174066470 0x7fb174068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0b1000 tx=0x7fb17c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.656+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb178050730 con 0x7fb188070da0 2023-11-24T06:30:29.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb188147030 con 0x7fb188070da0 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb16ffff640 1 -- 172.21.15.143:0/2175928856 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb178018070 con 0x7fb188070da0 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:29.814 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb174066470 msgr2=0x7fb174068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb174066470 0x7fb174068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0b1000 tx=0x7fb17c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 msgr2=0x7fb188159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 0x7fb188159700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c7b0 tx=0x7fb17800cc70 comp rx=0 tx=0).stop 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 shutdown_connections 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb174066470 0x7fb174068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb18815a320 0x7fb188146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1880b36c0 0x7fb18814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 --2- 172.21.15.143:0/2175928856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb188070da0 0x7fb188159700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 >> 172.21.15.143:0/2175928856 conn(0x7fb1880b0bf0 msgr2=0x7fb1880b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 shutdown_connections 2023-11-24T06:30:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.808+0000 7fb18de79640 1 -- 172.21.15.143:0/2175928856 wait complete. 2023-11-24T06:30:29.835 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:30:29.835 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:30:29.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.968+0000 7fdcda1f5640 1 Processor -- start 2023-11-24T06:30:29.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcda1f5640 1 -- start start 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcda1f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdcd406c650 0x7fdcd409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcda1f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd406d8b0 con 0x7fdcd4144030 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcda1f5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd406cca0 con 0x7fdcd40709c0 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcda1f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd4145020 con 0x7fdcd406c650 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fdcd4144030 0x7fdcd406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55066/0 (socket says 172.21.15.143:55066) 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd37fe640 1 -- 172.21.15.143:0/94497598 learned_addr learned my addr 172.21.15.143:0/94497598 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd2ffd640 1 --2- 172.21.15.143:0/94497598 >> v2:172.21.15.143:3300/0 conn(0x7fdcd406c650 0x7fdcd409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd27fc640 1 -- 172.21.15.143:0/94497598 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076102229 0 0) 0x7fdcd406d8b0 con 0x7fdcd4144030 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd27fc640 1 -- 172.21.15.143:0/94497598 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcbc003530 con 0x7fdcd4144030 2023-11-24T06:30:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd2ffd640 1 -- 172.21.15.143:0/94497598 >> v1:172.21.15.146:6789/0 conn(0x7fdcd40709c0 legacy=0x7fdcd4070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd2ffd640 1 -- 172.21.15.143:0/94497598 >> v1:172.21.15.143:6789/0 conn(0x7fdcd4144030 legacy=0x7fdcd406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.972+0000 7fdcd2ffd640 1 -- 172.21.15.143:0/94497598 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd406cf80 con 0x7fdcd406c650 2023-11-24T06:30:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcd2ffd640 1 --2- 172.21.15.143:0/94497598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd409cc20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80097c0 tx=0x7fdcc801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a413ccf98fa711f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcd27fc640 1 -- 172.21.15.143:0/94497598 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80ab600 con 0x7fdcd406c650 2023-11-24T06:30:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcd27fc640 1 -- 172.21.15.143:0/94497598 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc80a7050 con 0x7fdcd406c650 2023-11-24T06:30:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcd27fc640 1 -- 172.21.15.143:0/94497598 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80ab960 con 0x7fdcd406c650 2023-11-24T06:30:29.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 -- 172.21.15.143:0/94497598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 msgr2=0x7fdcd409cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/94497598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd409cc20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80097c0 tx=0x7fdcc801c480 comp rx=0 tx=0).stop 2023-11-24T06:30:29.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 -- 172.21.15.143:0/94497598 shutdown_connections 2023-11-24T06:30:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/94497598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd409cc20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 -- 172.21.15.143:0/94497598 >> 172.21.15.143:0/94497598 conn(0x7fdcd40b0bf0 msgr2=0x7fdcd40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 -- 172.21.15.143:0/94497598 shutdown_connections 2023-11-24T06:30:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 -- 172.21.15.143:0/94497598 wait complete. 2023-11-24T06:30:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 Processor -- start 2023-11-24T06:30:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.976+0000 7fdcda1f5640 1 -- start start 2023-11-24T06:30:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd4137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd40709c0 0x7fdcd41595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcd4144030 0x7fdcd4152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41539a0 con 0x7fdcd406c650 2023-11-24T06:30:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b2f60 con 0x7fdcd40709c0 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4138390 con 0x7fdcd4144030 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd4137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd4137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48290/0 (socket says 172.21.15.143:48290) 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 -- 172.21.15.143:0/392986995 learned_addr learned my addr 172.21.15.143:0/392986995 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd3fff640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcd4144030 0x7fdcd4152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd2ffd640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd40709c0 0x7fdcd41595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 -- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcd4144030 msgr2=0x7fdcd4152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcd4144030 0x7fdcd4152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 -- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd40709c0 msgr2=0x7fdcd41595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd40709c0 0x7fdcd41595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 -- 172.21.15.143:0/392986995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8009420 con 0x7fdcd406c650 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcd37fe640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd4137e50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c450 tx=0x7fdcc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4005cf0 con 0x7fdcd406c650 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4005e50 con 0x7fdcd406c650 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4007270 con 0x7fdcd406c650 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40b2630 con 0x7fdcd406c650 2023-11-24T06:30:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd40b2bf0 con 0x7fdcd406c650 2023-11-24T06:30:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.980+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4067520 con 0x7fdcd406c650 2023-11-24T06:30:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.984+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcc40073d0 con 0x7fdcd406c650 2023-11-24T06:30:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.984+0000 7fdcbbfff640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdcc0066470 0x7fdcc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.984+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdcc4082e70 con 0x7fdcd406c650 2023-11-24T06:30:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.984+0000 7fdcd2ffd640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdcc0066470 0x7fdcc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.984+0000 7fdcd2ffd640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdcc0066470 0x7fdcc0068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80ad000 tx=0x7fdcc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:29.988+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcc4050780 con 0x7fdcd406c650 2023-11-24T06:30:30.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:30.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdcd409cdc0 con 0x7fdcd406c650 2023-11-24T06:30:31.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.136+0000 7fdcbbfff640 1 -- 172.21.15.143:0/392986995 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdcc4017020 con 0x7fdcd406c650 2023-11-24T06:30:31.144 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2023-11-24T06:30:31.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdcc0066470 msgr2=0x7fdcc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:31.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdcc0066470 0x7fdcc0068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80ad000 tx=0x7fdcc8008040 comp rx=0 tx=0).stop 2023-11-24T06:30:31.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 msgr2=0x7fdcd4137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:31.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd4137e50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c450 tx=0x7fdcc400c910 comp rx=0 tx=0).stop 2023-11-24T06:30:31.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 shutdown_connections 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdcc0066470 0x7fdcc0068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcd4144030 0x7fdcd4152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd40709c0 0x7fdcd41595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 --2- 172.21.15.143:0/392986995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcd406c650 0x7fdcd4137e50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 >> 172.21.15.143:0/392986995 conn(0x7fdcd40b0bf0 msgr2=0x7fdcd40abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 shutdown_connections 2023-11-24T06:30:31.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.144+0000 7fdcda1f5640 1 -- 172.21.15.143:0/392986995 wait complete. 2023-11-24T06:30:31.175 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:30:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.316+0000 7f1af22d3640 1 Processor -- start 2023-11-24T06:30:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.316+0000 7f1af22d3640 1 -- start start 2023-11-24T06:30:31.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af22d3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0b8ed0 0x7f1aec0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:31.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af22d3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1aec0cdf80 0x7f1aec0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:31.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af22d3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b6a30 con 0x7f1aec1608f0 2023-11-24T06:30:31.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af22d3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec160cd0 con 0x7f1aec0cdf80 2023-11-24T06:30:31.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af22d3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0b9310 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af1ad2640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1aec0cdf80 0x7f1aec0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af0ad0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0b8ed0 0x7f1aec0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af12d1640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1aec1608f0 0x7f1aec0b6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:34922/0 (socket says 172.21.15.143:34922) 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af12d1640 1 -- 172.21.15.143:0/3249852568 learned_addr learned my addr 172.21.15.143:0/3249852568 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1ae3fff640 1 -- 172.21.15.143:0/3249852568 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23540188 0 0) 0x7f1ae8001120 con 0x7f1aec1608f0 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1ae3fff640 1 -- 172.21.15.143:0/3249852568 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad8003530 con 0x7f1aec1608f0 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af1ad2640 1 -- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0b8ed0 msgr2=0x7f1aec0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af1ad2640 1 --2- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0b8ed0 0x7f1aec0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af1ad2640 1 -- 172.21.15.143:0/3249852568 >> v1:172.21.15.146:6789/0 conn(0x7f1aec1608f0 legacy=0x7f1aec0b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:31.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af1ad2640 1 -- 172.21.15.143:0/3249852568 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0ce950 con 0x7f1aec0cdf80 2023-11-24T06:30:31.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.320+0000 7f1af0ad0640 1 --2- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0b8ed0 0x7f1aec0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:30:31.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af1ad2640 1 --2- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec0cdf80 0x7f1aec0ce410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009d90 tx=0x7f1ae401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f1bc01a91722e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:31.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1ae3fff640 1 -- 172.21.15.143:0/3249852568 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40a59e0 con 0x7f1aec0cdf80 2023-11-24T06:30:31.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1ae3fff640 1 -- 172.21.15.143:0/3249852568 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae40a5b40 con 0x7f1aec0cdf80 2023-11-24T06:30:31.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1ae3fff640 1 -- 172.21.15.143:0/3249852568 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40ad440 con 0x7f1aec0cdf80 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 -- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec0cdf80 msgr2=0x7f1aec0ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 --2- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec0cdf80 0x7f1aec0ce410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009d90 tx=0x7f1ae401c920 comp rx=0 tx=0).stop 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 -- 172.21.15.143:0/3249852568 shutdown_connections 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 --2- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec0cdf80 0x7f1aec0ce410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 --2- 172.21.15.143:0/3249852568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0b8ed0 0x7f1aec0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 -- 172.21.15.143:0/3249852568 >> 172.21.15.143:0/3249852568 conn(0x7f1aec0613d0 msgr2=0x7f1aec0617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 -- 172.21.15.143:0/3249852568 shutdown_connections 2023-11-24T06:30:31.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 -- 172.21.15.143:0/3249852568 wait complete. 2023-11-24T06:30:31.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 Processor -- start 2023-11-24T06:30:31.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.324+0000 7f1af22d3640 1 -- start start 2023-11-24T06:30:31.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 0x7f1aec15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:31.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0cdf80 0x7f1aec0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:31.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1608f0 0x7f1aec14cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:31.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0b78f0 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec15ffd0 con 0x7f1aec1608f0 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec15fd20 con 0x7f1aec0cdf80 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 0x7f1aec15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 0x7f1aec15f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48298/0 (socket says 172.21.15.143:48298) 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 -- 172.21.15.143:0/2997707427 learned_addr learned my addr 172.21.15.143:0/2997707427 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af1ad2640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1608f0 0x7f1aec14cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af0ad0640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0cdf80 0x7f1aec0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 -- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0cdf80 msgr2=0x7f1aec0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0cdf80 0x7f1aec0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 -- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1608f0 msgr2=0x7f1aec14cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1608f0 0x7f1aec14cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 -- 172.21.15.143:0/2997707427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc009420 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af12d1640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 0x7f1aec15f7e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c500 tx=0x7f1ae800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8005cf0 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8005e50 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae4009a70 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8007310 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec157570 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec04e850 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.328+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ae8007470 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.332+0000 7f1ae1ffb640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ad0066470 0x7f1ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:31.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.332+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1ae8083130 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.332+0000 7f1af0ad0640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ad0066470 0x7f1ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.332+0000 7f1af0ad0640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ad0066470 0x7f1ad0068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0c6640 tx=0x7f1adc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:31.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.336+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ae8050820 con 0x7f1aec0b8ed0 2023-11-24T06:30:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:31.484+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1aec0b6a30 con 0x7f1aec0b8ed0 2023-11-24T06:30:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.140+0000 7f1ae1ffb640 1 -- 172.21.15.143:0/2997707427 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1aec0b6a30 con 0x7f1aec0b8ed0 2023-11-24T06:30:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2023-11-24T06:30:32.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ad0066470 msgr2=0x7f1ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ad0066470 0x7f1ad0068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0c6640 tx=0x7f1adc008040 comp rx=0 tx=0).stop 2023-11-24T06:30:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 msgr2=0x7f1aec15f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 0x7f1aec15f7e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c500 tx=0x7f1ae800c9c0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 shutdown_connections 2023-11-24T06:30:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ad0066470 0x7f1ad0068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1608f0 0x7f1aec14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1aec0cdf80 0x7f1aec0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 --2- 172.21.15.143:0/2997707427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1aec0b8ed0 0x7f1aec15f7e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 >> 172.21.15.143:0/2997707427 conn(0x7f1aec0613d0 msgr2=0x7f1aec15ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 shutdown_connections 2023-11-24T06:30:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.144+0000 7f1af22d3640 1 -- 172.21.15.143:0/2997707427 wait complete. 2023-11-24T06:30:32.197 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:30:32.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb752ae4640 1 Processor -- start 2023-11-24T06:30:32.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb752ae4640 1 -- start start 2023-11-24T06:30:32.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb752ae4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb74c0cd850 0x7fb74c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:32.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb752ae4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74c0b3510 con 0x7fb74c0ce420 2023-11-24T06:30:32.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb752ae4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74c0b37f0 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb752ae4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74c0b3ad0 con 0x7fb74c0cd850 2023-11-24T06:30:32.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb743fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb74c0ce420 0x7fb74c06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55080/0 (socket says 172.21.15.143:55080) 2023-11-24T06:30:32.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.332+0000 7fb751081640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb74c0cd850 0x7fb74c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:32.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb743fff640 1 -- 172.21.15.143:0/4226088616 learned_addr learned my addr 172.21.15.143:0/4226088616 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:32.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb751081640 1 -- 172.21.15.143:0/4226088616 >> v1:172.21.15.146:6789/0 conn(0x7fb74c0ae4a0 legacy=0x7fb74c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb7437fe640 1 -- 172.21.15.143:0/4226088616 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936081823 0 0) 0x7fb74c0b3510 con 0x7fb74c0ce420 2023-11-24T06:30:32.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb751081640 1 -- 172.21.15.143:0/4226088616 >> v1:172.21.15.143:6789/0 conn(0x7fb74c0ce420 legacy=0x7fb74c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb751081640 1 -- 172.21.15.143:0/4226088616 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c0b3db0 con 0x7fb74c0cd850 2023-11-24T06:30:32.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb751081640 1 --2- 172.21.15.143:0/4226088616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0cd850 0x7fb74c15ba00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb744009d90 tx=0x7fb74401c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd33f18d85dce50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:32.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb7437fe640 1 -- 172.21.15.143:0/4226088616 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a5830 con 0x7fb74c0cd850 2023-11-24T06:30:32.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb7437fe640 1 -- 172.21.15.143:0/4226088616 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440a5990 con 0x7fb74c0cd850 2023-11-24T06:30:32.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.336+0000 7fb7437fe640 1 -- 172.21.15.143:0/4226088616 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a5d20 con 0x7fb74c0cd850 2023-11-24T06:30:32.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- 172.21.15.143:0/4226088616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0cd850 msgr2=0x7fb74c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 --2- 172.21.15.143:0/4226088616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0cd850 0x7fb74c15ba00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb744009d90 tx=0x7fb74401c7d0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- 172.21.15.143:0/4226088616 shutdown_connections 2023-11-24T06:30:32.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 --2- 172.21.15.143:0/4226088616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0cd850 0x7fb74c15ba00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- 172.21.15.143:0/4226088616 >> 172.21.15.143:0/4226088616 conn(0x7fb74c0b0c80 msgr2=0x7fb74c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:32.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- 172.21.15.143:0/4226088616 shutdown_connections 2023-11-24T06:30:32.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- 172.21.15.143:0/4226088616 wait complete. 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 Processor -- start 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- start start 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 0x7fb74c09cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb74c0cd850 0x7fb74c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb74c0ce420 0x7fb74c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c152f80 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c15cfe0 con 0x7fb74c0ce420 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb752ae4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c148930 con 0x7fb74c0cd850 2023-11-24T06:30:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 0x7fb74c09cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 0x7fb74c09cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48314/0 (socket says 172.21.15.143:48314) 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 -- 172.21.15.143:0/2159903653 learned_addr learned my addr 172.21.15.143:0/2159903653 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb751081640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb74c0ce420 0x7fb74c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb743fff640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb74c0cd850 0x7fb74c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 -- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb74c0cd850 msgr2=0x7fb74c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb74c0cd850 0x7fb74c0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 -- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb74c0ce420 msgr2=0x7fb74c1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb74c0ce420 0x7fb74c1522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb750880640 1 -- 172.21.15.143:0/2159903653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009a70 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.340+0000 7fb751081640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb74c0ce420 0x7fb74c1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:32.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb750880640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 0x7fb74c09cd80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c750 tx=0x7fb74800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748005280 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7480053e0 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c1529c0 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800a880 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c15cc70 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c15cad0 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb74800a9e0 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb7417fa640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb738066470 0x7fb738068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb748083650 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.344+0000 7fb743fff640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb738066470 0x7fb738068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.348+0000 7fb743fff640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb738066470 0x7fb738068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb74c15e790 tx=0x7fb73c007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:32.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.352+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb74c15cad0 con 0x7fb74c0ae4a0 2023-11-24T06:30:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:32.528+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb74c15cad0 con 0x7fb74c0ae4a0 2023-11-24T06:30:33.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.180+0000 7fb7417fa640 1 -- 172.21.15.143:0/2159903653 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb74c15cad0 con 0x7fb74c0ae4a0 2023-11-24T06:30:33.187 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T06:30:33.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb738066470 msgr2=0x7fb738068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb738066470 0x7fb738068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb74c15e790 tx=0x7fb73c007d10 comp rx=0 tx=0).stop 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 msgr2=0x7fb74c09cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 0x7fb74c09cd80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c750 tx=0x7fb74800cc10 comp rx=0 tx=0).stop 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 shutdown_connections 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb738066470 0x7fb738068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb74c0ce420 0x7fb74c1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb74c0cd850 0x7fb74c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 --2- 172.21.15.143:0/2159903653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb74c0ae4a0 0x7fb74c09cd80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 >> 172.21.15.143:0/2159903653 conn(0x7fb74c0b0c80 msgr2=0x7fb74c15baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:33.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.184+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 shutdown_connections 2023-11-24T06:30:33.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.188+0000 7fb752ae4640 1 -- 172.21.15.143:0/2159903653 wait complete. 2023-11-24T06:30:33.222 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:33.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed06db8640 1 Processor -- start 2023-11-24T06:30:33.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed06db8640 1 -- start start 2023-11-24T06:30:33.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed06db8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed000cee20 0x7fed001682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed06db8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0006d050 con 0x7fed000b25c0 2023-11-24T06:30:33.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed06db8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0006c720 con 0x7fed0015d720 2023-11-24T06:30:33.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed06db8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed000d2240 con 0x7fed000cee20 2023-11-24T06:30:33.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecfffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fed000b25c0 0x7fed000d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55096/0 (socket says 172.21.15.143:55096) 2023-11-24T06:30:33.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecfffff640 1 -- 172.21.15.143:0/3994199485 learned_addr learned my addr 172.21.15.143:0/3994199485 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:33.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fed05355640 1 --2- 172.21.15.143:0/3994199485 >> v2:172.21.15.146:3300/0 conn(0x7fed000cee20 0x7fed001682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804918209 0 0) 0x7fed0006d050 con 0x7fed000b25c0 2023-11-24T06:30:33.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf0003530 con 0x7fed000b25c0 2023-11-24T06:30:33.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401851041 0 0) 0x7fed0006c720 con 0x7fed0015d720 2023-11-24T06:30:33.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed0006d050 con 0x7fed0015d720 2023-11-24T06:30:33.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612757895 0 0) 0x7fecf0003530 con 0x7fed000b25c0 2023-11-24T06:30:33.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 >> v2:172.21.15.146:3300/0 conn(0x7fed000cee20 msgr2=0x7fed001682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:33.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 --2- 172.21.15.143:0/3994199485 >> v2:172.21.15.146:3300/0 conn(0x7fed000cee20 0x7fed001682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 >> v1:172.21.15.146:6789/0 conn(0x7fed0015d720 legacy=0x7fed000d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0006ca00 con 0x7fed000b25c0 2023-11-24T06:30:33.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fecec001680 con 0x7fed000b25c0 2023-11-24T06:30:33.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 >> v1:172.21.15.143:6789/0 conn(0x7fed000b25c0 legacy=0x7fed000d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fecf0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf00047d0 0x7fecf0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf0005190 0x7fecf000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000d2240 con 0x7fecf0003b10 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf000c010 con 0x7fecf00047d0 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.356+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf000c1d0 con 0x7fecf0005190 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fecf0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fecfffff640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf00047d0 0x7fecf0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed05355640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf0005190 0x7fecf000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 -- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf0005190 msgr2=0x7fecf000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:33.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf0005190 0x7fecf000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 -- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf00047d0 msgr2=0x7fecf0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:33.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf00047d0 0x7fecf0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 -- 172.21.15.143:0/3994199485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0003530 con 0x7fecf0003b10 2023-11-24T06:30:33.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed05355640 1 -- 172.21.15.143:0/3994199485 reap_dead start 2023-11-24T06:30:33.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed04b54640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fecf0003f10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fecf40018d0 tx=0x7fecf401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb52c5b0c157b54 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:33.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40052d0 con 0x7fecf0003b10 2023-11-24T06:30:33.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40a7050 con 0x7fecf0003b10 2023-11-24T06:30:33.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fecff7fe640 1 -- 172.21.15.143:0/3994199485 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4003600 con 0x7fecf0003b10 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed06db8640 1 -- 172.21.15.143:0/3994199485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 msgr2=0x7fecf0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.360+0000 7fed06db8640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fecf0003f10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fecf40018d0 tx=0x7fecf401c500 comp rx=0 tx=0).stop 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- 172.21.15.143:0/3994199485 shutdown_connections 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 --2- 172.21.15.143:0/3994199485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fecf0003f10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- 172.21.15.143:0/3994199485 >> 172.21.15.143:0/3994199485 conn(0x7fed0008af70 msgr2=0x7fed0009c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- 172.21.15.143:0/3994199485 shutdown_connections 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- 172.21.15.143:0/3994199485 wait complete. 2023-11-24T06:30:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 Processor -- start 2023-11-24T06:30:33.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- start start 2023-11-24T06:30:33.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fed00157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed000b7b30 0x7fed000b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed000b13f0 0x7fed000b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000b1db0 con 0x7fecf0003b10 2023-11-24T06:30:33.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed001f65c0 con 0x7fed000b7b30 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed06db8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed00158150 con 0x7fed000b13f0 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fed00157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fed00157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48338/0 (socket says 172.21.15.143:48338) 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 -- 172.21.15.143:0/3762905677 learned_addr learned my addr 172.21.15.143:0/3762905677 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fecfffff640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed000b7b30 0x7fed000b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed05355640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed000b13f0 0x7fed000b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 -- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed000b13f0 msgr2=0x7fed000b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed000b13f0 0x7fed000b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 -- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed000b7b30 msgr2=0x7fed000b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed000b7b30 0x7fed000b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fed04b54640 1 -- 172.21.15.143:0/3762905677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000b68b0 con 0x7fecf0003b10 2023-11-24T06:30:33.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.364+0000 7fecfffff640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed000b7b30 0x7fed000b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:33.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fed04b54640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fed00157c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fecf40018d0 tx=0x7fecf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:33.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40069e0 con 0x7fecf0003b10 2023-11-24T06:30:33.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf4006b40 con 0x7fecf0003b10 2023-11-24T06:30:33.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4007030 con 0x7fecf0003b10 2023-11-24T06:30:33.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed000b6b90 con 0x7fecf0003b10 2023-11-24T06:30:33.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed000b7150 con 0x7fecf0003b10 2023-11-24T06:30:33.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed001f63f0 con 0x7fecf0003b10 2023-11-24T06:30:33.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecf4007190 con 0x7fecf0003b10 2023-11-24T06:30:33.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfd7fa640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fece40664a0 0x7fece4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecf411d270 con 0x7fecf0003b10 2023-11-24T06:30:33.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.368+0000 7fecfffff640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fece40664a0 0x7fece4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.372+0000 7fecfffff640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fece40664a0 0x7fece4068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fecec001060 tx=0x7fecec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:33.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.372+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fecf40ea5c0 con 0x7fecf0003b10 2023-11-24T06:30:33.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed00067520 con 0x7fecf0003b10 2023-11-24T06:30:33.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fecfd7fa640 1 -- 172.21.15.143:0/3762905677 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16630 (secure 0 0 0) 0x7fecf40bc020 con 0x7fecf0003b10 2023-11-24T06:30:33.534 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:33.534 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":31,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:32.534708+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:33.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fece40664a0 msgr2=0x7fece4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fece40664a0 0x7fece4068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fecec001060 tx=0x7fecec009040 comp rx=0 tx=0).stop 2023-11-24T06:30:33.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 msgr2=0x7fed00157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fed00157c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fecf40018d0 tx=0x7fecf0005800 comp rx=0 tx=0).stop 2023-11-24T06:30:33.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 shutdown_connections 2023-11-24T06:30:33.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fece40664a0 0x7fece4068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed000b13f0 0x7fed000b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed000b7b30 0x7fed000b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 --2- 172.21.15.143:0/3762905677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fecf0003b10 0x7fed00157c10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 >> 172.21.15.143:0/3762905677 conn(0x7fed0008af70 msgr2=0x7fed000cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:33.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 shutdown_connections 2023-11-24T06:30:33.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.528+0000 7fed06db8640 1 -- 172.21.15.143:0/3762905677 wait complete. 2023-11-24T06:30:33.556 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:33.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.684+0000 7fd386ce4640 1 Processor -- start 2023-11-24T06:30:33.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd386ce4640 1 -- start start 2023-11-24T06:30:33.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd386ce4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd38015a320 0x7fd3800b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd386ce4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd380070da0 0x7fd3800711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd386ce4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38015a700 con 0x7fd3800b36c0 2023-11-24T06:30:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd386ce4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800b2430 con 0x7fd380070da0 2023-11-24T06:30:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd386ce4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800b2620 con 0x7fd38015a320 2023-11-24T06:30:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd380070da0 0x7fd3800711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd380070da0 0x7fd3800711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48352/0 (socket says 172.21.15.143:48352) 2023-11-24T06:30:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 -- 172.21.15.143:0/1781651043 learned_addr learned my addr 172.21.15.143:0/1781651043 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:33.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd384a80640 1 --2- 172.21.15.143:0/1781651043 >> v2:172.21.15.146:3300/0 conn(0x7fd38015a320 0x7fd3800b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 -- 172.21.15.143:0/1781651043 >> v2:172.21.15.146:3300/0 conn(0x7fd38015a320 msgr2=0x7fd3800b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:33.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 --2- 172.21.15.143:0/1781651043 >> v2:172.21.15.146:3300/0 conn(0x7fd38015a320 0x7fd3800b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 -- 172.21.15.143:0/1781651043 >> v1:172.21.15.146:6789/0 conn(0x7fd3800b36c0 legacy=0x7fd380070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:33.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.688+0000 7fd385281640 1 -- 172.21.15.143:0/1781651043 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800b2900 con 0x7fd380070da0 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd385281640 1 --2- 172.21.15.143:0/1781651043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd380070da0 0x7fd3800711f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd38006c0c0 tx=0x7fd37801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843393499b4982e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd3777fe640 1 -- 172.21.15.143:0/1781651043 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a5860 con 0x7fd380070da0 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd3777fe640 1 -- 172.21.15.143:0/1781651043 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780a59c0 con 0x7fd380070da0 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd3777fe640 1 -- 172.21.15.143:0/1781651043 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a5d50 con 0x7fd380070da0 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 -- 172.21.15.143:0/1781651043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd380070da0 msgr2=0x7fd3800711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 --2- 172.21.15.143:0/1781651043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd380070da0 0x7fd3800711f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd38006c0c0 tx=0x7fd37801c9a0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 -- 172.21.15.143:0/1781651043 shutdown_connections 2023-11-24T06:30:33.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 --2- 172.21.15.143:0/1781651043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd380070da0 0x7fd3800711f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 --2- 172.21.15.143:0/1781651043 >> v2:172.21.15.146:3300/0 conn(0x7fd38015a320 0x7fd3800b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 -- 172.21.15.143:0/1781651043 >> 172.21.15.143:0/1781651043 conn(0x7fd3800b0bf0 msgr2=0x7fd3800b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:33.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 -- 172.21.15.143:0/1781651043 shutdown_connections 2023-11-24T06:30:33.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 -- 172.21.15.143:0/1781651043 wait complete. 2023-11-24T06:30:33.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 Processor -- start 2023-11-24T06:30:33.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.692+0000 7fd386ce4640 1 -- start start 2023-11-24T06:30:33.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380070da0 0x7fd380152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 0x7fd38014da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38015a320 0x7fd380163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380157ab0 con 0x7fd3800b36c0 2023-11-24T06:30:33.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380157d90 con 0x7fd380070da0 2023-11-24T06:30:33.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd380153010 con 0x7fd38015a320 2023-11-24T06:30:33.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 0x7fd38014da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd384a80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380070da0 0x7fd380152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 0x7fd38014da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48354/0 (socket says 172.21.15.143:48354) 2023-11-24T06:30:33.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 -- 172.21.15.143:0/205932395 learned_addr learned my addr 172.21.15.143:0/205932395 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:33.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd385281640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38015a320 0x7fd380163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 -- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38015a320 msgr2=0x7fd380163310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38015a320 0x7fd380163310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 -- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380070da0 msgr2=0x7fd380152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380070da0 0x7fd380152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 -- 172.21.15.143:0/205932395 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd378009b30 con 0x7fd3800b36c0 2023-11-24T06:30:33.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd377fff640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 0x7fd38014da80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd37000c530 tx=0x7fd37000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:33.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370005220 con 0x7fd3800b36c0 2023-11-24T06:30:33.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370005380 con 0x7fd3800b36c0 2023-11-24T06:30:33.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370007270 con 0x7fd3800b36c0 2023-11-24T06:30:33.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380153290 con 0x7fd3800b36c0 2023-11-24T06:30:33.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd380153850 con 0x7fd3800b36c0 2023-11-24T06:30:33.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.696+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380067520 con 0x7fd3800b36c0 2023-11-24T06:30:33.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.700+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3700073d0 con 0x7fd3800b36c0 2023-11-24T06:30:33.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.700+0000 7fd3757fa640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd36c066470 0x7fd36c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:33.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.700+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3700835c0 con 0x7fd3800b36c0 2023-11-24T06:30:33.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.700+0000 7fd384a80640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd36c066470 0x7fd36c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:33.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.700+0000 7fd384a80640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd36c066470 0x7fd36c068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0079c0 tx=0x7fd37c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:33.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.704+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd370050b60 con 0x7fd3800b36c0 2023-11-24T06:30:33.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.852+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd380152550 con 0x7fd3800b36c0 2023-11-24T06:30:33.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd3757fa640 1 -- 172.21.15.143:0/205932395 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16630 (secure 0 0 0) 0x7fd370054180 con 0x7fd3800b36c0 2023-11-24T06:30:33.862 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:33.862 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":31,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:32.534708+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd36c066470 msgr2=0x7fd36c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd36c066470 0x7fd36c068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0079c0 tx=0x7fd37c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 msgr2=0x7fd38014da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 0x7fd38014da80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd37000c530 tx=0x7fd37000c9f0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 shutdown_connections 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd36c066470 0x7fd36c068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38015a320 0x7fd380163310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3800b36c0 0x7fd38014da80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 --2- 172.21.15.143:0/205932395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380070da0 0x7fd380152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:33.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 >> 172.21.15.143:0/205932395 conn(0x7fd3800b0bf0 msgr2=0x7fd3800b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:33.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 shutdown_connections 2023-11-24T06:30:33.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:33.856+0000 7fd386ce4640 1 -- 172.21.15.143:0/205932395 wait complete. 2023-11-24T06:30:33.883 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:30:34.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.016+0000 7fc49fb0f640 1 Processor -- start 2023-11-24T06:30:34.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.016+0000 7fc49fb0f640 1 -- start start 2023-11-24T06:30:34.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.016+0000 7fc49fb0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4981624f0 0x7fc4981628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:34.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49fb0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4980723c0 con 0x7fc4980ccef0 2023-11-24T06:30:34.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49fb0f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4980726a0 con 0x7fc4980cd380 2023-11-24T06:30:34.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49fb0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc498072980 con 0x7fc4981624f0 2023-11-24T06:30:34.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d8ab640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4981624f0 0x7fc4981628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:34.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d0aa640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc4980ccef0 0x7fc498071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55110/0 (socket says 172.21.15.143:55110) 2023-11-24T06:30:34.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d0aa640 1 -- 172.21.15.143:0/1909444224 learned_addr learned my addr 172.21.15.143:0/1909444224 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:34.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d8ab640 1 -- 172.21.15.143:0/1909444224 >> v1:172.21.15.146:6789/0 conn(0x7fc4980cd380 legacy=0x7fc4980cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:34.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d8ab640 1 -- 172.21.15.143:0/1909444224 >> v1:172.21.15.143:6789/0 conn(0x7fc4980ccef0 legacy=0x7fc498071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:34.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d8ab640 1 -- 172.21.15.143:0/1909444224 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49806c7e0 con 0x7fc4981624f0 2023-11-24T06:30:34.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49d8ab640 1 --2- 172.21.15.143:0/1909444224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4981624f0 0x7fc4981628d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097c0 tx=0x7fc49401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc552e28a76ed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:34.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49c8a9640 1 -- 172.21.15.143:0/1909444224 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940ad660 con 0x7fc4981624f0 2023-11-24T06:30:34.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49c8a9640 1 -- 172.21.15.143:0/1909444224 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4940ad7c0 con 0x7fc4981624f0 2023-11-24T06:30:34.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.020+0000 7fc49c8a9640 1 -- 172.21.15.143:0/1909444224 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940adb50 con 0x7fc4981624f0 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- 172.21.15.143:0/1909444224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4981624f0 msgr2=0x7fc4981628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/1909444224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4981624f0 0x7fc4981628d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097c0 tx=0x7fc49401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- 172.21.15.143:0/1909444224 shutdown_connections 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/1909444224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4981624f0 0x7fc4981628d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- 172.21.15.143:0/1909444224 >> 172.21.15.143:0/1909444224 conn(0x7fc4980b0c80 msgr2=0x7fc4980b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- 172.21.15.143:0/1909444224 shutdown_connections 2023-11-24T06:30:34.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- 172.21.15.143:0/1909444224 wait complete. 2023-11-24T06:30:34.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 Processor -- start 2023-11-24T06:30:34.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- start start 2023-11-24T06:30:34.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 0x7fc49814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:34.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4980cd380 0x7fc4981506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:34.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4981624f0 0x7fc4981643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:34.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49814fb00 con 0x7fc4980ccef0 2023-11-24T06:30:34.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498152040 con 0x7fc4980cd380 2023-11-24T06:30:34.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49fb0f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc498150c20 con 0x7fc4981624f0 2023-11-24T06:30:34.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49d8ab640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 0x7fc49814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:34.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49d8ab640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 0x7fc49814b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48372/0 (socket says 172.21.15.143:48372) 2023-11-24T06:30:34.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49d8ab640 1 -- 172.21.15.143:0/316901485 learned_addr learned my addr 172.21.15.143:0/316901485 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:34.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49e0ac640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4981624f0 0x7fc4981643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:34.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.024+0000 7fc49d0aa640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4980cd380 0x7fc4981506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:34.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d8ab640 1 -- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4981624f0 msgr2=0x7fc4981643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:34.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d8ab640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4981624f0 0x7fc4981643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:34.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d8ab640 1 -- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4980cd380 msgr2=0x7fc4981506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:34.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d8ab640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4980cd380 0x7fc4981506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:34.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d8ab640 1 -- 172.21.15.143:0/316901485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009420 con 0x7fc4980ccef0 2023-11-24T06:30:34.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d0aa640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4980cd380 0x7fc4981506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:34.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d8ab640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 0x7fc49814b7f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc4940b0040 tx=0x7fc49401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:34.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940b9650 con 0x7fc4980ccef0 2023-11-24T06:30:34.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4940b97d0 con 0x7fc4980ccef0 2023-11-24T06:30:34.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940b9b80 con 0x7fc4980ccef0 2023-11-24T06:30:34.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc498152250 con 0x7fc4980ccef0 2023-11-24T06:30:34.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc498152810 con 0x7fc4980ccef0 2023-11-24T06:30:34.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49804e8c0 con 0x7fc4980ccef0 2023-11-24T06:30:34.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4940b9ce0 con 0x7fc4980ccef0 2023-11-24T06:30:34.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc48e7fc640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc47c066470 0x7fc47c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:34.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc49411ea60 con 0x7fc4980ccef0 2023-11-24T06:30:34.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.028+0000 7fc49d0aa640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc47c066470 0x7fc47c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:34.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.032+0000 7fc49d0aa640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc47c066470 0x7fc47c068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc488005890 tx=0x7fc488009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:34.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.032+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4940ebed0 con 0x7fc4980ccef0 2023-11-24T06:30:34.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:34.216+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc498098db0 con 0x7fc4980ccef0 2023-11-24T06:30:35.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc48e7fc640 1 -- 172.21.15.143:0/316901485 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc4940ef4f0 con 0x7fc4980ccef0 2023-11-24T06:30:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc47c066470 msgr2=0x7fc47c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc47c066470 0x7fc47c068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc488005890 tx=0x7fc488009040 comp rx=0 tx=0).stop 2023-11-24T06:30:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 msgr2=0x7fc49814b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 0x7fc49814b7f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc4940b0040 tx=0x7fc49401ac00 comp rx=0 tx=0).stop 2023-11-24T06:30:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 shutdown_connections 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc47c066470 0x7fc47c068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4981624f0 0x7fc4981643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4980cd380 0x7fc4981506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 --2- 172.21.15.143:0/316901485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4980ccef0 0x7fc49814b7f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 >> 172.21.15.143:0/316901485 conn(0x7fc4980b0c80 msgr2=0x7fc498165c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 shutdown_connections 2023-11-24T06:30:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.204+0000 7fc49fb0f640 1 -- 172.21.15.143:0/316901485 wait complete. 2023-11-24T06:30:35.235 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:30:35.235 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:30:35.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.372+0000 7fd142e32640 1 Processor -- start 2023-11-24T06:30:35.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.372+0000 7fd142e32640 1 -- start start 2023-11-24T06:30:35.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd142e32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd13c0b1f80 0x7fd13c0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd142e32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c070f00 con 0x7fd13c15ec60 2023-11-24T06:30:35.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd142e32640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c071170 con 0x7fd13c15a290 2023-11-24T06:30:35.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd142e32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0cb690 con 0x7fd13c0b1f80 2023-11-24T06:30:35.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd133fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd13c15ec60 0x7fd13c0cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55116/0 (socket says 172.21.15.143:55116) 2023-11-24T06:30:35.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd133fff640 1 -- 172.21.15.143:0/421245950 learned_addr learned my addr 172.21.15.143:0/421245950 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:35.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1413cf640 1 --2- 172.21.15.143:0/421245950 >> v2:172.21.15.146:3300/0 conn(0x7fd13c0b1f80 0x7fd13c0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525070188 0 0) 0x7fd13c070f00 con 0x7fd13c15ec60 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd124003530 con 0x7fd13c15ec60 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769857839 0 0) 0x7fd13c071170 con 0x7fd13c15a290 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd13c070f00 con 0x7fd13c15a290 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614034369 0 0) 0x7fd124003530 con 0x7fd13c15ec60 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 >> v2:172.21.15.146:3300/0 conn(0x7fd13c0b1f80 msgr2=0x7fd13c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 --2- 172.21.15.143:0/421245950 >> v2:172.21.15.146:3300/0 conn(0x7fd13c0b1f80 0x7fd13c0b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 >> v1:172.21.15.146:6789/0 conn(0x7fd13c15a290 legacy=0x7fd13c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0cb970 con 0x7fd13c15ec60 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fd12c001680 con 0x7fd13c15ec60 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 >> v1:172.21.15.143:6789/0 conn(0x7fd13c15ec60 legacy=0x7fd13c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd124003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1240047d0 0x7fd124004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1240051e0 0x7fd12400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0cb690 con 0x7fd124003b60 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12400c110 con 0x7fd1240051e0 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12400c2d0 con 0x7fd1240047d0 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd140bce640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd124003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1413cf640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1240051e0 0x7fd12400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd133fff640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1240047d0 0x7fd124004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd140bce640 1 -- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1240047d0 msgr2=0x7fd124004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd140bce640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1240047d0 0x7fd124004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd140bce640 1 -- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1240051e0 msgr2=0x7fd12400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd140bce640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1240051e0 0x7fd12400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd140bce640 1 -- 172.21.15.143:0/421245950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124003530 con 0x7fd124003b60 2023-11-24T06:30:35.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.376+0000 7fd1413cf640 1 -- 172.21.15.143:0/421245950 reap_dead start 2023-11-24T06:30:35.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd140bce640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd124003f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1380018d0 tx=0x7fd13801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6ffb95121eb416 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:35.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380052d0 con 0x7fd124003b60 2023-11-24T06:30:35.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1380a7050 con 0x7fd124003b60 2023-11-24T06:30:35.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd1337fe640 1 -- 172.21.15.143:0/421245950 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138003600 con 0x7fd124003b60 2023-11-24T06:30:35.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 -- 172.21.15.143:0/421245950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 msgr2=0x7fd124003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd124003f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1380018d0 tx=0x7fd13801c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 -- 172.21.15.143:0/421245950 shutdown_connections 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 --2- 172.21.15.143:0/421245950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd124003f60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 -- 172.21.15.143:0/421245950 >> 172.21.15.143:0/421245950 conn(0x7fd13c0b0c80 msgr2=0x7fd13c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 -- 172.21.15.143:0/421245950 shutdown_connections 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.380+0000 7fd142e32640 1 -- 172.21.15.143:0/421245950 wait complete. 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 Processor -- start 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 -- start start 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd13c0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13c158370 0x7fd13c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13c155550 0x7fd13c099320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0c9230 con 0x7fd124003b60 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0c94b0 con 0x7fd13c155550 2023-11-24T06:30:35.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0c9790 con 0x7fd13c158370 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd13c0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd13c0ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48396/0 (socket says 172.21.15.143:48396) 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 -- 172.21.15.143:0/4188094923 learned_addr learned my addr 172.21.15.143:0/4188094923 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd133fff640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13c158370 0x7fd13c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd1413cf640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13c155550 0x7fd13c099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 -- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13c158370 msgr2=0x7fd13c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13c158370 0x7fd13c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 -- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13c155550 msgr2=0x7fd13c099320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13c155550 0x7fd13c099320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 -- 172.21.15.143:0/4188094923 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0c9a70 con 0x7fd124003b60 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd140bce640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd13c0ca550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1380ad040 tx=0x7fd124005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380069e0 con 0x7fd124003b60 2023-11-24T06:30:35.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138006b40 con 0x7fd124003b60 2023-11-24T06:30:35.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138007030 con 0x7fd124003b60 2023-11-24T06:30:35.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c0c9d50 con 0x7fd124003b60 2023-11-24T06:30:35.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.384+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c1559d0 con 0x7fd124003b60 2023-11-24T06:30:35.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.388+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c04e8c0 con 0x7fd124003b60 2023-11-24T06:30:35.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.388+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd138007190 con 0x7fd124003b60 2023-11-24T06:30:35.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.388+0000 7fd1317fa640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd128066470 0x7fd128068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:35.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.388+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd13811cff0 con 0x7fd124003b60 2023-11-24T06:30:35.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.388+0000 7fd133fff640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd128066470 0x7fd128068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:35.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.388+0000 7fd133fff640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd128066470 0x7fd128068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd12c001ec0 tx=0x7fd12c007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:35.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.392+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1380ea4a0 con 0x7fd124003b60 2023-11-24T06:30:35.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:35.572+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd13c155bc0 con 0x7fd124003b60 2023-11-24T06:30:36.131 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-11-24T06:30:36.129+0000 7f448113a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:30:36.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.204+0000 7fd1317fa640 1 -- 172.21.15.143:0/4188094923 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd1380edac0 con 0x7fd124003b60 2023-11-24T06:30:36.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd128066470 msgr2=0x7fd128068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd128066470 0x7fd128068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd12c001ec0 tx=0x7fd12c007040 comp rx=0 tx=0).stop 2023-11-24T06:30:36.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 msgr2=0x7fd13c0ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd13c0ca550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1380ad040 tx=0x7fd124005800 comp rx=0 tx=0).stop 2023-11-24T06:30:36.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 shutdown_connections 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd128066470 0x7fd128068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13c155550 0x7fd13c099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd13c158370 0x7fd13c0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 --2- 172.21.15.143:0/4188094923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd124003b60 0x7fd13c0ca550 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 >> 172.21.15.143:0/4188094923 conn(0x7fd13c0b0c80 msgr2=0x7fd13c06d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 shutdown_connections 2023-11-24T06:30:36.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.208+0000 7fd142e32640 1 -- 172.21.15.143:0/4188094923 wait complete. 2023-11-24T06:30:36.235 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:30:36.236 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:36.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 Processor -- start 2023-11-24T06:30:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 -- start start 2023-11-24T06:30:36.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa584159a80 0x7fa58406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5840ad5e0 0x7fa58406d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5840ae950 con 0x7fa58406cee0 2023-11-24T06:30:36.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58406d8b0 con 0x7fa584159a80 2023-11-24T06:30:36.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa589ee3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840b1ef0 con 0x7fa5840ad5e0 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa5837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa584159a80 0x7fa58406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa57bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa58406cee0 0x7fa5840b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55132/0 (socket says 172.21.15.143:55132) 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa57bfff640 1 -- 172.21.15.143:0/2789133771 learned_addr learned my addr 172.21.15.143:0/2789133771 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa583fff640 1 --2- 172.21.15.143:0/2789133771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5840ad5e0 0x7fa58406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa5837fe640 1 -- 172.21.15.143:0/2789133771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5840ad5e0 msgr2=0x7fa58406d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa5837fe640 1 --2- 172.21.15.143:0/2789133771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5840ad5e0 0x7fa58406d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa5837fe640 1 -- 172.21.15.143:0/2789133771 >> v1:172.21.15.143:6789/0 conn(0x7fa58406cee0 legacy=0x7fa5840b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa5837fe640 1 -- 172.21.15.143:0/2789133771 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840ada70 con 0x7fa584159a80 2023-11-24T06:30:36.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.368+0000 7fa582ffd640 1 -- 172.21.15.143:0/2789133771 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250260947 0 0) 0x7fa5840ae950 con 0x7fa58406cee0 2023-11-24T06:30:36.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa5837fe640 1 --2- 172.21.15.143:0/2789133771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa584159a80 0x7fa58406de50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097c0 tx=0x7fa57401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7ff8758f25b62a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:36.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa582ffd640 1 -- 172.21.15.143:0/2789133771 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740ac630 con 0x7fa584159a80 2023-11-24T06:30:36.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa582ffd640 1 -- 172.21.15.143:0/2789133771 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740ac790 con 0x7fa584159a80 2023-11-24T06:30:36.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa582ffd640 1 -- 172.21.15.143:0/2789133771 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740acb20 con 0x7fa584159a80 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 -- 172.21.15.143:0/2789133771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa584159a80 msgr2=0x7fa58406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 --2- 172.21.15.143:0/2789133771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa584159a80 0x7fa58406de50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097c0 tx=0x7fa57401c450 comp rx=0 tx=0).stop 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 -- 172.21.15.143:0/2789133771 shutdown_connections 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 --2- 172.21.15.143:0/2789133771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5840ad5e0 0x7fa58406d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 --2- 172.21.15.143:0/2789133771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa584159a80 0x7fa58406de50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 -- 172.21.15.143:0/2789133771 >> 172.21.15.143:0/2789133771 conn(0x7fa5840b0bf0 msgr2=0x7fa5840b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:36.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 -- 172.21.15.143:0/2789133771 shutdown_connections 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.372+0000 7fa589ee3640 1 -- 172.21.15.143:0/2789133771 wait complete. 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 Processor -- start 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 -- start start 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 0x7fa584146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5840ad5e0 0x7fa584147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa584159a80 0x7fa584156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584154d70 con 0x7fa58406cee0 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58414cf30 con 0x7fa5840ad5e0 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58414d180 con 0x7fa584159a80 2023-11-24T06:30:36.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 0x7fa584146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 0x7fa584146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48424/0 (socket says 172.21.15.143:48424) 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 -- 172.21.15.143:0/365700107 learned_addr learned my addr 172.21.15.143:0/365700107 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 -- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa584159a80 msgr2=0x7fa584156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa584159a80 0x7fa584156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 -- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5840ad5e0 msgr2=0x7fa584147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa57bfff640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5840ad5e0 0x7fa584147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5840ad5e0 0x7fa584147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 -- 172.21.15.143:0/365700107 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574009420 con 0x7fa58406cee0 2023-11-24T06:30:36.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa57bfff640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5840ad5e0 0x7fa584147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:36.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa5837fe640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 0x7fa584146bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa57401a080 tx=0x7fa5740191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:36.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574004220 con 0x7fa58406cee0 2023-11-24T06:30:36.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574004380 con 0x7fa58406cee0 2023-11-24T06:30:36.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58414d460 con 0x7fa58406cee0 2023-11-24T06:30:36.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574003820 con 0x7fa58406cee0 2023-11-24T06:30:36.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.376+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58414da20 con 0x7fa58406cee0 2023-11-24T06:30:36.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.380+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584067520 con 0x7fa58406cee0 2023-11-24T06:30:36.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.380+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5740b3040 con 0x7fa58406cee0 2023-11-24T06:30:36.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.380+0000 7fa580ff9640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa564066470 0x7fa564068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.380+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa57411d4d0 con 0x7fa58406cee0 2023-11-24T06:30:36.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.380+0000 7fa57bfff640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa564066470 0x7fa564068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.380+0000 7fa57bfff640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa564066470 0x7fa564068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa584157f40 tx=0x7fa56c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:36.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.384+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5740ea8b0 con 0x7fa58406cee0 2023-11-24T06:30:36.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa584157c90 con 0x7fa58406cee0 2023-11-24T06:30:36.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa580ff9640 1 -- 172.21.15.143:0/365700107 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fa5740b1090 con 0x7fa58406cee0 2023-11-24T06:30:36.570 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:36.570 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:30:32.535019+0000","modified":"2023-11-24T06:30:35.578491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4939":{"gid":4939,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/3105261355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3105261355},{"type":"v1","addr":"172.21.15.146:6834","nonce":3105261355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:30:36.571 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 17 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa564066470 msgr2=0x7fa564068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa564066470 0x7fa564068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa584157f40 tx=0x7fa56c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 msgr2=0x7fa584146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 0x7fa584146bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa57401a080 tx=0x7fa5740191f0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 shutdown_connections 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa564066470 0x7fa564068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa584159a80 0x7fa584156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5840ad5e0 0x7fa584147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 --2- 172.21.15.143:0/365700107 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa58406cee0 0x7fa584146bf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 >> 172.21.15.143:0/365700107 conn(0x7fa5840b0bf0 msgr2=0x7fa5840af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:36.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 shutdown_connections 2023-11-24T06:30:36.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.564+0000 7fa589ee3640 1 -- 172.21.15.143:0/365700107 wait complete. 2023-11-24T06:30:36.592 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:36.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.720+0000 7f77f83b8640 1 Processor -- start 2023-11-24T06:30:36.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.720+0000 7f77f83b8640 1 -- start start 2023-11-24T06:30:36.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f83b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f01612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f83b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f77f0161830 0x7f77f00ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f83b8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77f00cecb0 0x7f77f00cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f83b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00cf160 con 0x7f77f0161830 2023-11-24T06:30:36.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f83b8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f0147520 con 0x7f77f00cecb0 2023-11-24T06:30:36.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f83b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00caf20 con 0x7f77f0147140 2023-11-24T06:30:36.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f77f0161830 0x7f77f00ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f77f0161830 0x7f77f00ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48438/0 (socket says 172.21.15.143:48438) 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 -- 172.21.15.143:0/193430285 learned_addr learned my addr 172.21.15.143:0/193430285 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f6955640 1 --2- 172.21.15.143:0/193430285 >> v2:172.21.15.146:3300/0 conn(0x7f77f00cecb0 0x7f77f00cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f6154640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f01612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 -- 172.21.15.143:0/193430285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 msgr2=0x7f77f01612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f01612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 -- 172.21.15.143:0/193430285 >> v2:172.21.15.146:3300/0 conn(0x7f77f00cecb0 msgr2=0x7f77f00cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 --2- 172.21.15.143:0/193430285 >> v2:172.21.15.146:3300/0 conn(0x7f77f00cecb0 0x7f77f00cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f5953640 1 -- 172.21.15.143:0/193430285 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0161d40 con 0x7f77f0161830 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f6154640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f01612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:36.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.724+0000 7f77f6955640 1 --2- 172.21.15.143:0/193430285 >> v2:172.21.15.146:3300/0 conn(0x7f77f00cecb0 0x7f77f00cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:36.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f5953640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f00ce770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ce660 tx=0x7f77e001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed007d38423b9f6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:36.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f5152640 1 -- 172.21.15.143:0/193430285 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00ab600 con 0x7f77f0161830 2023-11-24T06:30:36.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f5152640 1 -- 172.21.15.143:0/193430285 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e00a7050 con 0x7f77f0161830 2023-11-24T06:30:36.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f5152640 1 -- 172.21.15.143:0/193430285 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00ab980 con 0x7f77f0161830 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 -- 172.21.15.143:0/193430285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 msgr2=0x7f77f00ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f00ce770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ce660 tx=0x7f77e001c240 comp rx=0 tx=0).stop 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 -- 172.21.15.143:0/193430285 shutdown_connections 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 --2- 172.21.15.143:0/193430285 >> v2:172.21.15.146:3300/0 conn(0x7f77f00cecb0 0x7f77f00cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f00ce770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 --2- 172.21.15.143:0/193430285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f01612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 -- 172.21.15.143:0/193430285 >> 172.21.15.143:0/193430285 conn(0x7f77f00b1180 msgr2=0x7f77f00b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 -- 172.21.15.143:0/193430285 shutdown_connections 2023-11-24T06:30:36.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 -- 172.21.15.143:0/193430285 wait complete. 2023-11-24T06:30:36.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 Processor -- start 2023-11-24T06:30:36.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.728+0000 7f77f83b8640 1 -- start start 2023-11-24T06:30:36.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77f00cecb0 0x7f77f0139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f01435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00b3160 con 0x7f77f0161830 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f015eb20 con 0x7f77f00cecb0 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00b2270 con 0x7f77f0147140 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f01435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f01435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48452/0 (socket says 172.21.15.143:48452) 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 -- 172.21.15.143:0/2236981094 learned_addr learned my addr 172.21.15.143:0/2236981094 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:36.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6154640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77f00cecb0 0x7f77f0139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f5953640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 -- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 msgr2=0x7f77f015e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f015e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 -- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77f00cecb0 msgr2=0x7f77f0139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77f00cecb0 0x7f77f0139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 -- 172.21.15.143:0/2236981094 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0009480 con 0x7f77f0161830 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f6955640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f01435a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f77e8007db0 tx=0x7f77e800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80039a0 con 0x7f77f0161830 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e800f040 con 0x7f77f0161830 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f006cc80 con 0x7f77f0161830 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8003d60 con 0x7f77f0161830 2023-11-24T06:30:36.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f00b2830 con 0x7f77f0161830 2023-11-24T06:30:36.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f0067520 con 0x7f77f0161830 2023-11-24T06:30:36.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.732+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77e8004030 con 0x7f77f0161830 2023-11-24T06:30:36.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.736+0000 7f77e6ffd640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f77d4066470 0x7f77d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:36.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.736+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77e8084110 con 0x7f77f0161830 2023-11-24T06:30:36.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.736+0000 7f77f6154640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f77d4066470 0x7f77d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:36.743 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.736+0000 7f77f6154640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f77d4066470 0x7f77d4068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009950 tx=0x7f77ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:36.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.740+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77e80515a0 con 0x7f77f0161830 2023-11-24T06:30:36.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77f015f000 con 0x7f77f0161830 2023-11-24T06:30:36.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77e6ffd640 1 -- 172.21.15.143:0/2236981094 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f77e8054bc0 con 0x7f77f0161830 2023-11-24T06:30:36.898 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:36.898 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:34.165701+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:36.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f77d4066470 msgr2=0x7f77d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f77d4066470 0x7f77d4068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009950 tx=0x7f77ec008040 comp rx=0 tx=0).stop 2023-11-24T06:30:36.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 msgr2=0x7f77f01435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:36.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f01435a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f77e8007db0 tx=0x7f77e800d4a0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 shutdown_connections 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f77d4066470 0x7f77d4068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77f0161830 0x7f77f01435a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77f0147140 0x7f77f015e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 --2- 172.21.15.143:0/2236981094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77f00cecb0 0x7f77f0139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 >> 172.21.15.143:0/2236981094 conn(0x7f77f00b1180 msgr2=0x7f77f00b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 shutdown_connections 2023-11-24T06:30:36.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:36.896+0000 7f77f83b8640 1 -- 172.21.15.143:0/2236981094 wait complete. 2023-11-24T06:30:36.919 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:30:36.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:30:37.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.052+0000 7f60d8c32640 1 Processor -- start 2023-11-24T06:30:37.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.052+0000 7f60d8c32640 1 -- start start 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d8c32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60d406d5f0 0x7f60d406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d8c32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60d40b3670 0x7f60d40ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d8c32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d40ae950 con 0x7f60d4159a80 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d8c32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d40b1ef0 con 0x7f60d406d5f0 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d8c32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d40adca0 con 0x7f60d40b3670 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f60d4159a80 0x7f60d406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:55134/0 (socket says 172.21.15.143:55134) 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d259c640 1 -- 172.21.15.143:0/1985926448 learned_addr learned my addr 172.21.15.143:0/1985926448 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60c9d9b640 1 --2- 172.21.15.143:0/1985926448 >> v2:172.21.15.143:3300/0 conn(0x7f60d406d5f0 0x7f60d406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d2d9d640 1 --2- 172.21.15.143:0/1985926448 >> v2:172.21.15.146:3300/0 conn(0x7f60d40b3670 0x7f60d40ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d1d9b640 1 -- 172.21.15.143:0/1985926448 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520503042 0 0) 0x7f60d40ae950 con 0x7f60d4159a80 2023-11-24T06:30:37.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60d1d9b640 1 -- 172.21.15.143:0/1985926448 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c0003530 con 0x7f60d4159a80 2023-11-24T06:30:37.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60c9d9b640 1 -- 172.21.15.143:0/1985926448 >> v2:172.21.15.146:3300/0 conn(0x7f60d40b3670 msgr2=0x7f60d40ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:37.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60c9d9b640 1 --2- 172.21.15.143:0/1985926448 >> v2:172.21.15.146:3300/0 conn(0x7f60d40b3670 0x7f60d40ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60c9d9b640 1 -- 172.21.15.143:0/1985926448 >> v1:172.21.15.143:6789/0 conn(0x7f60d4159a80 legacy=0x7f60d406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.056+0000 7f60c9d9b640 1 -- 172.21.15.143:0/1985926448 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40adf80 con 0x7f60d406d5f0 2023-11-24T06:30:37.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60c9d9b640 1 --2- 172.21.15.143:0/1985926448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d406d5f0 0x7f60d406de50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f60d40b5040 tx=0x7f60bc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6683b87d097cfc88 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d1d9b640 1 -- 172.21.15.143:0/1985926448 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0ab600 con 0x7f60d406d5f0 2023-11-24T06:30:37.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d1d9b640 1 -- 172.21.15.143:0/1985926448 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0a7050 con 0x7f60d406d5f0 2023-11-24T06:30:37.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d1d9b640 1 -- 172.21.15.143:0/1985926448 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0ab980 con 0x7f60d406d5f0 2023-11-24T06:30:37.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 -- 172.21.15.143:0/1985926448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d406d5f0 msgr2=0x7f60d406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 --2- 172.21.15.143:0/1985926448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d406d5f0 0x7f60d406de50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f60d40b5040 tx=0x7f60bc01c3a0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 -- 172.21.15.143:0/1985926448 shutdown_connections 2023-11-24T06:30:37.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 --2- 172.21.15.143:0/1985926448 >> v2:172.21.15.146:3300/0 conn(0x7f60d40b3670 0x7f60d40ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 --2- 172.21.15.143:0/1985926448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d406d5f0 0x7f60d406de50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 -- 172.21.15.143:0/1985926448 >> 172.21.15.143:0/1985926448 conn(0x7f60d40b0bf0 msgr2=0x7f60d40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:37.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 -- 172.21.15.143:0/1985926448 shutdown_connections 2023-11-24T06:30:37.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.060+0000 7f60d8c32640 1 -- 172.21.15.143:0/1985926448 wait complete. 2023-11-24T06:30:37.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 Processor -- start 2023-11-24T06:30:37.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- start start 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60d406d5f0 0x7f60d4146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 0x7f60d414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60d4159a80 0x7f60d414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4146940 con 0x7f60d40b3670 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4159040 con 0x7f60d4159a80 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d414ca30 con 0x7f60d406d5f0 2023-11-24T06:30:37.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 0x7f60d414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 0x7f60d414e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48468/0 (socket says 172.21.15.143:48468) 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 -- 172.21.15.143:0/183539544 learned_addr learned my addr 172.21.15.143:0/183539544 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d2d9d640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60d4159a80 0x7f60d414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d259c640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60d406d5f0 0x7f60d4146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 -- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60d406d5f0 msgr2=0x7f60d4146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60d406d5f0 0x7f60d4146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 -- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60d4159a80 msgr2=0x7f60d414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60d4159a80 0x7f60d414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 -- 172.21.15.143:0/183539544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009420 con 0x7f60d40b3670 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d2d9d640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60d4159a80 0x7f60d414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60c9d9b640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 0x7f60d414e120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f60bc01aa50 tx=0x7f60bc019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0b4410 con 0x7f60d40b3670 2023-11-24T06:30:37.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0b4570 con 0x7f60d40b3670 2023-11-24T06:30:37.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0b4920 con 0x7f60d40b3670 2023-11-24T06:30:37.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d414c720 con 0x7f60d40b3670 2023-11-24T06:30:37.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d414ad20 con 0x7f60d40b3670 2023-11-24T06:30:37.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.064+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d4067520 con 0x7f60d40b3670 2023-11-24T06:30:37.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.068+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f60bc0b2040 con 0x7f60d40b3670 2023-11-24T06:30:37.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.068+0000 7f60cb7fe640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f60b4066470 0x7f60b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.068+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60bc11def0 con 0x7f60d40b3670 2023-11-24T06:30:37.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.068+0000 7f60d259c640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f60b4066470 0x7f60b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.068+0000 7f60d259c640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f60b4066470 0x7f60b4068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60c40011f0 tx=0x7f60c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.072+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60bc0eb2d0 con 0x7f60d40b3670 2023-11-24T06:30:37.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.220+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60d40708c0 con 0x7f60b4066470 2023-11-24T06:30:37.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.228+0000 7f60cb7fe640 1 -- 172.21.15.143:0/183539544 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288782 (secure 0 0 0) 0x7f60d40708c0 con 0x7f60b4066470 2023-11-24T06:30:37.235 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:37.236 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:30:37.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f60b4066470 msgr2=0x7f60b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f60b4066470 0x7f60b4068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60c40011f0 tx=0x7f60c4009040 comp rx=0 tx=0).stop 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 msgr2=0x7f60d414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 0x7f60d414e120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f60bc01aa50 tx=0x7f60bc019140 comp rx=0 tx=0).stop 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 shutdown_connections 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f60b4066470 0x7f60b4068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60d4159a80 0x7f60d414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60d40b3670 0x7f60d414e120 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 --2- 172.21.15.143:0/183539544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60d406d5f0 0x7f60d4146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 >> 172.21.15.143:0/183539544 conn(0x7f60d40b0bf0 msgr2=0x7f60d41532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 shutdown_connections 2023-11-24T06:30:37.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.232+0000 7f60d8c32640 1 -- 172.21.15.143:0/183539544 wait complete. 2023-11-24T06:30:37.254 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-24T06:30:36.217078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3870720,"data_stored":2199575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.072837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204069+0000","last_change":"2023-11-24T06:30:33.201334+0000","last_active":"2023-11-24T06:30:33.204069+0000","last_peered":"2023-11-24T06:30:33.204069+0000","last_clean":"2023-11-24T06:30:33.204069+0000","last_became_active":"2023-11-24T06:30:33.200810+0000","last_became_peered":"2023-11-24T06:30:33.200810+0000","last_unstale":"2023-11-24T06:30:33.204069+0000","last_undegraded":"2023-11-24T06:30:33.204069+0000","last_fullsized":"2023-11-24T06:30:33.204069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:45.524728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199637+0000","last_change":"2023-11-24T06:30:33.191145+0000","last_active":"2023-11-24T06:30:33.199637+0000","last_peered":"2023-11-24T06:30:33.199637+0000","last_clean":"2023-11-24T06:30:33.199637+0000","last_became_active":"2023-11-24T06:30:33.190835+0000","last_became_peered":"2023-11-24T06:30:33.190835+0000","last_unstale":"2023-11-24T06:30:33.199637+0000","last_undegraded":"2023-11-24T06:30:33.199637+0000","last_fullsized":"2023-11-24T06:30:33.199637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.797499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.202315+0000","last_change":"2023-11-24T06:30:33.197752+0000","last_active":"2023-11-24T06:30:33.202315+0000","last_peered":"2023-11-24T06:30:33.202315+0000","last_clean":"2023-11-24T06:30:33.202315+0000","last_became_active":"2023-11-24T06:30:33.197461+0000","last_became_peered":"2023-11-24T06:30:33.197461+0000","last_unstale":"2023-11-24T06:30:33.202315+0000","last_undegraded":"2023-11-24T06:30:33.202315+0000","last_fullsized":"2023-11-24T06:30:33.202315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:24.388914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.192498+0000","last_change":"2023-11-24T06:30:33.187260+0000","last_active":"2023-11-24T06:30:33.192498+0000","last_peered":"2023-11-24T06:30:33.192498+0000","last_clean":"2023-11-24T06:30:33.192498+0000","last_became_active":"2023-11-24T06:30:33.184642+0000","last_became_peered":"2023-11-24T06:30:33.184642+0000","last_unstale":"2023-11-24T06:30:33.192498+0000","last_undegraded":"2023-11-24T06:30:33.192498+0000","last_fullsized":"2023-11-24T06:30:33.192498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:06.375447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191525+0000","last_change":"2023-11-24T06:30:33.185925+0000","last_active":"2023-11-24T06:30:33.191525+0000","last_peered":"2023-11-24T06:30:33.191525+0000","last_clean":"2023-11-24T06:30:33.191525+0000","last_became_active":"2023-11-24T06:30:33.185628+0000","last_became_peered":"2023-11-24T06:30:33.185628+0000","last_unstale":"2023-11-24T06:30:33.191525+0000","last_undegraded":"2023-11-24T06:30:33.191525+0000","last_fullsized":"2023-11-24T06:30:33.191525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:25.508171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.196697+0000","last_change":"2023-11-24T06:30:33.190952+0000","last_active":"2023-11-24T06:30:33.196697+0000","last_peered":"2023-11-24T06:30:33.196697+0000","last_clean":"2023-11-24T06:30:33.196697+0000","last_became_active":"2023-11-24T06:30:33.190536+0000","last_became_peered":"2023-11-24T06:30:33.190536+0000","last_unstale":"2023-11-24T06:30:33.196697+0000","last_undegraded":"2023-11-24T06:30:33.196697+0000","last_fullsized":"2023-11-24T06:30:33.196697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.207469+0000","last_change":"2023-11-24T06:30:33.205148+0000","last_active":"2023-11-24T06:30:33.207469+0000","last_peered":"2023-11-24T06:30:33.207469+0000","last_clean":"2023-11-24T06:30:33.207469+0000","last_became_active":"2023-11-24T06:30:33.204838+0000","last_became_peered":"2023-11-24T06:30:33.204838+0000","last_unstale":"2023-11-24T06:30:33.207469+0000","last_undegraded":"2023-11-24T06:30:33.207469+0000","last_fullsized":"2023-11-24T06:30:33.207469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:39.133696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.201825+0000","last_change":"2023-11-24T06:30:33.188873+0000","last_active":"2023-11-24T06:30:33.201825+0000","last_peered":"2023-11-24T06:30:33.201825+0000","last_clean":"2023-11-24T06:30:33.201825+0000","last_became_active":"2023-11-24T06:30:33.188079+0000","last_became_peered":"2023-11-24T06:30:33.188079+0000","last_unstale":"2023-11-24T06:30:33.201825+0000","last_undegraded":"2023-11-24T06:30:33.201825+0000","last_fullsized":"2023-11-24T06:30:33.201825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:24.739599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191574+0000","last_change":"2023-11-24T06:30:33.185334+0000","last_active":"2023-11-24T06:30:33.191574+0000","last_peered":"2023-11-24T06:30:33.191574+0000","last_clean":"2023-11-24T06:30:33.191574+0000","last_became_active":"2023-11-24T06:30:33.184744+0000","last_became_peered":"2023-11-24T06:30:33.184744+0000","last_unstale":"2023-11-24T06:30:33.191574+0000","last_undegraded":"2023-11-24T06:30:33.191574+0000","last_fullsized":"2023-11-24T06:30:33.191574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:37:05.431691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205940+0000","last_change":"2023-11-24T06:30:33.194302+0000","last_active":"2023-11-24T06:30:33.205940+0000","last_peered":"2023-11-24T06:30:33.205940+0000","last_clean":"2023-11-24T06:30:33.205940+0000","last_became_active":"2023-11-24T06:30:33.193842+0000","last_became_peered":"2023-11-24T06:30:33.193842+0000","last_unstale":"2023-11-24T06:30:33.205940+0000","last_undegraded":"2023-11-24T06:30:33.205940+0000","last_fullsized":"2023-11-24T06:30:33.205940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.202064+0000","last_change":"2023-11-24T06:30:33.189006+0000","last_active":"2023-11-24T06:30:33.202064+0000","last_peered":"2023-11-24T06:30:33.202064+0000","last_clean":"2023-11-24T06:30:33.202064+0000","last_became_active":"2023-11-24T06:30:33.188735+0000","last_became_peered":"2023-11-24T06:30:33.188735+0000","last_unstale":"2023-11-24T06:30:33.202064+0000","last_undegraded":"2023-11-24T06:30:33.202064+0000","last_fullsized":"2023-11-24T06:30:33.202064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:36.798373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204363+0000","last_change":"2023-11-24T06:30:33.198702+0000","last_active":"2023-11-24T06:30:33.204363+0000","last_peered":"2023-11-24T06:30:33.204363+0000","last_clean":"2023-11-24T06:30:33.204363+0000","last_became_active":"2023-11-24T06:30:33.198338+0000","last_became_peered":"2023-11-24T06:30:33.198338+0000","last_unstale":"2023-11-24T06:30:33.204363+0000","last_undegraded":"2023-11-24T06:30:33.204363+0000","last_fullsized":"2023-11-24T06:30:33.204363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:32.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.184910+0000","last_change":"2023-11-24T06:30:33.180437+0000","last_active":"2023-11-24T06:30:33.184910+0000","last_peered":"2023-11-24T06:30:33.184910+0000","last_clean":"2023-11-24T06:30:33.184910+0000","last_became_active":"2023-11-24T06:30:33.180089+0000","last_became_peered":"2023-11-24T06:30:33.180089+0000","last_unstale":"2023-11-24T06:30:33.184910+0000","last_undegraded":"2023-11-24T06:30:33.184910+0000","last_fullsized":"2023-11-24T06:30:33.184910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:05.519032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190846+0000","last_change":"2023-11-24T06:30:33.186799+0000","last_active":"2023-11-24T06:30:33.190846+0000","last_peered":"2023-11-24T06:30:33.190846+0000","last_clean":"2023-11-24T06:30:33.190846+0000","last_became_active":"2023-11-24T06:30:33.185946+0000","last_became_peered":"2023-11-24T06:30:33.185946+0000","last_unstale":"2023-11-24T06:30:33.190846+0000","last_undegraded":"2023-11-24T06:30:33.190846+0000","last_fullsized":"2023-11-24T06:30:33.190846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:56.636296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.206920+0000","last_change":"2023-11-24T06:30:33.202641+0000","last_active":"2023-11-24T06:30:33.206920+0000","last_peered":"2023-11-24T06:30:33.206920+0000","last_clean":"2023-11-24T06:30:33.206920+0000","last_became_active":"2023-11-24T06:30:33.202334+0000","last_became_peered":"2023-11-24T06:30:33.202334+0000","last_unstale":"2023-11-24T06:30:33.206920+0000","last_undegraded":"2023-11-24T06:30:33.206920+0000","last_fullsized":"2023-11-24T06:30:33.206920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203528+0000","last_change":"2023-11-24T06:30:33.192280+0000","last_active":"2023-11-24T06:30:33.203528+0000","last_peered":"2023-11-24T06:30:33.203528+0000","last_clean":"2023-11-24T06:30:33.203528+0000","last_became_active":"2023-11-24T06:30:33.192049+0000","last_became_peered":"2023-11-24T06:30:33.192049+0000","last_unstale":"2023-11-24T06:30:33.203528+0000","last_undegraded":"2023-11-24T06:30:33.203528+0000","last_fullsized":"2023-11-24T06:30:33.203528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.207504+0000","last_change":"2023-11-24T06:30:33.205341+0000","last_active":"2023-11-24T06:30:33.207504+0000","last_peered":"2023-11-24T06:30:33.207504+0000","last_clean":"2023-11-24T06:30:33.207504+0000","last_became_active":"2023-11-24T06:30:33.204422+0000","last_became_peered":"2023-11-24T06:30:33.204422+0000","last_unstale":"2023-11-24T06:30:33.207504+0000","last_undegraded":"2023-11-24T06:30:33.207504+0000","last_fullsized":"2023-11-24T06:30:33.207504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:32.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199746+0000","last_change":"2023-11-24T06:30:33.192073+0000","last_active":"2023-11-24T06:30:33.199746+0000","last_peered":"2023-11-24T06:30:33.199746+0000","last_clean":"2023-11-24T06:30:33.199746+0000","last_became_active":"2023-11-24T06:30:33.191528+0000","last_became_peered":"2023-11-24T06:30:33.191528+0000","last_unstale":"2023-11-24T06:30:33.199746+0000","last_undegraded":"2023-11-24T06:30:33.199746+0000","last_fullsized":"2023-11-24T06:30:33.199746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:24.388914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.193385+0000","last_change":"2023-11-24T06:30:33.188259+0000","last_active":"2023-11-24T06:30:33.193385+0000","last_peered":"2023-11-24T06:30:33.193385+0000","last_clean":"2023-11-24T06:30:33.193385+0000","last_became_active":"2023-11-24T06:30:33.187984+0000","last_became_peered":"2023-11-24T06:30:33.187984+0000","last_unstale":"2023-11-24T06:30:33.193385+0000","last_undegraded":"2023-11-24T06:30:33.193385+0000","last_fullsized":"2023-11-24T06:30:33.193385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199512+0000","last_change":"2023-11-24T06:30:33.194802+0000","last_active":"2023-11-24T06:30:33.199512+0000","last_peered":"2023-11-24T06:30:33.199512+0000","last_clean":"2023-11-24T06:30:33.199512+0000","last_became_active":"2023-11-24T06:30:33.194468+0000","last_became_peered":"2023-11-24T06:30:33.194468+0000","last_unstale":"2023-11-24T06:30:33.199512+0000","last_undegraded":"2023-11-24T06:30:33.199512+0000","last_fullsized":"2023-11-24T06:30:33.199512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:37:05.431691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191213+0000","last_change":"2023-11-24T06:30:33.184092+0000","last_active":"2023-11-24T06:30:33.191213+0000","last_peered":"2023-11-24T06:30:33.191213+0000","last_clean":"2023-11-24T06:30:33.191213+0000","last_became_active":"2023-11-24T06:30:33.183748+0000","last_became_peered":"2023-11-24T06:30:33.183748+0000","last_unstale":"2023-11-24T06:30:33.191213+0000","last_undegraded":"2023-11-24T06:30:33.191213+0000","last_fullsized":"2023-11-24T06:30:33.191213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:25.508171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199543+0000","last_change":"2023-11-24T06:30:33.189408+0000","last_active":"2023-11-24T06:30:33.199543+0000","last_peered":"2023-11-24T06:30:33.199543+0000","last_clean":"2023-11-24T06:30:33.199543+0000","last_became_active":"2023-11-24T06:30:33.189114+0000","last_became_peered":"2023-11-24T06:30:33.189114+0000","last_unstale":"2023-11-24T06:30:33.199543+0000","last_undegraded":"2023-11-24T06:30:33.199543+0000","last_fullsized":"2023-11-24T06:30:33.199543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:54.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.189204+0000","last_change":"2023-11-24T06:30:33.186020+0000","last_active":"2023-11-24T06:30:33.189204+0000","last_peered":"2023-11-24T06:30:33.189204+0000","last_clean":"2023-11-24T06:30:33.189204+0000","last_became_active":"2023-11-24T06:30:33.185715+0000","last_became_peered":"2023-11-24T06:30:33.185715+0000","last_unstale":"2023-11-24T06:30:33.189204+0000","last_undegraded":"2023-11-24T06:30:33.189204+0000","last_fullsized":"2023-11-24T06:30:33.189204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:55.706024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190572+0000","last_change":"2023-11-24T06:30:33.187466+0000","last_active":"2023-11-24T06:30:33.190572+0000","last_peered":"2023-11-24T06:30:33.190572+0000","last_clean":"2023-11-24T06:30:33.190572+0000","last_became_active":"2023-11-24T06:30:33.187063+0000","last_became_peered":"2023-11-24T06:30:33.187063+0000","last_unstale":"2023-11-24T06:30:33.190572+0000","last_undegraded":"2023-11-24T06:30:33.190572+0000","last_fullsized":"2023-11-24T06:30:33.190572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.206032+0000","last_change":"2023-11-24T06:30:33.195547+0000","last_active":"2023-11-24T06:30:33.206032+0000","last_peered":"2023-11-24T06:30:33.206032+0000","last_clean":"2023-11-24T06:30:33.206032+0000","last_became_active":"2023-11-24T06:30:33.195285+0000","last_became_peered":"2023-11-24T06:30:33.195285+0000","last_unstale":"2023-11-24T06:30:33.206032+0000","last_undegraded":"2023-11-24T06:30:33.206032+0000","last_fullsized":"2023-11-24T06:30:33.206032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:08.718077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.208818+0000","last_change":"2023-11-24T06:30:33.203314+0000","last_active":"2023-11-24T06:30:33.208818+0000","last_peered":"2023-11-24T06:30:33.208818+0000","last_clean":"2023-11-24T06:30:33.208818+0000","last_became_active":"2023-11-24T06:30:33.203042+0000","last_became_peered":"2023-11-24T06:30:33.203042+0000","last_unstale":"2023-11-24T06:30:33.208818+0000","last_undegraded":"2023-11-24T06:30:33.208818+0000","last_fullsized":"2023-11-24T06:30:33.208818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:36.798373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.194096+0000","last_change":"2023-11-24T06:30:33.186341+0000","last_active":"2023-11-24T06:30:33.194096+0000","last_peered":"2023-11-24T06:30:33.194096+0000","last_clean":"2023-11-24T06:30:33.194096+0000","last_became_active":"2023-11-24T06:30:33.185831+0000","last_became_peered":"2023-11-24T06:30:33.185831+0000","last_unstale":"2023-11-24T06:30:33.194096+0000","last_undegraded":"2023-11-24T06:30:33.194096+0000","last_fullsized":"2023-11-24T06:30:33.194096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190604+0000","last_change":"2023-11-24T06:30:33.187984+0000","last_active":"2023-11-24T06:30:33.190604+0000","last_peered":"2023-11-24T06:30:33.190604+0000","last_clean":"2023-11-24T06:30:33.190604+0000","last_became_active":"2023-11-24T06:30:33.187712+0000","last_became_peered":"2023-11-24T06:30:33.187712+0000","last_unstale":"2023-11-24T06:30:33.190604+0000","last_undegraded":"2023-11-24T06:30:33.190604+0000","last_fullsized":"2023-11-24T06:30:33.190604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:58.841532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191232+0000","last_change":"2023-11-24T06:30:33.184874+0000","last_active":"2023-11-24T06:30:33.191232+0000","last_peered":"2023-11-24T06:30:33.191232+0000","last_clean":"2023-11-24T06:30:33.191232+0000","last_became_active":"2023-11-24T06:30:33.184556+0000","last_became_peered":"2023-11-24T06:30:33.184556+0000","last_unstale":"2023-11-24T06:30:33.191232+0000","last_undegraded":"2023-11-24T06:30:33.191232+0000","last_fullsized":"2023-11-24T06:30:33.191232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:05.519032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204172+0000","last_change":"2023-11-24T06:30:33.194634+0000","last_active":"2023-11-24T06:30:33.204172+0000","last_peered":"2023-11-24T06:30:33.204172+0000","last_clean":"2023-11-24T06:30:33.204172+0000","last_became_active":"2023-11-24T06:30:33.194293+0000","last_became_peered":"2023-11-24T06:30:33.194293+0000","last_unstale":"2023-11-24T06:30:33.204172+0000","last_undegraded":"2023-11-24T06:30:33.204172+0000","last_fullsized":"2023-11-24T06:30:33.204172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:42.500807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199465+0000","last_change":"2023-11-24T06:30:33.197347+0000","last_active":"2023-11-24T06:30:33.199465+0000","last_peered":"2023-11-24T06:30:33.199465+0000","last_clean":"2023-11-24T06:30:33.199465+0000","last_became_active":"2023-11-24T06:30:33.195787+0000","last_became_peered":"2023-11-24T06:30:33.195787+0000","last_unstale":"2023-11-24T06:30:33.199465+0000","last_undegraded":"2023-11-24T06:30:33.199465+0000","last_fullsized":"2023-11-24T06:30:33.199465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:40:34.383971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.201849+0000","last_change":"2023-11-24T06:30:33.189077+0000","last_active":"2023-11-24T06:30:33.201849+0000","last_peered":"2023-11-24T06:30:33.201849+0000","last_clean":"2023-11-24T06:30:33.201849+0000","last_became_active":"2023-11-24T06:30:33.188491+0000","last_became_peered":"2023-11-24T06:30:33.188491+0000","last_unstale":"2023-11-24T06:30:33.201849+0000","last_undegraded":"2023-11-24T06:30:33.201849+0000","last_fullsized":"2023-11-24T06:30:33.201849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:56.636296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.197080+0000","last_change":"2023-11-24T06:30:33.193080+0000","last_active":"2023-11-24T06:30:33.197080+0000","last_peered":"2023-11-24T06:30:33.197080+0000","last_clean":"2023-11-24T06:30:33.197080+0000","last_became_active":"2023-11-24T06:30:33.192806+0000","last_became_peered":"2023-11-24T06:30:33.192806+0000","last_unstale":"2023-11-24T06:30:33.197080+0000","last_undegraded":"2023-11-24T06:30:33.197080+0000","last_fullsized":"2023-11-24T06:30:33.197080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:24.739599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218235+0000","last_change":"2023-11-24T06:30:32.178356+0000","last_active":"2023-11-24T06:30:33.218235+0000","last_peered":"2023-11-24T06:30:33.218235+0000","last_clean":"2023-11-24T06:30:33.218235+0000","last_became_active":"2023-11-24T06:30:32.178042+0000","last_became_peered":"2023-11-24T06:30:32.178042+0000","last_unstale":"2023-11-24T06:30:33.218235+0000","last_undegraded":"2023-11-24T06:30:33.218235+0000","last_fullsized":"2023-11-24T06:30:33.218235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:54.698351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204050+0000","last_change":"2023-11-24T06:30:33.201081+0000","last_active":"2023-11-24T06:30:33.204050+0000","last_peered":"2023-11-24T06:30:33.204050+0000","last_clean":"2023-11-24T06:30:33.204050+0000","last_became_active":"2023-11-24T06:30:33.200435+0000","last_became_peered":"2023-11-24T06:30:33.200435+0000","last_unstale":"2023-11-24T06:30:33.204050+0000","last_undegraded":"2023-11-24T06:30:33.204050+0000","last_fullsized":"2023-11-24T06:30:33.204050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:21:00.845787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.216109+0000","last_change":"2023-11-24T06:30:32.181591+0000","last_active":"2023-11-24T06:30:33.216109+0000","last_peered":"2023-11-24T06:30:33.216109+0000","last_clean":"2023-11-24T06:30:33.216109+0000","last_became_active":"2023-11-24T06:30:32.181226+0000","last_became_peered":"2023-11-24T06:30:32.181226+0000","last_unstale":"2023-11-24T06:30:33.216109+0000","last_undegraded":"2023-11-24T06:30:33.216109+0000","last_fullsized":"2023-11-24T06:30:33.216109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:07.710405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199886+0000","last_change":"2023-11-24T06:30:33.187944+0000","last_active":"2023-11-24T06:30:33.199886+0000","last_peered":"2023-11-24T06:30:33.199886+0000","last_clean":"2023-11-24T06:30:33.199886+0000","last_became_active":"2023-11-24T06:30:33.187646+0000","last_became_peered":"2023-11-24T06:30:33.187646+0000","last_unstale":"2023-11-24T06:30:33.199886+0000","last_undegraded":"2023-11-24T06:30:33.199886+0000","last_fullsized":"2023-11-24T06:30:33.199886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:52:05.765398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.216970+0000","last_change":"2023-11-24T06:30:32.172571+0000","last_active":"2023-11-24T06:30:33.216970+0000","last_peered":"2023-11-24T06:30:33.216970+0000","last_clean":"2023-11-24T06:30:33.216970+0000","last_became_active":"2023-11-24T06:30:32.168293+0000","last_became_peered":"2023-11-24T06:30:32.168293+0000","last_unstale":"2023-11-24T06:30:33.216970+0000","last_undegraded":"2023-11-24T06:30:33.216970+0000","last_fullsized":"2023-11-24T06:30:33.216970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:09:11.414275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.194076+0000","last_change":"2023-11-24T06:30:33.186173+0000","last_active":"2023-11-24T06:30:33.194076+0000","last_peered":"2023-11-24T06:30:33.194076+0000","last_clean":"2023-11-24T06:30:33.194076+0000","last_became_active":"2023-11-24T06:30:33.185509+0000","last_became_peered":"2023-11-24T06:30:33.185509+0000","last_unstale":"2023-11-24T06:30:33.194076+0000","last_undegraded":"2023-11-24T06:30:33.194076+0000","last_fullsized":"2023-11-24T06:30:33.194076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:57.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218020+0000","last_change":"2023-11-24T06:30:32.179661+0000","last_active":"2023-11-24T06:30:33.218020+0000","last_peered":"2023-11-24T06:30:33.218020+0000","last_clean":"2023-11-24T06:30:33.218020+0000","last_became_active":"2023-11-24T06:30:32.179132+0000","last_became_peered":"2023-11-24T06:30:32.179132+0000","last_unstale":"2023-11-24T06:30:33.218020+0000","last_undegraded":"2023-11-24T06:30:33.218020+0000","last_fullsized":"2023-11-24T06:30:33.218020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:53.380369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203493+0000","last_change":"2023-11-24T06:30:33.193945+0000","last_active":"2023-11-24T06:30:33.203493+0000","last_peered":"2023-11-24T06:30:33.203493+0000","last_clean":"2023-11-24T06:30:33.203493+0000","last_became_active":"2023-11-24T06:30:33.193685+0000","last_became_peered":"2023-11-24T06:30:33.193685+0000","last_unstale":"2023-11-24T06:30:33.203493+0000","last_undegraded":"2023-11-24T06:30:33.203493+0000","last_fullsized":"2023-11-24T06:30:33.203493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:58.841532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218764+0000","last_change":"2023-11-24T06:30:32.171295+0000","last_active":"2023-11-24T06:30:33.218764+0000","last_peered":"2023-11-24T06:30:33.218764+0000","last_clean":"2023-11-24T06:30:33.218764+0000","last_became_active":"2023-11-24T06:30:32.171000+0000","last_became_peered":"2023-11-24T06:30:32.171000+0000","last_unstale":"2023-11-24T06:30:33.218764+0000","last_undegraded":"2023-11-24T06:30:33.218764+0000","last_fullsized":"2023-11-24T06:30:33.218764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:34:28.015616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191463+0000","last_change":"2023-11-24T06:30:33.189288+0000","last_active":"2023-11-24T06:30:33.191463+0000","last_peered":"2023-11-24T06:30:33.191463+0000","last_clean":"2023-11-24T06:30:33.191463+0000","last_became_active":"2023-11-24T06:30:33.186409+0000","last_became_peered":"2023-11-24T06:30:33.186409+0000","last_unstale":"2023-11-24T06:30:33.191463+0000","last_undegraded":"2023-11-24T06:30:33.191463+0000","last_fullsized":"2023-11-24T06:30:33.191463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:42.500807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218561+0000","last_change":"2023-11-24T06:30:32.169738+0000","last_active":"2023-11-24T06:30:33.218561+0000","last_peered":"2023-11-24T06:30:33.218561+0000","last_clean":"2023-11-24T06:30:33.218561+0000","last_became_active":"2023-11-24T06:30:32.169419+0000","last_became_peered":"2023-11-24T06:30:32.169419+0000","last_unstale":"2023-11-24T06:30:33.218561+0000","last_undegraded":"2023-11-24T06:30:33.218561+0000","last_fullsized":"2023-11-24T06:30:33.218561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:40:33.376298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199610+0000","last_change":"2023-11-24T06:30:33.191608+0000","last_active":"2023-11-24T06:30:33.199610+0000","last_peered":"2023-11-24T06:30:33.199610+0000","last_clean":"2023-11-24T06:30:33.199610+0000","last_became_active":"2023-11-24T06:30:33.188677+0000","last_became_peered":"2023-11-24T06:30:33.188677+0000","last_unstale":"2023-11-24T06:30:33.199610+0000","last_undegraded":"2023-11-24T06:30:33.199610+0000","last_fullsized":"2023-11-24T06:30:33.199610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:48.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.179088+0000","last_change":"2023-11-24T06:30:32.175942+0000","last_active":"2023-11-24T06:30:33.179088+0000","last_peered":"2023-11-24T06:30:33.179088+0000","last_clean":"2023-11-24T06:30:33.179088+0000","last_became_active":"2023-11-24T06:30:32.175210+0000","last_became_peered":"2023-11-24T06:30:32.175210+0000","last_unstale":"2023-11-24T06:30:33.179088+0000","last_undegraded":"2023-11-24T06:30:33.179088+0000","last_fullsized":"2023-11-24T06:30:33.179088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:43.899750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.194514+0000","last_change":"2023-11-24T06:30:33.191671+0000","last_active":"2023-11-24T06:30:33.194514+0000","last_peered":"2023-11-24T06:30:33.194514+0000","last_clean":"2023-11-24T06:30:33.194514+0000","last_became_active":"2023-11-24T06:30:33.191398+0000","last_became_peered":"2023-11-24T06:30:33.191398+0000","last_unstale":"2023-11-24T06:30:33.194514+0000","last_undegraded":"2023-11-24T06:30:33.194514+0000","last_fullsized":"2023-11-24T06:30:33.194514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:55.706024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.176239+0000","last_change":"2023-11-24T06:30:32.174113+0000","last_active":"2023-11-24T06:30:33.176239+0000","last_peered":"2023-11-24T06:30:33.176239+0000","last_clean":"2023-11-24T06:30:33.176239+0000","last_became_active":"2023-11-24T06:30:32.173787+0000","last_became_peered":"2023-11-24T06:30:32.173787+0000","last_unstale":"2023-11-24T06:30:33.176239+0000","last_undegraded":"2023-11-24T06:30:33.176239+0000","last_fullsized":"2023-11-24T06:30:33.176239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:16:25.310624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203258+0000","last_change":"2023-11-24T06:30:33.197729+0000","last_active":"2023-11-24T06:30:33.203258+0000","last_peered":"2023-11-24T06:30:33.203258+0000","last_clean":"2023-11-24T06:30:33.203258+0000","last_became_active":"2023-11-24T06:30:33.197442+0000","last_became_peered":"2023-11-24T06:30:33.197442+0000","last_unstale":"2023-11-24T06:30:33.203258+0000","last_undegraded":"2023-11-24T06:30:33.203258+0000","last_fullsized":"2023-11-24T06:30:33.203258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:44.907422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.179661+0000","last_change":"2023-11-24T06:30:32.180890+0000","last_active":"2023-11-24T06:30:33.179661+0000","last_peered":"2023-11-24T06:30:33.179661+0000","last_clean":"2023-11-24T06:30:33.179661+0000","last_became_active":"2023-11-24T06:30:32.180575+0000","last_became_peered":"2023-11-24T06:30:32.180575+0000","last_unstale":"2023-11-24T06:30:33.179661+0000","last_undegraded":"2023-11-24T06:30:33.179661+0000","last_fullsized":"2023-11-24T06:30:33.179661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:13.543360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.196011+0000","last_change":"2023-11-24T06:30:33.189686+0000","last_active":"2023-11-24T06:30:33.196011+0000","last_peered":"2023-11-24T06:30:33.196011+0000","last_clean":"2023-11-24T06:30:33.196011+0000","last_became_active":"2023-11-24T06:30:33.189421+0000","last_became_peered":"2023-11-24T06:30:33.189421+0000","last_unstale":"2023-11-24T06:30:33.196011+0000","last_undegraded":"2023-11-24T06:30:33.196011+0000","last_fullsized":"2023-11-24T06:30:33.196011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:39.133696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.170516+0000","last_change":"2023-11-24T06:30:32.172290+0000","last_active":"2023-11-24T06:30:33.170516+0000","last_peered":"2023-11-24T06:30:33.170516+0000","last_clean":"2023-11-24T06:30:33.170516+0000","last_became_active":"2023-11-24T06:30:32.171990+0000","last_became_peered":"2023-11-24T06:30:32.171990+0000","last_unstale":"2023-11-24T06:30:33.170516+0000","last_undegraded":"2023-11-24T06:30:33.170516+0000","last_fullsized":"2023-11-24T06:30:33.170516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:22.950101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.200216+0000","last_change":"2023-11-24T06:30:33.194377+0000","last_active":"2023-11-24T06:30:33.200216+0000","last_peered":"2023-11-24T06:30:33.200216+0000","last_clean":"2023-11-24T06:30:33.200216+0000","last_became_active":"2023-11-24T06:30:33.194096+0000","last_became_peered":"2023-11-24T06:30:33.194096+0000","last_unstale":"2023-11-24T06:30:33.200216+0000","last_undegraded":"2023-11-24T06:30:33.200216+0000","last_fullsized":"2023-11-24T06:30:33.200216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:42.500807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.217182+0000","last_change":"2023-11-24T06:30:32.181102+0000","last_active":"2023-11-24T06:30:33.217182+0000","last_peered":"2023-11-24T06:30:33.217182+0000","last_clean":"2023-11-24T06:30:33.217182+0000","last_became_active":"2023-11-24T06:30:32.180737+0000","last_became_peered":"2023-11-24T06:30:32.180737+0000","last_unstale":"2023-11-24T06:30:33.217182+0000","last_undegraded":"2023-11-24T06:30:33.217182+0000","last_fullsized":"2023-11-24T06:30:33.217182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:57.003160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.206765+0000","last_change":"2023-11-24T06:30:33.202191+0000","last_active":"2023-11-24T06:30:33.206765+0000","last_peered":"2023-11-24T06:30:33.206765+0000","last_clean":"2023-11-24T06:30:33.206765+0000","last_became_active":"2023-11-24T06:30:33.200436+0000","last_became_peered":"2023-11-24T06:30:33.200436+0000","last_unstale":"2023-11-24T06:30:33.206765+0000","last_undegraded":"2023-11-24T06:30:33.206765+0000","last_fullsized":"2023-11-24T06:30:33.206765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:39.133696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.220341+0000","last_change":"2023-11-24T06:30:32.167604+0000","last_active":"2023-11-24T06:30:33.220341+0000","last_peered":"2023-11-24T06:30:33.220341+0000","last_clean":"2023-11-24T06:30:33.220341+0000","last_became_active":"2023-11-24T06:30:32.165627+0000","last_became_peered":"2023-11-24T06:30:32.165627+0000","last_unstale":"2023-11-24T06:30:33.220341+0000","last_undegraded":"2023-11-24T06:30:33.220341+0000","last_fullsized":"2023-11-24T06:30:33.220341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:33:06.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.192472+0000","last_change":"2023-11-24T06:30:33.187822+0000","last_active":"2023-11-24T06:30:33.192472+0000","last_peered":"2023-11-24T06:30:33.192472+0000","last_clean":"2023-11-24T06:30:33.192472+0000","last_became_active":"2023-11-24T06:30:33.187555+0000","last_became_peered":"2023-11-24T06:30:33.187555+0000","last_unstale":"2023-11-24T06:30:33.192472+0000","last_undegraded":"2023-11-24T06:30:33.192472+0000","last_fullsized":"2023-11-24T06:30:33.192472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:45.524728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218710+0000","last_change":"2023-11-24T06:30:32.162640+0000","last_active":"2023-11-24T06:30:33.218710+0000","last_peered":"2023-11-24T06:30:33.218710+0000","last_clean":"2023-11-24T06:30:33.218710+0000","last_became_active":"2023-11-24T06:30:32.162331+0000","last_became_peered":"2023-11-24T06:30:32.162331+0000","last_unstale":"2023-11-24T06:30:33.218710+0000","last_undegraded":"2023-11-24T06:30:33.218710+0000","last_fullsized":"2023-11-24T06:30:33.218710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:44.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199778+0000","last_change":"2023-11-24T06:30:33.192114+0000","last_active":"2023-11-24T06:30:33.199778+0000","last_peered":"2023-11-24T06:30:33.199778+0000","last_clean":"2023-11-24T06:30:33.199778+0000","last_became_active":"2023-11-24T06:30:33.191852+0000","last_became_peered":"2023-11-24T06:30:33.191852+0000","last_unstale":"2023-11-24T06:30:33.199778+0000","last_undegraded":"2023-11-24T06:30:33.199778+0000","last_fullsized":"2023-11-24T06:30:33.199778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:24.739599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.172375+0000","last_change":"2023-11-24T06:30:32.163298+0000","last_active":"2023-11-24T06:30:33.172375+0000","last_peered":"2023-11-24T06:30:33.172375+0000","last_clean":"2023-11-24T06:30:33.172375+0000","last_became_active":"2023-11-24T06:30:32.163046+0000","last_became_peered":"2023-11-24T06:30:32.163046+0000","last_unstale":"2023-11-24T06:30:33.172375+0000","last_undegraded":"2023-11-24T06:30:33.172375+0000","last_fullsized":"2023-11-24T06:30:33.172375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:23.731927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205598+0000","last_change":"2023-11-24T06:30:33.195872+0000","last_active":"2023-11-24T06:30:33.205598+0000","last_peered":"2023-11-24T06:30:33.205598+0000","last_clean":"2023-11-24T06:30:33.205598+0000","last_became_active":"2023-11-24T06:30:33.195193+0000","last_became_peered":"2023-11-24T06:30:33.195193+0000","last_unstale":"2023-11-24T06:30:33.205598+0000","last_undegraded":"2023-11-24T06:30:33.205598+0000","last_fullsized":"2023-11-24T06:30:33.205598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.179208+0000","last_change":"2023-11-24T06:30:32.177970+0000","last_active":"2023-11-24T06:30:33.179208+0000","last_peered":"2023-11-24T06:30:33.179208+0000","last_clean":"2023-11-24T06:30:33.179208+0000","last_became_active":"2023-11-24T06:30:32.177638+0000","last_became_peered":"2023-11-24T06:30:32.177638+0000","last_unstale":"2023-11-24T06:30:33.179208+0000","last_undegraded":"2023-11-24T06:30:33.179208+0000","last_fullsized":"2023-11-24T06:30:33.179208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:57.003160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199218+0000","last_change":"2023-11-24T06:30:33.196750+0000","last_active":"2023-11-24T06:30:33.199218+0000","last_peered":"2023-11-24T06:30:33.199218+0000","last_clean":"2023-11-24T06:30:33.199218+0000","last_became_active":"2023-11-24T06:30:33.195233+0000","last_became_peered":"2023-11-24T06:30:33.195233+0000","last_unstale":"2023-11-24T06:30:33.199218+0000","last_undegraded":"2023-11-24T06:30:33.199218+0000","last_fullsized":"2023-11-24T06:30:33.199218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:13.745015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218586+0000","last_change":"2023-11-24T06:30:32.168393+0000","last_active":"2023-11-24T06:30:33.218586+0000","last_peered":"2023-11-24T06:30:33.218586+0000","last_clean":"2023-11-24T06:30:33.218586+0000","last_became_active":"2023-11-24T06:30:32.167560+0000","last_became_peered":"2023-11-24T06:30:32.167560+0000","last_unstale":"2023-11-24T06:30:33.218586+0000","last_undegraded":"2023-11-24T06:30:33.218586+0000","last_fullsized":"2023-11-24T06:30:33.218586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:57.833859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205769+0000","last_change":"2023-11-24T06:30:33.196490+0000","last_active":"2023-11-24T06:30:33.205769+0000","last_peered":"2023-11-24T06:30:33.205769+0000","last_clean":"2023-11-24T06:30:33.205769+0000","last_became_active":"2023-11-24T06:30:33.196216+0000","last_became_peered":"2023-11-24T06:30:33.196216+0000","last_unstale":"2023-11-24T06:30:33.205769+0000","last_undegraded":"2023-11-24T06:30:33.205769+0000","last_fullsized":"2023-11-24T06:30:33.205769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:55.706024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.216612+0000","last_change":"2023-11-24T06:30:32.169806+0000","last_active":"2023-11-24T06:30:33.216612+0000","last_peered":"2023-11-24T06:30:33.216612+0000","last_clean":"2023-11-24T06:30:33.216612+0000","last_became_active":"2023-11-24T06:30:32.169485+0000","last_became_peered":"2023-11-24T06:30:32.169485+0000","last_unstale":"2023-11-24T06:30:33.216612+0000","last_undegraded":"2023-11-24T06:30:33.216612+0000","last_fullsized":"2023-11-24T06:30:33.216612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:35.790701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.196228+0000","last_change":"2023-11-24T06:30:33.192709+0000","last_active":"2023-11-24T06:30:33.196228+0000","last_peered":"2023-11-24T06:30:33.196228+0000","last_clean":"2023-11-24T06:30:33.196228+0000","last_became_active":"2023-11-24T06:30:33.192053+0000","last_became_peered":"2023-11-24T06:30:33.192053+0000","last_unstale":"2023-11-24T06:30:33.196228+0000","last_undegraded":"2023-11-24T06:30:33.196228+0000","last_fullsized":"2023-11-24T06:30:33.196228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:33:07.152004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218271+0000","last_change":"2023-11-24T06:30:32.175791+0000","last_active":"2023-11-24T06:30:33.218271+0000","last_peered":"2023-11-24T06:30:33.218271+0000","last_clean":"2023-11-24T06:30:33.218271+0000","last_became_active":"2023-11-24T06:30:32.175469+0000","last_became_peered":"2023-11-24T06:30:32.175469+0000","last_unstale":"2023-11-24T06:30:33.218271+0000","last_undegraded":"2023-11-24T06:30:33.218271+0000","last_fullsized":"2023-11-24T06:30:33.218271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:56.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.187160+0000","last_change":"2023-11-24T06:30:33.180721+0000","last_active":"2023-11-24T06:30:33.187160+0000","last_peered":"2023-11-24T06:30:33.187160+0000","last_clean":"2023-11-24T06:30:33.187160+0000","last_became_active":"2023-11-24T06:30:33.180448+0000","last_became_peered":"2023-11-24T06:30:33.180448+0000","last_unstale":"2023-11-24T06:30:33.187160+0000","last_undegraded":"2023-11-24T06:30:33.187160+0000","last_fullsized":"2023-11-24T06:30:33.187160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:27.678200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.217884+0000","last_change":"2023-11-24T06:30:32.177204+0000","last_active":"2023-11-24T06:30:33.217884+0000","last_peered":"2023-11-24T06:30:33.217884+0000","last_clean":"2023-11-24T06:30:33.217884+0000","last_became_active":"2023-11-24T06:30:32.176814+0000","last_became_peered":"2023-11-24T06:30:32.176814+0000","last_unstale":"2023-11-24T06:30:33.217884+0000","last_undegraded":"2023-11-24T06:30:33.217884+0000","last_fullsized":"2023-11-24T06:30:33.217884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:01.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.186191+0000","last_change":"2023-11-24T06:30:33.184124+0000","last_active":"2023-11-24T06:30:33.186191+0000","last_peered":"2023-11-24T06:30:33.186191+0000","last_clean":"2023-11-24T06:30:33.186191+0000","last_became_active":"2023-11-24T06:30:33.183818+0000","last_became_peered":"2023-11-24T06:30:33.183818+0000","last_unstale":"2023-11-24T06:30:33.186191+0000","last_undegraded":"2023-11-24T06:30:33.186191+0000","last_fullsized":"2023-11-24T06:30:33.186191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:03.189073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.177434+0000","last_change":"2023-11-24T06:30:32.170231+0000","last_active":"2023-11-24T06:30:33.177434+0000","last_peered":"2023-11-24T06:30:33.177434+0000","last_clean":"2023-11-24T06:30:33.177434+0000","last_became_active":"2023-11-24T06:30:32.169843+0000","last_became_peered":"2023-11-24T06:30:32.169843+0000","last_unstale":"2023-11-24T06:30:33.177434+0000","last_undegraded":"2023-11-24T06:30:33.177434+0000","last_fullsized":"2023-11-24T06:30:33.177434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:59.838115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.185023+0000","last_change":"2023-11-24T06:30:33.181252+0000","last_active":"2023-11-24T06:30:33.185023+0000","last_peered":"2023-11-24T06:30:33.185023+0000","last_clean":"2023-11-24T06:30:33.185023+0000","last_became_active":"2023-11-24T06:30:33.180915+0000","last_became_peered":"2023-11-24T06:30:33.180915+0000","last_unstale":"2023-11-24T06:30:33.185023+0000","last_undegraded":"2023-11-24T06:30:33.185023+0000","last_fullsized":"2023-11-24T06:30:33.185023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:52:05.765398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218313+0000","last_change":"2023-11-24T06:30:32.157719+0000","last_active":"2023-11-24T06:30:33.218313+0000","last_peered":"2023-11-24T06:30:33.218313+0000","last_clean":"2023-11-24T06:30:33.218313+0000","last_became_active":"2023-11-24T06:30:32.157400+0000","last_became_peered":"2023-11-24T06:30:32.157400+0000","last_unstale":"2023-11-24T06:30:33.218313+0000","last_undegraded":"2023-11-24T06:30:33.218313+0000","last_fullsized":"2023-11-24T06:30:33.218313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:44.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.183632+0000","last_change":"2023-11-24T06:30:33.175553+0000","last_active":"2023-11-24T06:30:33.183632+0000","last_peered":"2023-11-24T06:30:33.183632+0000","last_clean":"2023-11-24T06:30:33.183632+0000","last_became_active":"2023-11-24T06:30:33.175253+0000","last_became_peered":"2023-11-24T06:30:33.175253+0000","last_unstale":"2023-11-24T06:30:33.183632+0000","last_undegraded":"2023-11-24T06:30:33.183632+0000","last_fullsized":"2023-11-24T06:30:33.183632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:48.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.182193+0000","last_change":"2023-11-24T06:30:32.179628+0000","last_active":"2023-11-24T06:30:33.182193+0000","last_peered":"2023-11-24T06:30:33.182193+0000","last_clean":"2023-11-24T06:30:33.182193+0000","last_became_active":"2023-11-24T06:30:32.179285+0000","last_became_peered":"2023-11-24T06:30:32.179285+0000","last_unstale":"2023-11-24T06:30:33.182193+0000","last_undegraded":"2023-11-24T06:30:33.182193+0000","last_fullsized":"2023-11-24T06:30:33.182193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:01.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.182764+0000","last_change":"2023-11-24T06:30:33.175755+0000","last_active":"2023-11-24T06:30:33.182764+0000","last_peered":"2023-11-24T06:30:33.182764+0000","last_clean":"2023-11-24T06:30:33.182764+0000","last_became_active":"2023-11-24T06:30:33.175443+0000","last_became_peered":"2023-11-24T06:30:33.175443+0000","last_unstale":"2023-11-24T06:30:33.182764+0000","last_undegraded":"2023-11-24T06:30:33.182764+0000","last_fullsized":"2023-11-24T06:30:33.182764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:44.561011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.176311+0000","last_change":"2023-11-24T06:30:32.161503+0000","last_active":"2023-11-24T06:30:33.176311+0000","last_peered":"2023-11-24T06:30:33.176311+0000","last_clean":"2023-11-24T06:30:33.176311+0000","last_became_active":"2023-11-24T06:30:32.161146+0000","last_became_peered":"2023-11-24T06:30:32.161146+0000","last_unstale":"2023-11-24T06:30:33.176311+0000","last_undegraded":"2023-11-24T06:30:33.176311+0000","last_fullsized":"2023-11-24T06:30:33.176311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:08.975583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.207640+0000","last_change":"2023-11-24T06:30:33.205270+0000","last_active":"2023-11-24T06:30:33.207640+0000","last_peered":"2023-11-24T06:30:33.207640+0000","last_clean":"2023-11-24T06:30:33.207640+0000","last_became_active":"2023-11-24T06:30:33.204994+0000","last_became_peered":"2023-11-24T06:30:33.204994+0000","last_unstale":"2023-11-24T06:30:33.207640+0000","last_undegraded":"2023-11-24T06:30:33.207640+0000","last_fullsized":"2023-11-24T06:30:33.207640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:24.388914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.174171+0000","last_change":"2023-11-24T06:30:32.180988+0000","last_active":"2023-11-24T06:30:33.174171+0000","last_peered":"2023-11-24T06:30:33.174171+0000","last_clean":"2023-11-24T06:30:33.174171+0000","last_became_active":"2023-11-24T06:30:32.180694+0000","last_became_peered":"2023-11-24T06:30:32.180694+0000","last_unstale":"2023-11-24T06:30:33.174171+0000","last_undegraded":"2023-11-24T06:30:33.174171+0000","last_fullsized":"2023-11-24T06:30:33.174171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:35.790701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199564+0000","last_change":"2023-11-24T06:30:33.195070+0000","last_active":"2023-11-24T06:30:33.199564+0000","last_peered":"2023-11-24T06:30:33.199564+0000","last_clean":"2023-11-24T06:30:33.199564+0000","last_became_active":"2023-11-24T06:30:33.192667+0000","last_became_peered":"2023-11-24T06:30:33.192667+0000","last_unstale":"2023-11-24T06:30:33.199564+0000","last_undegraded":"2023-11-24T06:30:33.199564+0000","last_fullsized":"2023-11-24T06:30:33.199564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:12.435644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.217956+0000","last_change":"2023-11-24T06:30:32.172658+0000","last_active":"2023-11-24T06:30:33.217956+0000","last_peered":"2023-11-24T06:30:33.217956+0000","last_clean":"2023-11-24T06:30:33.217956+0000","last_became_active":"2023-11-24T06:30:32.172322+0000","last_became_peered":"2023-11-24T06:30:32.172322+0000","last_unstale":"2023-11-24T06:30:33.217956+0000","last_undegraded":"2023-11-24T06:30:33.217956+0000","last_fullsized":"2023-11-24T06:30:33.217956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:41.493135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205660+0000","last_change":"2023-11-24T06:30:33.199285+0000","last_active":"2023-11-24T06:30:33.205660+0000","last_peered":"2023-11-24T06:30:33.205660+0000","last_clean":"2023-11-24T06:30:33.205660+0000","last_became_active":"2023-11-24T06:30:33.198995+0000","last_became_peered":"2023-11-24T06:30:33.198995+0000","last_unstale":"2023-11-24T06:30:33.205660+0000","last_undegraded":"2023-11-24T06:30:33.205660+0000","last_fullsized":"2023-11-24T06:30:33.205660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:09:12.421947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.171509+0000","last_change":"2023-11-24T06:30:32.160352+0000","last_active":"2023-11-24T06:30:33.171509+0000","last_peered":"2023-11-24T06:30:33.171509+0000","last_clean":"2023-11-24T06:30:33.171509+0000","last_became_active":"2023-11-24T06:30:32.160015+0000","last_became_peered":"2023-11-24T06:30:32.160015+0000","last_unstale":"2023-11-24T06:30:33.171509+0000","last_undegraded":"2023-11-24T06:30:33.171509+0000","last_fullsized":"2023-11-24T06:30:33.171509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:55.628624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.184661+0000","last_change":"2023-11-24T06:30:33.180728+0000","last_active":"2023-11-24T06:30:33.184661+0000","last_peered":"2023-11-24T06:30:33.184661+0000","last_clean":"2023-11-24T06:30:33.184661+0000","last_became_active":"2023-11-24T06:30:33.180453+0000","last_became_peered":"2023-11-24T06:30:33.180453+0000","last_unstale":"2023-11-24T06:30:33.184661+0000","last_undegraded":"2023-11-24T06:30:33.184661+0000","last_fullsized":"2023-11-24T06:30:33.184661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:57.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.173297+0000","last_change":"2023-11-24T06:30:32.177465+0000","last_active":"2023-11-24T06:30:33.173297+0000","last_peered":"2023-11-24T06:30:33.173297+0000","last_clean":"2023-11-24T06:30:33.173297+0000","last_became_active":"2023-11-24T06:30:32.177105+0000","last_became_peered":"2023-11-24T06:30:32.177105+0000","last_unstale":"2023-11-24T06:30:33.173297+0000","last_undegraded":"2023-11-24T06:30:33.173297+0000","last_fullsized":"2023-11-24T06:30:33.173297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:57.833859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199287+0000","last_change":"2023-11-24T06:30:33.194624+0000","last_active":"2023-11-24T06:30:33.199287+0000","last_peered":"2023-11-24T06:30:33.199287+0000","last_clean":"2023-11-24T06:30:33.199287+0000","last_became_active":"2023-11-24T06:30:33.194203+0000","last_became_peered":"2023-11-24T06:30:33.194203+0000","last_unstale":"2023-11-24T06:30:33.199287+0000","last_undegraded":"2023-11-24T06:30:33.199287+0000","last_fullsized":"2023-11-24T06:30:33.199287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:09.983255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.169815+0000","last_change":"2023-11-24T06:30:32.166442+0000","last_active":"2023-11-24T06:30:33.169815+0000","last_peered":"2023-11-24T06:30:33.169815+0000","last_clean":"2023-11-24T06:30:33.169815+0000","last_became_active":"2023-11-24T06:30:32.166141+0000","last_became_peered":"2023-11-24T06:30:32.166141+0000","last_unstale":"2023-11-24T06:30:33.169815+0000","last_undegraded":"2023-11-24T06:30:33.169815+0000","last_fullsized":"2023-11-24T06:30:33.169815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:05.367775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199443+0000","last_change":"2023-11-24T06:30:33.194869+0000","last_active":"2023-11-24T06:30:33.199443+0000","last_peered":"2023-11-24T06:30:33.199443+0000","last_clean":"2023-11-24T06:30:33.199443+0000","last_became_active":"2023-11-24T06:30:33.194623+0000","last_became_peered":"2023-11-24T06:30:33.194623+0000","last_unstale":"2023-11-24T06:30:33.199443+0000","last_undegraded":"2023-11-24T06:30:33.199443+0000","last_fullsized":"2023-11-24T06:30:33.199443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:27.678200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.172398+0000","last_change":"2023-11-24T06:30:32.172024+0000","last_active":"2023-11-24T06:30:33.172398+0000","last_peered":"2023-11-24T06:30:33.172398+0000","last_clean":"2023-11-24T06:30:33.172398+0000","last_became_active":"2023-11-24T06:30:32.171767+0000","last_became_peered":"2023-11-24T06:30:32.171767+0000","last_unstale":"2023-11-24T06:30:33.172398+0000","last_undegraded":"2023-11-24T06:30:33.172398+0000","last_fullsized":"2023-11-24T06:30:33.172398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:55.628624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190888+0000","last_change":"2023-11-24T06:30:33.184413+0000","last_active":"2023-11-24T06:30:33.190888+0000","last_peered":"2023-11-24T06:30:33.190888+0000","last_clean":"2023-11-24T06:30:33.190888+0000","last_became_active":"2023-11-24T06:30:33.184118+0000","last_became_peered":"2023-11-24T06:30:33.184118+0000","last_unstale":"2023-11-24T06:30:33.190888+0000","last_undegraded":"2023-11-24T06:30:33.190888+0000","last_fullsized":"2023-11-24T06:30:33.190888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:08.718077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.176438+0000","last_change":"2023-11-24T06:30:32.166357+0000","last_active":"2023-11-24T06:30:33.176438+0000","last_peered":"2023-11-24T06:30:33.176438+0000","last_clean":"2023-11-24T06:30:33.176438+0000","last_became_active":"2023-11-24T06:30:32.166108+0000","last_became_peered":"2023-11-24T06:30:32.166108+0000","last_unstale":"2023-11-24T06:30:33.176438+0000","last_undegraded":"2023-11-24T06:30:33.176438+0000","last_fullsized":"2023-11-24T06:30:33.176438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:12.737342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203454+0000","last_change":"2023-11-24T06:30:33.195809+0000","last_active":"2023-11-24T06:30:33.203454+0000","last_peered":"2023-11-24T06:30:33.203454+0000","last_clean":"2023-11-24T06:30:33.203454+0000","last_became_active":"2023-11-24T06:30:33.195539+0000","last_became_peered":"2023-11-24T06:30:33.195539+0000","last_unstale":"2023-11-24T06:30:33.203454+0000","last_undegraded":"2023-11-24T06:30:33.203454+0000","last_fullsized":"2023-11-24T06:30:33.203454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:03.189073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.178247+0000","last_change":"2023-11-24T06:30:32.180905+0000","last_active":"2023-11-24T06:30:33.178247+0000","last_peered":"2023-11-24T06:30:33.178247+0000","last_clean":"2023-11-24T06:30:33.178247+0000","last_became_active":"2023-11-24T06:30:32.180581+0000","last_became_peered":"2023-11-24T06:30:32.180581+0000","last_unstale":"2023-11-24T06:30:33.178247+0000","last_undegraded":"2023-11-24T06:30:33.178247+0000","last_fullsized":"2023-11-24T06:30:33.178247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:31.482219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203460+0000","last_change":"2023-11-24T06:30:33.192172+0000","last_active":"2023-11-24T06:30:33.203460+0000","last_peered":"2023-11-24T06:30:33.203460+0000","last_clean":"2023-11-24T06:30:33.203460+0000","last_became_active":"2023-11-24T06:30:33.191793+0000","last_became_peered":"2023-11-24T06:30:33.191793+0000","last_unstale":"2023-11-24T06:30:33.203460+0000","last_undegraded":"2023-11-24T06:30:33.203460+0000","last_fullsized":"2023-11-24T06:30:33.203460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:44.907422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.181850+0000","last_change":"2023-11-24T06:30:32.181310+0000","last_active":"2023-11-24T06:30:33.181850+0000","last_peered":"2023-11-24T06:30:33.181850+0000","last_clean":"2023-11-24T06:30:33.181850+0000","last_became_active":"2023-11-24T06:30:32.180985+0000","last_became_peered":"2023-11-24T06:30:32.180985+0000","last_unstale":"2023-11-24T06:30:33.181850+0000","last_undegraded":"2023-11-24T06:30:33.181850+0000","last_fullsized":"2023-11-24T06:30:33.181850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:34:28.015616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-24T06:30:32.172979+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:30:32.172979+0000","last_peered":"2023-11-24T06:30:32.172979+0000","last_clean":"2023-11-24T06:30:32.172979+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:30:32.172979+0000","last_undegraded":"2023-11-24T06:30:32.172979+0000","last_fullsized":"2023-11-24T06:30:32.172979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.92600000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.98899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.94999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.879},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.85699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.72599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.625}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.745}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.495}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.626},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.438},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.748},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":716875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.44},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.204},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.998}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.88}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.044},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.129},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:30:37.259 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:30:37.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 Processor -- start 2023-11-24T06:30:37.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 -- start start 2023-11-24T06:30:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 0x7fe69006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6900ce8b0 0x7fe6900ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900d1cc0 con 0x7fe6900d3020 2023-11-24T06:30:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6900d1fa0 con 0x7fe6900ce8b0 2023-11-24T06:30:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe69492a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900ce0b0 con 0x7fe69015d570 2023-11-24T06:30:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68dd9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe6900d3020 0x7fe6900d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38862/0 (socket says 172.21.15.143:38862) 2023-11-24T06:30:37.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68dd9b640 1 -- 172.21.15.143:0/63397313 learned_addr learned my addr 172.21.15.143:0/63397313 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:37.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68ed9d640 1 --2- 172.21.15.143:0/63397313 >> v2:172.21.15.146:3300/0 conn(0x7fe6900ce8b0 0x7fe6900ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68e59c640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 0x7fe69006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176161868 0 0) 0x7fe6900d1cc0 con 0x7fe6900d3020 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe678003530 con 0x7fe6900d3020 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2312340354 0 0) 0x7fe678003530 con 0x7fe6900d3020 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 msgr2=0x7fe69006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 0x7fe69006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 >> v2:172.21.15.146:3300/0 conn(0x7fe6900ce8b0 msgr2=0x7fe6900ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 --2- 172.21.15.143:0/63397313 >> v2:172.21.15.146:3300/0 conn(0x7fe6900ce8b0 0x7fe6900ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900ce390 con 0x7fe6900d3020 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fe684001680 con 0x7fe6900d3020 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 >> v1:172.21.15.143:6789/0 conn(0x7fe6900d3020 legacy=0x7fe6900d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe678003980 0x7fe678003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6780047d0 0x7fe678004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 0x7fe678005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900d1fa0 con 0x7fe678003980 2023-11-24T06:30:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900ce0b0 con 0x7fe6780047d0 2023-11-24T06:30:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67800b990 con 0x7fe69015d570 2023-11-24T06:30:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68e59c640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe678003980 0x7fe678003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68dd9b640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6780047d0 0x7fe678004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.436+0000 7fe68ed9d640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 0x7fe678005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68e59c640 1 -- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 msgr2=0x7fe678005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68e59c640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe69015d570 0x7fe678005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68e59c640 1 -- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6780047d0 msgr2=0x7fe678004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:37.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68e59c640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6780047d0 0x7fe678004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68e59c640 1 -- 172.21.15.143:0/63397313 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678003530 con 0x7fe678003980 2023-11-24T06:30:37.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68e59c640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe678003980 0x7fe678003da0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ae0 tx=0x7fe68001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9121affc339a76 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a6410 con 0x7fe678003980 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800a6570 con 0x7fe678003980 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68d59a640 1 -- 172.21.15.143:0/63397313 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a6920 con 0x7fe678003980 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe69492a640 1 -- 172.21.15.143:0/63397313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe678003980 msgr2=0x7fe678003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe69492a640 1 --2- 172.21.15.143:0/63397313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe678003980 0x7fe678003da0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ae0 tx=0x7fe68001c9f0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.440+0000 7fe68ed9d640 1 -- 172.21.15.143:0/63397313 reap_dead start 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- 172.21.15.143:0/63397313 shutdown_connections 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- 172.21.15.143:0/63397313 >> 172.21.15.143:0/63397313 conn(0x7fe69008ceb0 msgr2=0x7fe69009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- 172.21.15.143:0/63397313 shutdown_connections 2023-11-24T06:30:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- 172.21.15.143:0/63397313 wait complete. 2023-11-24T06:30:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 Processor -- start 2023-11-24T06:30:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- start start 2023-11-24T06:30:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe678003980 0x7fe69015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe690152a10 0x7fe6900b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 0x7fe6900b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69015f6b0 con 0x7fe6900b81a0 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900b6290 con 0x7fe678003980 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe69492a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900b6f00 con 0x7fe690152a10 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 0x7fe6900b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 0x7fe6900b8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59734/0 (socket says 172.21.15.143:59734) 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 -- 172.21.15.143:0/1249905152 learned_addr learned my addr 172.21.15.143:0/1249905152 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68e59c640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe678003980 0x7fe69015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68dd9b640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe690152a10 0x7fe6900b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 -- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe690152a10 msgr2=0x7fe6900b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe690152a10 0x7fe6900b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 -- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe678003980 msgr2=0x7fe69015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe678003980 0x7fe69015db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.444+0000 7fe68ed9d640 1 -- 172.21.15.143:0/1249905152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900b71e0 con 0x7fe6900b81a0 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe68ed9d640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 0x7fe6900b8620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe6900d0eb0 tx=0x7fe68800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800e040 con 0x7fe6900b81a0 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800f040 con 0x7fe6900b81a0 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688015430 con 0x7fe6900b81a0 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900b74c0 con 0x7fe6900b81a0 2023-11-24T06:30:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6900b77a0 con 0x7fe6900b81a0 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69015f4f0 con 0x7fe6900b81a0 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe688015590 con 0x7fe6900b81a0 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe67effd640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6700664a0 0x7fe670068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6880846b0 con 0x7fe6900b81a0 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.448+0000 7fe68e59c640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6700664a0 0x7fe670068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.452+0000 7fe68e59c640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6700664a0 0x7fe670068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6800ad000 tx=0x7fe6800b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.452+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe69015f4f0 con 0x7fe6900b81a0 2023-11-24T06:30:37.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.600+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe69015f4f0 con 0x7fe6700664a0 2023-11-24T06:30:37.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.608+0000 7fe67effd640 1 -- 172.21.15.143:0/1249905152 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288782 (secure 0 0 0) 0x7fe69015f4f0 con 0x7fe6700664a0 2023-11-24T06:30:37.614 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:37.615 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:30:37.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6700664a0 msgr2=0x7fe670068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6700664a0 0x7fe670068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6800ad000 tx=0x7fe6800b3040 comp rx=0 tx=0).stop 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 msgr2=0x7fe6900b8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 0x7fe6900b8620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe6900d0eb0 tx=0x7fe68800f580 comp rx=0 tx=0).stop 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 shutdown_connections 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6700664a0 0x7fe670068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6900b81a0 0x7fe6900b8620 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe690152a10 0x7fe6900b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 --2- 172.21.15.143:0/1249905152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe678003980 0x7fe69015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 >> 172.21.15.143:0/1249905152 conn(0x7fe69008ceb0 msgr2=0x7fe6901617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 shutdown_connections 2023-11-24T06:30:37.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.612+0000 7fe69492a640 1 -- 172.21.15.143:0/1249905152 wait complete. 2023-11-24T06:30:37.634 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-24T06:30:36.217078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3870720,"data_stored":2199575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.072837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204069+0000","last_change":"2023-11-24T06:30:33.201334+0000","last_active":"2023-11-24T06:30:33.204069+0000","last_peered":"2023-11-24T06:30:33.204069+0000","last_clean":"2023-11-24T06:30:33.204069+0000","last_became_active":"2023-11-24T06:30:33.200810+0000","last_became_peered":"2023-11-24T06:30:33.200810+0000","last_unstale":"2023-11-24T06:30:33.204069+0000","last_undegraded":"2023-11-24T06:30:33.204069+0000","last_fullsized":"2023-11-24T06:30:33.204069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:45.524728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199637+0000","last_change":"2023-11-24T06:30:33.191145+0000","last_active":"2023-11-24T06:30:33.199637+0000","last_peered":"2023-11-24T06:30:33.199637+0000","last_clean":"2023-11-24T06:30:33.199637+0000","last_became_active":"2023-11-24T06:30:33.190835+0000","last_became_peered":"2023-11-24T06:30:33.190835+0000","last_unstale":"2023-11-24T06:30:33.199637+0000","last_undegraded":"2023-11-24T06:30:33.199637+0000","last_fullsized":"2023-11-24T06:30:33.199637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.797499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.202315+0000","last_change":"2023-11-24T06:30:33.197752+0000","last_active":"2023-11-24T06:30:33.202315+0000","last_peered":"2023-11-24T06:30:33.202315+0000","last_clean":"2023-11-24T06:30:33.202315+0000","last_became_active":"2023-11-24T06:30:33.197461+0000","last_became_peered":"2023-11-24T06:30:33.197461+0000","last_unstale":"2023-11-24T06:30:33.202315+0000","last_undegraded":"2023-11-24T06:30:33.202315+0000","last_fullsized":"2023-11-24T06:30:33.202315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:24.388914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.192498+0000","last_change":"2023-11-24T06:30:33.187260+0000","last_active":"2023-11-24T06:30:33.192498+0000","last_peered":"2023-11-24T06:30:33.192498+0000","last_clean":"2023-11-24T06:30:33.192498+0000","last_became_active":"2023-11-24T06:30:33.184642+0000","last_became_peered":"2023-11-24T06:30:33.184642+0000","last_unstale":"2023-11-24T06:30:33.192498+0000","last_undegraded":"2023-11-24T06:30:33.192498+0000","last_fullsized":"2023-11-24T06:30:33.192498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:06.375447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191525+0000","last_change":"2023-11-24T06:30:33.185925+0000","last_active":"2023-11-24T06:30:33.191525+0000","last_peered":"2023-11-24T06:30:33.191525+0000","last_clean":"2023-11-24T06:30:33.191525+0000","last_became_active":"2023-11-24T06:30:33.185628+0000","last_became_peered":"2023-11-24T06:30:33.185628+0000","last_unstale":"2023-11-24T06:30:33.191525+0000","last_undegraded":"2023-11-24T06:30:33.191525+0000","last_fullsized":"2023-11-24T06:30:33.191525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:25.508171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.196697+0000","last_change":"2023-11-24T06:30:33.190952+0000","last_active":"2023-11-24T06:30:33.196697+0000","last_peered":"2023-11-24T06:30:33.196697+0000","last_clean":"2023-11-24T06:30:33.196697+0000","last_became_active":"2023-11-24T06:30:33.190536+0000","last_became_peered":"2023-11-24T06:30:33.190536+0000","last_unstale":"2023-11-24T06:30:33.196697+0000","last_undegraded":"2023-11-24T06:30:33.196697+0000","last_fullsized":"2023-11-24T06:30:33.196697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.207469+0000","last_change":"2023-11-24T06:30:33.205148+0000","last_active":"2023-11-24T06:30:33.207469+0000","last_peered":"2023-11-24T06:30:33.207469+0000","last_clean":"2023-11-24T06:30:33.207469+0000","last_became_active":"2023-11-24T06:30:33.204838+0000","last_became_peered":"2023-11-24T06:30:33.204838+0000","last_unstale":"2023-11-24T06:30:33.207469+0000","last_undegraded":"2023-11-24T06:30:33.207469+0000","last_fullsized":"2023-11-24T06:30:33.207469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:39.133696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.201825+0000","last_change":"2023-11-24T06:30:33.188873+0000","last_active":"2023-11-24T06:30:33.201825+0000","last_peered":"2023-11-24T06:30:33.201825+0000","last_clean":"2023-11-24T06:30:33.201825+0000","last_became_active":"2023-11-24T06:30:33.188079+0000","last_became_peered":"2023-11-24T06:30:33.188079+0000","last_unstale":"2023-11-24T06:30:33.201825+0000","last_undegraded":"2023-11-24T06:30:33.201825+0000","last_fullsized":"2023-11-24T06:30:33.201825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:24.739599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191574+0000","last_change":"2023-11-24T06:30:33.185334+0000","last_active":"2023-11-24T06:30:33.191574+0000","last_peered":"2023-11-24T06:30:33.191574+0000","last_clean":"2023-11-24T06:30:33.191574+0000","last_became_active":"2023-11-24T06:30:33.184744+0000","last_became_peered":"2023-11-24T06:30:33.184744+0000","last_unstale":"2023-11-24T06:30:33.191574+0000","last_undegraded":"2023-11-24T06:30:33.191574+0000","last_fullsized":"2023-11-24T06:30:33.191574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:37:05.431691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205940+0000","last_change":"2023-11-24T06:30:33.194302+0000","last_active":"2023-11-24T06:30:33.205940+0000","last_peered":"2023-11-24T06:30:33.205940+0000","last_clean":"2023-11-24T06:30:33.205940+0000","last_became_active":"2023-11-24T06:30:33.193842+0000","last_became_peered":"2023-11-24T06:30:33.193842+0000","last_unstale":"2023-11-24T06:30:33.205940+0000","last_undegraded":"2023-11-24T06:30:33.205940+0000","last_fullsized":"2023-11-24T06:30:33.205940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.202064+0000","last_change":"2023-11-24T06:30:33.189006+0000","last_active":"2023-11-24T06:30:33.202064+0000","last_peered":"2023-11-24T06:30:33.202064+0000","last_clean":"2023-11-24T06:30:33.202064+0000","last_became_active":"2023-11-24T06:30:33.188735+0000","last_became_peered":"2023-11-24T06:30:33.188735+0000","last_unstale":"2023-11-24T06:30:33.202064+0000","last_undegraded":"2023-11-24T06:30:33.202064+0000","last_fullsized":"2023-11-24T06:30:33.202064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:36.798373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204363+0000","last_change":"2023-11-24T06:30:33.198702+0000","last_active":"2023-11-24T06:30:33.204363+0000","last_peered":"2023-11-24T06:30:33.204363+0000","last_clean":"2023-11-24T06:30:33.204363+0000","last_became_active":"2023-11-24T06:30:33.198338+0000","last_became_peered":"2023-11-24T06:30:33.198338+0000","last_unstale":"2023-11-24T06:30:33.204363+0000","last_undegraded":"2023-11-24T06:30:33.204363+0000","last_fullsized":"2023-11-24T06:30:33.204363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:32.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.184910+0000","last_change":"2023-11-24T06:30:33.180437+0000","last_active":"2023-11-24T06:30:33.184910+0000","last_peered":"2023-11-24T06:30:33.184910+0000","last_clean":"2023-11-24T06:30:33.184910+0000","last_became_active":"2023-11-24T06:30:33.180089+0000","last_became_peered":"2023-11-24T06:30:33.180089+0000","last_unstale":"2023-11-24T06:30:33.184910+0000","last_undegraded":"2023-11-24T06:30:33.184910+0000","last_fullsized":"2023-11-24T06:30:33.184910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:05.519032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190846+0000","last_change":"2023-11-24T06:30:33.186799+0000","last_active":"2023-11-24T06:30:33.190846+0000","last_peered":"2023-11-24T06:30:33.190846+0000","last_clean":"2023-11-24T06:30:33.190846+0000","last_became_active":"2023-11-24T06:30:33.185946+0000","last_became_peered":"2023-11-24T06:30:33.185946+0000","last_unstale":"2023-11-24T06:30:33.190846+0000","last_undegraded":"2023-11-24T06:30:33.190846+0000","last_fullsized":"2023-11-24T06:30:33.190846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:56.636296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.206920+0000","last_change":"2023-11-24T06:30:33.202641+0000","last_active":"2023-11-24T06:30:33.206920+0000","last_peered":"2023-11-24T06:30:33.206920+0000","last_clean":"2023-11-24T06:30:33.206920+0000","last_became_active":"2023-11-24T06:30:33.202334+0000","last_became_peered":"2023-11-24T06:30:33.202334+0000","last_unstale":"2023-11-24T06:30:33.206920+0000","last_undegraded":"2023-11-24T06:30:33.206920+0000","last_fullsized":"2023-11-24T06:30:33.206920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203528+0000","last_change":"2023-11-24T06:30:33.192280+0000","last_active":"2023-11-24T06:30:33.203528+0000","last_peered":"2023-11-24T06:30:33.203528+0000","last_clean":"2023-11-24T06:30:33.203528+0000","last_became_active":"2023-11-24T06:30:33.192049+0000","last_became_peered":"2023-11-24T06:30:33.192049+0000","last_unstale":"2023-11-24T06:30:33.203528+0000","last_undegraded":"2023-11-24T06:30:33.203528+0000","last_fullsized":"2023-11-24T06:30:33.203528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.207504+0000","last_change":"2023-11-24T06:30:33.205341+0000","last_active":"2023-11-24T06:30:33.207504+0000","last_peered":"2023-11-24T06:30:33.207504+0000","last_clean":"2023-11-24T06:30:33.207504+0000","last_became_active":"2023-11-24T06:30:33.204422+0000","last_became_peered":"2023-11-24T06:30:33.204422+0000","last_unstale":"2023-11-24T06:30:33.207504+0000","last_undegraded":"2023-11-24T06:30:33.207504+0000","last_fullsized":"2023-11-24T06:30:33.207504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:32.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199746+0000","last_change":"2023-11-24T06:30:33.192073+0000","last_active":"2023-11-24T06:30:33.199746+0000","last_peered":"2023-11-24T06:30:33.199746+0000","last_clean":"2023-11-24T06:30:33.199746+0000","last_became_active":"2023-11-24T06:30:33.191528+0000","last_became_peered":"2023-11-24T06:30:33.191528+0000","last_unstale":"2023-11-24T06:30:33.199746+0000","last_undegraded":"2023-11-24T06:30:33.199746+0000","last_fullsized":"2023-11-24T06:30:33.199746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:24.388914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.193385+0000","last_change":"2023-11-24T06:30:33.188259+0000","last_active":"2023-11-24T06:30:33.193385+0000","last_peered":"2023-11-24T06:30:33.193385+0000","last_clean":"2023-11-24T06:30:33.193385+0000","last_became_active":"2023-11-24T06:30:33.187984+0000","last_became_peered":"2023-11-24T06:30:33.187984+0000","last_unstale":"2023-11-24T06:30:33.193385+0000","last_undegraded":"2023-11-24T06:30:33.193385+0000","last_fullsized":"2023-11-24T06:30:33.193385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:05:09.954926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199512+0000","last_change":"2023-11-24T06:30:33.194802+0000","last_active":"2023-11-24T06:30:33.199512+0000","last_peered":"2023-11-24T06:30:33.199512+0000","last_clean":"2023-11-24T06:30:33.199512+0000","last_became_active":"2023-11-24T06:30:33.194468+0000","last_became_peered":"2023-11-24T06:30:33.194468+0000","last_unstale":"2023-11-24T06:30:33.199512+0000","last_undegraded":"2023-11-24T06:30:33.199512+0000","last_fullsized":"2023-11-24T06:30:33.199512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:37:05.431691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191213+0000","last_change":"2023-11-24T06:30:33.184092+0000","last_active":"2023-11-24T06:30:33.191213+0000","last_peered":"2023-11-24T06:30:33.191213+0000","last_clean":"2023-11-24T06:30:33.191213+0000","last_became_active":"2023-11-24T06:30:33.183748+0000","last_became_peered":"2023-11-24T06:30:33.183748+0000","last_unstale":"2023-11-24T06:30:33.191213+0000","last_undegraded":"2023-11-24T06:30:33.191213+0000","last_fullsized":"2023-11-24T06:30:33.191213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:25.508171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199543+0000","last_change":"2023-11-24T06:30:33.189408+0000","last_active":"2023-11-24T06:30:33.199543+0000","last_peered":"2023-11-24T06:30:33.199543+0000","last_clean":"2023-11-24T06:30:33.199543+0000","last_became_active":"2023-11-24T06:30:33.189114+0000","last_became_peered":"2023-11-24T06:30:33.189114+0000","last_unstale":"2023-11-24T06:30:33.199543+0000","last_undegraded":"2023-11-24T06:30:33.199543+0000","last_fullsized":"2023-11-24T06:30:33.199543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:54.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.189204+0000","last_change":"2023-11-24T06:30:33.186020+0000","last_active":"2023-11-24T06:30:33.189204+0000","last_peered":"2023-11-24T06:30:33.189204+0000","last_clean":"2023-11-24T06:30:33.189204+0000","last_became_active":"2023-11-24T06:30:33.185715+0000","last_became_peered":"2023-11-24T06:30:33.185715+0000","last_unstale":"2023-11-24T06:30:33.189204+0000","last_undegraded":"2023-11-24T06:30:33.189204+0000","last_fullsized":"2023-11-24T06:30:33.189204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:55.706024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190572+0000","last_change":"2023-11-24T06:30:33.187466+0000","last_active":"2023-11-24T06:30:33.190572+0000","last_peered":"2023-11-24T06:30:33.190572+0000","last_clean":"2023-11-24T06:30:33.190572+0000","last_became_active":"2023-11-24T06:30:33.187063+0000","last_became_peered":"2023-11-24T06:30:33.187063+0000","last_unstale":"2023-11-24T06:30:33.190572+0000","last_undegraded":"2023-11-24T06:30:33.190572+0000","last_fullsized":"2023-11-24T06:30:33.190572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.206032+0000","last_change":"2023-11-24T06:30:33.195547+0000","last_active":"2023-11-24T06:30:33.206032+0000","last_peered":"2023-11-24T06:30:33.206032+0000","last_clean":"2023-11-24T06:30:33.206032+0000","last_became_active":"2023-11-24T06:30:33.195285+0000","last_became_peered":"2023-11-24T06:30:33.195285+0000","last_unstale":"2023-11-24T06:30:33.206032+0000","last_undegraded":"2023-11-24T06:30:33.206032+0000","last_fullsized":"2023-11-24T06:30:33.206032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:08.718077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.208818+0000","last_change":"2023-11-24T06:30:33.203314+0000","last_active":"2023-11-24T06:30:33.208818+0000","last_peered":"2023-11-24T06:30:33.208818+0000","last_clean":"2023-11-24T06:30:33.208818+0000","last_became_active":"2023-11-24T06:30:33.203042+0000","last_became_peered":"2023-11-24T06:30:33.203042+0000","last_unstale":"2023-11-24T06:30:33.208818+0000","last_undegraded":"2023-11-24T06:30:33.208818+0000","last_fullsized":"2023-11-24T06:30:33.208818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:36.798373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.194096+0000","last_change":"2023-11-24T06:30:33.186341+0000","last_active":"2023-11-24T06:30:33.194096+0000","last_peered":"2023-11-24T06:30:33.194096+0000","last_clean":"2023-11-24T06:30:33.194096+0000","last_became_active":"2023-11-24T06:30:33.185831+0000","last_became_peered":"2023-11-24T06:30:33.185831+0000","last_unstale":"2023-11-24T06:30:33.194096+0000","last_undegraded":"2023-11-24T06:30:33.194096+0000","last_fullsized":"2023-11-24T06:30:33.194096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190604+0000","last_change":"2023-11-24T06:30:33.187984+0000","last_active":"2023-11-24T06:30:33.190604+0000","last_peered":"2023-11-24T06:30:33.190604+0000","last_clean":"2023-11-24T06:30:33.190604+0000","last_became_active":"2023-11-24T06:30:33.187712+0000","last_became_peered":"2023-11-24T06:30:33.187712+0000","last_unstale":"2023-11-24T06:30:33.190604+0000","last_undegraded":"2023-11-24T06:30:33.190604+0000","last_fullsized":"2023-11-24T06:30:33.190604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:58.841532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191232+0000","last_change":"2023-11-24T06:30:33.184874+0000","last_active":"2023-11-24T06:30:33.191232+0000","last_peered":"2023-11-24T06:30:33.191232+0000","last_clean":"2023-11-24T06:30:33.191232+0000","last_became_active":"2023-11-24T06:30:33.184556+0000","last_became_peered":"2023-11-24T06:30:33.184556+0000","last_unstale":"2023-11-24T06:30:33.191232+0000","last_undegraded":"2023-11-24T06:30:33.191232+0000","last_fullsized":"2023-11-24T06:30:33.191232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:05.519032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204172+0000","last_change":"2023-11-24T06:30:33.194634+0000","last_active":"2023-11-24T06:30:33.204172+0000","last_peered":"2023-11-24T06:30:33.204172+0000","last_clean":"2023-11-24T06:30:33.204172+0000","last_became_active":"2023-11-24T06:30:33.194293+0000","last_became_peered":"2023-11-24T06:30:33.194293+0000","last_unstale":"2023-11-24T06:30:33.204172+0000","last_undegraded":"2023-11-24T06:30:33.204172+0000","last_fullsized":"2023-11-24T06:30:33.204172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:42.500807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199465+0000","last_change":"2023-11-24T06:30:33.197347+0000","last_active":"2023-11-24T06:30:33.199465+0000","last_peered":"2023-11-24T06:30:33.199465+0000","last_clean":"2023-11-24T06:30:33.199465+0000","last_became_active":"2023-11-24T06:30:33.195787+0000","last_became_peered":"2023-11-24T06:30:33.195787+0000","last_unstale":"2023-11-24T06:30:33.199465+0000","last_undegraded":"2023-11-24T06:30:33.199465+0000","last_fullsized":"2023-11-24T06:30:33.199465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:40:34.383971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.201849+0000","last_change":"2023-11-24T06:30:33.189077+0000","last_active":"2023-11-24T06:30:33.201849+0000","last_peered":"2023-11-24T06:30:33.201849+0000","last_clean":"2023-11-24T06:30:33.201849+0000","last_became_active":"2023-11-24T06:30:33.188491+0000","last_became_peered":"2023-11-24T06:30:33.188491+0000","last_unstale":"2023-11-24T06:30:33.201849+0000","last_undegraded":"2023-11-24T06:30:33.201849+0000","last_fullsized":"2023-11-24T06:30:33.201849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:56.636296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.197080+0000","last_change":"2023-11-24T06:30:33.193080+0000","last_active":"2023-11-24T06:30:33.197080+0000","last_peered":"2023-11-24T06:30:33.197080+0000","last_clean":"2023-11-24T06:30:33.197080+0000","last_became_active":"2023-11-24T06:30:33.192806+0000","last_became_peered":"2023-11-24T06:30:33.192806+0000","last_unstale":"2023-11-24T06:30:33.197080+0000","last_undegraded":"2023-11-24T06:30:33.197080+0000","last_fullsized":"2023-11-24T06:30:33.197080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:24.739599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218235+0000","last_change":"2023-11-24T06:30:32.178356+0000","last_active":"2023-11-24T06:30:33.218235+0000","last_peered":"2023-11-24T06:30:33.218235+0000","last_clean":"2023-11-24T06:30:33.218235+0000","last_became_active":"2023-11-24T06:30:32.178042+0000","last_became_peered":"2023-11-24T06:30:32.178042+0000","last_unstale":"2023-11-24T06:30:33.218235+0000","last_undegraded":"2023-11-24T06:30:33.218235+0000","last_fullsized":"2023-11-24T06:30:33.218235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:54.698351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.204050+0000","last_change":"2023-11-24T06:30:33.201081+0000","last_active":"2023-11-24T06:30:33.204050+0000","last_peered":"2023-11-24T06:30:33.204050+0000","last_clean":"2023-11-24T06:30:33.204050+0000","last_became_active":"2023-11-24T06:30:33.200435+0000","last_became_peered":"2023-11-24T06:30:33.200435+0000","last_unstale":"2023-11-24T06:30:33.204050+0000","last_undegraded":"2023-11-24T06:30:33.204050+0000","last_fullsized":"2023-11-24T06:30:33.204050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:21:00.845787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.216109+0000","last_change":"2023-11-24T06:30:32.181591+0000","last_active":"2023-11-24T06:30:33.216109+0000","last_peered":"2023-11-24T06:30:33.216109+0000","last_clean":"2023-11-24T06:30:33.216109+0000","last_became_active":"2023-11-24T06:30:32.181226+0000","last_became_peered":"2023-11-24T06:30:32.181226+0000","last_unstale":"2023-11-24T06:30:33.216109+0000","last_undegraded":"2023-11-24T06:30:33.216109+0000","last_fullsized":"2023-11-24T06:30:33.216109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:07.710405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199886+0000","last_change":"2023-11-24T06:30:33.187944+0000","last_active":"2023-11-24T06:30:33.199886+0000","last_peered":"2023-11-24T06:30:33.199886+0000","last_clean":"2023-11-24T06:30:33.199886+0000","last_became_active":"2023-11-24T06:30:33.187646+0000","last_became_peered":"2023-11-24T06:30:33.187646+0000","last_unstale":"2023-11-24T06:30:33.199886+0000","last_undegraded":"2023-11-24T06:30:33.199886+0000","last_fullsized":"2023-11-24T06:30:33.199886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:52:05.765398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.216970+0000","last_change":"2023-11-24T06:30:32.172571+0000","last_active":"2023-11-24T06:30:33.216970+0000","last_peered":"2023-11-24T06:30:33.216970+0000","last_clean":"2023-11-24T06:30:33.216970+0000","last_became_active":"2023-11-24T06:30:32.168293+0000","last_became_peered":"2023-11-24T06:30:32.168293+0000","last_unstale":"2023-11-24T06:30:33.216970+0000","last_undegraded":"2023-11-24T06:30:33.216970+0000","last_fullsized":"2023-11-24T06:30:33.216970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:09:11.414275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.194076+0000","last_change":"2023-11-24T06:30:33.186173+0000","last_active":"2023-11-24T06:30:33.194076+0000","last_peered":"2023-11-24T06:30:33.194076+0000","last_clean":"2023-11-24T06:30:33.194076+0000","last_became_active":"2023-11-24T06:30:33.185509+0000","last_became_peered":"2023-11-24T06:30:33.185509+0000","last_unstale":"2023-11-24T06:30:33.194076+0000","last_undegraded":"2023-11-24T06:30:33.194076+0000","last_fullsized":"2023-11-24T06:30:33.194076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:57.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218020+0000","last_change":"2023-11-24T06:30:32.179661+0000","last_active":"2023-11-24T06:30:33.218020+0000","last_peered":"2023-11-24T06:30:33.218020+0000","last_clean":"2023-11-24T06:30:33.218020+0000","last_became_active":"2023-11-24T06:30:32.179132+0000","last_became_peered":"2023-11-24T06:30:32.179132+0000","last_unstale":"2023-11-24T06:30:33.218020+0000","last_undegraded":"2023-11-24T06:30:33.218020+0000","last_fullsized":"2023-11-24T06:30:33.218020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:53.380369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203493+0000","last_change":"2023-11-24T06:30:33.193945+0000","last_active":"2023-11-24T06:30:33.203493+0000","last_peered":"2023-11-24T06:30:33.203493+0000","last_clean":"2023-11-24T06:30:33.203493+0000","last_became_active":"2023-11-24T06:30:33.193685+0000","last_became_peered":"2023-11-24T06:30:33.193685+0000","last_unstale":"2023-11-24T06:30:33.203493+0000","last_undegraded":"2023-11-24T06:30:33.203493+0000","last_fullsized":"2023-11-24T06:30:33.203493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:58.841532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218764+0000","last_change":"2023-11-24T06:30:32.171295+0000","last_active":"2023-11-24T06:30:33.218764+0000","last_peered":"2023-11-24T06:30:33.218764+0000","last_clean":"2023-11-24T06:30:33.218764+0000","last_became_active":"2023-11-24T06:30:32.171000+0000","last_became_peered":"2023-11-24T06:30:32.171000+0000","last_unstale":"2023-11-24T06:30:33.218764+0000","last_undegraded":"2023-11-24T06:30:33.218764+0000","last_fullsized":"2023-11-24T06:30:33.218764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:34:28.015616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.191463+0000","last_change":"2023-11-24T06:30:33.189288+0000","last_active":"2023-11-24T06:30:33.191463+0000","last_peered":"2023-11-24T06:30:33.191463+0000","last_clean":"2023-11-24T06:30:33.191463+0000","last_became_active":"2023-11-24T06:30:33.186409+0000","last_became_peered":"2023-11-24T06:30:33.186409+0000","last_unstale":"2023-11-24T06:30:33.191463+0000","last_undegraded":"2023-11-24T06:30:33.191463+0000","last_fullsized":"2023-11-24T06:30:33.191463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:42.500807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218561+0000","last_change":"2023-11-24T06:30:32.169738+0000","last_active":"2023-11-24T06:30:33.218561+0000","last_peered":"2023-11-24T06:30:33.218561+0000","last_clean":"2023-11-24T06:30:33.218561+0000","last_became_active":"2023-11-24T06:30:32.169419+0000","last_became_peered":"2023-11-24T06:30:32.169419+0000","last_unstale":"2023-11-24T06:30:33.218561+0000","last_undegraded":"2023-11-24T06:30:33.218561+0000","last_fullsized":"2023-11-24T06:30:33.218561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:40:33.376298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199610+0000","last_change":"2023-11-24T06:30:33.191608+0000","last_active":"2023-11-24T06:30:33.199610+0000","last_peered":"2023-11-24T06:30:33.199610+0000","last_clean":"2023-11-24T06:30:33.199610+0000","last_became_active":"2023-11-24T06:30:33.188677+0000","last_became_peered":"2023-11-24T06:30:33.188677+0000","last_unstale":"2023-11-24T06:30:33.199610+0000","last_undegraded":"2023-11-24T06:30:33.199610+0000","last_fullsized":"2023-11-24T06:30:33.199610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:48.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.179088+0000","last_change":"2023-11-24T06:30:32.175942+0000","last_active":"2023-11-24T06:30:33.179088+0000","last_peered":"2023-11-24T06:30:33.179088+0000","last_clean":"2023-11-24T06:30:33.179088+0000","last_became_active":"2023-11-24T06:30:32.175210+0000","last_became_peered":"2023-11-24T06:30:32.175210+0000","last_unstale":"2023-11-24T06:30:33.179088+0000","last_undegraded":"2023-11-24T06:30:33.179088+0000","last_fullsized":"2023-11-24T06:30:33.179088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:43.899750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.194514+0000","last_change":"2023-11-24T06:30:33.191671+0000","last_active":"2023-11-24T06:30:33.194514+0000","last_peered":"2023-11-24T06:30:33.194514+0000","last_clean":"2023-11-24T06:30:33.194514+0000","last_became_active":"2023-11-24T06:30:33.191398+0000","last_became_peered":"2023-11-24T06:30:33.191398+0000","last_unstale":"2023-11-24T06:30:33.194514+0000","last_undegraded":"2023-11-24T06:30:33.194514+0000","last_fullsized":"2023-11-24T06:30:33.194514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:55.706024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.176239+0000","last_change":"2023-11-24T06:30:32.174113+0000","last_active":"2023-11-24T06:30:33.176239+0000","last_peered":"2023-11-24T06:30:33.176239+0000","last_clean":"2023-11-24T06:30:33.176239+0000","last_became_active":"2023-11-24T06:30:32.173787+0000","last_became_peered":"2023-11-24T06:30:32.173787+0000","last_unstale":"2023-11-24T06:30:33.176239+0000","last_undegraded":"2023-11-24T06:30:33.176239+0000","last_fullsized":"2023-11-24T06:30:33.176239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:16:25.310624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203258+0000","last_change":"2023-11-24T06:30:33.197729+0000","last_active":"2023-11-24T06:30:33.203258+0000","last_peered":"2023-11-24T06:30:33.203258+0000","last_clean":"2023-11-24T06:30:33.203258+0000","last_became_active":"2023-11-24T06:30:33.197442+0000","last_became_peered":"2023-11-24T06:30:33.197442+0000","last_unstale":"2023-11-24T06:30:33.203258+0000","last_undegraded":"2023-11-24T06:30:33.203258+0000","last_fullsized":"2023-11-24T06:30:33.203258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:44.907422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.179661+0000","last_change":"2023-11-24T06:30:32.180890+0000","last_active":"2023-11-24T06:30:33.179661+0000","last_peered":"2023-11-24T06:30:33.179661+0000","last_clean":"2023-11-24T06:30:33.179661+0000","last_became_active":"2023-11-24T06:30:32.180575+0000","last_became_peered":"2023-11-24T06:30:32.180575+0000","last_unstale":"2023-11-24T06:30:33.179661+0000","last_undegraded":"2023-11-24T06:30:33.179661+0000","last_fullsized":"2023-11-24T06:30:33.179661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:13.543360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.196011+0000","last_change":"2023-11-24T06:30:33.189686+0000","last_active":"2023-11-24T06:30:33.196011+0000","last_peered":"2023-11-24T06:30:33.196011+0000","last_clean":"2023-11-24T06:30:33.196011+0000","last_became_active":"2023-11-24T06:30:33.189421+0000","last_became_peered":"2023-11-24T06:30:33.189421+0000","last_unstale":"2023-11-24T06:30:33.196011+0000","last_undegraded":"2023-11-24T06:30:33.196011+0000","last_fullsized":"2023-11-24T06:30:33.196011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:39.133696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.170516+0000","last_change":"2023-11-24T06:30:32.172290+0000","last_active":"2023-11-24T06:30:33.170516+0000","last_peered":"2023-11-24T06:30:33.170516+0000","last_clean":"2023-11-24T06:30:33.170516+0000","last_became_active":"2023-11-24T06:30:32.171990+0000","last_became_peered":"2023-11-24T06:30:32.171990+0000","last_unstale":"2023-11-24T06:30:33.170516+0000","last_undegraded":"2023-11-24T06:30:33.170516+0000","last_fullsized":"2023-11-24T06:30:33.170516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:22.950101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.200216+0000","last_change":"2023-11-24T06:30:33.194377+0000","last_active":"2023-11-24T06:30:33.200216+0000","last_peered":"2023-11-24T06:30:33.200216+0000","last_clean":"2023-11-24T06:30:33.200216+0000","last_became_active":"2023-11-24T06:30:33.194096+0000","last_became_peered":"2023-11-24T06:30:33.194096+0000","last_unstale":"2023-11-24T06:30:33.200216+0000","last_undegraded":"2023-11-24T06:30:33.200216+0000","last_fullsized":"2023-11-24T06:30:33.200216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:42.500807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.217182+0000","last_change":"2023-11-24T06:30:32.181102+0000","last_active":"2023-11-24T06:30:33.217182+0000","last_peered":"2023-11-24T06:30:33.217182+0000","last_clean":"2023-11-24T06:30:33.217182+0000","last_became_active":"2023-11-24T06:30:32.180737+0000","last_became_peered":"2023-11-24T06:30:32.180737+0000","last_unstale":"2023-11-24T06:30:33.217182+0000","last_undegraded":"2023-11-24T06:30:33.217182+0000","last_fullsized":"2023-11-24T06:30:33.217182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:57.003160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.206765+0000","last_change":"2023-11-24T06:30:33.202191+0000","last_active":"2023-11-24T06:30:33.206765+0000","last_peered":"2023-11-24T06:30:33.206765+0000","last_clean":"2023-11-24T06:30:33.206765+0000","last_became_active":"2023-11-24T06:30:33.200436+0000","last_became_peered":"2023-11-24T06:30:33.200436+0000","last_unstale":"2023-11-24T06:30:33.206765+0000","last_undegraded":"2023-11-24T06:30:33.206765+0000","last_fullsized":"2023-11-24T06:30:33.206765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:39.133696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.220341+0000","last_change":"2023-11-24T06:30:32.167604+0000","last_active":"2023-11-24T06:30:33.220341+0000","last_peered":"2023-11-24T06:30:33.220341+0000","last_clean":"2023-11-24T06:30:33.220341+0000","last_became_active":"2023-11-24T06:30:32.165627+0000","last_became_peered":"2023-11-24T06:30:32.165627+0000","last_unstale":"2023-11-24T06:30:33.220341+0000","last_undegraded":"2023-11-24T06:30:33.220341+0000","last_fullsized":"2023-11-24T06:30:33.220341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:33:06.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.192472+0000","last_change":"2023-11-24T06:30:33.187822+0000","last_active":"2023-11-24T06:30:33.192472+0000","last_peered":"2023-11-24T06:30:33.192472+0000","last_clean":"2023-11-24T06:30:33.192472+0000","last_became_active":"2023-11-24T06:30:33.187555+0000","last_became_peered":"2023-11-24T06:30:33.187555+0000","last_unstale":"2023-11-24T06:30:33.192472+0000","last_undegraded":"2023-11-24T06:30:33.192472+0000","last_fullsized":"2023-11-24T06:30:33.192472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:45.524728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218710+0000","last_change":"2023-11-24T06:30:32.162640+0000","last_active":"2023-11-24T06:30:33.218710+0000","last_peered":"2023-11-24T06:30:33.218710+0000","last_clean":"2023-11-24T06:30:33.218710+0000","last_became_active":"2023-11-24T06:30:32.162331+0000","last_became_peered":"2023-11-24T06:30:32.162331+0000","last_unstale":"2023-11-24T06:30:33.218710+0000","last_undegraded":"2023-11-24T06:30:33.218710+0000","last_fullsized":"2023-11-24T06:30:33.218710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:44.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199778+0000","last_change":"2023-11-24T06:30:33.192114+0000","last_active":"2023-11-24T06:30:33.199778+0000","last_peered":"2023-11-24T06:30:33.199778+0000","last_clean":"2023-11-24T06:30:33.199778+0000","last_became_active":"2023-11-24T06:30:33.191852+0000","last_became_peered":"2023-11-24T06:30:33.191852+0000","last_unstale":"2023-11-24T06:30:33.199778+0000","last_undegraded":"2023-11-24T06:30:33.199778+0000","last_fullsized":"2023-11-24T06:30:33.199778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:24.739599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.172375+0000","last_change":"2023-11-24T06:30:32.163298+0000","last_active":"2023-11-24T06:30:33.172375+0000","last_peered":"2023-11-24T06:30:33.172375+0000","last_clean":"2023-11-24T06:30:33.172375+0000","last_became_active":"2023-11-24T06:30:32.163046+0000","last_became_peered":"2023-11-24T06:30:32.163046+0000","last_unstale":"2023-11-24T06:30:33.172375+0000","last_undegraded":"2023-11-24T06:30:33.172375+0000","last_fullsized":"2023-11-24T06:30:33.172375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:23.731927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205598+0000","last_change":"2023-11-24T06:30:33.195872+0000","last_active":"2023-11-24T06:30:33.205598+0000","last_peered":"2023-11-24T06:30:33.205598+0000","last_clean":"2023-11-24T06:30:33.205598+0000","last_became_active":"2023-11-24T06:30:33.195193+0000","last_became_peered":"2023-11-24T06:30:33.195193+0000","last_unstale":"2023-11-24T06:30:33.205598+0000","last_undegraded":"2023-11-24T06:30:33.205598+0000","last_fullsized":"2023-11-24T06:30:33.205598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:23.957773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.179208+0000","last_change":"2023-11-24T06:30:32.177970+0000","last_active":"2023-11-24T06:30:33.179208+0000","last_peered":"2023-11-24T06:30:33.179208+0000","last_clean":"2023-11-24T06:30:33.179208+0000","last_became_active":"2023-11-24T06:30:32.177638+0000","last_became_peered":"2023-11-24T06:30:32.177638+0000","last_unstale":"2023-11-24T06:30:33.179208+0000","last_undegraded":"2023-11-24T06:30:33.179208+0000","last_fullsized":"2023-11-24T06:30:33.179208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:57.003160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199218+0000","last_change":"2023-11-24T06:30:33.196750+0000","last_active":"2023-11-24T06:30:33.199218+0000","last_peered":"2023-11-24T06:30:33.199218+0000","last_clean":"2023-11-24T06:30:33.199218+0000","last_became_active":"2023-11-24T06:30:33.195233+0000","last_became_peered":"2023-11-24T06:30:33.195233+0000","last_unstale":"2023-11-24T06:30:33.199218+0000","last_undegraded":"2023-11-24T06:30:33.199218+0000","last_fullsized":"2023-11-24T06:30:33.199218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:13.745015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218586+0000","last_change":"2023-11-24T06:30:32.168393+0000","last_active":"2023-11-24T06:30:33.218586+0000","last_peered":"2023-11-24T06:30:33.218586+0000","last_clean":"2023-11-24T06:30:33.218586+0000","last_became_active":"2023-11-24T06:30:32.167560+0000","last_became_peered":"2023-11-24T06:30:32.167560+0000","last_unstale":"2023-11-24T06:30:33.218586+0000","last_undegraded":"2023-11-24T06:30:33.218586+0000","last_fullsized":"2023-11-24T06:30:33.218586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:57.833859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205769+0000","last_change":"2023-11-24T06:30:33.196490+0000","last_active":"2023-11-24T06:30:33.205769+0000","last_peered":"2023-11-24T06:30:33.205769+0000","last_clean":"2023-11-24T06:30:33.205769+0000","last_became_active":"2023-11-24T06:30:33.196216+0000","last_became_peered":"2023-11-24T06:30:33.196216+0000","last_unstale":"2023-11-24T06:30:33.205769+0000","last_undegraded":"2023-11-24T06:30:33.205769+0000","last_fullsized":"2023-11-24T06:30:33.205769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:55.706024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.216612+0000","last_change":"2023-11-24T06:30:32.169806+0000","last_active":"2023-11-24T06:30:33.216612+0000","last_peered":"2023-11-24T06:30:33.216612+0000","last_clean":"2023-11-24T06:30:33.216612+0000","last_became_active":"2023-11-24T06:30:32.169485+0000","last_became_peered":"2023-11-24T06:30:32.169485+0000","last_unstale":"2023-11-24T06:30:33.216612+0000","last_undegraded":"2023-11-24T06:30:33.216612+0000","last_fullsized":"2023-11-24T06:30:33.216612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:35.790701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.196228+0000","last_change":"2023-11-24T06:30:33.192709+0000","last_active":"2023-11-24T06:30:33.196228+0000","last_peered":"2023-11-24T06:30:33.196228+0000","last_clean":"2023-11-24T06:30:33.196228+0000","last_became_active":"2023-11-24T06:30:33.192053+0000","last_became_peered":"2023-11-24T06:30:33.192053+0000","last_unstale":"2023-11-24T06:30:33.196228+0000","last_undegraded":"2023-11-24T06:30:33.196228+0000","last_fullsized":"2023-11-24T06:30:33.196228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:33:07.152004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218271+0000","last_change":"2023-11-24T06:30:32.175791+0000","last_active":"2023-11-24T06:30:33.218271+0000","last_peered":"2023-11-24T06:30:33.218271+0000","last_clean":"2023-11-24T06:30:33.218271+0000","last_became_active":"2023-11-24T06:30:32.175469+0000","last_became_peered":"2023-11-24T06:30:32.175469+0000","last_unstale":"2023-11-24T06:30:33.218271+0000","last_undegraded":"2023-11-24T06:30:33.218271+0000","last_fullsized":"2023-11-24T06:30:33.218271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:56.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.187160+0000","last_change":"2023-11-24T06:30:33.180721+0000","last_active":"2023-11-24T06:30:33.187160+0000","last_peered":"2023-11-24T06:30:33.187160+0000","last_clean":"2023-11-24T06:30:33.187160+0000","last_became_active":"2023-11-24T06:30:33.180448+0000","last_became_peered":"2023-11-24T06:30:33.180448+0000","last_unstale":"2023-11-24T06:30:33.187160+0000","last_undegraded":"2023-11-24T06:30:33.187160+0000","last_fullsized":"2023-11-24T06:30:33.187160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:27.678200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.217884+0000","last_change":"2023-11-24T06:30:32.177204+0000","last_active":"2023-11-24T06:30:33.217884+0000","last_peered":"2023-11-24T06:30:33.217884+0000","last_clean":"2023-11-24T06:30:33.217884+0000","last_became_active":"2023-11-24T06:30:32.176814+0000","last_became_peered":"2023-11-24T06:30:32.176814+0000","last_unstale":"2023-11-24T06:30:33.217884+0000","last_undegraded":"2023-11-24T06:30:33.217884+0000","last_fullsized":"2023-11-24T06:30:33.217884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:01.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.186191+0000","last_change":"2023-11-24T06:30:33.184124+0000","last_active":"2023-11-24T06:30:33.186191+0000","last_peered":"2023-11-24T06:30:33.186191+0000","last_clean":"2023-11-24T06:30:33.186191+0000","last_became_active":"2023-11-24T06:30:33.183818+0000","last_became_peered":"2023-11-24T06:30:33.183818+0000","last_unstale":"2023-11-24T06:30:33.186191+0000","last_undegraded":"2023-11-24T06:30:33.186191+0000","last_fullsized":"2023-11-24T06:30:33.186191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:03.189073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.177434+0000","last_change":"2023-11-24T06:30:32.170231+0000","last_active":"2023-11-24T06:30:33.177434+0000","last_peered":"2023-11-24T06:30:33.177434+0000","last_clean":"2023-11-24T06:30:33.177434+0000","last_became_active":"2023-11-24T06:30:32.169843+0000","last_became_peered":"2023-11-24T06:30:32.169843+0000","last_unstale":"2023-11-24T06:30:33.177434+0000","last_undegraded":"2023-11-24T06:30:33.177434+0000","last_fullsized":"2023-11-24T06:30:33.177434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:59.838115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.185023+0000","last_change":"2023-11-24T06:30:33.181252+0000","last_active":"2023-11-24T06:30:33.185023+0000","last_peered":"2023-11-24T06:30:33.185023+0000","last_clean":"2023-11-24T06:30:33.185023+0000","last_became_active":"2023-11-24T06:30:33.180915+0000","last_became_peered":"2023-11-24T06:30:33.180915+0000","last_unstale":"2023-11-24T06:30:33.185023+0000","last_undegraded":"2023-11-24T06:30:33.185023+0000","last_fullsized":"2023-11-24T06:30:33.185023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:52:05.765398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.218313+0000","last_change":"2023-11-24T06:30:32.157719+0000","last_active":"2023-11-24T06:30:33.218313+0000","last_peered":"2023-11-24T06:30:33.218313+0000","last_clean":"2023-11-24T06:30:33.218313+0000","last_became_active":"2023-11-24T06:30:32.157400+0000","last_became_peered":"2023-11-24T06:30:32.157400+0000","last_unstale":"2023-11-24T06:30:33.218313+0000","last_undegraded":"2023-11-24T06:30:33.218313+0000","last_fullsized":"2023-11-24T06:30:33.218313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:44.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.183632+0000","last_change":"2023-11-24T06:30:33.175553+0000","last_active":"2023-11-24T06:30:33.183632+0000","last_peered":"2023-11-24T06:30:33.183632+0000","last_clean":"2023-11-24T06:30:33.183632+0000","last_became_active":"2023-11-24T06:30:33.175253+0000","last_became_peered":"2023-11-24T06:30:33.175253+0000","last_unstale":"2023-11-24T06:30:33.183632+0000","last_undegraded":"2023-11-24T06:30:33.183632+0000","last_fullsized":"2023-11-24T06:30:33.183632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:48.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.182193+0000","last_change":"2023-11-24T06:30:32.179628+0000","last_active":"2023-11-24T06:30:33.182193+0000","last_peered":"2023-11-24T06:30:33.182193+0000","last_clean":"2023-11-24T06:30:33.182193+0000","last_became_active":"2023-11-24T06:30:32.179285+0000","last_became_peered":"2023-11-24T06:30:32.179285+0000","last_unstale":"2023-11-24T06:30:33.182193+0000","last_undegraded":"2023-11-24T06:30:33.182193+0000","last_fullsized":"2023-11-24T06:30:33.182193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:01.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.182764+0000","last_change":"2023-11-24T06:30:33.175755+0000","last_active":"2023-11-24T06:30:33.182764+0000","last_peered":"2023-11-24T06:30:33.182764+0000","last_clean":"2023-11-24T06:30:33.182764+0000","last_became_active":"2023-11-24T06:30:33.175443+0000","last_became_peered":"2023-11-24T06:30:33.175443+0000","last_unstale":"2023-11-24T06:30:33.182764+0000","last_undegraded":"2023-11-24T06:30:33.182764+0000","last_fullsized":"2023-11-24T06:30:33.182764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:44.561011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.176311+0000","last_change":"2023-11-24T06:30:32.161503+0000","last_active":"2023-11-24T06:30:33.176311+0000","last_peered":"2023-11-24T06:30:33.176311+0000","last_clean":"2023-11-24T06:30:33.176311+0000","last_became_active":"2023-11-24T06:30:32.161146+0000","last_became_peered":"2023-11-24T06:30:32.161146+0000","last_unstale":"2023-11-24T06:30:33.176311+0000","last_undegraded":"2023-11-24T06:30:33.176311+0000","last_fullsized":"2023-11-24T06:30:33.176311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:08.975583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.207640+0000","last_change":"2023-11-24T06:30:33.205270+0000","last_active":"2023-11-24T06:30:33.207640+0000","last_peered":"2023-11-24T06:30:33.207640+0000","last_clean":"2023-11-24T06:30:33.207640+0000","last_became_active":"2023-11-24T06:30:33.204994+0000","last_became_peered":"2023-11-24T06:30:33.204994+0000","last_unstale":"2023-11-24T06:30:33.207640+0000","last_undegraded":"2023-11-24T06:30:33.207640+0000","last_fullsized":"2023-11-24T06:30:33.207640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:24.388914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.174171+0000","last_change":"2023-11-24T06:30:32.180988+0000","last_active":"2023-11-24T06:30:33.174171+0000","last_peered":"2023-11-24T06:30:33.174171+0000","last_clean":"2023-11-24T06:30:33.174171+0000","last_became_active":"2023-11-24T06:30:32.180694+0000","last_became_peered":"2023-11-24T06:30:32.180694+0000","last_unstale":"2023-11-24T06:30:33.174171+0000","last_undegraded":"2023-11-24T06:30:33.174171+0000","last_fullsized":"2023-11-24T06:30:33.174171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:35.790701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199564+0000","last_change":"2023-11-24T06:30:33.195070+0000","last_active":"2023-11-24T06:30:33.199564+0000","last_peered":"2023-11-24T06:30:33.199564+0000","last_clean":"2023-11-24T06:30:33.199564+0000","last_became_active":"2023-11-24T06:30:33.192667+0000","last_became_peered":"2023-11-24T06:30:33.192667+0000","last_unstale":"2023-11-24T06:30:33.199564+0000","last_undegraded":"2023-11-24T06:30:33.199564+0000","last_fullsized":"2023-11-24T06:30:33.199564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:12.435644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.217956+0000","last_change":"2023-11-24T06:30:32.172658+0000","last_active":"2023-11-24T06:30:33.217956+0000","last_peered":"2023-11-24T06:30:33.217956+0000","last_clean":"2023-11-24T06:30:33.217956+0000","last_became_active":"2023-11-24T06:30:32.172322+0000","last_became_peered":"2023-11-24T06:30:32.172322+0000","last_unstale":"2023-11-24T06:30:33.217956+0000","last_undegraded":"2023-11-24T06:30:33.217956+0000","last_fullsized":"2023-11-24T06:30:33.217956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:41.493135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.205660+0000","last_change":"2023-11-24T06:30:33.199285+0000","last_active":"2023-11-24T06:30:33.205660+0000","last_peered":"2023-11-24T06:30:33.205660+0000","last_clean":"2023-11-24T06:30:33.205660+0000","last_became_active":"2023-11-24T06:30:33.198995+0000","last_became_peered":"2023-11-24T06:30:33.198995+0000","last_unstale":"2023-11-24T06:30:33.205660+0000","last_undegraded":"2023-11-24T06:30:33.205660+0000","last_fullsized":"2023-11-24T06:30:33.205660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:09:12.421947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.171509+0000","last_change":"2023-11-24T06:30:32.160352+0000","last_active":"2023-11-24T06:30:33.171509+0000","last_peered":"2023-11-24T06:30:33.171509+0000","last_clean":"2023-11-24T06:30:33.171509+0000","last_became_active":"2023-11-24T06:30:32.160015+0000","last_became_peered":"2023-11-24T06:30:32.160015+0000","last_unstale":"2023-11-24T06:30:33.171509+0000","last_undegraded":"2023-11-24T06:30:33.171509+0000","last_fullsized":"2023-11-24T06:30:33.171509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:55.628624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.184661+0000","last_change":"2023-11-24T06:30:33.180728+0000","last_active":"2023-11-24T06:30:33.184661+0000","last_peered":"2023-11-24T06:30:33.184661+0000","last_clean":"2023-11-24T06:30:33.184661+0000","last_became_active":"2023-11-24T06:30:33.180453+0000","last_became_peered":"2023-11-24T06:30:33.180453+0000","last_unstale":"2023-11-24T06:30:33.184661+0000","last_undegraded":"2023-11-24T06:30:33.184661+0000","last_fullsized":"2023-11-24T06:30:33.184661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:57.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.173297+0000","last_change":"2023-11-24T06:30:32.177465+0000","last_active":"2023-11-24T06:30:33.173297+0000","last_peered":"2023-11-24T06:30:33.173297+0000","last_clean":"2023-11-24T06:30:33.173297+0000","last_became_active":"2023-11-24T06:30:32.177105+0000","last_became_peered":"2023-11-24T06:30:32.177105+0000","last_unstale":"2023-11-24T06:30:33.173297+0000","last_undegraded":"2023-11-24T06:30:33.173297+0000","last_fullsized":"2023-11-24T06:30:33.173297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:57.833859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199287+0000","last_change":"2023-11-24T06:30:33.194624+0000","last_active":"2023-11-24T06:30:33.199287+0000","last_peered":"2023-11-24T06:30:33.199287+0000","last_clean":"2023-11-24T06:30:33.199287+0000","last_became_active":"2023-11-24T06:30:33.194203+0000","last_became_peered":"2023-11-24T06:30:33.194203+0000","last_unstale":"2023-11-24T06:30:33.199287+0000","last_undegraded":"2023-11-24T06:30:33.199287+0000","last_fullsized":"2023-11-24T06:30:33.199287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:09.983255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.169815+0000","last_change":"2023-11-24T06:30:32.166442+0000","last_active":"2023-11-24T06:30:33.169815+0000","last_peered":"2023-11-24T06:30:33.169815+0000","last_clean":"2023-11-24T06:30:33.169815+0000","last_became_active":"2023-11-24T06:30:32.166141+0000","last_became_peered":"2023-11-24T06:30:32.166141+0000","last_unstale":"2023-11-24T06:30:33.169815+0000","last_undegraded":"2023-11-24T06:30:33.169815+0000","last_fullsized":"2023-11-24T06:30:33.169815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:05.367775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.199443+0000","last_change":"2023-11-24T06:30:33.194869+0000","last_active":"2023-11-24T06:30:33.199443+0000","last_peered":"2023-11-24T06:30:33.199443+0000","last_clean":"2023-11-24T06:30:33.199443+0000","last_became_active":"2023-11-24T06:30:33.194623+0000","last_became_peered":"2023-11-24T06:30:33.194623+0000","last_unstale":"2023-11-24T06:30:33.199443+0000","last_undegraded":"2023-11-24T06:30:33.199443+0000","last_fullsized":"2023-11-24T06:30:33.199443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:27.678200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.172398+0000","last_change":"2023-11-24T06:30:32.172024+0000","last_active":"2023-11-24T06:30:33.172398+0000","last_peered":"2023-11-24T06:30:33.172398+0000","last_clean":"2023-11-24T06:30:33.172398+0000","last_became_active":"2023-11-24T06:30:32.171767+0000","last_became_peered":"2023-11-24T06:30:32.171767+0000","last_unstale":"2023-11-24T06:30:33.172398+0000","last_undegraded":"2023-11-24T06:30:33.172398+0000","last_fullsized":"2023-11-24T06:30:33.172398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:55.628624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.190888+0000","last_change":"2023-11-24T06:30:33.184413+0000","last_active":"2023-11-24T06:30:33.190888+0000","last_peered":"2023-11-24T06:30:33.190888+0000","last_clean":"2023-11-24T06:30:33.190888+0000","last_became_active":"2023-11-24T06:30:33.184118+0000","last_became_peered":"2023-11-24T06:30:33.184118+0000","last_unstale":"2023-11-24T06:30:33.190888+0000","last_undegraded":"2023-11-24T06:30:33.190888+0000","last_fullsized":"2023-11-24T06:30:33.190888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:08.718077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.176438+0000","last_change":"2023-11-24T06:30:32.166357+0000","last_active":"2023-11-24T06:30:33.176438+0000","last_peered":"2023-11-24T06:30:33.176438+0000","last_clean":"2023-11-24T06:30:33.176438+0000","last_became_active":"2023-11-24T06:30:32.166108+0000","last_became_peered":"2023-11-24T06:30:32.166108+0000","last_unstale":"2023-11-24T06:30:33.176438+0000","last_undegraded":"2023-11-24T06:30:33.176438+0000","last_fullsized":"2023-11-24T06:30:33.176438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:12.737342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203454+0000","last_change":"2023-11-24T06:30:33.195809+0000","last_active":"2023-11-24T06:30:33.203454+0000","last_peered":"2023-11-24T06:30:33.203454+0000","last_clean":"2023-11-24T06:30:33.203454+0000","last_became_active":"2023-11-24T06:30:33.195539+0000","last_became_peered":"2023-11-24T06:30:33.195539+0000","last_unstale":"2023-11-24T06:30:33.203454+0000","last_undegraded":"2023-11-24T06:30:33.203454+0000","last_fullsized":"2023-11-24T06:30:33.203454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:03.189073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.178247+0000","last_change":"2023-11-24T06:30:32.180905+0000","last_active":"2023-11-24T06:30:33.178247+0000","last_peered":"2023-11-24T06:30:33.178247+0000","last_clean":"2023-11-24T06:30:33.178247+0000","last_became_active":"2023-11-24T06:30:32.180581+0000","last_became_peered":"2023-11-24T06:30:32.180581+0000","last_unstale":"2023-11-24T06:30:33.178247+0000","last_undegraded":"2023-11-24T06:30:33.178247+0000","last_fullsized":"2023-11-24T06:30:33.178247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:31.482219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.203460+0000","last_change":"2023-11-24T06:30:33.192172+0000","last_active":"2023-11-24T06:30:33.203460+0000","last_peered":"2023-11-24T06:30:33.203460+0000","last_clean":"2023-11-24T06:30:33.203460+0000","last_became_active":"2023-11-24T06:30:33.191793+0000","last_became_peered":"2023-11-24T06:30:33.191793+0000","last_unstale":"2023-11-24T06:30:33.203460+0000","last_undegraded":"2023-11-24T06:30:33.203460+0000","last_fullsized":"2023-11-24T06:30:33.203460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:32.143460+0000","last_clean_scrub_stamp":"2023-11-24T06:30:32.143460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:44.907422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:30:33.181850+0000","last_change":"2023-11-24T06:30:32.181310+0000","last_active":"2023-11-24T06:30:33.181850+0000","last_peered":"2023-11-24T06:30:33.181850+0000","last_clean":"2023-11-24T06:30:33.181850+0000","last_became_active":"2023-11-24T06:30:32.180985+0000","last_became_peered":"2023-11-24T06:30:32.180985+0000","last_unstale":"2023-11-24T06:30:33.181850+0000","last_undegraded":"2023-11-24T06:30:33.181850+0000","last_fullsized":"2023-11-24T06:30:33.181850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:30:31.135787+0000","last_clean_scrub_stamp":"2023-11-24T06:30:31.135787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:34:28.015616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-24T06:30:32.172979+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:30:32.172979+0000","last_peered":"2023-11-24T06:30:32.172979+0000","last_clean":"2023-11-24T06:30:32.172979+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:30:32.172979+0000","last_undegraded":"2023-11-24T06:30:32.172979+0000","last_fullsized":"2023-11-24T06:30:32.172979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.92600000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.98899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.94999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.879},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.85699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.72599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.625}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.745}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.495}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.626},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.438},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.748},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":716875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.44},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.204},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.998}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.88}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.044},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.129},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:30:37.639 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:30:37.639 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:30:37.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.820+0000 7fa8265b8640 1 Processor -- start 2023-11-24T06:30:37.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.820+0000 7fa8265b8640 1 -- start start 2023-11-24T06:30:37.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa8265b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa82015a4d0 0x7fa8200c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa8265b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82006d740 0x7fa82006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa8265b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82006e0d0 con 0x7fa8200cad20 2023-11-24T06:30:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa8265b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82015a8b0 con 0x7fa82015a4d0 2023-11-24T06:30:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa8265b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200c9c30 con 0x7fa82006d740 2023-11-24T06:30:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa8200cad20 0x7fa82015e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38874/0 (socket says 172.21.15.143:38874) 2023-11-24T06:30:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81f7fe640 1 -- 172.21.15.143:0/3976052646 learned_addr learned my addr 172.21.15.143:0/3976052646 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81ffff640 1 --2- 172.21.15.143:0/3976052646 >> v2:172.21.15.143:3300/0 conn(0x7fa82015a4d0 0x7fa8200c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa824b55640 1 --2- 172.21.15.143:0/3976052646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82006d740 0x7fa82006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81effd640 1 -- 172.21.15.143:0/3976052646 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373444299 0 0) 0x7fa814001120 con 0x7fa8200cad20 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81effd640 1 -- 172.21.15.143:0/3976052646 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa808005740 con 0x7fa8200cad20 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81ffff640 1 -- 172.21.15.143:0/3976052646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82006d740 msgr2=0x7fa82006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81ffff640 1 --2- 172.21.15.143:0/3976052646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82006d740 0x7fa82006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81ffff640 1 -- 172.21.15.143:0/3976052646 >> v1:172.21.15.143:6789/0 conn(0x7fa8200cad20 legacy=0x7fa82015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.824+0000 7fa81ffff640 1 -- 172.21.15.143:0/3976052646 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200c9f60 con 0x7fa82015a4d0 2023-11-24T06:30:37.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa81ffff640 1 --2- 172.21.15.143:0/3976052646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82015a4d0 0x7fa8200c9650 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8100097c0 tx=0x7fa81001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460472dd0411994d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa81effd640 1 -- 172.21.15.143:0/3976052646 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ac620 con 0x7fa82015a4d0 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa81effd640 1 -- 172.21.15.143:0/3976052646 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100ac780 con 0x7fa82015a4d0 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa81effd640 1 -- 172.21.15.143:0/3976052646 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100acb10 con 0x7fa82015a4d0 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 -- 172.21.15.143:0/3976052646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82015a4d0 msgr2=0x7fa8200c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3976052646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82015a4d0 0x7fa8200c9650 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8100097c0 tx=0x7fa81001c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 -- 172.21.15.143:0/3976052646 shutdown_connections 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3976052646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82006d740 0x7fa82006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3976052646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82015a4d0 0x7fa8200c9650 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 -- 172.21.15.143:0/3976052646 >> 172.21.15.143:0/3976052646 conn(0x7fa8200b0bf0 msgr2=0x7fa8200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:37.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 -- 172.21.15.143:0/3976052646 shutdown_connections 2023-11-24T06:30:37.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 -- 172.21.15.143:0/3976052646 wait complete. 2023-11-24T06:30:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 Processor -- start 2023-11-24T06:30:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.828+0000 7fa8265b8640 1 -- start start 2023-11-24T06:30:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 0x7fa8200b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8200cad20 0x7fa8200ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82015a4d0 0x7fa82014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200b21f0 con 0x7fa82006d740 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200ac560 con 0x7fa8200cad20 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200ad3c0 con 0x7fa82015a4d0 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 0x7fa8200b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 0x7fa8200b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59748/0 (socket says 172.21.15.143:59748) 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 -- 172.21.15.143:0/3200802532 learned_addr learned my addr 172.21.15.143:0/3200802532 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa824b55640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82015a4d0 0x7fa82014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81f7fe640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8200cad20 0x7fa8200ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 -- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82015a4d0 msgr2=0x7fa82014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82015a4d0 0x7fa82014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 -- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8200cad20 msgr2=0x7fa8200ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8200cad20 0x7fa8200ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:37.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 -- 172.21.15.143:0/3200802532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810009420 con 0x7fa82006d740 2023-11-24T06:30:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81ffff640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 0x7fa8200b1cb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa810019ff0 tx=0x7fa810019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ac620 con 0x7fa82006d740 2023-11-24T06:30:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100b5410 con 0x7fa82006d740 2023-11-24T06:30:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b57a0 con 0x7fa82006d740 2023-11-24T06:30:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200ac7b0 con 0x7fa82006d740 2023-11-24T06:30:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8200acd70 con 0x7fa82006d740 2023-11-24T06:30:37.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.832+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82009d250 con 0x7fa82006d740 2023-11-24T06:30:37.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.836+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8100b3040 con 0x7fa82006d740 2023-11-24T06:30:37.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.836+0000 7fa81cff9640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa80c0664a0 0x7fa80c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:37.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.836+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa81011db30 con 0x7fa82006d740 2023-11-24T06:30:37.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.836+0000 7fa81f7fe640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa80c0664a0 0x7fa80c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:37.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.836+0000 7fa81f7fe640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa80c0664a0 0x7fa80c068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa8200b4870 tx=0x7fa814007bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:37.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:37.840+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8100eafc0 con 0x7fa82006d740 2023-11-24T06:30:38.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.040+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa8200c93c0 con 0x7fa82006d740 2023-11-24T06:30:38.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.044+0000 7fa81cff9640 1 -- 172.21.15.143:0/3200802532 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa8100b10e0 con 0x7fa82006d740 2023-11-24T06:30:38.047 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-11-24T06:30:38.047 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:30:38.047 INFO:teuthology.orchestra.run.smithi143.stdout: caps mds = "allow" 2023-11-24T06:30:38.047 INFO:teuthology.orchestra.run.smithi143.stdout: caps mon = "allow r" 2023-11-24T06:30:38.047 INFO:teuthology.orchestra.run.smithi143.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:30:38.048 INFO:teuthology.orchestra.run.smithi143.stderr:updated caps for client.0 2023-11-24T06:30:38.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa80c0664a0 msgr2=0x7fa80c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa80c0664a0 0x7fa80c068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa8200b4870 tx=0x7fa814007bc0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 msgr2=0x7fa8200b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 0x7fa8200b1cb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa810019ff0 tx=0x7fa810019160 comp rx=0 tx=0).stop 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 shutdown_connections 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa80c0664a0 0x7fa80c068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82015a4d0 0x7fa82014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8200cad20 0x7fa8200ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 --2- 172.21.15.143:0/3200802532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa82006d740 0x7fa8200b1cb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 >> 172.21.15.143:0/3200802532 conn(0x7fa8200b0bf0 msgr2=0x7fa8200af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 shutdown_connections 2023-11-24T06:30:38.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.048+0000 7fa8265b8640 1 -- 172.21.15.143:0/3200802532 wait complete. 2023-11-24T06:30:38.069 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:38.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 Processor -- start 2023-11-24T06:30:38.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 -- start start 2023-11-24T06:30:38.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe415a320 0x7f2fe40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fe40b36c0 0x7f2fe4070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fe4070bd0 0x7f2fe4071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe40b2430 con 0x7f2fe40b36c0 2023-11-24T06:30:38.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe415a700 con 0x7f2fe4070bd0 2023-11-24T06:30:38.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2feb357640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4071580 con 0x7f2fe415a320 2023-11-24T06:30:38.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fe40b36c0 0x7f2fe4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fe40b36c0 0x7f2fe4070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59762/0 (socket says 172.21.15.143:59762) 2023-11-24T06:30:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 -- 172.21.15.143:0/4088277459 learned_addr learned my addr 172.21.15.143:0/4088277459 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe90f3640 1 --2- 172.21.15.143:0/4088277459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe415a320 0x7f2fe40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe98f4640 1 --2- 172.21.15.143:0/4088277459 >> v2:172.21.15.146:3300/0 conn(0x7f2fe4070bd0 0x7f2fe4071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 -- 172.21.15.143:0/4088277459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe415a320 msgr2=0x7f2fe40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 --2- 172.21.15.143:0/4088277459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe415a320 0x7f2fe40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 -- 172.21.15.143:0/4088277459 >> v2:172.21.15.146:3300/0 conn(0x7f2fe4070bd0 msgr2=0x7f2fe4071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:38.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 --2- 172.21.15.143:0/4088277459 >> v2:172.21.15.146:3300/0 conn(0x7f2fe4070bd0 0x7f2fe4071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe88f2640 1 -- 172.21.15.143:0/4088277459 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe40b2620 con 0x7f2fe40b36c0 2023-11-24T06:30:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.204+0000 7f2fe98f4640 1 --2- 172.21.15.143:0/4088277459 >> v2:172.21.15.146:3300/0 conn(0x7f2fe4070bd0 0x7f2fe4071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:38.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2fe88f2640 1 --2- 172.21.15.143:0/4088277459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe4070690 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b5040 tx=0x7f2fd401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ef3ff0f0e49b04 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2fdbfff640 1 -- 172.21.15.143:0/4088277459 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40a7b30 con 0x7f2fe40b36c0 2023-11-24T06:30:38.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2fdbfff640 1 -- 172.21.15.143:0/4088277459 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40a7c90 con 0x7f2fe40b36c0 2023-11-24T06:30:38.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2fdbfff640 1 -- 172.21.15.143:0/4088277459 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40af440 con 0x7f2fe40b36c0 2023-11-24T06:30:38.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 -- 172.21.15.143:0/4088277459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 msgr2=0x7f2fe4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 --2- 172.21.15.143:0/4088277459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe4070690 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b5040 tx=0x7f2fd401eba0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 -- 172.21.15.143:0/4088277459 shutdown_connections 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 --2- 172.21.15.143:0/4088277459 >> v2:172.21.15.146:3300/0 conn(0x7f2fe4070bd0 0x7f2fe4071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 --2- 172.21.15.143:0/4088277459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe4070690 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 --2- 172.21.15.143:0/4088277459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe415a320 0x7f2fe40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 -- 172.21.15.143:0/4088277459 >> 172.21.15.143:0/4088277459 conn(0x7f2fe40b0bf0 msgr2=0x7f2fe40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 -- 172.21.15.143:0/4088277459 shutdown_connections 2023-11-24T06:30:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.208+0000 7f2feb357640 1 -- 172.21.15.143:0/4088277459 wait complete. 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 Processor -- start 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 -- start start 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe4070bd0 0x7f2fe409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fe415a320 0x7f2fe414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4152530 con 0x7f2fe40b36c0 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe415b3b0 con 0x7f2fe415a320 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe415b690 con 0x7f2fe4070bd0 2023-11-24T06:30:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe414d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59766/0 (socket says 172.21.15.143:59766) 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 -- 172.21.15.143:0/175228482 learned_addr learned my addr 172.21.15.143:0/175228482 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe90f3640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe4070bd0 0x7f2fe409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 -- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe4070bd0 msgr2=0x7f2fe409b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe4070bd0 0x7f2fe409b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 -- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fe415a320 msgr2=0x7f2fe414db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe98f4640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fe415a320 0x7f2fe414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fe415a320 0x7f2fe414db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 -- 172.21.15.143:0/175228482 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd400b770 con 0x7f2fe40b36c0 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe90f3640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe4070bd0 0x7f2fe409b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe98f4640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fe415a320 0x7f2fe414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fe88f2640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe414d5d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400b2c0 tx=0x7f2fd401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40afbf0 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40afd50 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40ba6c0 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe415b970 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.212+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe415bf30 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.216+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe40c8270 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.216+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fd40ba820 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.216+0000 7f2fd9ffb640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fc8066470 0x7f2fc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.216+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fd411f310 con 0x7f2fe40b36c0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.216+0000 7f2fe90f3640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fc8066470 0x7f2fc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.216+0000 7f2fe90f3640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fc8066470 0x7f2fc8068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009a40 tx=0x7f2fe0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.220+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fe40c8270 con 0x7f2fe40b36c0 2023-11-24T06:30:38.235 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:30:38.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:30:38.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.404+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fe40c8270 con 0x7f2fe40b36c0 2023-11-24T06:30:38.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.404+0000 7f2fd9ffb640 1 -- 172.21.15.143:0/175228482 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f2fe40c8270 con 0x7f2fe40b36c0 2023-11-24T06:30:38.409 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:38.409 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:30:32.535019+0000","modified":"2023-11-24T06:30:35.578491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4939":{"gid":4939,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/3105261355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3105261355},{"type":"v1","addr":"172.21.15.146:6834","nonce":3105261355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:30:38.409 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 17 2023-11-24T06:30:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fc8066470 msgr2=0x7f2fc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fc8066470 0x7f2fc8068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009a40 tx=0x7f2fe0008040 comp rx=0 tx=0).stop 2023-11-24T06:30:38.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 msgr2=0x7f2fe414d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe414d5d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400b2c0 tx=0x7f2fd401d3e0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 shutdown_connections 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fc8066470 0x7f2fc8068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fe415a320 0x7f2fe414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b36c0 0x7f2fe414d5d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 --2- 172.21.15.143:0/175228482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fe4070bd0 0x7f2fe409b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 >> 172.21.15.143:0/175228482 conn(0x7f2fe40b0bf0 msgr2=0x7f2fe4099ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 shutdown_connections 2023-11-24T06:30:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.408+0000 7f2feb357640 1 -- 172.21.15.143:0/175228482 wait complete. 2023-11-24T06:30:38.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:30:32.535019+0000', 'modified': '2023-11-24T06:30:35.578491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4939}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4939': {'gid': 4939, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6834/3105261355', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 3105261355}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 3105261355}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:30:38.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:30:38.833 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T06:30:38.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.968+0000 7f7d934fe640 1 Processor -- start 2023-11-24T06:30:38.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.968+0000 7f7d934fe640 1 -- start start 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d934fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d8c06de50 0x7f7d8c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d934fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c15a8b0 con 0x7f7d8c0cad20 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d934fe640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0c9c30 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d934fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c9f60 con 0x7f7d8c06de50 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d91a9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d8c06de50 0x7f7d8c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d90a99640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7d8c0cad20 0x7f7d8c06d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38882/0 (socket says 172.21.15.143:38882) 2023-11-24T06:30:38.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d90a99640 1 -- 172.21.15.143:0/318204302 learned_addr learned my addr 172.21.15.143:0/318204302 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:38.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d83fff640 1 -- 172.21.15.143:0/318204302 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931843717 0 0) 0x7f7d8c15a8b0 con 0x7f7d8c0cad20 2023-11-24T06:30:38.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d83fff640 1 -- 172.21.15.143:0/318204302 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d78003530 con 0x7f7d8c0cad20 2023-11-24T06:30:38.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d91a9b640 1 -- 172.21.15.143:0/318204302 >> v1:172.21.15.146:6789/0 conn(0x7f7d8c15a4d0 legacy=0x7f7d8c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d91a9b640 1 -- 172.21.15.143:0/318204302 >> v1:172.21.15.143:6789/0 conn(0x7f7d8c0cad20 legacy=0x7f7d8c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.972+0000 7f7d91a9b640 1 -- 172.21.15.143:0/318204302 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0ca240 con 0x7f7d8c06de50 2023-11-24T06:30:38.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/318204302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c9650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d90 tx=0x7f7d8401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3766da3fa56a92a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d83fff640 1 -- 172.21.15.143:0/318204302 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a5850 con 0x7f7d8c06de50 2023-11-24T06:30:38.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d83fff640 1 -- 172.21.15.143:0/318204302 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840a59b0 con 0x7f7d8c06de50 2023-11-24T06:30:38.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d83fff640 1 -- 172.21.15.143:0/318204302 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a5d40 con 0x7f7d8c06de50 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 -- 172.21.15.143:0/318204302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c06de50 msgr2=0x7f7d8c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 --2- 172.21.15.143:0/318204302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c9650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d90 tx=0x7f7d8401c890 comp rx=0 tx=0).stop 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 -- 172.21.15.143:0/318204302 shutdown_connections 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 --2- 172.21.15.143:0/318204302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c9650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 -- 172.21.15.143:0/318204302 >> 172.21.15.143:0/318204302 conn(0x7f7d8c0b0bf0 msgr2=0x7f7d8c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 -- 172.21.15.143:0/318204302 shutdown_connections 2023-11-24T06:30:38.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 -- 172.21.15.143:0/318204302 wait complete. 2023-11-24T06:30:38.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 Processor -- start 2023-11-24T06:30:38.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.976+0000 7f7d934fe640 1 -- start start 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d8c0cad20 0x7f7d8c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 0x7f7d8c1683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1645a0 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c159800 con 0x7f7d8c06de50 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c76b0 con 0x7f7d8c0cad20 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 0x7f7d8c1683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 0x7f7d8c1683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59796/0 (socket says 172.21.15.143:59796) 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 -- 172.21.15.143:0/1811774227 learned_addr learned my addr 172.21.15.143:0/1811774227 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d90a99640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d8c0cad20 0x7f7d8c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 -- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d8c0cad20 msgr2=0x7f7d8c151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d8c0cad20 0x7f7d8c151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 -- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d8c06de50 msgr2=0x7f7d8c0c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 -- 172.21.15.143:0/1811774227 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009a70 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 0x7f7d8c1683d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7d840b0040 tx=0x7f7d84019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d81ffb640 1 -- 172.21.15.143:0/1811774227 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b9650 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d81ffb640 1 -- 172.21.15.143:0/1811774227 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840b97b0 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c0c7950 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d81ffb640 1 -- 172.21.15.143:0/1811774227 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b9b40 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0c7f10 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.980+0000 7f7d81ffb640 1 -- 172.21.15.143:0/1811774227 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d840b9ca0 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d81ffb640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d70066470 0x7f7d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d81ffb640 1 -- 172.21.15.143:0/1811774227 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d8411f150 con 0x7f7d8c15a4d0 2023-11-24T06:30:38.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d70066470 0x7f7d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 Processor -- start 2023-11-24T06:30:38.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 -- start start 2023-11-24T06:30:38.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d70066470 0x7f7d70068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0cb190 tx=0x7f7d88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 0x560d52b41070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52af6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52af7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d52961130 con 0x560d52b40c90 2023-11-24T06:30:38.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d5294e9a0 con 0x560d52af7320 2023-11-24T06:30:38.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d5294bed0 con 0x560d52b415b0 2023-11-24T06:30:38.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 0x560d52b41070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 0x560d52b41070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59808/0 (socket says 172.21.15.143:59808) 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 -- 172.21.15.143:0/1187951849 learned_addr learned my addr 172.21.15.143:0/1187951849 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52af7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d90a99640 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52af6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 -- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 msgr2=0x560d52af6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52af6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 -- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 msgr2=0x560d52af7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52af7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 -- 172.21.15.143:0/1187951849 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d5263f890 con 0x560d52b40c90 2023-11-24T06:30:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52af7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 0x560d52b41070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7d88001ea0 tx=0x7f7d88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601416e70d887e92 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d76ffd640 1 -- 172.21.15.143:0/1187951849 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88003600 con 0x560d52b40c90 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d76ffd640 1 -- 172.21.15.143:0/1187951849 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88003760 con 0x560d52b40c90 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.984+0000 7f7d76ffd640 1 -- 172.21.15.143:0/1187951849 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88003ad0 con 0x560d52b40c90 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/1187951849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 msgr2=0x560d52b41070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 0x560d52b41070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7d88001ea0 tx=0x7f7d88011000 comp rx=0 tx=0).stop 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/1187951849 shutdown_connections 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52af7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52af6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- 172.21.15.143:0/1187951849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b40c90 0x560d52b41070 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/1187951849 >> 172.21.15.143:0/1187951849 conn(0x560d52af32d0 msgr2=0x560d52af56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:38.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/1187951849 shutdown_connections 2023-11-24T06:30:38.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/1187951849 wait complete. 2023-11-24T06:30:38.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- start start 2023-11-24T06:30:38.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 Processor -- start 2023-11-24T06:30:38.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52afbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b40c90 0x560d52afc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 0x560d52b0f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:38.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d529477c0 con 0x560d52b415b0 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d528ffbf0 con 0x560d52af7320 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d52905a90 con 0x560d52b40c90 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 10 client.0 _ll_register_callbacks cb 0x560d52ae23c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 0x560d52b0f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 0x560d52b0f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59824/0 (socket says 172.21.15.143:59824) 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 -- 172.21.15.143:0/749502921 learned_addr learned my addr 172.21.15.143:0/749502921 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d9129a640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52afbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d90a99640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b40c90 0x560d52afc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 -- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b40c90 msgr2=0x560d52afc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b40c90 0x560d52afc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 -- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 msgr2=0x560d52afbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:38.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52afbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 -- 172.21.15.143:0/749502921 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8800f040 con 0x560d52b415b0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d90a99640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b40c90 0x560d52afc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d9129a640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52afbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 0x560d52b0f910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d8401ce00 tx=0x7f7d840f08f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7d55dcb32bac48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d6bfff640 1 -- 172.21.15.143:0/749502921 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840f84f0 con 0x560d52b415b0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d6bfff640 1 -- 172.21.15.143:0/749502921 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d840c2400 con 0x560d52b415b0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d52909470 con 0x560d52b415b0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d6bfff640 1 -- 172.21.15.143:0/749502921 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d840c25c0 con 0x560d52b415b0 2023-11-24T06:30:38.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 10 client.5286 fetch_fsmap learned FSMap version 17 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560d52908190 con 0x560d52b415b0 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.988+0000 7f7d6bfff640 1 -- 172.21.15.143:0/749502921 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d52909470 con 0x560d52b415b0 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d6bfff640 1 -- 172.21.15.143:0/749502921 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7d84005d20 con 0x560d52b415b0 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 10 client.5286 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 10 client.5286 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 20 client.5286 populate_metadata read hostname 'smithi143' 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b10320 0x560d52b52f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 4 client.5286 mds_command: new command op to 4939 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:30:39.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 --> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d5290cb50 con 0x560d52b10320 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d9129a640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b10320 0x560d52b52f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d9129a640 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b10320 0x560d52b52f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29efbd92cd4f7229 server_cookie=98da477961ae3df4 in_seq=0 out_seq=0 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d6bfff640 10 client.5286 ms_handle_connect on v2:172.21.15.146:6832/3105261355 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d6bfff640 1 -- 172.21.15.143:0/749502921 <== mds.0 v2:172.21.15.146:6832/3105261355 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d5290cb50 con 0x560d52b10320 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d6bfff640 10 client.5286 handle_command_reply: tid=0 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 client.5286 shutdown 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 msgr2=0x560d52b0f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 0x560d52b0f910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d8401ce00 tx=0x7f7d840f08f0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 shutdown_connections 2023-11-24T06:30:39.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b10320 0x560d52b52f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52b415b0 0x560d52b0f910 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b40c90 0x560d52afc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 --2- 172.21.15.143:0/749502921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52af7320 0x560d52afbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d6bfff640 0 client.5286 ms_handle_reset on v2:172.21.15.146:6832/3105261355 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 >> 172.21.15.143:0/749502921 conn(0x560d52af32d0 msgr2=0x560d52af56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 shutdown_connections 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 1 -- 172.21.15.143:0/749502921 wait complete. 2023-11-24T06:30:39.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:38.992+0000 7f7d96862000 20 client.5286 trim_cache size 0 max 16384 2023-11-24T06:30:39.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 Processor -- start 2023-11-24T06:30:39.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 -- start start 2023-11-24T06:30:39.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52b3fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52b3eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b3f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d52600940 con 0x560d52af7320 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d5294b7c0 con 0x560d52b40c90 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d52910910 con 0x560d52b415b0 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52b3fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52b3fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59834/0 (socket says 172.21.15.143:59834) 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 -- 172.21.15.143:0/3410175771 learned_addr learned my addr 172.21.15.143:0/3410175771 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 -- 172.21.15.143:0/3410175771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 msgr2=0x560d52b3f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b3f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 -- 172.21.15.143:0/3410175771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 msgr2=0x560d52b3eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52b3eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 -- 172.21.15.143:0/3410175771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d528ee490 con 0x560d52af7320 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d9129a640 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52b3fc90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d88007ee0 tx=0x7f7d88005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1e56714504e93 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d777fe640 1 -- 172.21.15.143:0/3410175771 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88028040 con 0x560d52af7320 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d777fe640 1 -- 172.21.15.143:0/3410175771 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8802e420 con 0x560d52af7320 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.008+0000 7f7d777fe640 1 -- 172.21.15.143:0/3410175771 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8802e7d0 con 0x560d52af7320 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/3410175771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 msgr2=0x560d52b3fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52b3fc90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d88007ee0 tx=0x7f7d88005000 comp rx=0 tx=0).stop 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/3410175771 shutdown_connections 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b3f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52b3eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- 172.21.15.143:0/3410175771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52b3fc90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/3410175771 >> 172.21.15.143:0/3410175771 conn(0x560d52af32d0 msgr2=0x560d52b4e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:39.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/3410175771 shutdown_connections 2023-11-24T06:30:39.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/3410175771 wait complete. 2023-11-24T06:30:39.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- start start 2023-11-24T06:30:39.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 Processor -- start 2023-11-24T06:30:39.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52af86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52af8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b52f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d528fc760 con 0x560d52af7320 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d52afcfb0 con 0x560d52b40c90 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d52944bc0 con 0x560d52b415b0 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 10 client.0 _ll_register_callbacks cb 0x560d52995c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52af86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52af86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59842/0 (socket says 172.21.15.143:59842) 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 -- 172.21.15.143:0/1930402247 learned_addr learned my addr 172.21.15.143:0/1930402247 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d90a99640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52af8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b52f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 -- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 msgr2=0x560d52b52f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b52f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 -- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 msgr2=0x560d52af8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52af8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 -- 172.21.15.143:0/1930402247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d5263f890 con 0x560d52af7320 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d90a99640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52af8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d91a9b640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b52f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d9129a640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52af86a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d88005040 tx=0x7f7d88000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67fb2f0797d82ff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d6bfff640 1 -- 172.21.15.143:0/1930402247 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88028040 con 0x560d52af7320 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d6bfff640 1 -- 172.21.15.143:0/1930402247 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d8802e7a0 con 0x560d52af7320 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d52946110 con 0x560d52af7320 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d6bfff640 1 -- 172.21.15.143:0/1930402247 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d880038a0 con 0x560d52af7320 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 10 client.5292 fetch_fsmap learned FSMap version 17 2023-11-24T06:30:39.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560d5263fcc0 con 0x560d52af7320 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d6bfff640 1 -- 172.21.15.143:0/1930402247 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d52946110 con 0x560d52af7320 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.012+0000 7f7d6bfff640 1 -- 172.21.15.143:0/1930402247 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7d88003a00 con 0x560d52af7320 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 10 client.5292 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 10 client.5292 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 20 client.5292 populate_metadata read hostname 'smithi143' 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b53490 0x560d52b53870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 4 client.5292 mds_command: new command op to 4939 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:30:39.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 --> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560d529759a0 con 0x560d52b53490 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d90a99640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b53490 0x560d52b53870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d6bfff640 10 client.5292 ms_handle_connect on v2:172.21.15.146:6832/3105261355 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d90a99640 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b53490 0x560d52b53870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72cfa934739e84b0 server_cookie=26e8a10d49a8dff7 in_seq=0 out_seq=0 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d6bfff640 1 -- 172.21.15.143:0/1930402247 <== mds.0 v2:172.21.15.146:6832/3105261355 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x560d529759a0 con 0x560d52b53490 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d6bfff640 10 client.5292 handle_command_reply: tid=0 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 client.5292 shutdown 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 msgr2=0x560d52af86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52af86a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d88005040 tx=0x7f7d88000ee0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 shutdown_connections 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:6832/3105261355,v1:172.21.15.146:6834/3105261355] conn(0x560d52b53490 0x560d52b53870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560d52b415b0 0x560d52b52f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d6bfff640 0 client.5292 ms_handle_reset on v2:172.21.15.146:6832/3105261355 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d52b40c90 0x560d52af8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 --2- 172.21.15.143:0/1930402247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560d52af7320 0x560d52af86a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 >> 172.21.15.143:0/1930402247 conn(0x560d52af32d0 msgr2=0x560d52af56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 shutdown_connections 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 1 -- 172.21.15.143:0/1930402247 wait complete. 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d96862000 20 client.5292 trim_cache size 0 max 16384 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "039ed6d4-b5c2-4e8e-a15f-05a601a78248", 2023-11-24T06:30:39.029 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4939, 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 5.8242143100000003, 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 17, 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 32, 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 32, 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 13.70309975 2023-11-24T06:30:39.030 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:30:39.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d70066470 msgr2=0x7f7d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d70066470 0x7f7d70068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0cb190 tx=0x7f7d88009040 comp rx=0 tx=0).stop 2023-11-24T06:30:39.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 msgr2=0x7f7d8c1683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 0x7f7d8c1683d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7d840b0040 tx=0x7f7d84019630 comp rx=0 tx=0).stop 2023-11-24T06:30:39.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 shutdown_connections 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d70066470 0x7f7d70068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d8c15a4d0 0x7f7d8c1683d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d8c0cad20 0x7f7d8c151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 --2- 172.21.15.143:0/1811774227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d8c06de50 0x7f7d8c0c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 >> 172.21.15.143:0/1811774227 conn(0x7f7d8c0b0bf0 msgr2=0x7f7d8c0aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 shutdown_connections 2023-11-24T06:30:39.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.016+0000 7f7d934fe640 1 -- 172.21.15.143:0/1811774227 wait complete. 2023-11-24T06:30:39.039 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:30:39.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c7613640 1 Processor -- start 2023-11-24T06:30:39.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c7613640 1 -- start start 2023-11-24T06:30:39.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c7613640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57c00ce8b0 0x7f57c00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c7613640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c006c0e0 con 0x7f57c00d3020 2023-11-24T06:30:39.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c7613640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00d1cc0 con 0x7f57c015d570 2023-11-24T06:30:39.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c7613640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00d1fa0 con 0x7f57c00ce8b0 2023-11-24T06:30:39.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c4bae640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f57c00d3020 0x7f57c00d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38894/0 (socket says 172.21.15.143:38894) 2023-11-24T06:30:39.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c4bae640 1 -- 172.21.15.143:0/3652326783 learned_addr learned my addr 172.21.15.143:0/3652326783 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488768588 0 0) 0x7f57c006c0e0 con 0x7f57c00d3020 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57ac003530 con 0x7f57c00d3020 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/3652326783 >> v2:172.21.15.146:3300/0 conn(0x7f57c00ce8b0 0x7f57c00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2161668699 0 0) 0x7f57ac003530 con 0x7f57c00d3020 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 >> v2:172.21.15.146:3300/0 conn(0x7f57c00ce8b0 msgr2=0x7f57c00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 --2- 172.21.15.143:0/3652326783 >> v2:172.21.15.146:3300/0 conn(0x7f57c00ce8b0 0x7f57c00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 >> v1:172.21.15.146:6789/0 conn(0x7f57c015d570 legacy=0x7f57c006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00ce0b0 con 0x7f57c00d3020 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f57b0001680 con 0x7f57c00d3020 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 >> v1:172.21.15.143:6789/0 conn(0x7f57c00d3020 legacy=0x7f57c00d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac0039d0 0x7f57ac003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ac0047d0 0x7f57ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57ac005190 0x7f57ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00d1fa0 con 0x7f57ac005190 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac00c090 con 0x7f57ac0047d0 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac00c250 con 0x7f57ac0039d0 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c53af640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac0039d0 0x7f57ac003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57ac005190 0x7f57ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c4bae640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ac0047d0 0x7f57ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 -- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac0039d0 msgr2=0x7f57ac003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac0039d0 0x7f57ac003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 -- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ac0047d0 msgr2=0x7f57ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ac0047d0 0x7f57ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.176+0000 7f57c5bb0640 1 -- 172.21.15.143:0/3652326783 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac003530 con 0x7f57ac005190 2023-11-24T06:30:39.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c5bb0640 1 -- 172.21.15.143:0/3652326783 reap_dead start 2023-11-24T06:30:39.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57ac005190 0x7f57ac00b990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009fc0 tx=0x7f57b801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb6124437fd2410 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:39.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80a5cb0 con 0x7f57ac005190 2023-11-24T06:30:39.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b800f040 con 0x7f57ac005190 2023-11-24T06:30:39.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57b7fff640 1 -- 172.21.15.143:0/3652326783 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8003be0 con 0x7f57ac005190 2023-11-24T06:30:39.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 -- 172.21.15.143:0/3652326783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57ac005190 msgr2=0x7f57ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57ac005190 0x7f57ac00b990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009fc0 tx=0x7f57b801cca0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 -- 172.21.15.143:0/3652326783 shutdown_connections 2023-11-24T06:30:39.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 --2- 172.21.15.143:0/3652326783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57ac005190 0x7f57ac00b990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 -- 172.21.15.143:0/3652326783 >> 172.21.15.143:0/3652326783 conn(0x7f57c008ceb0 msgr2=0x7f57c009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:39.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 -- 172.21.15.143:0/3652326783 shutdown_connections 2023-11-24T06:30:39.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.180+0000 7f57c7613640 1 -- 172.21.15.143:0/3652326783 wait complete. 2023-11-24T06:30:39.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 Processor -- start 2023-11-24T06:30:39.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 -- start start 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac005190 0x7f57c0160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57c01f6890 0x7f57c01f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 0x7f57c00c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01f7250 con 0x7f57c00c7380 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c015f310 con 0x7f57c01f6890 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c015f5f0 con 0x7f57ac005190 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 0x7f57c00c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 0x7f57c00c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59866/0 (socket says 172.21.15.143:59866) 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 -- 172.21.15.143:0/732349811 learned_addr learned my addr 172.21.15.143:0/732349811 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 -- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac005190 msgr2=0x7f57c0160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c53af640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac005190 0x7f57c0160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c4bae640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57c01f6890 0x7f57c01f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac005190 0x7f57c0160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 -- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57c01f6890 msgr2=0x7f57c01f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57c01f6890 0x7f57c01f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 -- 172.21.15.143:0/732349811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c015f8d0 con 0x7f57c00c7380 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c53af640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac005190 0x7f57c0160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c4bae640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57c01f6890 0x7f57c01f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:39.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c5bb0640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 0x7f57c00c7810 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f57b80987d0 tx=0x7f57b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:39.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80aed30 con 0x7f57c00c7380 2023-11-24T06:30:39.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b80aeeb0 con 0x7f57c00c7380 2023-11-24T06:30:39.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8003be0 con 0x7f57c00c7380 2023-11-24T06:30:39.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c015fbb0 con 0x7f57c00c7380 2023-11-24T06:30:39.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.184+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c00c7d50 con 0x7f57c00c7380 2023-11-24T06:30:39.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.188+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0067520 con 0x7f57c00c7380 2023-11-24T06:30:39.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.188+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57b8004030 con 0x7f57c00c7380 2023-11-24T06:30:39.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.188+0000 7f57b5ffb640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f57a4066470 0x7f57a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:39.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.188+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57b80a6e40 con 0x7f57c00c7380 2023-11-24T06:30:39.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.188+0000 7f57c53af640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f57a4066470 0x7f57a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:39.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.188+0000 7f57c53af640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f57a4066470 0x7f57a4068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57c00ccee0 tx=0x7f57bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:39.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.192+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57b80ec5a0 con 0x7f57c00c7380 2023-11-24T06:30:39.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57c00ca290 con 0x7f57c00c7380 2023-11-24T06:30:39.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57b5ffb640 1 -- 172.21.15.143:0/732349811 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f57b80be070 con 0x7f57c00c7380 2023-11-24T06:30:39.379 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:30:39.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f57a4066470 msgr2=0x7f57a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f57a4066470 0x7f57a4068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57c00ccee0 tx=0x7f57bc009040 comp rx=0 tx=0).stop 2023-11-24T06:30:39.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 msgr2=0x7f57c00c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:39.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 0x7f57c00c7810 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f57b80987d0 tx=0x7f57b8009750 comp rx=0 tx=0).stop 2023-11-24T06:30:39.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 shutdown_connections 2023-11-24T06:30:39.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f57a4066470 0x7f57a4068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57c00c7380 0x7f57c00c7810 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57c01f6890 0x7f57c01f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 --2- 172.21.15.143:0/732349811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57ac005190 0x7f57c0160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:39.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 >> 172.21.15.143:0/732349811 conn(0x7f57c008ceb0 msgr2=0x7f57c00d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:39.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 shutdown_connections 2023-11-24T06:30:39.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:39.376+0000 7f57c7613640 1 -- 172.21.15.143:0/732349811 wait complete. 2023-11-24T06:30:39.399 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:30:39.400 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:30:39.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.400 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:30:39.411 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:30:39.411 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:30:39.411 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:30:39.411 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.412 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:30:39.412 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.412 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:39.412 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:39.412 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:30:39.412 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:39.413 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:39.413 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:30:39.413 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:39.413 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:39.413 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:30:39.413 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42324sec preferred_lft 42324sec 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:30:39.415 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:30:39.416 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:30:39.417 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:39.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.417 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:30:39.476 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:30:39.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.478 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:30:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:30:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:30:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:30:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:30:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:30:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:30:39.532 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:39.532 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:39.532 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:39.532 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:30:39.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.532 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:30:39.532 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:30:39.532 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:30:39.532 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:30:39.532 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:30:39.532 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:30:39.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.624 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:30:39.632 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:30:39.633 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:30:39.633 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:30:39.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-11-24T06:30:39.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:39.697 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:30:39.753 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:30:39.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:39.753 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:30:39.808 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:30:39.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:39.898 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:39.898 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:39.912 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:39.912 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:39.913 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:30:39.913 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:30:39.913 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:30:39.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:30:39.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.916 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:30:39.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:39.938 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:40.000 INFO:teuthology.orchestra.run.smithi143.stdout:client5301 2023-11-24T06:30:40.000 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:40.000 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:40.049 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:30:40.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.232+0000 7f0a621aa640 1 Processor -- start 2023-11-24T06:30:40.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a621aa640 1 -- start start 2023-11-24T06:30:40.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a621aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a5c15d570 0x7f0a5c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:40.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a621aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c0d1cc0 con 0x7f0a5c0ce8b0 2023-11-24T06:30:40.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a621aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c0d1fa0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a621aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c0ce0b0 con 0x7f0a5c15d570 2023-11-24T06:30:40.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0a5c0ce8b0 0x7f0a5c0ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38902/0 (socket says 172.21.15.143:38902) 2023-11-24T06:30:40.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5bfff640 1 -- 172.21.15.143:0/2169264649 learned_addr learned my addr 172.21.15.143:0/2169264649 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:40.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5b7fe640 1 --2- 172.21.15.143:0/2169264649 >> v2:172.21.15.146:3300/0 conn(0x7f0a5c15d570 0x7f0a5c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:40.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10436023 0 0) 0x7f0a5c0d1cc0 con 0x7f0a5c0ce8b0 2023-11-24T06:30:40.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a44003530 con 0x7f0a5c0ce8b0 2023-11-24T06:30:40.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072754044 0 0) 0x7f0a5c0d1fa0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c0d1cc0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5b7fe640 1 -- 172.21.15.143:0/2169264649 >> v1:172.21.15.146:6789/0 conn(0x7f0a5c0d3020 legacy=0x7f0a5c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5b7fe640 1 -- 172.21.15.143:0/2169264649 >> v1:172.21.15.143:6789/0 conn(0x7f0a5c0ce8b0 legacy=0x7f0a5c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.236+0000 7f0a5b7fe640 1 -- 172.21.15.143:0/2169264649 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0ce390 con 0x7f0a5c15d570 2023-11-24T06:30:40.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a5b7fe640 1 --2- 172.21.15.143:0/2169264649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c06b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0097c0 tx=0x7f0a4c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7871bbe00405b28a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:40.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0a8050 con 0x7f0a5c15d570 2023-11-24T06:30:40.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c0ac5f0 con 0x7f0a5c15d570 2023-11-24T06:30:40.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a5a7fc640 1 -- 172.21.15.143:0/2169264649 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0ac960 con 0x7f0a5c15d570 2023-11-24T06:30:40.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 -- 172.21.15.143:0/2169264649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 msgr2=0x7f0a5c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 --2- 172.21.15.143:0/2169264649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c06b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0097c0 tx=0x7f0a4c01c480 comp rx=0 tx=0).stop 2023-11-24T06:30:40.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 -- 172.21.15.143:0/2169264649 shutdown_connections 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 --2- 172.21.15.143:0/2169264649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c06b9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 -- 172.21.15.143:0/2169264649 >> 172.21.15.143:0/2169264649 conn(0x7f0a5c08ceb0 msgr2=0x7f0a5c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 -- 172.21.15.143:0/2169264649 shutdown_connections 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 -- 172.21.15.143:0/2169264649 wait complete. 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.240+0000 7f0a621aa640 1 Processor -- start 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- start start 2023-11-24T06:30:40.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a5c0ce8b0 0x7f0a5c159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:40.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 0x7f0a5c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:40.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:40.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0b6b90 con 0x7f0a5c0d3020 2023-11-24T06:30:40.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0b6e70 con 0x7f0a5c15d570 2023-11-24T06:30:40.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0b7420 con 0x7f0a5c0ce8b0 2023-11-24T06:30:40.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 0x7f0a5c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 0x7f0a5c158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59872/0 (socket says 172.21.15.143:59872) 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 -- 172.21.15.143:0/1728440035 learned_addr learned my addr 172.21.15.143:0/1728440035 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5b7fe640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a5c0ce8b0 0x7f0a5c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5bfff640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 -- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a5c0ce8b0 msgr2=0x7f0a5c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a5c0ce8b0 0x7f0a5c159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 -- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 msgr2=0x7f0a5c0b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c0b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 -- 172.21.15.143:0/1728440035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c009420 con 0x7f0a5c0d3020 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a5affd640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 0x7f0a5c158cf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000c500 tx=0x7f0a5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a500052d0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a50005430 con 0x7f0a5c0d3020 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50012870 con 0x7f0a5c0d3020 2023-11-24T06:30:40.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c0b7700 con 0x7f0a5c0d3020 2023-11-24T06:30:40.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c159230 con 0x7f0a5c0d3020 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.244+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c159420 con 0x7f0a5c0d3020 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.248+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a500129d0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.248+0000 7f0a43fff640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0a480664a0 0x7f0a48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.248+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a50083ba0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.248+0000 7f0a5b7fe640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0a480664a0 0x7f0a48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.248+0000 7f0a5b7fe640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0a480664a0 0x7f0a48068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0ae000 tx=0x7f0a4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:40.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.252+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a50050f90 con 0x7f0a5c0d3020 2023-11-24T06:30:40.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a5c0b78f0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a43fff640 1 -- 172.21.15.143:0/1728440035 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0a500545b0 con 0x7f0a5c0d3020 2023-11-24T06:30:40.439 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:30:40.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0a480664a0 msgr2=0x7f0a48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0a480664a0 0x7f0a48068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0ae000 tx=0x7f0a4c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:40.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 msgr2=0x7f0a5c158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:40.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 0x7f0a5c158cf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000c500 tx=0x7f0a5000c9c0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 shutdown_connections 2023-11-24T06:30:40.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0a480664a0 0x7f0a48068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a5c15d570 0x7f0a5c0b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a5c0d3020 0x7f0a5c158cf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 --2- 172.21.15.143:0/1728440035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a5c0ce8b0 0x7f0a5c159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:40.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 >> 172.21.15.143:0/1728440035 conn(0x7f0a5c08ceb0 msgr2=0x7f0a5c0b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:40.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 shutdown_connections 2023-11-24T06:30:40.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:40.436+0000 7f0a621aa640 1 -- 172.21.15.143:0/1728440035 wait complete. 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:30:40.460 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:30:40.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.461 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:30:40.472 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:30:40.472 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:30:40.472 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:30:40.473 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.473 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:30:40.473 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.473 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:40.474 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:40.474 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:30:40.474 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:40.475 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:40.475 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:30:40.475 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:30:40.475 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:40.476 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:30:40.476 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:40.476 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:30:40.476 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42354sec preferred_lft 42354sec 2023-11-24T06:30:40.477 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:30:40.477 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.477 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:30:40.478 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:40.478 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:30:40.478 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.478 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:30:40.479 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:30:40.479 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:30:40.479 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.479 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:30:40.480 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.480 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:30:40.480 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:30:40.481 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:30:40.481 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.481 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:30:40.481 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:30:40.481 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:30:40.482 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:30:40.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.482 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:30:40.538 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:30:40.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.541 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:30:40.593 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:30:40.593 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:30:40.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.595 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:30:40.595 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:30:40.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:30:40.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:30:40.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:30:40.595 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:30:40.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.693 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:30:40.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:30:40.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:30:40.703 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:30:40.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-11-24T06:30:40.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:40.768 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:40.818 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:30:40.818 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:30:40.818 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:40.873 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:30:40.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:40.969 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:40.969 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:40.983 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:30:40.983 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:30:40.983 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:30:40.983 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 1@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:30:40.983 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:30:40.988 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:30:40.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:40.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:41.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:41.008 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:30:41.061 INFO:teuthology.orchestra.run.smithi146.stdout:client5116 2023-11-24T06:30:41.061 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:41.061 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:41.114 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:30:41.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3e29a640 1 Processor -- start 2023-11-24T06:30:41.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3e29a640 1 -- start start 2023-11-24T06:30:41.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3e29a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c380cee80 0x7f6c3815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:41.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3e29a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c381617f0 con 0x7f6c3815dd10 2023-11-24T06:30:41.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3e29a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3815e7d0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3e29a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3815eab0 con 0x7f6c380cee80 2023-11-24T06:30:41.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c377fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6c3815dd10 0x7f6c380ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38918/0 (socket says 172.21.15.143:38918) 2023-11-24T06:30:41.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c377fe640 1 -- 172.21.15.143:0/2928386444 learned_addr learned my addr 172.21.15.143:0/2928386444 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3c837640 1 --2- 172.21.15.143:0/2928386444 >> v2:172.21.15.146:3300/0 conn(0x7f6c380cee80 0x7f6c3815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390019534 0 0) 0x7f6c381617f0 con 0x7f6c3815dd10 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c20003530 con 0x7f6c3815dd10 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529931546 0 0) 0x7f6c3815e7d0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c381617f0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670933274 0 0) 0x7f6c20003530 con 0x7f6c3815dd10 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3c837640 1 -- 172.21.15.143:0/2928386444 >> v1:172.21.15.146:6789/0 conn(0x7f6c380ae9c0 legacy=0x7f6c38161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:41.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3c837640 1 -- 172.21.15.143:0/2928386444 >> v1:172.21.15.143:6789/0 conn(0x7f6c3815dd10 legacy=0x7f6c380ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:41.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.264+0000 7f6c3c837640 1 -- 172.21.15.143:0/2928386444 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38161480 con 0x7f6c380cee80 2023-11-24T06:30:41.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3c837640 1 --2- 172.21.15.143:0/2928386444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c380cee80 0x7f6c3815e1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009d90 tx=0x7f6c3001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180fc39f05a9850 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:41.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c001800 con 0x7f6c380cee80 2023-11-24T06:30:41.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c300a5530 con 0x7f6c380cee80 2023-11-24T06:30:41.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c36ffd640 1 -- 172.21.15.143:0/2928386444 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300a58c0 con 0x7f6c380cee80 2023-11-24T06:30:41.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2928386444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c380cee80 msgr2=0x7f6c3815e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:41.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2928386444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c380cee80 0x7f6c3815e1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009d90 tx=0x7f6c3001c7e0 comp rx=0 tx=0).stop 2023-11-24T06:30:41.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2928386444 shutdown_connections 2023-11-24T06:30:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2928386444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c380cee80 0x7f6c3815e1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2928386444 >> 172.21.15.143:0/2928386444 conn(0x7f6c380b1180 msgr2=0x7f6c380b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2928386444 shutdown_connections 2023-11-24T06:30:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.268+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2928386444 wait complete. 2023-11-24T06:30:41.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 Processor -- start 2023-11-24T06:30:41.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 -- start start 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 0x7f6c380b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c380cee80 0x7f6c3815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c3815dd10 0x7f6c38157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3813cba0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3813cd80 con 0x7f6c3815dd10 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3813d060 con 0x7f6c380cee80 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 0x7f6c380b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:41.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 0x7f6c380b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59886/0 (socket says 172.21.15.143:59886) 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 -- 172.21.15.143:0/2616771288 learned_addr learned my addr 172.21.15.143:0/2616771288 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3c837640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c3815dd10 0x7f6c38157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c377fe640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c380cee80 0x7f6c3815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 -- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c380cee80 msgr2=0x7f6c3815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c380cee80 0x7f6c3815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 -- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c3815dd10 msgr2=0x7f6c38157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c3815dd10 0x7f6c38157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 -- 172.21.15.143:0/2616771288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30009a70 con 0x7f6c380ae9c0 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c37fff640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 0x7f6c380b2250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c490 tx=0x7f6c2800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280052d0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28005430 con 0x7f6c380ae9c0 2023-11-24T06:30:41.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28012870 con 0x7f6c380ae9c0 2023-11-24T06:30:41.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3813d340 con 0x7f6c380ae9c0 2023-11-24T06:30:41.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.272+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3813d900 con 0x7f6c380ae9c0 2023-11-24T06:30:41.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.276+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c38067520 con 0x7f6c380ae9c0 2023-11-24T06:30:41.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.276+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c280129d0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.276+0000 7f6c34ff9640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c240664a0 0x7f6c24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:41.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.276+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c280839c0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.276+0000 7f6c377fe640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c240664a0 0x7f6c24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:41.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.276+0000 7f6c377fe640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c240664a0 0x7f6c24068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c38154660 tx=0x7f6c2c001dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:41.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.280+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c28050dc0 con 0x7f6c380ae9c0 2023-11-24T06:30:41.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:41.460+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6c38070be0 con 0x7f6c380ae9c0 2023-11-24T06:30:42.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.240+0000 7f6c34ff9640 1 -- 172.21.15.143:0/2616771288 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6c280543e0 con 0x7f6c380ae9c0 2023-11-24T06:30:42.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c240664a0 msgr2=0x7f6c24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c240664a0 0x7f6c24068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c38154660 tx=0x7f6c2c001dc0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 msgr2=0x7f6c380b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 0x7f6c380b2250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c490 tx=0x7f6c2800c950 comp rx=0 tx=0).stop 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 shutdown_connections 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c240664a0 0x7f6c24068960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c3815dd10 0x7f6c38157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c380cee80 0x7f6c3815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 --2- 172.21.15.143:0/2616771288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c380ae9c0 0x7f6c380b2250 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 >> 172.21.15.143:0/2616771288 conn(0x7f6c380b1180 msgr2=0x7f6c380cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 shutdown_connections 2023-11-24T06:30:42.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.244+0000 7f6c3e29a640 1 -- 172.21.15.143:0/2616771288 wait complete. 2023-11-24T06:30:42.267 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:30:42.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6bb94640 1 Processor -- start 2023-11-24T06:30:42.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6bb94640 1 -- start start 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6bb94640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcf640cab60 0x7fcf640caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6bb94640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf640ccbd0 con 0x7fcf640cb480 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6bb94640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6406dac0 con 0x7fcf640ce070 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6bb94640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6406dda0 con 0x7fcf640cab60 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf69930640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcf640cab60 0x7fcf640caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf69930640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcf640cab60 0x7fcf640caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59892/0 (socket says 172.21.15.143:59892) 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf69930640 1 -- 172.21.15.143:0/4178194762 learned_addr learned my addr 172.21.15.143:0/4178194762 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.404+0000 7fcf6912f640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fcf640cb480 0x7fcf6406cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38922/0 (socket says 172.21.15.143:38922) 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf69930640 1 -- 172.21.15.143:0/4178194762 >> v1:172.21.15.146:6789/0 conn(0x7fcf640ce070 legacy=0x7fcf6416b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf69930640 1 -- 172.21.15.143:0/4178194762 >> v1:172.21.15.143:6789/0 conn(0x7fcf640cb480 legacy=0x7fcf6406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf69930640 1 -- 172.21.15.143:0/4178194762 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6406e080 con 0x7fcf640cab60 2023-11-24T06:30:42.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6892e640 1 -- 172.21.15.143:0/4178194762 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491265799 0 0) 0x7fcf640ccbd0 con 0x7fcf640cb480 2023-11-24T06:30:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf69930640 1 --2- 172.21.15.143:0/4178194762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cab60 0x7fcf640caf40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fcb8f27bb24325 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6892e640 1 -- 172.21.15.143:0/4178194762 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60004230 con 0x7fcf640cab60 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6892e640 1 -- 172.21.15.143:0/4178194762 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600a7050 con 0x7fcf640cab60 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6892e640 1 -- 172.21.15.143:0/4178194762 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60003620 con 0x7fcf640cab60 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6bb94640 1 -- 172.21.15.143:0/4178194762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cab60 msgr2=0x7fcf640caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/4178194762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cab60 0x7fcf640caf40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6001c500 comp rx=0 tx=0).stop 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6bb94640 1 -- 172.21.15.143:0/4178194762 shutdown_connections 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/4178194762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cab60 0x7fcf640caf40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.408+0000 7fcf6bb94640 1 -- 172.21.15.143:0/4178194762 >> 172.21.15.143:0/4178194762 conn(0x7fcf640b0bf0 msgr2=0x7fcf640b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- 172.21.15.143:0/4178194762 shutdown_connections 2023-11-24T06:30:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- 172.21.15.143:0/4178194762 wait complete. 2023-11-24T06:30:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 Processor -- start 2023-11-24T06:30:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- start start 2023-11-24T06:30:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf640cab60 0x7fcf641610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 0x7fcf640c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf640ce070 0x7fcf6409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6409ad60 con 0x7fcf640cb480 2023-11-24T06:30:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c34d0 con 0x7fcf640ce070 2023-11-24T06:30:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c37b0 con 0x7fcf640cab60 2023-11-24T06:30:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 0x7fcf640c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 0x7fcf640c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59894/0 (socket says 172.21.15.143:59894) 2023-11-24T06:30:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 -- 172.21.15.143:0/2196771900 learned_addr learned my addr 172.21.15.143:0/2196771900 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf69930640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf640cab60 0x7fcf641610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6a131640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf640ce070 0x7fcf6409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 -- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf640cab60 msgr2=0x7fcf641610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf640cab60 0x7fcf641610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 -- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf640ce070 msgr2=0x7fcf6409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf640ce070 0x7fcf6409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 -- 172.21.15.143:0/2196771900 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600094d0 con 0x7fcf640cb480 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6912f640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 0x7fcf640c5270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c4b0 tx=0x7fcf5400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540074e0 con 0x7fcf640cb480 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54007660 con 0x7fcf640cb480 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf640c3a90 con 0x7fcf640cb480 2023-11-24T06:30:42.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.412+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54004a30 con 0x7fcf640cb480 2023-11-24T06:30:42.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf640c4050 con 0x7fcf640cb480 2023-11-24T06:30:42.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf640c4270 con 0x7fcf640cb480 2023-11-24T06:30:42.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf54004b90 con 0x7fcf640cb480 2023-11-24T06:30:42.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf5a7fc640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcf48066470 0x7fcf48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf54083440 con 0x7fcf640cb480 2023-11-24T06:30:42.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf69930640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcf48066470 0x7fcf48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.416+0000 7fcf69930640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcf48066470 0x7fcf48068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf600ad000 tx=0x7fcf60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:42.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.420+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf54050970 con 0x7fcf640cb480 2023-11-24T06:30:42.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.591+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf640b1570 con 0x7fcf48066470 2023-11-24T06:30:42.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.591+0000 7fcf5a7fc640 1 -- 172.21.15.143:0/2196771900 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcf640b1570 con 0x7fcf48066470 2023-11-24T06:30:42.596 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:30:42.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:30:42.596 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "cephfs" 2023-11-24T06:30:42.597 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:30:42.597 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:30:42.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcf48066470 msgr2=0x7fcf48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcf48066470 0x7fcf48068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf600ad000 tx=0x7fcf60008040 comp rx=0 tx=0).stop 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 msgr2=0x7fcf640c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 0x7fcf640c5270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c4b0 tx=0x7fcf5400c970 comp rx=0 tx=0).stop 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 shutdown_connections 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcf48066470 0x7fcf48068930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf640ce070 0x7fcf6409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf640cb480 0x7fcf640c5270 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 --2- 172.21.15.143:0/2196771900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf640cab60 0x7fcf641610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 >> 172.21.15.143:0/2196771900 conn(0x7fcf640b0bf0 msgr2=0x7fcf6406cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:42.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 shutdown_connections 2023-11-24T06:30:42.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.595+0000 7fcf6bb94640 1 -- 172.21.15.143:0/2196771900 wait complete. 2023-11-24T06:30:42.618 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:30:42.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 Processor -- start 2023-11-24T06:30:42.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 -- start start 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f589c0d39b0 0x7f589c06bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f589c0b2100 0x7f589c06c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c0b0090 con 0x7f589c15d7f0 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c06b980 con 0x7f589c0d39b0 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58a1a06640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c0b0330 con 0x7f589c0b2100 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f589affd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f589c15d7f0 0x7f589c0d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38924/0 (socket says 172.21.15.143:38924) 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f589affd640 1 -- 172.21.15.143:0/1142573355 learned_addr learned my addr 172.21.15.143:0/1142573355 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58927fc640 1 --2- 172.21.15.143:0/1142573355 >> v2:172.21.15.143:3300/0 conn(0x7f589c0d39b0 0x7f589c06bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f589b7fe640 1 --2- 172.21.15.143:0/1142573355 >> v2:172.21.15.146:3300/0 conn(0x7f589c0b2100 0x7f589c06c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f589a7fc640 1 -- 172.21.15.143:0/1142573355 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646577343 0 0) 0x7f589c0b0090 con 0x7f589c15d7f0 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f589a7fc640 1 -- 172.21.15.143:0/1142573355 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5888003530 con 0x7f589c15d7f0 2023-11-24T06:30:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58927fc640 1 -- 172.21.15.143:0/1142573355 >> v2:172.21.15.146:3300/0 conn(0x7f589c0b2100 msgr2=0x7f589c06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58927fc640 1 --2- 172.21.15.143:0/1142573355 >> v2:172.21.15.146:3300/0 conn(0x7f589c0b2100 0x7f589c06c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58927fc640 1 -- 172.21.15.143:0/1142573355 >> v1:172.21.15.143:6789/0 conn(0x7f589c15d7f0 legacy=0x7f589c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.755+0000 7f58927fc640 1 -- 172.21.15.143:0/1142573355 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c0b0610 con 0x7f589c0d39b0 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58927fc640 1 --2- 172.21.15.143:0/1142573355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c06bcd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f589c06bb60 tx=0x7f588401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5a97f661f4da9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f589a7fc640 1 -- 172.21.15.143:0/1142573355 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840a58c0 con 0x7f589c0d39b0 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f589a7fc640 1 -- 172.21.15.143:0/1142573355 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58840a5a20 con 0x7f589c0d39b0 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f589a7fc640 1 -- 172.21.15.143:0/1142573355 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840a5db0 con 0x7f589c0d39b0 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 -- 172.21.15.143:0/1142573355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 msgr2=0x7f589c06bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 --2- 172.21.15.143:0/1142573355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c06bcd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f589c06bb60 tx=0x7f588401c910 comp rx=0 tx=0).stop 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 -- 172.21.15.143:0/1142573355 shutdown_connections 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 --2- 172.21.15.143:0/1142573355 >> v2:172.21.15.146:3300/0 conn(0x7f589c0b2100 0x7f589c06c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 --2- 172.21.15.143:0/1142573355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c06bcd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 -- 172.21.15.143:0/1142573355 >> 172.21.15.143:0/1142573355 conn(0x7f589c09c790 msgr2=0x7f589c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:42.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 -- 172.21.15.143:0/1142573355 shutdown_connections 2023-11-24T06:30:42.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.759+0000 7f58a1a06640 1 -- 172.21.15.143:0/1142573355 wait complete. 2023-11-24T06:30:42.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 Processor -- start 2023-11-24T06:30:42.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 -- start start 2023-11-24T06:30:42.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f589c0b2100 0x7f589c14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f589c15d7f0 0x7f589c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c0ceb30 con 0x7f589c0d39b0 2023-11-24T06:30:42.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c14de50 con 0x7f589c0b2100 2023-11-24T06:30:42.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c0cdeb0 con 0x7f589c15d7f0 2023-11-24T06:30:42.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59924/0 (socket says 172.21.15.143:59924) 2023-11-24T06:30:42.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 -- 172.21.15.143:0/3703499914 learned_addr learned my addr 172.21.15.143:0/3703499914 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:42.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f589b7fe640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f589c15d7f0 0x7f589c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f589affd640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f589c0b2100 0x7f589c14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 -- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f589c15d7f0 msgr2=0x7f589c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f589c15d7f0 0x7f589c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 -- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f589c0b2100 msgr2=0x7f589c14d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f589c0b2100 0x7f589c14d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 -- 172.21.15.143:0/3703499914 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5884009a70 con 0x7f589c0d39b0 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f589b7fe640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f589c15d7f0 0x7f589c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f589affd640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f589c0b2100 0x7f589c14d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58927fc640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c0b2dd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f58840b0040 tx=0x7f58840196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840b9860 con 0x7f589c0d39b0 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58840b99e0 con 0x7f589c0d39b0 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589c0ce190 con 0x7f589c0d39b0 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840b9d90 con 0x7f589c0d39b0 2023-11-24T06:30:42.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.763+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589c0ce750 con 0x7f589c0d39b0 2023-11-24T06:30:42.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.767+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589c04e8c0 con 0x7f589c0d39b0 2023-11-24T06:30:42.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.767+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58840ad440 con 0x7f589c0d39b0 2023-11-24T06:30:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.767+0000 7f5898ff9640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f587c0664a0 0x7f587c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.767+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f588411ed10 con 0x7f589c0d39b0 2023-11-24T06:30:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.767+0000 7f589affd640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f587c0664a0 0x7f587c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.767+0000 7f589affd640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f587c0664a0 0x7f587c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f588c0011f0 tx=0x7f588c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:42.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.771+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58840ec2d0 con 0x7f589c0d39b0 2023-11-24T06:30:42.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.919+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f589c14dfc0 con 0x7f589c0d39b0 2023-11-24T06:30:42.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f5898ff9640 1 -- 172.21.15.143:0/3703499914 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58840ef8f0 con 0x7f589c0d39b0 2023-11-24T06:30:42.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f587c0664a0 msgr2=0x7f587c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f587c0664a0 0x7f587c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f588c0011f0 tx=0x7f588c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 msgr2=0x7f589c0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c0b2dd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f58840b0040 tx=0x7f58840196b0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 shutdown_connections 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f587c0664a0 0x7f587c068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f589c15d7f0 0x7f589c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f589c0d39b0 0x7f589c0b2dd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 --2- 172.21.15.143:0/3703499914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f589c0b2100 0x7f589c14d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:42.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 >> 172.21.15.143:0/3703499914 conn(0x7f589c09c790 msgr2=0x7f589c14e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:42.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 shutdown_connections 2023-11-24T06:30:42.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:42.923+0000 7f58a1a06640 1 -- 172.21.15.143:0/3703499914 wait complete. 2023-11-24T06:30:42.947 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp2937 2023-11-24T06:30:43.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 Processor -- start 2023-11-24T06:30:43.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 -- start start 2023-11-24T06:30:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53c415d7f0 0x7f53c40d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c40d37e0 0x7f53c40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53c40b1630 0x7f53c40b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c406b980 con 0x7f53c40b1630 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c40d3c60 con 0x7f53c415d7f0 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.083+0000 7f53cbe32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40b0090 con 0x7f53c40d37e0 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53c40b1630 0x7f53c40b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53c40b1630 0x7f53c40b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59940/0 (socket says 172.21.15.143:59940) 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 -- 172.21.15.143:0/4053750272 learned_addr learned my addr 172.21.15.143:0/4053750272 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53c9bce640 1 --2- 172.21.15.143:0/4053750272 >> v2:172.21.15.146:3300/0 conn(0x7f53c415d7f0 0x7f53c40d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53c93cd640 1 --2- 172.21.15.143:0/4053750272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c40d37e0 0x7f53c40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 -- 172.21.15.143:0/4053750272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c40d37e0 msgr2=0x7f53c40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 --2- 172.21.15.143:0/4053750272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c40d37e0 0x7f53c40b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 -- 172.21.15.143:0/4053750272 >> v2:172.21.15.146:3300/0 conn(0x7f53c415d7f0 msgr2=0x7f53c40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 --2- 172.21.15.143:0/4053750272 >> v2:172.21.15.146:3300/0 conn(0x7f53c415d7f0 0x7f53c40d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 -- 172.21.15.143:0/4053750272 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40b0330 con 0x7f53c40b1630 2023-11-24T06:30:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53c9bce640 1 --2- 172.21.15.143:0/4053750272 >> v2:172.21.15.146:3300/0 conn(0x7f53c415d7f0 0x7f53c40d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:43.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53ca3cf640 1 --2- 172.21.15.143:0/4053750272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40b1630 0x7f53c40b1ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f53c408ce00 tx=0x7f53bc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c78e5a8b88d12b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53c8bcc640 1 -- 172.21.15.143:0/4053750272 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0a5650 con 0x7f53c40b1630 2023-11-24T06:30:43.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53c8bcc640 1 -- 172.21.15.143:0/4053750272 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc0a57b0 con 0x7f53c40b1630 2023-11-24T06:30:43.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.087+0000 7f53c8bcc640 1 -- 172.21.15.143:0/4053750272 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0a5b40 con 0x7f53c40b1630 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- 172.21.15.143:0/4053750272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40b1630 msgr2=0x7f53c40b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- 172.21.15.143:0/4053750272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40b1630 0x7f53c40b1ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f53c408ce00 tx=0x7f53bc01c9d0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- 172.21.15.143:0/4053750272 shutdown_connections 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- 172.21.15.143:0/4053750272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40b1630 0x7f53c40b1ac0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- 172.21.15.143:0/4053750272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c40d37e0 0x7f53c40b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- 172.21.15.143:0/4053750272 >> v2:172.21.15.146:3300/0 conn(0x7f53c415d7f0 0x7f53c40d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- 172.21.15.143:0/4053750272 >> 172.21.15.143:0/4053750272 conn(0x7f53c409c790 msgr2=0x7f53c408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- 172.21.15.143:0/4053750272 shutdown_connections 2023-11-24T06:30:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- 172.21.15.143:0/4053750272 wait complete. 2023-11-24T06:30:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 Processor -- start 2023-11-24T06:30:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- start start 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40b1630 0x7f53c414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 0x7f53c41f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c415d7f0 0x7f53c414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41fa940 con 0x7f53c40d37e0 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41fa380 con 0x7f53c40b1630 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53cbe32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41fa660 con 0x7f53c415d7f0 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53c93cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 0x7f53c41f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53c93cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 0x7f53c41f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59948/0 (socket says 172.21.15.143:59948) 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53c93cd640 1 -- 172.21.15.143:0/2375004425 learned_addr learned my addr 172.21.15.143:0/2375004425 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53c9bce640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40b1630 0x7f53c414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.091+0000 7f53ca3cf640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c415d7f0 0x7f53c414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c93cd640 1 -- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c415d7f0 msgr2=0x7f53c414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c93cd640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c415d7f0 0x7f53c414f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c93cd640 1 -- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40b1630 msgr2=0x7f53c414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c93cd640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40b1630 0x7f53c414dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c93cd640 1 -- 172.21.15.143:0/2375004425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc009b30 con 0x7f53c40d37e0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c93cd640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 0x7f53c41f99a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53b400d800 tx=0x7f53b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40096a0 con 0x7f53c40d37e0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4009800 con 0x7f53c40d37e0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4009b70 con 0x7f53c40d37e0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c40b61c0 con 0x7f53c40d37e0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c414e280 con 0x7f53c40d37e0 2023-11-24T06:30:43.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c40b6020 con 0x7f53c40d37e0 2023-11-24T06:30:43.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53b4009cd0 con 0x7f53c40d37e0 2023-11-24T06:30:43.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53ba7fc640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53a8066470 0x7f53a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b4084480 con 0x7f53c40d37e0 2023-11-24T06:30:43.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.095+0000 7f53c9bce640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53a8066470 0x7f53a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.099+0000 7f53c9bce640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53a8066470 0x7f53a8068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f53c0006e90 tx=0x7f53c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.099+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53c40b6020 con 0x7f53c40d37e0 2023-11-24T06:30:43.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.271+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp2937", "target": ["mon-mgr", ""]}) v1 -- 0x7f53c40b6670 con 0x7f53a8066470 2023-11-24T06:30:43.283 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:30:43.279+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:30:43.283 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:30:43.279+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:30:43.283 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:30:43.279+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:30:43.283 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:30:43.279+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:30:43.283 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:30:43.279+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:30:43.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.295+0000 7f53ba7fc640 1 -- 172.21.15.143:0/2375004425 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f53c0007630 con 0x7f53a8066470 2023-11-24T06:30:43.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53a8066470 msgr2=0x7f53a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53a8066470 0x7f53a8068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f53c0006e90 tx=0x7f53c0008040 comp rx=0 tx=0).stop 2023-11-24T06:30:43.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 msgr2=0x7f53c41f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 0x7f53c41f99a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53b400d800 tx=0x7f53b400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 shutdown_connections 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53a8066470 0x7f53a8068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53c415d7f0 0x7f53c414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53c40d37e0 0x7f53c41f99a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 --2- 172.21.15.143:0/2375004425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40b1630 0x7f53c414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 >> 172.21.15.143:0/2375004425 conn(0x7f53c409c790 msgr2=0x7f53c40cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 shutdown_connections 2023-11-24T06:30:43.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.299+0000 7f53cbe32640 1 -- 172.21.15.143:0/2375004425 wait complete. 2023-11-24T06:30:43.322 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs subvol_grp2937 subvol_snap4344 2023-11-24T06:30:43.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae2bdf640 1 Processor -- start 2023-11-24T06:30:43.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae2bdf640 1 -- start start 2023-11-24T06:30:43.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae2bdf640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1adc159a80 0x7f1adc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae2bdf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc0ae950 con 0x7f1adc0ad5e0 2023-11-24T06:30:43.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae2bdf640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc0b1ef0 con 0x7f1adc06cee0 2023-11-24T06:30:43.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae2bdf640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc0ada50 con 0x7f1adc159a80 2023-11-24T06:30:43.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae117c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1adc0ad5e0 0x7f1adc0b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38932/0 (socket says 172.21.15.143:38932) 2023-11-24T06:30:43.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae117c640 1 -- 172.21.15.143:0/978665599 learned_addr learned my addr 172.21.15.143:0/978665599 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:43.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae097b640 1 --2- 172.21.15.143:0/978665599 >> v2:172.21.15.146:3300/0 conn(0x7f1adc159a80 0x7f1adc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ad37fe640 1 -- 172.21.15.143:0/978665599 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400971050 0 0) 0x7f1adc0ae950 con 0x7f1adc0ad5e0 2023-11-24T06:30:43.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ad37fe640 1 -- 172.21.15.143:0/978665599 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac4003530 con 0x7f1adc0ad5e0 2023-11-24T06:30:43.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ad37fe640 1 -- 172.21.15.143:0/978665599 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2368915647 0 0) 0x7f1ac4003530 con 0x7f1adc0ad5e0 2023-11-24T06:30:43.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae097b640 1 -- 172.21.15.143:0/978665599 >> v1:172.21.15.146:6789/0 conn(0x7f1adc06cee0 legacy=0x7f1adc0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae097b640 1 -- 172.21.15.143:0/978665599 >> v1:172.21.15.143:6789/0 conn(0x7f1adc0ad5e0 legacy=0x7f1adc0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.467+0000 7f1ae097b640 1 -- 172.21.15.143:0/978665599 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0adca0 con 0x7f1adc159a80 2023-11-24T06:30:43.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae097b640 1 --2- 172.21.15.143:0/978665599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc159a80 0x7f1adc06de50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80097c0 tx=0x7f1ad801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4fdaf680219a27e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ad37fe640 1 -- 172.21.15.143:0/978665599 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4001a00 con 0x7f1adc159a80 2023-11-24T06:30:43.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ad37fe640 1 -- 172.21.15.143:0/978665599 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad80a7050 con 0x7f1adc159a80 2023-11-24T06:30:43.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ad37fe640 1 -- 172.21.15.143:0/978665599 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80ab600 con 0x7f1adc159a80 2023-11-24T06:30:43.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/978665599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc159a80 msgr2=0x7f1adc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 --2- 172.21.15.143:0/978665599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc159a80 0x7f1adc06de50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80097c0 tx=0x7f1ad801c370 comp rx=0 tx=0).stop 2023-11-24T06:30:43.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/978665599 shutdown_connections 2023-11-24T06:30:43.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 --2- 172.21.15.143:0/978665599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc159a80 0x7f1adc06de50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/978665599 >> 172.21.15.143:0/978665599 conn(0x7f1adc0b0bf0 msgr2=0x7f1adc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:43.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/978665599 shutdown_connections 2023-11-24T06:30:43.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.471+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/978665599 wait complete. 2023-11-24T06:30:43.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 Processor -- start 2023-11-24T06:30:43.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 -- start start 2023-11-24T06:30:43.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1adc06cee0 0x7f1adc154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc0ad5e0 0x7f1adc1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1adc159a80 0x7f1adc1f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1f7730 con 0x7f1adc06cee0 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc154ed0 con 0x7f1adc0ad5e0 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae2bdf640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1f7260 con 0x7f1adc159a80 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1adc06cee0 0x7f1adc154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1adc06cee0 0x7f1adc154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59972/0 (socket says 172.21.15.143:59972) 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 -- 172.21.15.143:0/3693582237 learned_addr learned my addr 172.21.15.143:0/3693582237 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 -- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1adc159a80 msgr2=0x7f1adc1f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ad3fff640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc0ad5e0 0x7f1adc1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae117c640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1adc159a80 0x7f1adc1f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1adc159a80 0x7f1adc1f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 -- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc0ad5e0 msgr2=0x7f1adc1f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc0ad5e0 0x7f1adc1f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 -- 172.21.15.143:0/3693582237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8009420 con 0x7f1adc06cee0 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ad3fff640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1adc0ad5e0 0x7f1adc1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae117c640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1adc159a80 0x7f1adc1f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.475+0000 7f1ae097b640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1adc06cee0 0x7f1adc154990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c10 tx=0x7f1ad8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8003a30 con 0x7f1adc06cee0 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8003b90 con 0x7f1adc06cee0 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80b5410 con 0x7f1adc06cee0 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/3693582237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc153c30 con 0x7f1adc06cee0 2023-11-24T06:30:43.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/3693582237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc1f6f80 con 0x7f1adc06cee0 2023-11-24T06:30:43.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/3693582237 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc067520 con 0x7f1adc06cee0 2023-11-24T06:30:43.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ad80b2050 con 0x7f1adc06cee0 2023-11-24T06:30:43.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad17fa640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ac8066470 0x7f1ac8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ad811e2d0 con 0x7f1adc06cee0 2023-11-24T06:30:43.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad3fff640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ac8066470 0x7f1ac8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.479+0000 7f1ad3fff640 1 --2- 172.21.15.143:0/3693582237 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ac8066470 0x7f1ac8068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1adc15ac20 tx=0x7f1acc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.483+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ad80eb880 con 0x7f1adc06cee0 2023-11-24T06:30:43.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.655+0000 7f1ae2bdf640 1 -- 172.21.15.143:0/3693582237 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "cephfs", "group_name": "subvol_grp2937", "snap_name": "subvol_snap4344", "target": ["mon-mgr", ""]}) v1 -- 0x7f1adc159e60 con 0x7f1ac8066470 2023-11-24T06:30:43.659 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:30:43.655+0000 7f509801b640 -1 mgr.server reply reply (38) Function not implemented subvolume group snapshots are not supported 2023-11-24T06:30:43.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.655+0000 7f1ad17fa640 1 -- 172.21.15.143:0/3693582237 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: -38 subvolume group snapshots are not supported) v1 ==== 51+0+0 (secure 0 0 0) 0x7f1acc001cc0 con 0x7f1ac8066470 2023-11-24T06:30:43.660 INFO:teuthology.orchestra.run.smithi143.stderr:Error ENOSYS: subvolume group snapshots are not supported 2023-11-24T06:30:43.669 DEBUG:teuthology.orchestra.run:got remote process result: 38 2023-11-24T06:30:43.669 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp2937 2023-11-24T06:30:43.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 Processor -- start 2023-11-24T06:30:43.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 -- start start 2023-11-24T06:30:43.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c4c0ae4a0 0x7f9c4c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c4c0cd850 0x7f9c4c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0b3510 con 0x7f9c4c0ce250 2023-11-24T06:30:43.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0ce700 con 0x7f9c4c0ae4a0 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c51068640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0b37f0 con 0x7f9c4c0cd850 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c4c0ae4a0 0x7f9c4c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c4c0ae4a0 0x7f9c4c15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59986/0 (socket says 172.21.15.143:59986) 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 -- 172.21.15.143:0/739619119 learned_addr learned my addr 172.21.15.143:0/739619119 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4b59e640 1 --1- 172.21.15.143:0/739619119 >> v1:172.21.15.143:6789/0 conn(0x7f9c4c0ce250 0x7f9c4c15eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38948/0 (socket says 172.21.15.143:38948) 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4259c640 1 --2- 172.21.15.143:0/739619119 >> v2:172.21.15.146:3300/0 conn(0x7f9c4c0cd850 0x7f9c4c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 -- 172.21.15.143:0/739619119 >> v2:172.21.15.146:3300/0 conn(0x7f9c4c0cd850 msgr2=0x7f9c4c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:43.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 --2- 172.21.15.143:0/739619119 >> v2:172.21.15.146:3300/0 conn(0x7f9c4c0cd850 0x7f9c4c0cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 -- 172.21.15.143:0/739619119 >> v1:172.21.15.143:6789/0 conn(0x7f9c4c0ce250 legacy=0x7f9c4c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.807+0000 7f9c4ad9d640 1 -- 172.21.15.143:0/739619119 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0b3ad0 con 0x7f9c4c0ae4a0 2023-11-24T06:30:43.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c4ad9d640 1 --2- 172.21.15.143:0/739619119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ae4a0 0x7f9c4c15ba00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c06e670 tx=0x7f9c3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a279e739596fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c4a59c640 1 -- 172.21.15.143:0/739619119 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0aa430 con 0x7f9c4c0ae4a0 2023-11-24T06:30:43.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c4a59c640 1 -- 172.21.15.143:0/739619119 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c0aa590 con 0x7f9c4c0ae4a0 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c4a59c640 1 -- 172.21.15.143:0/739619119 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0aa920 con 0x7f9c4c0ae4a0 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 -- 172.21.15.143:0/739619119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ae4a0 msgr2=0x7f9c4c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 --2- 172.21.15.143:0/739619119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ae4a0 0x7f9c4c15ba00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c06e670 tx=0x7f9c3c01c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 -- 172.21.15.143:0/739619119 shutdown_connections 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 --2- 172.21.15.143:0/739619119 >> v2:172.21.15.146:3300/0 conn(0x7f9c4c0cd850 0x7f9c4c0cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 --2- 172.21.15.143:0/739619119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ae4a0 0x7f9c4c15ba00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 -- 172.21.15.143:0/739619119 >> 172.21.15.143:0/739619119 conn(0x7f9c4c0b0c80 msgr2=0x7f9c4c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:43.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 -- 172.21.15.143:0/739619119 shutdown_connections 2023-11-24T06:30:43.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.811+0000 7f9c51068640 1 -- 172.21.15.143:0/739619119 wait complete. 2023-11-24T06:30:43.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 Processor -- start 2023-11-24T06:30:43.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 -- start start 2023-11-24T06:30:43.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4c0ae4a0 0x7f9c4c14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4c0cd850 0x7f9c4c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 0x7f9c4c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c14e030 con 0x7f9c4c0ce250 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c153810 con 0x7f9c4c0cd850 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c153a20 con 0x7f9c4c0ae4a0 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 0x7f9c4c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 0x7f9c4c0ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60000/0 (socket says 172.21.15.143:60000) 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 -- 172.21.15.143:0/290183263 learned_addr learned my addr 172.21.15.143:0/290183263 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:43.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4259c640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4c0cd850 0x7f9c4c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4ad9d640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4c0ae4a0 0x7f9c4c14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 -- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4c0ae4a0 msgr2=0x7f9c4c14bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4c0ae4a0 0x7f9c4c14bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 -- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4c0cd850 msgr2=0x7f9c4c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4c0cd850 0x7f9c4c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 -- 172.21.15.143:0/290183263 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c0094d0 con 0x7f9c4c0ce250 2023-11-24T06:30:43.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c4b59e640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 0x7f9c4c0ac740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c3c0 tx=0x7f9c4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440074e0 con 0x7f9c4c0ce250 2023-11-24T06:30:43.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44007640 con 0x7f9c4c0ce250 2023-11-24T06:30:43.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c153d00 con 0x7f9c4c0ce250 2023-11-24T06:30:43.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004a10 con 0x7f9c4c0ce250 2023-11-24T06:30:43.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.815+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c1542c0 con 0x7f9c4c0ce250 2023-11-24T06:30:43.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.819+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c04e8c0 con 0x7f9c4c0ce250 2023-11-24T06:30:43.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.819+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c44004b70 con 0x7f9c4c0ce250 2023-11-24T06:30:43.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.819+0000 7f9c43fff640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c2c066470 0x7f9c2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:43.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.819+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c440837c0 con 0x7f9c4c0ce250 2023-11-24T06:30:43.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.819+0000 7f9c4ad9d640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c2c066470 0x7f9c2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:43.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.819+0000 7f9c4ad9d640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c2c066470 0x7f9c2c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0ae000 tx=0x7f9c3c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:43.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.823+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c44050c40 con 0x7f9c4c0ce250 2023-11-24T06:30:43.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.995+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp2937", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c4c168160 con 0x7f9c2c066470 2023-11-24T06:30:44.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:43.999+0000 7f9c43fff640 1 -- 172.21.15.143:0/290183263 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9c3c0aa960 con 0x7f9c2c066470 2023-11-24T06:30:44.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c2c066470 msgr2=0x7f9c2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c2c066470 0x7f9c2c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0ae000 tx=0x7f9c3c0a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:44.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 msgr2=0x7f9c4c0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 0x7f9c4c0ac740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c3c0 tx=0x7f9c4400c880 comp rx=0 tx=0).stop 2023-11-24T06:30:44.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 shutdown_connections 2023-11-24T06:30:44.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c2c066470 0x7f9c2c068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c4c0ce250 0x7f9c4c0ac740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4c0cd850 0x7f9c4c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 --2- 172.21.15.143:0/290183263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4c0ae4a0 0x7f9c4c14bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 >> 172.21.15.143:0/290183263 conn(0x7f9c4c0b0c80 msgr2=0x7f9c4c0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 shutdown_connections 2023-11-24T06:30:44.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.003+0000 7f9c51068640 1 -- 172.21.15.143:0/290183263 wait complete. 2023-11-24T06:30:44.026 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:30:44.026 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:30:44.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:30:44.244 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:30:44.245 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:44.245 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:44.258 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:44.258 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:44.310 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:44.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.487+0000 7f19a5e6b640 1 Processor -- start 2023-11-24T06:30:44.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.487+0000 7f19a5e6b640 1 -- start start 2023-11-24T06:30:44.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f19a5e6b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f19a0159a80 0x7f19a006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f19a5e6b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19a00ad5e0 0x7f19a006d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f19a5e6b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00ae950 con 0x7f19a006cee0 2023-11-24T06:30:44.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f19a5e6b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a006d8b0 con 0x7f19a0159a80 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f19a5e6b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00b1ef0 con 0x7f19a00ad5e0 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f19a0159a80 0x7f19a006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f19a0159a80 0x7f19a006de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60008/0 (socket says 172.21.15.143:60008) 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 -- 172.21.15.143:0/507797111 learned_addr learned my addr 172.21.15.143:0/507797111 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199ffff640 1 --2- 172.21.15.143:0/507797111 >> v2:172.21.15.146:3300/0 conn(0x7f19a00ad5e0 0x7f19a006d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 -- 172.21.15.143:0/507797111 >> v2:172.21.15.146:3300/0 conn(0x7f19a00ad5e0 msgr2=0x7f19a006d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 --2- 172.21.15.143:0/507797111 >> v2:172.21.15.146:3300/0 conn(0x7f19a00ad5e0 0x7f19a006d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 -- 172.21.15.143:0/507797111 >> v1:172.21.15.146:6789/0 conn(0x7f19a006cee0 legacy=0x7f19a00b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:44.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.491+0000 7f199f7fe640 1 -- 172.21.15.143:0/507797111 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00ada50 con 0x7f19a0159a80 2023-11-24T06:30:44.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f199f7fe640 1 --2- 172.21.15.143:0/507797111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a0159a80 0x7f19a006de50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f19a0073fc0 tx=0x7f199001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2dcdfa01a5db5d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:44.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f199e7fc640 1 -- 172.21.15.143:0/507797111 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900ab600 con 0x7f19a0159a80 2023-11-24T06:30:44.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f199e7fc640 1 -- 172.21.15.143:0/507797111 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19900a7050 con 0x7f19a0159a80 2023-11-24T06:30:44.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f199e7fc640 1 -- 172.21.15.143:0/507797111 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900ab980 con 0x7f19a0159a80 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 -- 172.21.15.143:0/507797111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a0159a80 msgr2=0x7f19a006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/507797111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a0159a80 0x7f19a006de50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f19a0073fc0 tx=0x7f199001c490 comp rx=0 tx=0).stop 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 -- 172.21.15.143:0/507797111 shutdown_connections 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/507797111 >> v2:172.21.15.146:3300/0 conn(0x7f19a00ad5e0 0x7f19a006d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/507797111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a0159a80 0x7f19a006de50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 -- 172.21.15.143:0/507797111 >> 172.21.15.143:0/507797111 conn(0x7f19a00b0bf0 msgr2=0x7f19a00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 -- 172.21.15.143:0/507797111 shutdown_connections 2023-11-24T06:30:44.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 -- 172.21.15.143:0/507797111 wait complete. 2023-11-24T06:30:44.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 Processor -- start 2023-11-24T06:30:44.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.495+0000 7f19a5e6b640 1 -- start start 2023-11-24T06:30:44.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 0x7f19a0161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19a00ad5e0 0x7f19a01678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a0159a80 0x7f19a0150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0166840 con 0x7f19a006cee0 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0166b20 con 0x7f19a0159a80 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0166e00 con 0x7f19a00ad5e0 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 0x7f19a0161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 0x7f19a0161bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60016/0 (socket says 172.21.15.143:60016) 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 -- 172.21.15.143:0/4056243228 learned_addr learned my addr 172.21.15.143:0/4056243228 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199ffff640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a0159a80 0x7f19a0150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199effd640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19a00ad5e0 0x7f19a01678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 -- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19a00ad5e0 msgr2=0x7f19a01678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19a00ad5e0 0x7f19a01678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 -- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a0159a80 msgr2=0x7f19a0150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a0159a80 0x7f19a0150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 -- 172.21.15.143:0/4056243228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900094d0 con 0x7f19a006cee0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f199f7fe640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 0x7f19a0161bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f19900ae040 tx=0x7f1990019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900b4640 con 0x7f19a006cee0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19900b47c0 con 0x7f19a006cee0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a01670e0 con 0x7f19a006cee0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900b4b70 con 0x7f19a006cee0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a0148600 con 0x7f19a006cee0 2023-11-24T06:30:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0067520 con 0x7f19a006cee0 2023-11-24T06:30:44.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.499+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f19900b2070 con 0x7f19a006cee0 2023-11-24T06:30:44.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.503+0000 7f1987fff640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f198c066500 0x7f198c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.503+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f199011df30 con 0x7f19a006cee0 2023-11-24T06:30:44.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.503+0000 7f199effd640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f198c066500 0x7f198c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.503+0000 7f199effd640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f198c066500 0x7f198c0689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f19a0164620 tx=0x7f1994009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:44.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.507+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19900eb240 con 0x7f19a006cee0 2023-11-24T06:30:44.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a006e700 con 0x7f19a006cee0 2023-11-24T06:30:44.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f1987fff640 1 -- 172.21.15.143:0/4056243228 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f19900ee860 con 0x7f19a006cee0 2023-11-24T06:30:44.663 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:44.663 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:34.165701+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f198c066500 msgr2=0x7f198c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f198c066500 0x7f198c0689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f19a0164620 tx=0x7f1994009040 comp rx=0 tx=0).stop 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 msgr2=0x7f19a0161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 0x7f19a0161bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f19900ae040 tx=0x7f1990019230 comp rx=0 tx=0).stop 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 shutdown_connections 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f198c066500 0x7f198c0689c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a0159a80 0x7f19a0150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19a00ad5e0 0x7f19a01678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 --2- 172.21.15.143:0/4056243228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19a006cee0 0x7f19a0161bf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 >> 172.21.15.143:0/4056243228 conn(0x7f19a00b0bf0 msgr2=0x7f19a0151a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 shutdown_connections 2023-11-24T06:30:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.659+0000 7f19a5e6b640 1 -- 172.21.15.143:0/4056243228 wait complete. 2023-11-24T06:30:44.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:30:30.193542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:30:31.535544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:44.685 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13895df640 1 Processor -- start 2023-11-24T06:30:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13895df640 1 -- start start 2023-11-24T06:30:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13895df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13840cd850 0x7f138415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13895df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840b3510 con 0x7f13840ce420 2023-11-24T06:30:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13895df640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840b37f0 con 0x7f13840ae4a0 2023-11-24T06:30:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13895df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840b3ad0 con 0x7f13840cd850 2023-11-24T06:30:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13840cd850 0x7f138415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13840cd850 0x7f138415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60032/0 (socket says 172.21.15.143:60032) 2023-11-24T06:30:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13837fe640 1 -- 172.21.15.143:0/3920010190 learned_addr learned my addr 172.21.15.143:0/3920010190 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:44.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13837fe640 1 -- 172.21.15.143:0/3920010190 >> v1:172.21.15.146:6789/0 conn(0x7f13840ae4a0 legacy=0x7f13840cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:44.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f1381ffb640 1 -- 172.21.15.143:0/3920010190 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834835441 0 0) 0x7f13840b3510 con 0x7f13840ce420 2023-11-24T06:30:44.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13837fe640 1 -- 172.21.15.143:0/3920010190 >> v1:172.21.15.143:6789/0 conn(0x7f13840ce420 legacy=0x7f138406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.823+0000 7f13837fe640 1 -- 172.21.15.143:0/3920010190 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840b3db0 con 0x7f13840cd850 2023-11-24T06:30:44.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13837fe640 1 --2- 172.21.15.143:0/3920010190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840cd850 0x7f138415ba00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f137c009e50 tx=0x7f137c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4430a4a49adf65 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:44.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f1381ffb640 1 -- 172.21.15.143:0/3920010190 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0a58d0 con 0x7f13840cd850 2023-11-24T06:30:44.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f1381ffb640 1 -- 172.21.15.143:0/3920010190 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0a5a30 con 0x7f13840cd850 2023-11-24T06:30:44.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f1381ffb640 1 -- 172.21.15.143:0/3920010190 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0a5dc0 con 0x7f13840cd850 2023-11-24T06:30:44.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 -- 172.21.15.143:0/3920010190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840cd850 msgr2=0x7f138415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 --2- 172.21.15.143:0/3920010190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840cd850 0x7f138415ba00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f137c009e50 tx=0x7f137c01c9e0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 -- 172.21.15.143:0/3920010190 shutdown_connections 2023-11-24T06:30:44.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 --2- 172.21.15.143:0/3920010190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840cd850 0x7f138415ba00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 -- 172.21.15.143:0/3920010190 >> 172.21.15.143:0/3920010190 conn(0x7f13840b0c80 msgr2=0x7f13840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:44.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 -- 172.21.15.143:0/3920010190 shutdown_connections 2023-11-24T06:30:44.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 -- 172.21.15.143:0/3920010190 wait complete. 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 Processor -- start 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.827+0000 7f13895df640 1 -- start start 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ae4a0 0x7f138415ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840cd850 0x7f138415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 0x7f1384151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138409d160 con 0x7f13840ce420 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138415f3a0 con 0x7f13840cd850 2023-11-24T06:30:44.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840709c0 con 0x7f13840ae4a0 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 0x7f1384151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 0x7f1384151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60044/0 (socket says 172.21.15.143:60044) 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 -- 172.21.15.143:0/1192926212 learned_addr learned my addr 172.21.15.143:0/1192926212 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13827fc640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840cd850 0x7f138415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f1382ffd640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ae4a0 0x7f138415ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 -- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ae4a0 msgr2=0x7f138415ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ae4a0 0x7f138415ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 -- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840cd850 msgr2=0x7f138415a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840cd850 0x7f138415a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 -- 172.21.15.143:0/1192926212 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c009b30 con 0x7f13840ce420 2023-11-24T06:30:44.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f1382ffd640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ae4a0 0x7f138415ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13837fe640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 0x7f1384151810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f137c0195f0 tx=0x7f137c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0b8880 con 0x7f13840ce420 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0b89e0 con 0x7f13840ce420 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0b8d90 con 0x7f13840ce420 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1384070ca0 con 0x7f13840ce420 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1384071260 con 0x7f13840ce420 2023-11-24T06:30:44.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138404e8c0 con 0x7f13840ce420 2023-11-24T06:30:44.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.831+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f137c0b6440 con 0x7f13840ce420 2023-11-24T06:30:44.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.835+0000 7f136b7fe640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1370066500 0x7f13700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:44.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.835+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f137c11f530 con 0x7f13840ce420 2023-11-24T06:30:44.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.835+0000 7f1382ffd640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1370066500 0x7f13700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:44.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.835+0000 7f1382ffd640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1370066500 0x7f13700689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1374000f70 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:44.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.839+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f137c0eca10 con 0x7f13840ce420 2023-11-24T06:30:44.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13840ac000 con 0x7f13840ce420 2023-11-24T06:30:44.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f136b7fe640 1 -- 172.21.15.143:0/1192926212 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f137c0f0030 con 0x7f13840ce420 2023-11-24T06:30:44.991 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:44.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1370066500 msgr2=0x7f13700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1370066500 0x7f13700689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1374000f70 tx=0x7f1374009040 comp rx=0 tx=0).stop 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 msgr2=0x7f1384151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 0x7f1384151810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f137c0195f0 tx=0x7f137c019780 comp rx=0 tx=0).stop 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 shutdown_connections 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1370066500 0x7f13700689c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce420 0x7f1384151810 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840cd850 0x7f138415a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 --2- 172.21.15.143:0/1192926212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ae4a0 0x7f138415ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.987+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 >> 172.21.15.143:0/1192926212 conn(0x7f13840b0c80 msgr2=0x7f138415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:44.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.991+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 shutdown_connections 2023-11-24T06:30:44.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:44.991+0000 7f13895df640 1 -- 172.21.15.143:0/1192926212 wait complete. 2023-11-24T06:30:45.012 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:45.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 Processor -- start 2023-11-24T06:30:45.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 -- start start 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f348c0ccef0 0x7f348c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f348c0ce2e0 0x7f348c163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c15a050 con 0x7f348c0b1f80 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c0722e0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f349273e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c072860 con 0x7f348c0ccef0 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f348c0ce2e0 0x7f348c163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f348c0ce2e0 0x7f348c163730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60046/0 (socket says 172.21.15.143:60046) 2023-11-24T06:30:45.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 -- 172.21.15.143:0/3032374668 learned_addr learned my addr 172.21.15.143:0/3032374668 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:45.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f348bfff640 1 --2- 172.21.15.143:0/3032374668 >> v2:172.21.15.146:3300/0 conn(0x7f348c0ccef0 0x7f348c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 -- 172.21.15.143:0/3032374668 >> v2:172.21.15.146:3300/0 conn(0x7f348c0ccef0 msgr2=0x7f348c06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:45.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 --2- 172.21.15.143:0/3032374668 >> v2:172.21.15.146:3300/0 conn(0x7f348c0ccef0 0x7f348c06d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 -- 172.21.15.143:0/3032374668 >> v1:172.21.15.143:6789/0 conn(0x7f348c0b1f80 legacy=0x7f348c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.151+0000 7f3490cdb640 1 -- 172.21.15.143:0/3032374668 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0705e0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f3490cdb640 1 --2- 172.21.15.143:0/3032374668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c163730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f348c072a90 tx=0x7f348401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674c4271e20cfb82 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f348affd640 1 -- 172.21.15.143:0/3032374668 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840a56d0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f348affd640 1 -- 172.21.15.143:0/3032374668 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840a5830 con 0x7f348c0ce2e0 2023-11-24T06:30:45.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f348affd640 1 -- 172.21.15.143:0/3032374668 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840a5bc0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 -- 172.21.15.143:0/3032374668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 msgr2=0x7f348c163730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 --2- 172.21.15.143:0/3032374668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c163730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f348c072a90 tx=0x7f348401c9a0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 -- 172.21.15.143:0/3032374668 shutdown_connections 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 --2- 172.21.15.143:0/3032374668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c163730 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 --2- 172.21.15.143:0/3032374668 >> v2:172.21.15.146:3300/0 conn(0x7f348c0ccef0 0x7f348c06d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 -- 172.21.15.143:0/3032374668 >> 172.21.15.143:0/3032374668 conn(0x7f348c0b0c80 msgr2=0x7f348c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 -- 172.21.15.143:0/3032374668 shutdown_connections 2023-11-24T06:30:45.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.155+0000 7f349273e640 1 -- 172.21.15.143:0/3032374668 wait complete. 2023-11-24T06:30:45.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 Processor -- start 2023-11-24T06:30:45.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 -- start start 2023-11-24T06:30:45.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0b1f80 0x7f348c14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f348c0ccef0 0x7f348c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0cf250 con 0x7f348c0ce2e0 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0cf530 con 0x7f348c0b1f80 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c15c930 con 0x7f348c0ccef0 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60052/0 (socket says 172.21.15.143:60052) 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 -- 172.21.15.143:0/3690533053 learned_addr learned my addr 172.21.15.143:0/3690533053 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 -- 172.21.15.143:0/3690533053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f348c0ccef0 msgr2=0x7f348c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f348c0ccef0 0x7f348c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 -- 172.21.15.143:0/3690533053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0b1f80 msgr2=0x7f348c14e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0b1f80 0x7f348c14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 -- 172.21.15.143:0/3690533053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009b30 con 0x7f348c0ce2e0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3490cdb640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c158a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f34840af040 tx=0x7f3484019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840b8670 con 0x7f348c0ce2e0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840b87d0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840b8b80 con 0x7f348c0ce2e0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c15cbd0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.159+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c15d190 con 0x7f348c0ce2e0 2023-11-24T06:30:45.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.163+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c1562e0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.163+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f34840b8ce0 con 0x7f348c0ce2e0 2023-11-24T06:30:45.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.163+0000 7f3488ff9640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3478066530 0x7f34780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.163+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348411f230 con 0x7f348c0ce2e0 2023-11-24T06:30:45.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.163+0000 7f348bfff640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3478066530 0x7f34780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.163+0000 7f348bfff640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3478066530 0x7f34780689f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f347c006aa0 tx=0x7f347c006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.167+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34840ec800 con 0x7f348c0ce2e0 2023-11-24T06:30:45.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.323+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f348c15d320 con 0x7f348c0ce2e0 2023-11-24T06:30:45.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.323+0000 7f3488ff9640 1 -- 172.21.15.143:0/3690533053 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3484009510 con 0x7f348c0ce2e0 2023-11-24T06:30:45.328 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:45.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3478066530 msgr2=0x7f34780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3478066530 0x7f34780689f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f347c006aa0 tx=0x7f347c006a30 comp rx=0 tx=0).stop 2023-11-24T06:30:45.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 msgr2=0x7f348c158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c158a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f34840af040 tx=0x7f3484019740 comp rx=0 tx=0).stop 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 shutdown_connections 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3478066530 0x7f34780689f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f348c0ce2e0 0x7f348c158a30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f348c0ccef0 0x7f348c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 --2- 172.21.15.143:0/3690533053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0b1f80 0x7f348c14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 >> 172.21.15.143:0/3690533053 conn(0x7f348c0b0c80 msgr2=0x7f348c0afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 shutdown_connections 2023-11-24T06:30:45.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.327+0000 7f349273e640 1 -- 172.21.15.143:0/3690533053 wait complete. 2023-11-24T06:30:45.349 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:45.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 Processor -- start 2023-11-24T06:30:45.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 -- start start 2023-11-24T06:30:45.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f27381624f0 0x7f27381628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27380ccef0 0x7f2738071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380723c0 con 0x7f27380cd380 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2738072980 con 0x7f27381624f0 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273fd0f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380726a0 con 0x7f27380ccef0 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273daab640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f27381624f0 0x7f27381628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273e2ac640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f27380cd380 0x7f27380cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38964/0 (socket says 172.21.15.143:38964) 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273e2ac640 1 -- 172.21.15.143:0/1646560075 learned_addr learned my addr 172.21.15.143:0/1646560075 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273d2aa640 1 --2- 172.21.15.143:0/1646560075 >> v2:172.21.15.146:3300/0 conn(0x7f27380ccef0 0x7f2738071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273daab640 1 -- 172.21.15.143:0/1646560075 >> v2:172.21.15.146:3300/0 conn(0x7f27380ccef0 msgr2=0x7f2738071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:45.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273daab640 1 --2- 172.21.15.143:0/1646560075 >> v2:172.21.15.146:3300/0 conn(0x7f27380ccef0 0x7f2738071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273daab640 1 -- 172.21.15.143:0/1646560075 >> v1:172.21.15.143:6789/0 conn(0x7f27380cd380 legacy=0x7f27380cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273daab640 1 -- 172.21.15.143:0/1646560075 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273806c7e0 con 0x7f27381624f0 2023-11-24T06:30:45.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.487+0000 7f273caa9640 1 -- 172.21.15.143:0/1646560075 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206709760 0 0) 0x7f27380723c0 con 0x7f27380cd380 2023-11-24T06:30:45.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273daab640 1 --2- 172.21.15.143:0/1646560075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27381624f0 0x7f27381628d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f27380ceea0 tx=0x7f273401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1226bb67111876c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273caa9640 1 -- 172.21.15.143:0/1646560075 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340ab600 con 0x7f27381624f0 2023-11-24T06:30:45.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273caa9640 1 -- 172.21.15.143:0/1646560075 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27340a7050 con 0x7f27381624f0 2023-11-24T06:30:45.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273caa9640 1 -- 172.21.15.143:0/1646560075 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340ab980 con 0x7f27381624f0 2023-11-24T06:30:45.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 -- 172.21.15.143:0/1646560075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27381624f0 msgr2=0x7f27381628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 --2- 172.21.15.143:0/1646560075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27381624f0 0x7f27381628d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f27380ceea0 tx=0x7f273401c3a0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 -- 172.21.15.143:0/1646560075 shutdown_connections 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 --2- 172.21.15.143:0/1646560075 >> v2:172.21.15.146:3300/0 conn(0x7f27380ccef0 0x7f2738071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 --2- 172.21.15.143:0/1646560075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27381624f0 0x7f27381628d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 -- 172.21.15.143:0/1646560075 >> 172.21.15.143:0/1646560075 conn(0x7f27380b0c80 msgr2=0x7f27380b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 -- 172.21.15.143:0/1646560075 shutdown_connections 2023-11-24T06:30:45.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.491+0000 7f273fd0f640 1 -- 172.21.15.143:0/1646560075 wait complete. 2023-11-24T06:30:45.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 Processor -- start 2023-11-24T06:30:45.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 -- start start 2023-11-24T06:30:45.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27380ccef0 0x7f273815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 0x7f273815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27381624f0 0x7f2738148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380ceb80 con 0x7f27380cd380 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273815de40 con 0x7f27380ccef0 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738160100 con 0x7f27381624f0 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 0x7f273815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 0x7f273815fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60060/0 (socket says 172.21.15.143:60060) 2023-11-24T06:30:45.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 -- 172.21.15.143:0/3114326198 learned_addr learned my addr 172.21.15.143:0/3114326198 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273e2ac640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27381624f0 0x7f2738148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273daab640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27380ccef0 0x7f273815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 -- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27381624f0 msgr2=0x7f2738148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27381624f0 0x7f2738148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 -- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27380ccef0 msgr2=0x7f273815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27380ccef0 0x7f273815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 -- 172.21.15.143:0/3114326198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009420 con 0x7f27380cd380 2023-11-24T06:30:45.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273d2aa640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 0x7f273815fa00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f272800d800 tx=0x7f272800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800b6c0 con 0x7f27380cd380 2023-11-24T06:30:45.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800b820 con 0x7f27380cd380 2023-11-24T06:30:45.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27381603e0 con 0x7f27380cd380 2023-11-24T06:30:45.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800bb90 con 0x7f27380cd380 2023-11-24T06:30:45.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.495+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273815e3c0 con 0x7f27380cd380 2023-11-24T06:30:45.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.499+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273804e8c0 con 0x7f27380cd380 2023-11-24T06:30:45.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.499+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f272800bcf0 con 0x7f27380cd380 2023-11-24T06:30:45.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.499+0000 7f272e7fc640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f271c066500 0x7f271c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.499+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27280843a0 con 0x7f27380cd380 2023-11-24T06:30:45.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.499+0000 7f273daab640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f271c066500 0x7f271c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.499+0000 7f273daab640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f271c066500 0x7f271c0689c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2738070610 tx=0x7f2734008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.503+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27280517e0 con 0x7f27380cd380 2023-11-24T06:30:45.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.651+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27381605d0 con 0x7f27380cd380 2023-11-24T06:30:45.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.651+0000 7f272e7fc640 1 -- 172.21.15.143:0/3114326198 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2728054e00 con 0x7f27380cd380 2023-11-24T06:30:45.657 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:45.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f271c066500 msgr2=0x7f271c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f271c066500 0x7f271c0689c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2738070610 tx=0x7f2734008040 comp rx=0 tx=0).stop 2023-11-24T06:30:45.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 msgr2=0x7f273815fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 0x7f273815fa00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f272800d800 tx=0x7f272800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 shutdown_connections 2023-11-24T06:30:45.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f271c066500 0x7f271c0689c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27381624f0 0x7f2738148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27380cd380 0x7f273815fa00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 --2- 172.21.15.143:0/3114326198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27380ccef0 0x7f273815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 >> 172.21.15.143:0/3114326198 conn(0x7f27380b0c80 msgr2=0x7f2738161330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:45.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 shutdown_connections 2023-11-24T06:30:45.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.655+0000 7f273fd0f640 1 -- 172.21.15.143:0/3114326198 wait complete. 2023-11-24T06:30:45.678 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:30:45.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.811+0000 7fef2b51d640 1 Processor -- start 2023-11-24T06:30:45.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.811+0000 7fef2b51d640 1 -- start start 2023-11-24T06:30:45.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef2b51d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fef2406b5c0 0x7fef24164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef2b51d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240cf2c0 con 0x7fef240aec90 2023-11-24T06:30:45.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef2b51d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240b3620 con 0x7fef24159aa0 2023-11-24T06:30:45.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef2b51d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240ce6f0 con 0x7fef2406b5c0 2023-11-24T06:30:45.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef292b9640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fef24159aa0 0x7fef240b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:34096/0 (socket says 172.21.15.143:34096) 2023-11-24T06:30:45.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef292b9640 1 -- 172.21.15.143:0/202477333 learned_addr learned my addr 172.21.15.143:0/202477333 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:45.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef29aba640 1 --2- 172.21.15.143:0/202477333 >> v2:172.21.15.143:3300/0 conn(0x7fef2406b5c0 0x7fef24164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef29aba640 1 -- 172.21.15.143:0/202477333 >> v1:172.21.15.146:6789/0 conn(0x7fef24159aa0 legacy=0x7fef240b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef29aba640 1 -- 172.21.15.143:0/202477333 >> v1:172.21.15.143:6789/0 conn(0x7fef240aec90 legacy=0x7fef240b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef1bfff640 1 -- 172.21.15.143:0/202477333 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415891750 0 0) 0x7fef240b3620 con 0x7fef24159aa0 2023-11-24T06:30:45.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.815+0000 7fef29aba640 1 -- 172.21.15.143:0/202477333 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240ce990 con 0x7fef2406b5c0 2023-11-24T06:30:45.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef29aba640 1 --2- 172.21.15.143:0/202477333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef2406b5c0 0x7fef24164b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d90 tx=0x7fef1c01c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5945bbde7f16ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef1bfff640 1 -- 172.21.15.143:0/202477333 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0a66f0 con 0x7fef2406b5c0 2023-11-24T06:30:45.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef1bfff640 1 -- 172.21.15.143:0/202477333 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c0a6850 con 0x7fef2406b5c0 2023-11-24T06:30:45.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef1bfff640 1 -- 172.21.15.143:0/202477333 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0a6be0 con 0x7fef2406b5c0 2023-11-24T06:30:45.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 -- 172.21.15.143:0/202477333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef2406b5c0 msgr2=0x7fef24164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 --2- 172.21.15.143:0/202477333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef2406b5c0 0x7fef24164b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d90 tx=0x7fef1c01c720 comp rx=0 tx=0).stop 2023-11-24T06:30:45.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 -- 172.21.15.143:0/202477333 shutdown_connections 2023-11-24T06:30:45.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 --2- 172.21.15.143:0/202477333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef2406b5c0 0x7fef24164b50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 -- 172.21.15.143:0/202477333 >> 172.21.15.143:0/202477333 conn(0x7fef240cc390 msgr2=0x7fef240cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:45.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 -- 172.21.15.143:0/202477333 shutdown_connections 2023-11-24T06:30:45.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 -- 172.21.15.143:0/202477333 wait complete. 2023-11-24T06:30:45.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 Processor -- start 2023-11-24T06:30:45.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.819+0000 7fef2b51d640 1 -- start start 2023-11-24T06:30:45.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef2406b5c0 0x7fef24141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 0x7fef24144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef24159aa0 0x7fef24146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24142490 con 0x7fef240aec90 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24144b70 con 0x7fef2406b5c0 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef24143920 con 0x7fef24159aa0 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 0x7fef24144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 0x7fef24144630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60070/0 (socket says 172.21.15.143:60070) 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 -- 172.21.15.143:0/28607643 learned_addr learned my addr 172.21.15.143:0/28607643 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef292b9640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef2406b5c0 0x7fef24141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef29aba640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef24159aa0 0x7fef24146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 -- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef24159aa0 msgr2=0x7fef24146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef24159aa0 0x7fef24146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 -- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef2406b5c0 msgr2=0x7fef24141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef2406b5c0 0x7fef24141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 -- 172.21.15.143:0/28607643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009a70 con 0x7fef240aec90 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef28ab8640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 0x7fef24144630 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c800 tx=0x7fef1400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14005270 con 0x7fef240aec90 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef140053f0 con 0x7fef240aec90 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400a880 con 0x7fef240aec90 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef24143360 con 0x7fef240aec90 2023-11-24T06:30:45.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef24168260 con 0x7fef240aec90 2023-11-24T06:30:45.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef24072850 con 0x7fef240aec90 2023-11-24T06:30:45.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.823+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fef1400a9e0 con 0x7fef240aec90 2023-11-24T06:30:45.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.827+0000 7fef19ffb640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fef08066500 0x7fef080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:45.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.827+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef14083670 con 0x7fef240aec90 2023-11-24T06:30:45.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.827+0000 7fef292b9640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fef08066500 0x7fef080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:45.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.827+0000 7fef292b9640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fef08066500 0x7fef080689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f70 tx=0x7fef20007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:45.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.831+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef14050a30 con 0x7fef240aec90 2023-11-24T06:30:45.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef2404e930 con 0x7fef240aec90 2023-11-24T06:30:45.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef19ffb640 1 -- 172.21.15.143:0/28607643 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef14054050 con 0x7fef240aec90 2023-11-24T06:30:45.994 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:30:45.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fef08066500 msgr2=0x7fef080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fef08066500 0x7fef080689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f70 tx=0x7fef20007df0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 msgr2=0x7fef24144630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 0x7fef24144630 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c800 tx=0x7fef1400ccc0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 shutdown_connections 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fef08066500 0x7fef080689c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef24159aa0 0x7fef24146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef240aec90 0x7fef24144630 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 --2- 172.21.15.143:0/28607643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef2406b5c0 0x7fef24141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 >> 172.21.15.143:0/28607643 conn(0x7fef240cc390 msgr2=0x7fef240cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 shutdown_connections 2023-11-24T06:30:45.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:45.991+0000 7fef2b51d640 1 -- 172.21.15.143:0/28607643 wait complete. 2023-11-24T06:30:46.015 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:30:46.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:46.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:30:46.043 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:30:46.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:46.043 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:30:46.099 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:46.099 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:46.111 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:46.111 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:46.163 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:46.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 Processor -- start 2023-11-24T06:30:46.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 -- start start 2023-11-24T06:30:46.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c580b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c580b36c0 0x7f0c58070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5815a700 con 0x7f0c58070bd0 2023-11-24T06:30:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580b2430 con 0x7f0c580b36c0 2023-11-24T06:30:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.299+0000 7f0c5f772640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580b2620 con 0x7f0c5815a320 2023-11-24T06:30:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c580b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5cd0d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c580b36c0 0x7f0c58070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c580b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:38502/0 (socket says 172.21.15.143:38502) 2023-11-24T06:30:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5cd0d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c580b36c0 0x7f0c58070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:35102/0 (socket says 172.21.15.143:35102) 2023-11-24T06:30:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 -- 172.21.15.143:0/3178343654 learned_addr learned my addr 172.21.15.143:0/3178343654 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5dd0f640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0c58070bd0 0x7f0c580ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:34104/0 (socket says 172.21.15.143:34104) 2023-11-24T06:30:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c4ffff640 1 -- 172.21.15.143:0/3178343654 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749311357 0 0) 0x7f0c5815a700 con 0x7f0c58070bd0 2023-11-24T06:30:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 -- 172.21.15.143:0/3178343654 >> v2:172.21.15.146:3300/0 conn(0x7f0c580b36c0 msgr2=0x7f0c58070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 --2- 172.21.15.143:0/3178343654 >> v2:172.21.15.146:3300/0 conn(0x7f0c580b36c0 0x7f0c58070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 -- 172.21.15.143:0/3178343654 >> v1:172.21.15.146:6789/0 conn(0x7f0c58070bd0 legacy=0x7f0c580ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 -- 172.21.15.143:0/3178343654 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580b2900 con 0x7f0c5815a320 2023-11-24T06:30:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c5d50e640 1 --2- 172.21.15.143:0/3178343654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c580b1ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009870 tx=0x7f0c5401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1b68bc44878d35 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c4ffff640 1 -- 172.21.15.143:0/3178343654 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c540a9400 con 0x7f0c5815a320 2023-11-24T06:30:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c4ffff640 1 -- 172.21.15.143:0/3178343654 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c540a9560 con 0x7f0c5815a320 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.303+0000 7f0c4ffff640 1 -- 172.21.15.143:0/3178343654 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c540a98f0 con 0x7f0c5815a320 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- 172.21.15.143:0/3178343654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 msgr2=0x7f0c580b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 --2- 172.21.15.143:0/3178343654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c580b1ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009870 tx=0x7f0c5401c540 comp rx=0 tx=0).stop 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- 172.21.15.143:0/3178343654 shutdown_connections 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 --2- 172.21.15.143:0/3178343654 >> v2:172.21.15.146:3300/0 conn(0x7f0c580b36c0 0x7f0c58070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 --2- 172.21.15.143:0/3178343654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c580b1ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- 172.21.15.143:0/3178343654 >> 172.21.15.143:0/3178343654 conn(0x7f0c580b0bf0 msgr2=0x7f0c580b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- 172.21.15.143:0/3178343654 shutdown_connections 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- 172.21.15.143:0/3178343654 wait complete. 2023-11-24T06:30:46.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 Processor -- start 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- start start 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c58070bd0 0x7f0c58160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 0x7f0c5815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c5815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58160660 con 0x7f0c580b36c0 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815fdc0 con 0x7f0c58070bd0 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5f772640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581600a0 con 0x7f0c5815a320 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 0x7f0c5815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 0x7f0c5815f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60078/0 (socket says 172.21.15.143:60078) 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 -- 172.21.15.143:0/1210759078 learned_addr learned my addr 172.21.15.143:0/1210759078 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5d50e640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c58070bd0 0x7f0c58160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5dd0f640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c5815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 -- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 msgr2=0x7f0c5815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c5815f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 -- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c58070bd0 msgr2=0x7f0c58160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c58070bd0 0x7f0c58160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.307+0000 7f0c5cd0d640 1 -- 172.21.15.143:0/1210759078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540094d0 con 0x7f0c580b36c0 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c5cd0d640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 0x7f0c5815f050 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e900 tx=0x7f0c4800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48009690 con 0x7f0c580b36c0 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800ca00 con 0x7f0c580b36c0 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800cdb0 con 0x7f0c580b36c0 2023-11-24T06:30:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58160380 con 0x7f0c580b36c0 2023-11-24T06:30:46.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5815fad0 con 0x7f0c580b36c0 2023-11-24T06:30:46.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58067520 con 0x7f0c580b36c0 2023-11-24T06:30:46.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f0c48013470 con 0x7f0c580b36c0 2023-11-24T06:30:46.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c4dffb640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c3c066500 0x7f0c3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c48083fd0 con 0x7f0c580b36c0 2023-11-24T06:30:46.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.311+0000 7f0c5d50e640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c3c066500 0x7f0c3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.315+0000 7f0c5d50e640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c3c066500 0x7f0c3c0689c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ae000 tx=0x7f0c54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.315+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c480515a0 con 0x7f0c580b36c0 2023-11-24T06:30:46.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.467+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c580999e0 con 0x7f0c580b36c0 2023-11-24T06:30:46.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.467+0000 7f0c4dffb640 1 -- 172.21.15.143:0/1210759078 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f0c48054bc0 con 0x7f0c580b36c0 2023-11-24T06:30:46.474 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:46.474 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:34.165701+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c3c066500 msgr2=0x7f0c3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c3c066500 0x7f0c3c0689c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ae000 tx=0x7f0c54008040 comp rx=0 tx=0).stop 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 msgr2=0x7f0c5815f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 0x7f0c5815f050 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e900 tx=0x7f0c4800edc0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 shutdown_connections 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c3c066500 0x7f0c3c0689c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5815a320 0x7f0c5815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c580b36c0 0x7f0c5815f050 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 --2- 172.21.15.143:0/1210759078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c58070bd0 0x7f0c58160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 >> 172.21.15.143:0/1210759078 conn(0x7f0c580b0bf0 msgr2=0x7f0c5806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:46.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 shutdown_connections 2023-11-24T06:30:46.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.471+0000 7f0c5f772640 1 -- 172.21.15.143:0/1210759078 wait complete. 2023-11-24T06:30:46.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:30:30.193542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:30:31.535544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:46.493 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.627+0000 7fdf3ed72640 1 Processor -- start 2023-11-24T06:30:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.627+0000 7fdf3ed72640 1 -- start start 2023-11-24T06:30:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf3ed72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdf3815ec60 0x7fdf380cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf3ed72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf38070f00 con 0x7fdf3815a290 2023-11-24T06:30:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf3ed72640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf38071170 con 0x7fdf380cc6b0 2023-11-24T06:30:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf3ed72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf380cb690 con 0x7fdf3815ec60 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf3cb0e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fdf3815a290 0x7fdf380707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38992/0 (socket says 172.21.15.143:38992) 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf3cb0e640 1 -- 172.21.15.143:0/3002434205 learned_addr learned my addr 172.21.15.143:0/3002434205 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf37fff640 1 --2- 172.21.15.143:0/3002434205 >> v2:172.21.15.143:3300/0 conn(0x7fdf3815ec60 0x7fdf380cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf377fe640 1 -- 172.21.15.143:0/3002434205 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411534045 0 0) 0x7fdf38070f00 con 0x7fdf3815a290 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf377fe640 1 -- 172.21.15.143:0/3002434205 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf28003530 con 0x7fdf3815a290 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf37fff640 1 -- 172.21.15.143:0/3002434205 >> v1:172.21.15.146:6789/0 conn(0x7fdf380cc6b0 legacy=0x7fdf380b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf37fff640 1 -- 172.21.15.143:0/3002434205 >> v1:172.21.15.143:6789/0 conn(0x7fdf3815a290 legacy=0x7fdf380707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.631+0000 7fdf37fff640 1 -- 172.21.15.143:0/3002434205 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf380cb970 con 0x7fdf3815ec60 2023-11-24T06:30:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf37fff640 1 --2- 172.21.15.143:0/3002434205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf3815ec60 0x7fdf380cc170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf240097c0 tx=0x7fdf2401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c4a4451ee77709 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf377fe640 1 -- 172.21.15.143:0/3002434205 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240ac640 con 0x7fdf3815ec60 2023-11-24T06:30:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf377fe640 1 -- 172.21.15.143:0/3002434205 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240ac7a0 con 0x7fdf3815ec60 2023-11-24T06:30:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf377fe640 1 -- 172.21.15.143:0/3002434205 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240acb10 con 0x7fdf3815ec60 2023-11-24T06:30:46.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 -- 172.21.15.143:0/3002434205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf3815ec60 msgr2=0x7fdf380cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/3002434205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf3815ec60 0x7fdf380cc170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf240097c0 tx=0x7fdf2401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 -- 172.21.15.143:0/3002434205 shutdown_connections 2023-11-24T06:30:46.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/3002434205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf3815ec60 0x7fdf380cc170 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 -- 172.21.15.143:0/3002434205 >> 172.21.15.143:0/3002434205 conn(0x7fdf380b0c80 msgr2=0x7fdf380b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:46.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 -- 172.21.15.143:0/3002434205 shutdown_connections 2023-11-24T06:30:46.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 -- 172.21.15.143:0/3002434205 wait complete. 2023-11-24T06:30:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 Processor -- start 2023-11-24T06:30:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.635+0000 7fdf3ed72640 1 -- start start 2023-11-24T06:30:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 0x7fdf38146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf3815a290 0x7fdf3815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3815ec60 0x7fdf3815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3815b0e0 con 0x7fdf380cc6b0 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3815cee0 con 0x7fdf3815ec60 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3815d1c0 con 0x7fdf3815a290 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 0x7fdf38146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 0x7fdf38146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60096/0 (socket says 172.21.15.143:60096) 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 -- 172.21.15.143:0/1131197541 learned_addr learned my addr 172.21.15.143:0/1131197541 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf37fff640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf3815a290 0x7fdf3815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3d30f640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3815ec60 0x7fdf3815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 -- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf3815a290 msgr2=0x7fdf3815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf3815a290 0x7fdf3815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 -- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3815ec60 msgr2=0x7fdf3815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3815ec60 0x7fdf3815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 -- 172.21.15.143:0/1131197541 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24009420 con 0x7fdf380cc6b0 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3d30f640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3815ec60 0x7fdf3815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf37fff640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf3815a290 0x7fdf3815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3cb0e640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 0x7fdf38146380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c4d0 tx=0x7fdf2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c005cf0 con 0x7fdf380cc6b0 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c005e50 con 0x7fdf380cc6b0 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c007270 con 0x7fdf380cc6b0 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3815aa20 con 0x7fdf380cc6b0 2023-11-24T06:30:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf381468c0 con 0x7fdf380cc6b0 2023-11-24T06:30:46.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3815a880 con 0x7fdf380cc6b0 2023-11-24T06:30:46.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.639+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fdf2c0073d0 con 0x7fdf380cc6b0 2023-11-24T06:30:46.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.643+0000 7fdf357fa640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf1c066500 0x7fdf1c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.643+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf2c0833c0 con 0x7fdf380cc6b0 2023-11-24T06:30:46.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.643+0000 7fdf37fff640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf1c066500 0x7fdf1c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.643+0000 7fdf37fff640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf1c066500 0x7fdf1c0689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdf240ae000 tx=0x7fdf240a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.647+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf3815a880 con 0x7fdf380cc6b0 2023-11-24T06:30:46.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.795+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf3815b220 con 0x7fdf380cc6b0 2023-11-24T06:30:46.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.795+0000 7fdf357fa640 1 -- 172.21.15.143:0/1131197541 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf3815b220 con 0x7fdf380cc6b0 2023-11-24T06:30:46.801 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf1c066500 msgr2=0x7fdf1c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf1c066500 0x7fdf1c0689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdf240ae000 tx=0x7fdf240a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 msgr2=0x7fdf38146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 0x7fdf38146380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c4d0 tx=0x7fdf2c00c990 comp rx=0 tx=0).stop 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 shutdown_connections 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf1c066500 0x7fdf1c0689c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3815ec60 0x7fdf3815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf3815a290 0x7fdf3815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 --2- 172.21.15.143:0/1131197541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf380cc6b0 0x7fdf38146380 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 >> 172.21.15.143:0/1131197541 conn(0x7fdf380b0c80 msgr2=0x7fdf380b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:46.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 shutdown_connections 2023-11-24T06:30:46.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.799+0000 7fdf3ed72640 1 -- 172.21.15.143:0/1131197541 wait complete. 2023-11-24T06:30:46.823 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.959+0000 7f759a625640 1 Processor -- start 2023-11-24T06:30:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.959+0000 7f759a625640 1 -- start start 2023-11-24T06:30:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.959+0000 7f759a625640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415ec60 0x7f75940cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.959+0000 7f759a625640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f75940cc6b0 0x7f75940b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.959+0000 7f759a625640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7594070f00 con 0x7f759415a290 2023-11-24T06:30:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f759a625640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7594071170 con 0x7f75940cc6b0 2023-11-24T06:30:46.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f759a625640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75940cb690 con 0x7f759415ec60 2023-11-24T06:30:46.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7593fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f759415a290 0x7f75940707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39000/0 (socket says 172.21.15.143:39000) 2023-11-24T06:30:46.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7593fff640 1 -- 172.21.15.143:0/4044423350 learned_addr learned my addr 172.21.15.143:0/4044423350 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7598bc2640 1 --2- 172.21.15.143:0/4044423350 >> v2:172.21.15.143:3300/0 conn(0x7f75940cc6b0 0x7f75940b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f75937fe640 1 --2- 172.21.15.143:0/4044423350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415ec60 0x7f75940cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7592ffd640 1 -- 172.21.15.143:0/4044423350 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312847626 0 0) 0x7f7594070f00 con 0x7f759415a290 2023-11-24T06:30:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7592ffd640 1 -- 172.21.15.143:0/4044423350 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f757c003530 con 0x7f759415a290 2023-11-24T06:30:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7598bc2640 1 -- 172.21.15.143:0/4044423350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415ec60 msgr2=0x7f75940cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7598bc2640 1 --2- 172.21.15.143:0/4044423350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415ec60 0x7f75940cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7598bc2640 1 -- 172.21.15.143:0/4044423350 >> v1:172.21.15.143:6789/0 conn(0x7f759415a290 legacy=0x7f75940707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7598bc2640 1 -- 172.21.15.143:0/4044423350 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940cb970 con 0x7f75940cc6b0 2023-11-24T06:30:46.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7598bc2640 1 --2- 172.21.15.143:0/4044423350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75940cc6b0 0x7f75940b1f80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f758c009d90 tx=0x7f758c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fc1c7107716843 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7592ffd640 1 -- 172.21.15.143:0/4044423350 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0a5860 con 0x7f75940cc6b0 2023-11-24T06:30:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7592ffd640 1 -- 172.21.15.143:0/4044423350 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0a59c0 con 0x7f75940cc6b0 2023-11-24T06:30:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.963+0000 7f7592ffd640 1 -- 172.21.15.143:0/4044423350 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0a5d50 con 0x7f75940cc6b0 2023-11-24T06:30:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- 172.21.15.143:0/4044423350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75940cc6b0 msgr2=0x7f75940b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 --2- 172.21.15.143:0/4044423350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75940cc6b0 0x7f75940b1f80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f758c009d90 tx=0x7f758c01c890 comp rx=0 tx=0).stop 2023-11-24T06:30:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- 172.21.15.143:0/4044423350 shutdown_connections 2023-11-24T06:30:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 --2- 172.21.15.143:0/4044423350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75940cc6b0 0x7f75940b1f80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 --2- 172.21.15.143:0/4044423350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415ec60 0x7f75940cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- 172.21.15.143:0/4044423350 >> 172.21.15.143:0/4044423350 conn(0x7f75940b0c80 msgr2=0x7f75940b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:46.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- 172.21.15.143:0/4044423350 shutdown_connections 2023-11-24T06:30:46.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- 172.21.15.143:0/4044423350 wait complete. 2023-11-24T06:30:46.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 Processor -- start 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- start start 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75940cc6b0 0x7f7594153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415a290 0x7f7594155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 0x7f7594155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759415c9e0 con 0x7f759415ec60 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759415c700 con 0x7f75940cc6b0 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f759a625640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7594156290 con 0x7f759415a290 2023-11-24T06:30:46.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f7598bc2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 0x7f7594155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f7598bc2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 0x7f7594155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60110/0 (socket says 172.21.15.143:60110) 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f7598bc2640 1 -- 172.21.15.143:0/387896504 learned_addr learned my addr 172.21.15.143:0/387896504 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f75937fe640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415a290 0x7f7594155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.967+0000 7f7593fff640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75940cc6b0 0x7f7594153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7598bc2640 1 -- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415a290 msgr2=0x7f7594155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7598bc2640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415a290 0x7f7594155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7598bc2640 1 -- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75940cc6b0 msgr2=0x7f7594153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7598bc2640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75940cc6b0 0x7f7594153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7598bc2640 1 -- 172.21.15.143:0/387896504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009a70 con 0x7f759415ec60 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7598bc2640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 0x7f7594155550 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f758c0b0040 tx=0x7f758c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0b9650 con 0x7f759415ec60 2023-11-24T06:30:46.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0b97b0 con 0x7f759415ec60 2023-11-24T06:30:46.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0b9b40 con 0x7f759415ec60 2023-11-24T06:30:46.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7594156570 con 0x7f759415ec60 2023-11-24T06:30:46.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75941537b0 con 0x7f759415ec60 2023-11-24T06:30:46.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759404e8c0 con 0x7f759415ec60 2023-11-24T06:30:46.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f758c0b9ca0 con 0x7f759415ec60 2023-11-24T06:30:46.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7590ff9640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7580066500 0x7f75800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:46.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f758c11efb0 con 0x7f759415ec60 2023-11-24T06:30:46.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.971+0000 7f7593fff640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7580066500 0x7f75800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:46.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.975+0000 7f7593fff640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7580066500 0x7f75800689c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f75840011f0 tx=0x7f7584007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:46.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:46.975+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f758c0ec480 con 0x7f759415ec60 2023-11-24T06:30:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75940b18e0 con 0x7f759415ec60 2023-11-24T06:30:47.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f7590ff9640 1 -- 172.21.15.143:0/387896504 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f758c0efaa0 con 0x7f759415ec60 2023-11-24T06:30:47.130 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7580066500 msgr2=0x7f75800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7580066500 0x7f75800689c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f75840011f0 tx=0x7f7584007d40 comp rx=0 tx=0).stop 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 msgr2=0x7f7594155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 0x7f7594155550 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f758c0b0040 tx=0x7f758c019630 comp rx=0 tx=0).stop 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 shutdown_connections 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7580066500 0x7f75800689c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f759415ec60 0x7f7594155550 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f759415a290 0x7f7594155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 --2- 172.21.15.143:0/387896504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75940cc6b0 0x7f7594153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 >> 172.21.15.143:0/387896504 conn(0x7f75940b0c80 msgr2=0x7f75940b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 shutdown_connections 2023-11-24T06:30:47.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.127+0000 7f759a625640 1 -- 172.21.15.143:0/387896504 wait complete. 2023-11-24T06:30:47.153 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:47.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d9df5640 1 Processor -- start 2023-11-24T06:30:47.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d9df5640 1 -- start start 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d9df5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa6d40b1f80 0x7fa6d4164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d9df5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d415a050 con 0x7fa6d40ccef0 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d9df5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d406e150 con 0x7fa6d40ce2e0 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d9df5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40722e0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa6d40ccef0 0x7fa6d406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39012/0 (socket says 172.21.15.143:39012) 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d37fe640 1 -- 172.21.15.143:0/177607918 learned_addr learned my addr 172.21.15.143:0/177607918 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d3fff640 1 --2- 172.21.15.143:0/177607918 >> v2:172.21.15.143:3300/0 conn(0x7fa6d40b1f80 0x7fa6d4164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d2ffd640 1 -- 172.21.15.143:0/177607918 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311283526 0 0) 0x7fa6d415a050 con 0x7fa6d40ccef0 2023-11-24T06:30:47.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d2ffd640 1 -- 172.21.15.143:0/177607918 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c0003530 con 0x7fa6d40ccef0 2023-11-24T06:30:47.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d3fff640 1 -- 172.21.15.143:0/177607918 >> v1:172.21.15.146:6789/0 conn(0x7fa6d40ce2e0 legacy=0x7fa6d406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d3fff640 1 -- 172.21.15.143:0/177607918 >> v1:172.21.15.143:6789/0 conn(0x7fa6d40ccef0 legacy=0x7fa6d406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.291+0000 7fa6d3fff640 1 -- 172.21.15.143:0/177607918 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4072860 con 0x7fa6d40b1f80 2023-11-24T06:30:47.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d3fff640 1 --2- 172.21.15.143:0/177607918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4164740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00aea0 tx=0x7fa6cc01da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfcc2cf78c14056 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:47.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d2ffd640 1 -- 172.21.15.143:0/177607918 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00a2d0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d2ffd640 1 -- 172.21.15.143:0/177607918 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc0a6860 con 0x7fa6d40b1f80 2023-11-24T06:30:47.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d2ffd640 1 -- 172.21.15.143:0/177607918 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0a6bf0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 -- 172.21.15.143:0/177607918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 msgr2=0x7fa6d4164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/177607918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4164740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00aea0 tx=0x7fa6cc01da20 comp rx=0 tx=0).stop 2023-11-24T06:30:47.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 -- 172.21.15.143:0/177607918 shutdown_connections 2023-11-24T06:30:47.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/177607918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4164740 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 -- 172.21.15.143:0/177607918 >> 172.21.15.143:0/177607918 conn(0x7fa6d40b0c80 msgr2=0x7fa6d40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:47.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 -- 172.21.15.143:0/177607918 shutdown_connections 2023-11-24T06:30:47.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.295+0000 7fa6d9df5640 1 -- 172.21.15.143:0/177607918 wait complete. 2023-11-24T06:30:47.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 Processor -- start 2023-11-24T06:30:47.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- start start 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40ccef0 0x7fa6d414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6d40ce2e0 0x7fa6d41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41598d0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4154df0 con 0x7fa6d40ccef0 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d414b530 con 0x7fa6d40ce2e0 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60122/0 (socket says 172.21.15.143:60122) 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 -- 172.21.15.143:0/2849179158 learned_addr learned my addr 172.21.15.143:0/2849179158 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6cbfff640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40ccef0 0x7fa6d414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d3fff640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6d40ce2e0 0x7fa6d41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 -- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6d40ce2e0 msgr2=0x7fa6d41562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6d40ce2e0 0x7fa6d41562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 -- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40ccef0 msgr2=0x7fa6d414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40ccef0 0x7fa6d414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 -- 172.21.15.143:0/2849179158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc00ab80 con 0x7fa6d40b1f80 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6cbfff640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40ccef0 0x7fa6d414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d37fe640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4159390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c4d0 tx=0x7fa6c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4005cf0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4005e50 con 0x7fa6d40b1f80 2023-11-24T06:30:47.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4007270 con 0x7fa6d40b1f80 2023-11-24T06:30:47.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d4154270 con 0x7fa6d40b1f80 2023-11-24T06:30:47.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d4154830 con 0x7fa6d40b1f80 2023-11-24T06:30:47.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.299+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40abff0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.303+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fa6c40073d0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.303+0000 7fa6d0ff9640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6b4066500 0x7fa6b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.303+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6c4083450 con 0x7fa6d40b1f80 2023-11-24T06:30:47.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.303+0000 7fa6cbfff640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6b4066500 0x7fa6b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.303+0000 7fa6cbfff640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6b4066500 0x7fa6b40689c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40cb740 tx=0x7fa6bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:47.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.307+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6d40abff0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6d404e8c0 con 0x7fa6d40b1f80 2023-11-24T06:30:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d0ff9640 1 -- 172.21.15.143:0/2849179158 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6c4054320 con 0x7fa6d40b1f80 2023-11-24T06:30:47.459 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6b4066500 msgr2=0x7fa6b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6b4066500 0x7fa6b40689c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40cb740 tx=0x7fa6bc009040 comp rx=0 tx=0).stop 2023-11-24T06:30:47.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 msgr2=0x7fa6d4159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4159390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c4d0 tx=0x7fa6c400c990 comp rx=0 tx=0).stop 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 shutdown_connections 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6b4066500 0x7fa6b40689c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6d40ce2e0 0x7fa6d41562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40ccef0 0x7fa6d414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 --2- 172.21.15.143:0/2849179158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6d40b1f80 0x7fa6d4159390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 >> 172.21.15.143:0/2849179158 conn(0x7fa6d40b0c80 msgr2=0x7fa6d40b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.455+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 shutdown_connections 2023-11-24T06:30:47.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.459+0000 7fa6d9df5640 1 -- 172.21.15.143:0/2849179158 wait complete. 2023-11-24T06:30:47.480 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:30:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 Processor -- start 2023-11-24T06:30:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 -- start start 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad080b6320 0x7fad080d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080b6c70 con 0x7fad080b6760 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08160cd0 con 0x7fad080b6320 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0e51e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b78f0 con 0x7fad081608f0 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0cd1b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad080b6320 0x7fad080d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0dd1d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fad080b6760 0x7fad080cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44256/0 (socket says 172.21.15.143:44256) 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0dd1d640 1 -- 172.21.15.143:0/3549102936 learned_addr learned my addr 172.21.15.143:0/3549102936 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0d51c640 1 --2- 172.21.15.143:0/3549102936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0cd1b640 1 -- 172.21.15.143:0/3549102936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 msgr2=0x7fad080b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:47.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0cd1b640 1 --2- 172.21.15.143:0/3549102936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0cd1b640 1 -- 172.21.15.143:0/3549102936 >> v1:172.21.15.143:6789/0 conn(0x7fad080b6760 legacy=0x7fad080cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7fad0cd1b640 1 -- 172.21.15.143:0/3549102936 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080b6f50 con 0x7fad080b6320 2023-11-24T06:30:47.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.615+0000 7facfffff640 1 -- 172.21.15.143:0/3549102936 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686721197 0 0) 0x7fad080b6c70 con 0x7fad080b6760 2023-11-24T06:30:47.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0cd1b640 1 --2- 172.21.15.143:0/3549102936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6320 0x7fad080d12f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7facf80097c0 tx=0x7facf801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a40af96308e282e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:47.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7facfffff640 1 -- 172.21.15.143:0/3549102936 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80ab650 con 0x7fad080b6320 2023-11-24T06:30:47.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7facfffff640 1 -- 172.21.15.143:0/3549102936 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf80ab7b0 con 0x7fad080b6320 2023-11-24T06:30:47.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7facfffff640 1 -- 172.21.15.143:0/3549102936 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80abb40 con 0x7fad080b6320 2023-11-24T06:30:47.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 -- 172.21.15.143:0/3549102936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6320 msgr2=0x7fad080d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 --2- 172.21.15.143:0/3549102936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6320 0x7fad080d12f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7facf80097c0 tx=0x7facf801c450 comp rx=0 tx=0).stop 2023-11-24T06:30:47.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 -- 172.21.15.143:0/3549102936 shutdown_connections 2023-11-24T06:30:47.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 --2- 172.21.15.143:0/3549102936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6320 0x7fad080d12f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 --2- 172.21.15.143:0/3549102936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 -- 172.21.15.143:0/3549102936 >> 172.21.15.143:0/3549102936 conn(0x7fad080613d0 msgr2=0x7fad080617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:47.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 -- 172.21.15.143:0/3549102936 shutdown_connections 2023-11-24T06:30:47.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.619+0000 7fad0e51e640 1 -- 172.21.15.143:0/3549102936 wait complete. 2023-11-24T06:30:47.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 Processor -- start 2023-11-24T06:30:47.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 -- start start 2023-11-24T06:30:47.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad080b6320 0x7fad080cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 0x7fad0814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080cc080 con 0x7fad080b6760 2023-11-24T06:30:47.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080cc320 con 0x7fad080b6320 2023-11-24T06:30:47.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080cc600 con 0x7fad081608f0 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 0x7fad0814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 0x7fad0814fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40850/0 (socket says 172.21.15.143:40850) 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 -- 172.21.15.143:0/2036690130 learned_addr learned my addr 172.21.15.143:0/2036690130 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0dd1d640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0d51c640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad080b6320 0x7fad080cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 -- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 msgr2=0x7fad080c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 -- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad080b6320 msgr2=0x7fad080cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad080b6320 0x7fad080cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 -- 172.21.15.143:0/2036690130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009420 con 0x7fad080b6760 2023-11-24T06:30:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0cd1b640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 0x7fad0814fd30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7facf801ab00 tx=0x7facf801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:47.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8004220 con 0x7fad080b6760 2023-11-24T06:30:47.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf80b9070 con 0x7fad080b6760 2023-11-24T06:30:47.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad080cc8e0 con 0x7fad080b6760 2023-11-24T06:30:47.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8003620 con 0x7fad080b6760 2023-11-24T06:30:47.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.623+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad08150270 con 0x7fad080b6760 2023-11-24T06:30:47.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.627+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0804e850 con 0x7fad080b6760 2023-11-24T06:30:47.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.627+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7facf8003780 con 0x7fad080b6760 2023-11-24T06:30:47.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.627+0000 7facfdffb640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facec066500 0x7facec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:47.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.627+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf80bb070 con 0x7fad080b6760 2023-11-24T06:30:47.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.627+0000 7fad0d51c640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facec066500 0x7facec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:47.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.627+0000 7fad0d51c640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facec066500 0x7facec0689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad04009a50 tx=0x7fad04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:47.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.631+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facf80ebe30 con 0x7fad080b6760 2023-11-24T06:30:47.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad080d1d60 con 0x7fad080b6760 2023-11-24T06:30:47.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7facfdffb640 1 -- 172.21.15.143:0/2036690130 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7facf80c4080 con 0x7fad080b6760 2023-11-24T06:30:47.799 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facec066500 msgr2=0x7facec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facec066500 0x7facec0689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad04009a50 tx=0x7fad04008040 comp rx=0 tx=0).stop 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 msgr2=0x7fad0814fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 0x7fad0814fd30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7facf801ab00 tx=0x7facf801ac90 comp rx=0 tx=0).stop 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 shutdown_connections 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7facec066500 0x7facec0689c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad081608f0 0x7fad080c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad080b6760 0x7fad0814fd30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 --2- 172.21.15.143:0/2036690130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad080b6320 0x7fad080cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:47.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 >> 172.21.15.143:0/2036690130 conn(0x7fad080613d0 msgr2=0x7fad080d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:47.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 shutdown_connections 2023-11-24T06:30:47.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:47.795+0000 7fad0e51e640 1 -- 172.21.15.143:0/2036690130 wait complete. 2023-11-24T06:30:47.820 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:30:47.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:47.820 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:30:47.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:30:47.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:30:47.850 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:30:47.903 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:47.903 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:47.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:30:47.913 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:47.913 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:47.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:30:47.954 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:48.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.091+0000 7f88bec6b640 1 Processor -- start 2023-11-24T06:30:48.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bec6b640 1 -- start start 2023-11-24T06:30:48.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bec6b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88b80b36c0 0x7f88b80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bec6b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b815a700 con 0x7f88b8070da0 2023-11-24T06:30:48.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bec6b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80b2620 con 0x7f88b815a320 2023-11-24T06:30:48.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bec6b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80b2430 con 0x7f88b80b36c0 2023-11-24T06:30:48.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bd208640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f88b8070da0 0x7f88b815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44270/0 (socket says 172.21.15.143:44270) 2023-11-24T06:30:48.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bd208640 1 -- 172.21.15.143:0/608568851 learned_addr learned my addr 172.21.15.143:0/608568851 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:48.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88affff640 1 --2- 172.21.15.143:0/608568851 >> v2:172.21.15.146:3300/0 conn(0x7f88b80b36c0 0x7f88b80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406363580 0 0) 0x7f88b815a700 con 0x7f88b8070da0 2023-11-24T06:30:48.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a0003530 con 0x7f88b8070da0 2023-11-24T06:30:48.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471357550 0 0) 0x7f88a0003530 con 0x7f88b8070da0 2023-11-24T06:30:48.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 >> v2:172.21.15.146:3300/0 conn(0x7f88b80b36c0 msgr2=0x7f88b80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 --2- 172.21.15.143:0/608568851 >> v2:172.21.15.146:3300/0 conn(0x7f88b80b36c0 0x7f88b80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 >> v1:172.21.15.146:6789/0 conn(0x7f88b815a320 legacy=0x7f88b8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80b2900 con 0x7f88b8070da0 2023-11-24T06:30:48.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f88b0001a00 con 0x7f88b8070da0 2023-11-24T06:30:48.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 >> v1:172.21.15.143:6789/0 conn(0x7f88b8070da0 legacy=0x7f88b815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88a0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88a00047d0 0x7f88a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a0005190 0x7f88a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a000c060 con 0x7f88a00039d0 2023-11-24T06:30:48.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a000c1d0 con 0x7f88a0005190 2023-11-24T06:30:48.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a000e5a0 con 0x7f88a00047d0 2023-11-24T06:30:48.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bca07640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88a0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88affff640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88a00047d0 0x7f88a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bd208640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a0005190 0x7f88a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bca07640 1 -- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88a00047d0 msgr2=0x7f88a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bca07640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88a00047d0 0x7f88a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bca07640 1 -- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a0005190 msgr2=0x7f88a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bca07640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a0005190 0x7f88a000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bca07640 1 -- 172.21.15.143:0/608568851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0003530 con 0x7f88a00039d0 2023-11-24T06:30:48.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.095+0000 7f88bd208640 1 -- 172.21.15.143:0/608568851 reap_dead start 2023-11-24T06:30:48.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bca07640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88a0003df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001780 tx=0x7f88b401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abffbeed16a33520 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40052d0 con 0x7f88a00039d0 2023-11-24T06:30:48.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40a7050 con 0x7f88a00039d0 2023-11-24T06:30:48.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88af7fe640 1 -- 172.21.15.143:0/608568851 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4003600 con 0x7f88a00039d0 2023-11-24T06:30:48.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 -- 172.21.15.143:0/608568851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 msgr2=0x7f88a0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88a0003df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001780 tx=0x7f88b401c3b0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 -- 172.21.15.143:0/608568851 shutdown_connections 2023-11-24T06:30:48.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 --2- 172.21.15.143:0/608568851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88a0003df0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 -- 172.21.15.143:0/608568851 >> 172.21.15.143:0/608568851 conn(0x7f88b80b0bf0 msgr2=0x7f88b80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:48.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 -- 172.21.15.143:0/608568851 shutdown_connections 2023-11-24T06:30:48.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.099+0000 7f88bec6b640 1 -- 172.21.15.143:0/608568851 wait complete. 2023-11-24T06:30:48.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 Processor -- start 2023-11-24T06:30:48.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 -- start start 2023-11-24T06:30:48.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88b8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b80999e0 0x7f88b813d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b8156ca0 0x7f88b8157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8157660 con 0x7f88a00039d0 2023-11-24T06:30:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b809a150 con 0x7f88b80999e0 2023-11-24T06:30:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b809a430 con 0x7f88b8156ca0 2023-11-24T06:30:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88b8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88b8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40862/0 (socket says 172.21.15.143:40862) 2023-11-24T06:30:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 -- 172.21.15.143:0/699574177 learned_addr learned my addr 172.21.15.143:0/699574177 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bd208640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b8156ca0 0x7f88b8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88affff640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b80999e0 0x7f88b813d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 -- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b8156ca0 msgr2=0x7f88b8157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b8156ca0 0x7f88b8157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 -- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b80999e0 msgr2=0x7f88b813d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b80999e0 0x7f88b813d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 -- 172.21.15.143:0/699574177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b809a710 con 0x7f88a00039d0 2023-11-24T06:30:48.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88affff640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b80999e0 0x7f88b813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:48.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bca07640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88b8155e60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f88b4005040 tx=0x7f88a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4007350 con 0x7f88a00039d0 2023-11-24T06:30:48.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40074b0 con 0x7f88a00039d0 2023-11-24T06:30:48.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b809a9f0 con 0x7f88a00039d0 2023-11-24T06:30:48.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40067e0 con 0x7f88a00039d0 2023-11-24T06:30:48.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.103+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b8149cd0 con 0x7f88a00039d0 2023-11-24T06:30:48.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.107+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b8149ec0 con 0x7f88a00039d0 2023-11-24T06:30:48.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.107+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f88b4006960 con 0x7f88a00039d0 2023-11-24T06:30:48.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.107+0000 7f88ad7fa640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f88a4066500 0x7f88a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.107+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88b411e610 con 0x7f88a00039d0 2023-11-24T06:30:48.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.107+0000 7f88affff640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f88a4066500 0x7f88a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.107+0000 7f88affff640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f88a4066500 0x7f88a40689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f88b814c8b0 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.111+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88b40eb890 con 0x7f88a00039d0 2023-11-24T06:30:48.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.299+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b809a570 con 0x7f88a00039d0 2023-11-24T06:30:48.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.299+0000 7f88ad7fa640 1 -- 172.21.15.143:0/699574177 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f88b809a570 con 0x7f88a00039d0 2023-11-24T06:30:48.305 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:48.305 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:30:32.535019+0000","modified":"2023-11-24T06:30:35.578491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4939":{"gid":4939,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/3105261355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3105261355},{"type":"v1","addr":"172.21.15.146:6834","nonce":3105261355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:30:48.306 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 18 2023-11-24T06:30:48.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f88a4066500 msgr2=0x7f88a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f88a4066500 0x7f88a40689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f88b814c8b0 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2023-11-24T06:30:48.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 msgr2=0x7f88b8155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88b8155e60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f88b4005040 tx=0x7f88a0005800 comp rx=0 tx=0).stop 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 shutdown_connections 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f88a4066500 0x7f88a40689c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b8156ca0 0x7f88b8157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b80999e0 0x7f88b813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 --2- 172.21.15.143:0/699574177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88a00039d0 0x7f88b8155e60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 >> 172.21.15.143:0/699574177 conn(0x7f88b80b0bf0 msgr2=0x7f88b80ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 shutdown_connections 2023-11-24T06:30:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.303+0000 7f88bec6b640 1 -- 172.21.15.143:0/699574177 wait complete. 2023-11-24T06:30:48.325 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:48.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ec9a640 1 Processor -- start 2023-11-24T06:30:48.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ec9a640 1 -- start start 2023-11-24T06:30:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ec9a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe2280ce8b0 0x7fe2280ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ec9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22806c0e0 con 0x7fe22815d570 2023-11-24T06:30:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ec9a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2280d1cc0 con 0x7fe2280d3020 2023-11-24T06:30:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ec9a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2280d1fa0 con 0x7fe2280ce8b0 2023-11-24T06:30:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ca36640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe22815d570 0x7fe22806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44272/0 (socket says 172.21.15.143:44272) 2023-11-24T06:30:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22ca36640 1 -- 172.21.15.143:0/2722944736 learned_addr learned my addr 172.21.15.143:0/2722944736 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627376619 0 0) 0x7fe22806c0e0 con 0x7fe22815d570 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe210003530 con 0x7fe22815d570 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe22d237640 1 --2- 172.21.15.143:0/2722944736 >> v2:172.21.15.146:3300/0 conn(0x7fe2280ce8b0 0x7fe2280ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926543695 0 0) 0x7fe210003530 con 0x7fe22815d570 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 >> v2:172.21.15.146:3300/0 conn(0x7fe2280ce8b0 msgr2=0x7fe2280ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 --2- 172.21.15.143:0/2722944736 >> v2:172.21.15.146:3300/0 conn(0x7fe2280ce8b0 0x7fe2280ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 >> v1:172.21.15.146:6789/0 conn(0x7fe2280d3020 legacy=0x7fe2280d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2280ce0b0 con 0x7fe22815d570 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fe224001680 con 0x7fe22815d570 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.459+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 >> v1:172.21.15.143:6789/0 conn(0x7fe22815d570 legacy=0x7fe22806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe210003980 0x7fe210003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2100047d0 0x7fe210004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe21000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2280d1fa0 con 0x7fe210005190 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21000c030 con 0x7fe2100047d0 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21000c1f0 con 0x7fe210003980 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe21000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21ffff640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2100047d0 0x7fe210004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22ca36640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe210003980 0x7fe210003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 -- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe210003980 msgr2=0x7fe210003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe210003980 0x7fe210003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 -- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2100047d0 msgr2=0x7fe210004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2100047d0 0x7fe210004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 -- 172.21.15.143:0/2722944736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210003530 con 0x7fe210005190 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 -- 172.21.15.143:0/2722944736 reap_dead start 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe22d237640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe21000b990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe220009fc0 tx=0x7fe22001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52517dad7f1c3e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200a5cb0 con 0x7fe210005190 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22000f040 con 0x7fe210005190 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.463+0000 7fe21f7fe640 1 -- 172.21.15.143:0/2722944736 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220003be0 con 0x7fe210005190 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- 172.21.15.143:0/2722944736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 msgr2=0x7fe21000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe21000b990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe220009fc0 tx=0x7fe22001cca0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- 172.21.15.143:0/2722944736 shutdown_connections 2023-11-24T06:30:48.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/2722944736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe21000b990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- 172.21.15.143:0/2722944736 >> 172.21.15.143:0/2722944736 conn(0x7fe22808ceb0 msgr2=0x7fe22809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:48.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- 172.21.15.143:0/2722944736 shutdown_connections 2023-11-24T06:30:48.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- 172.21.15.143:0/2722944736 wait complete. 2023-11-24T06:30:48.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 Processor -- start 2023-11-24T06:30:48.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- start start 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe2281f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2280b5ff0 0x7fe228160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe228152b50 0x7fe22815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2280b87a0 con 0x7fe210005190 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2281f6a90 con 0x7fe2280b5ff0 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ec9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe228160b80 con 0x7fe228152b50 2023-11-24T06:30:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ca36640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe2281f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ca36640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe2281f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40880/0 (socket says 172.21.15.143:40880) 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22ca36640 1 -- 172.21.15.143:0/18246038 learned_addr learned my addr 172.21.15.143:0/18246038 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe22d237640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe228152b50 0x7fe22815f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.467+0000 7fe21ffff640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2280b5ff0 0x7fe228160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ca36640 1 -- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe228152b50 msgr2=0x7fe22815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ca36640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe228152b50 0x7fe22815f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ca36640 1 -- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2280b5ff0 msgr2=0x7fe228160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ca36640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2280b5ff0 0x7fe228160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ca36640 1 -- 172.21.15.143:0/18246038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2280b8fa0 con 0x7fe210005190 2023-11-24T06:30:48.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ca36640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe2281f6550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe224007290 tx=0x7fe224007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400f9c0 con 0x7fe210005190 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22400fb40 con 0x7fe210005190 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2280b89e0 con 0x7fe210005190 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240133f0 con 0x7fe210005190 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe228160120 con 0x7fe210005190 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe228067520 con 0x7fe210005190 2023-11-24T06:30:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fe224013550 con 0x7fe210005190 2023-11-24T06:30:48.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21d7fa640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe214066530 0x7fe2140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe224083ff0 con 0x7fe210005190 2023-11-24T06:30:48.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.471+0000 7fe21ffff640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe214066530 0x7fe2140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.475+0000 7fe21ffff640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe214066530 0x7fe2140689f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe218000c10 tx=0x7fe218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.475+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2240b5280 con 0x7fe210005190 2023-11-24T06:30:48.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.627+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe22806b7b0 con 0x7fe210005190 2023-11-24T06:30:48.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.627+0000 7fe21d7fa640 1 -- 172.21.15.143:0/18246038 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fe224051470 con 0x7fe210005190 2023-11-24T06:30:48.632 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:48.632 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:34.165701+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:48.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe214066530 msgr2=0x7fe2140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe214066530 0x7fe2140689f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe218000c10 tx=0x7fe218009040 comp rx=0 tx=0).stop 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 msgr2=0x7fe2281f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe2281f6550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe224007290 tx=0x7fe224007750 comp rx=0 tx=0).stop 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 shutdown_connections 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe214066530 0x7fe2140689f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe228152b50 0x7fe22815f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2280b5ff0 0x7fe228160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 --2- 172.21.15.143:0/18246038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe210005190 0x7fe2281f6550 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 >> 172.21.15.143:0/18246038 conn(0x7fe22808ceb0 msgr2=0x7fe2280b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 shutdown_connections 2023-11-24T06:30:48.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.631+0000 7fe22ec9a640 1 -- 172.21.15.143:0/18246038 wait complete. 2023-11-24T06:30:48.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:30:30.193542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:30:31.535544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:48.654 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:48.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 Processor -- start 2023-11-24T06:30:48.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 -- start start 2023-11-24T06:30:48.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5f2c0ce2e0 0x7f5f2c06da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f2c0b1f80 0x7f5f2c163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c15a050 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c0722e0 con 0x7f5f2c0ce2e0 2023-11-24T06:30:48.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f32c68640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c072860 con 0x7f5f2c0b1f80 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5f2c0ce2e0 0x7f5f2c06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5f2c0ce2e0 0x7f5f2c06da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40882/0 (socket says 172.21.15.143:40882) 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 -- 172.21.15.143:0/2769876718 learned_addr learned my addr 172.21.15.143:0/2769876718 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f31205640 1 --2- 172.21.15.143:0/2769876718 >> v2:172.21.15.146:3300/0 conn(0x7f5f2c0b1f80 0x7f5f2c163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 -- 172.21.15.143:0/2769876718 >> v2:172.21.15.146:3300/0 conn(0x7f5f2c0b1f80 msgr2=0x7f5f2c163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 --2- 172.21.15.143:0/2769876718 >> v2:172.21.15.146:3300/0 conn(0x7f5f2c0b1f80 0x7f5f2c163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 -- 172.21.15.143:0/2769876718 >> v1:172.21.15.146:6789/0 conn(0x7f5f2c0ccef0 legacy=0x7f5f2c06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.791+0000 7f5f23fff640 1 -- 172.21.15.143:0/2769876718 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0705e0 con 0x7f5f2c0ce2e0 2023-11-24T06:30:48.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f23fff640 1 --2- 172.21.15.143:0/2769876718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ce2e0 0x7f5f2c06da40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0719a0 tx=0x7f5f1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33fdb877dce90b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f237fe640 1 -- 172.21.15.143:0/2769876718 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0ab600 con 0x7f5f2c0ce2e0 2023-11-24T06:30:48.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f237fe640 1 -- 172.21.15.143:0/2769876718 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0a7050 con 0x7f5f2c0ce2e0 2023-11-24T06:30:48.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f237fe640 1 -- 172.21.15.143:0/2769876718 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0ab980 con 0x7f5f2c0ce2e0 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 -- 172.21.15.143:0/2769876718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ce2e0 msgr2=0x7f5f2c06da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 --2- 172.21.15.143:0/2769876718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ce2e0 0x7f5f2c06da40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0719a0 tx=0x7f5f1c01c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 -- 172.21.15.143:0/2769876718 shutdown_connections 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 --2- 172.21.15.143:0/2769876718 >> v2:172.21.15.146:3300/0 conn(0x7f5f2c0b1f80 0x7f5f2c163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 --2- 172.21.15.143:0/2769876718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ce2e0 0x7f5f2c06da40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 -- 172.21.15.143:0/2769876718 >> 172.21.15.143:0/2769876718 conn(0x7f5f2c0b0c80 msgr2=0x7f5f2c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 -- 172.21.15.143:0/2769876718 shutdown_connections 2023-11-24T06:30:48.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.795+0000 7f5f32c68640 1 -- 172.21.15.143:0/2769876718 wait complete. 2023-11-24T06:30:48.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 Processor -- start 2023-11-24T06:30:48.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- start start 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f2c0b1f80 0x7f5f2c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 0x7f5f2c09ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f2c0ce2e0 0x7f5f2c0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c165eb0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c1f67c0 con 0x7f5f2c0b1f80 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c166100 con 0x7f5f2c0ce2e0 2023-11-24T06:30:48.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 0x7f5f2c09ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 0x7f5f2c09ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40898/0 (socket says 172.21.15.143:40898) 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 -- 172.21.15.143:0/3459234015 learned_addr learned my addr 172.21.15.143:0/3459234015 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 -- 172.21.15.143:0/3459234015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f2c0ce2e0 msgr2=0x7f5f2c0aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f2c0ce2e0 0x7f5f2c0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 -- 172.21.15.143:0/3459234015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f2c0b1f80 msgr2=0x7f5f2c1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f2c0b1f80 0x7f5f2c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 -- 172.21.15.143:0/3459234015 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0094d0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f23fff640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 0x7f5f2c09ca80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c01a100 tx=0x7f5f1c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0b4420 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0b4580 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c1663e0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0b4910 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c1669a0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.799+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c04e8c0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.803+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f5f1c0b2070 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.803+0000 7f5f217fa640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f18066500 0x7f5f180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:48.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.803+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f1c11d3c0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.803+0000 7f5f30a04640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f18066500 0x7f5f180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:48.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.803+0000 7f5f30a04640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f18066500 0x7f5f180689c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000f70 tx=0x7f5f280079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.807+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f1c0ea5b0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.955+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f2c06e900 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.955+0000 7f5f217fa640 1 -- 172.21.15.143:0/3459234015 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f1c0b00a0 con 0x7f5f2c0ccef0 2023-11-24T06:30:48.960 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:48.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.955+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f18066500 msgr2=0x7f5f180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.955+0000 7f5f32c68640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f18066500 0x7f5f180689c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000f70 tx=0x7f5f280079c0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 msgr2=0x7f5f2c09ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:48.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 0x7f5f2c09ca80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c01a100 tx=0x7f5f1c019270 comp rx=0 tx=0).stop 2023-11-24T06:30:48.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 shutdown_connections 2023-11-24T06:30:48.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f18066500 0x7f5f180689c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f2c0ce2e0 0x7f5f2c0aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2c0ccef0 0x7f5f2c09ca80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 --2- 172.21.15.143:0/3459234015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f2c0b1f80 0x7f5f2c1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:48.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 >> 172.21.15.143:0/3459234015 conn(0x7f5f2c0b0c80 msgr2=0x7f5f2c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:48.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 shutdown_connections 2023-11-24T06:30:48.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:48.959+0000 7f5f32c68640 1 -- 172.21.15.143:0/3459234015 wait complete. 2023-11-24T06:30:48.981 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:30:49.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.115+0000 7f1dfd89a640 1 Processor -- start 2023-11-24T06:30:49.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.115+0000 7f1dfd89a640 1 -- start start 2023-11-24T06:30:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dfd89a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1df80ae4a0 0x7f1df815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dfd89a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dfd89a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1df80ce250 0x7f1df815eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dfd89a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df80ce6e0 con 0x7f1df80ae4a0 2023-11-24T06:30:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dfd89a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df80b3510 con 0x7f1df80ce250 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dfd89a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df80b37f0 con 0x7f1df80cd850 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1df80ae4a0 0x7f1df815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1df80ae4a0 0x7f1df815ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40900/0 (socket says 172.21.15.143:40900) 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 -- 172.21.15.143:0/1416525758 learned_addr learned my addr 172.21.15.143:0/1416525758 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df77fe640 1 --2- 172.21.15.143:0/1416525758 >> v2:172.21.15.146:3300/0 conn(0x7f1df80ce250 0x7f1df815eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1dee7fc640 1 --2- 172.21.15.143:0/1416525758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 -- 172.21.15.143:0/1416525758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 msgr2=0x7f1df80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/1416525758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df80cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 -- 172.21.15.143:0/1416525758 >> v2:172.21.15.146:3300/0 conn(0x7f1df80ce250 msgr2=0x7f1df815eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/1416525758 >> v2:172.21.15.146:3300/0 conn(0x7f1df80ce250 0x7f1df815eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.119+0000 7f1df6ffd640 1 -- 172.21.15.143:0/1416525758 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80b3ad0 con 0x7f1df80ae4a0 2023-11-24T06:30:49.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/1416525758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ae4a0 0x7f1df815ba00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1df80cc570 tx=0x7f1de801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd22ac66aa5ba2f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1df67fc640 1 -- 172.21.15.143:0/1416525758 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80a5560 con 0x7f1df80ae4a0 2023-11-24T06:30:49.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1df67fc640 1 -- 172.21.15.143:0/1416525758 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de80a56c0 con 0x7f1df80ae4a0 2023-11-24T06:30:49.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1df67fc640 1 -- 172.21.15.143:0/1416525758 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80a5a50 con 0x7f1df80ae4a0 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 -- 172.21.15.143:0/1416525758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ae4a0 msgr2=0x7f1df815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/1416525758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ae4a0 0x7f1df815ba00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1df80cc570 tx=0x7f1de801c6e0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 -- 172.21.15.143:0/1416525758 shutdown_connections 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/1416525758 >> v2:172.21.15.146:3300/0 conn(0x7f1df80ce250 0x7f1df815eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/1416525758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df80cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/1416525758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ae4a0 0x7f1df815ba00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 -- 172.21.15.143:0/1416525758 >> 172.21.15.143:0/1416525758 conn(0x7f1df80b0c80 msgr2=0x7f1df80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:49.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 -- 172.21.15.143:0/1416525758 shutdown_connections 2023-11-24T06:30:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 -- 172.21.15.143:0/1416525758 wait complete. 2023-11-24T06:30:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.123+0000 7f1dfd89a640 1 Processor -- start 2023-11-24T06:30:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- start start 2023-11-24T06:30:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ae4a0 0x7f1df814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 0x7f1df80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df814e8c0 con 0x7f1df80ce250 2023-11-24T06:30:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df814dc40 con 0x7f1df80ae4a0 2023-11-24T06:30:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df814df20 con 0x7f1df80cd850 2023-11-24T06:30:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 0x7f1df80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 0x7f1df80705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40912/0 (socket says 172.21.15.143:40912) 2023-11-24T06:30:49.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 -- 172.21.15.143:0/558223399 learned_addr learned my addr 172.21.15.143:0/558223399 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dee7fc640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 -- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 msgr2=0x7f1df814fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ae4a0 0x7f1df814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df814fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 -- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ae4a0 msgr2=0x7f1df814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ae4a0 0x7f1df814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 -- 172.21.15.143:0/558223399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009b30 con 0x7f1df80ce250 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dee7fc640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ae4a0 0x7f1df814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df77fe640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 0x7f1df80705e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1df000d560 tx=0x7f1df000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00125f0 con 0x7f1df80ce250 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0012770 con 0x7f1df80ce250 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0012b20 con 0x7f1df80ce250 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df814e200 con 0x7f1df80ce250 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df80af3e0 con 0x7f1df80ce250 2023-11-24T06:30:49.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.127+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df806c5c0 con 0x7f1df80ce250 2023-11-24T06:30:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.131+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f1df0012c80 con 0x7f1df80ce250 2023-11-24T06:30:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.131+0000 7f1df4ff9640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dd8066500 0x7f1dd80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.131+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1df00843e0 con 0x7f1df80ce250 2023-11-24T06:30:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.131+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dd8066500 0x7f1dd80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.131+0000 7f1df6ffd640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dd8066500 0x7f1dd80689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1de80ae000 tx=0x7f1de80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.135+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1df0051800 con 0x7f1df80ce250 2023-11-24T06:30:49.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1df804e8c0 con 0x7f1df80ce250 2023-11-24T06:30:49.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1df4ff9640 1 -- 172.21.15.143:0/558223399 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1df0054e20 con 0x7f1df80ce250 2023-11-24T06:30:49.295 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dd8066500 msgr2=0x7f1dd80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dd8066500 0x7f1dd80689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1de80ae000 tx=0x7f1de80a7070 comp rx=0 tx=0).stop 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 msgr2=0x7f1df80705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 0x7f1df80705e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1df000d560 tx=0x7f1df000da20 comp rx=0 tx=0).stop 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 shutdown_connections 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dd8066500 0x7f1dd80689c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1df80ce250 0x7f1df80705e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80cd850 0x7f1df814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 --2- 172.21.15.143:0/558223399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ae4a0 0x7f1df814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 >> 172.21.15.143:0/558223399 conn(0x7f1df80b0c80 msgr2=0x7f1df806dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:49.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 shutdown_connections 2023-11-24T06:30:49.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.291+0000 7f1dfd89a640 1 -- 172.21.15.143:0/558223399 wait complete. 2023-11-24T06:30:49.317 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:30:49.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 Processor -- start 2023-11-24T06:30:49.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 -- start start 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f95e415ec60 0x7f95e40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e40b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e4070f00 con 0x7f95e415a290 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e4071170 con 0x7f95e415ec60 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95ea794640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40cb690 con 0x7f95e40cc6b0 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f95e415ec60 0x7f95e40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f95e415ec60 0x7f95e40cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40928/0 (socket says 172.21.15.143:40928) 2023-11-24T06:30:49.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 -- 172.21.15.143:0/2475377794 learned_addr learned my addr 172.21.15.143:0/2475377794 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:49.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e8d31640 1 --2- 172.21.15.143:0/2475377794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e40b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 -- 172.21.15.143:0/2475377794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 msgr2=0x7f95e40b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:49.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 --2- 172.21.15.143:0/2475377794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e40b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 -- 172.21.15.143:0/2475377794 >> v1:172.21.15.146:6789/0 conn(0x7f95e415a290 legacy=0x7f95e40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.455+0000 7f95e37fe640 1 -- 172.21.15.143:0/2475377794 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40cb970 con 0x7f95e415ec60 2023-11-24T06:30:49.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95e37fe640 1 --2- 172.21.15.143:0/2475377794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415ec60 0x7f95e40cc170 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009870 tx=0x7f95d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de9c5056565767c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95e2ffd640 1 -- 172.21.15.143:0/2475377794 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80ad640 con 0x7f95e415ec60 2023-11-24T06:30:49.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95e2ffd640 1 -- 172.21.15.143:0/2475377794 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d80ad7a0 con 0x7f95e415ec60 2023-11-24T06:30:49.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95e2ffd640 1 -- 172.21.15.143:0/2475377794 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80adb30 con 0x7f95e415ec60 2023-11-24T06:30:49.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 -- 172.21.15.143:0/2475377794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415ec60 msgr2=0x7f95e40cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 --2- 172.21.15.143:0/2475377794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415ec60 0x7f95e40cc170 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009870 tx=0x7f95d801c480 comp rx=0 tx=0).stop 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 -- 172.21.15.143:0/2475377794 shutdown_connections 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 --2- 172.21.15.143:0/2475377794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e40b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 --2- 172.21.15.143:0/2475377794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415ec60 0x7f95e40cc170 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 -- 172.21.15.143:0/2475377794 >> 172.21.15.143:0/2475377794 conn(0x7f95e40b0c80 msgr2=0x7f95e40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 -- 172.21.15.143:0/2475377794 shutdown_connections 2023-11-24T06:30:49.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 -- 172.21.15.143:0/2475377794 wait complete. 2023-11-24T06:30:49.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.459+0000 7f95ea794640 1 Processor -- start 2023-11-24T06:30:49.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- start start 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e4147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 0x7f95e414dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e415ec60 0x7f95e414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e414ebc0 con 0x7f95e415a290 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40ad7f0 con 0x7f95e415ec60 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4150b50 con 0x7f95e40cc6b0 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 0x7f95e414dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 0x7f95e414dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40940/0 (socket says 172.21.15.143:40940) 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 -- 172.21.15.143:0/24322578 learned_addr learned my addr 172.21.15.143:0/24322578 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e3fff640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e4147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e8d31640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e415ec60 0x7f95e414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 -- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 msgr2=0x7f95e4147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e4147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 -- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e415ec60 msgr2=0x7f95e414e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e415ec60 0x7f95e414e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 -- 172.21.15.143:0/24322578 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80094d0 con 0x7f95e415a290 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e8d31640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e415ec60 0x7f95e414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:49.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e37fe640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 0x7f95e414dd30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f95d801a0b0 tx=0x7f95d8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80ad640 con 0x7f95e415a290 2023-11-24T06:30:49.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d80a6040 con 0x7f95e415a290 2023-11-24T06:30:49.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e4147c60 con 0x7f95e415a290 2023-11-24T06:30:49.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80b7a30 con 0x7f95e415a290 2023-11-24T06:30:49.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e4150220 con 0x7f95e415a290 2023-11-24T06:30:49.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.463+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e41634d0 con 0x7f95e415a290 2023-11-24T06:30:49.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.467+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f95d80b7b90 con 0x7f95e415a290 2023-11-24T06:30:49.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.467+0000 7f95e0ff9640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f95d0066530 0x7f95d00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.467+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95d811eca0 con 0x7f95e415a290 2023-11-24T06:30:49.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.467+0000 7f95e3fff640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f95d0066530 0x7f95d00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.467+0000 7f95e3fff640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f95d0066530 0x7f95d00689f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000f70 tx=0x7f95d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.471+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95d80ec150 con 0x7f95e415a290 2023-11-24T06:30:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.619+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95e404e8c0 con 0x7f95e415a290 2023-11-24T06:30:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.619+0000 7f95e0ff9640 1 -- 172.21.15.143:0/24322578 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95d80ef770 con 0x7f95e415a290 2023-11-24T06:30:49.625 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:30:49.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f95d0066530 msgr2=0x7f95d00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f95d0066530 0x7f95d00689f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000f70 tx=0x7f95d4009040 comp rx=0 tx=0).stop 2023-11-24T06:30:49.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 msgr2=0x7f95e414dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 0x7f95e414dd30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f95d801a0b0 tx=0x7f95d8019220 comp rx=0 tx=0).stop 2023-11-24T06:30:49.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 shutdown_connections 2023-11-24T06:30:49.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f95d0066530 0x7f95d00689f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e415ec60 0x7f95e414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e415a290 0x7f95e414dd30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 --2- 172.21.15.143:0/24322578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95e40cc6b0 0x7f95e4147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 >> 172.21.15.143:0/24322578 conn(0x7f95e40b0c80 msgr2=0x7f95e406c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:49.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 shutdown_connections 2023-11-24T06:30:49.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.623+0000 7f95ea794640 1 -- 172.21.15.143:0/24322578 wait complete. 2023-11-24T06:30:49.645 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:49.783 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74970d3640 1 Processor -- start 2023-11-24T06:30:49.783 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74970d3640 1 -- start start 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74970d3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7490144a10 0x7f749006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74970d3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7490144800 con 0x7f74900b1190 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74970d3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74900ceb80 con 0x7f7490144420 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74970d3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749006ccf0 con 0x7f7490144a10 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74958d0640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f74900b1190 0x7f74900b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44286/0 (socket says 172.21.15.143:44286) 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74958d0640 1 -- 172.21.15.143:0/358186876 learned_addr learned my addr 172.21.15.143:0/358186876 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:49.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.779+0000 7f74968d2640 1 --2- 172.21.15.143:0/358186876 >> v2:172.21.15.143:3300/0 conn(0x7f7490144a10 0x7f749006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74950cf640 1 -- 172.21.15.143:0/358186876 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396147842 0 0) 0x7f7490144800 con 0x7f74900b1190 2023-11-24T06:30:49.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74950cf640 1 -- 172.21.15.143:0/358186876 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747c003530 con 0x7f74900b1190 2023-11-24T06:30:49.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74968d2640 1 -- 172.21.15.143:0/358186876 >> v1:172.21.15.146:6789/0 conn(0x7f7490144420 legacy=0x7f74900b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74968d2640 1 -- 172.21.15.143:0/358186876 >> v1:172.21.15.143:6789/0 conn(0x7f74900b1190 legacy=0x7f74900b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74968d2640 1 -- 172.21.15.143:0/358186876 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749006cfd0 con 0x7f7490144a10 2023-11-24T06:30:49.788 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74968d2640 1 --2- 172.21.15.143:0/358186876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144a10 0x7f749006c660 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7488009d90 tx=0x7f748801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef46feaa7ee0cbf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.788 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74950cf640 1 -- 172.21.15.143:0/358186876 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880a5810 con 0x7f7490144a10 2023-11-24T06:30:49.788 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74950cf640 1 -- 172.21.15.143:0/358186876 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74880a5970 con 0x7f7490144a10 2023-11-24T06:30:49.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74950cf640 1 -- 172.21.15.143:0/358186876 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880a5d00 con 0x7f7490144a10 2023-11-24T06:30:49.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74970d3640 1 -- 172.21.15.143:0/358186876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144a10 msgr2=0x7f749006c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.783+0000 7f74970d3640 1 --2- 172.21.15.143:0/358186876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144a10 0x7f749006c660 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7488009d90 tx=0x7f748801c950 comp rx=0 tx=0).stop 2023-11-24T06:30:49.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- 172.21.15.143:0/358186876 shutdown_connections 2023-11-24T06:30:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 --2- 172.21.15.143:0/358186876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144a10 0x7f749006c660 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- 172.21.15.143:0/358186876 >> 172.21.15.143:0/358186876 conn(0x7f74900cb840 msgr2=0x7f74900cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- 172.21.15.143:0/358186876 shutdown_connections 2023-11-24T06:30:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- 172.21.15.143:0/358186876 wait complete. 2023-11-24T06:30:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 Processor -- start 2023-11-24T06:30:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- start start 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74900b1190 0x7f74900ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 0x7f7490142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7490144a10 0x7f7490071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749015a630 con 0x7f7490144420 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900c9110 con 0x7f7490144a10 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74970d3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74900c9360 con 0x7f74900b1190 2023-11-24T06:30:49.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 0x7f7490142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 0x7f7490142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40960/0 (socket says 172.21.15.143:40960) 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 -- 172.21.15.143:0/622682630 learned_addr learned my addr 172.21.15.143:0/622682630 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74960d1640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74900b1190 0x7f74900ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74968d2640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7490144a10 0x7f7490071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 -- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74900b1190 msgr2=0x7f74900ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74900b1190 0x7f74900ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 -- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7490144a10 msgr2=0x7f7490071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7490144a10 0x7f7490071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 -- 172.21.15.143:0/622682630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009a70 con 0x7f7490144420 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74960d1640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74900b1190 0x7f74900ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74968d2640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7490144a10 0x7f7490071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:49.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f74958d0640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 0x7f7490142e10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f748000c4d0 tx=0x7f748000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.787+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480005cf0 con 0x7f7490144420 2023-11-24T06:30:49.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480005e50 con 0x7f7490144420 2023-11-24T06:30:49.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74900c9640 con 0x7f7490144420 2023-11-24T06:30:49.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480007270 con 0x7f7490144420 2023-11-24T06:30:49.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74900c9c00 con 0x7f7490144420 2023-11-24T06:30:49.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74900c9e20 con 0x7f7490144420 2023-11-24T06:30:49.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f74800073d0 con 0x7f7490144420 2023-11-24T06:30:49.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f7486ffd640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7474066500 0x7f74740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:49.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74800834c0 con 0x7f7490144420 2023-11-24T06:30:49.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f74960d1640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7474066500 0x7f74740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:49.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.791+0000 7f74960d1640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7474066500 0x7f74740689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f748c000f70 tx=0x7f748c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:49.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.795+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7480050900 con 0x7f7490144420 2023-11-24T06:30:49.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.975+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f749004e850 con 0x7f7490144420 2023-11-24T06:30:49.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.975+0000 7f7486ffd640 1 -- 172.21.15.143:0/622682630 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f7480053f20 con 0x7f7490144420 2023-11-24T06:30:49.981 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:49.981 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:30:32.535019+0000","modified":"2023-11-24T06:30:35.578491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4939":{"gid":4939,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/3105261355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3105261355},{"type":"v1","addr":"172.21.15.146:6834","nonce":3105261355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:30:49.981 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 18 2023-11-24T06:30:49.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7474066500 msgr2=0x7f74740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7474066500 0x7f74740689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f748c000f70 tx=0x7f748c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:49.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 msgr2=0x7f7490142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:49.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 0x7f7490142e10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f748000c4d0 tx=0x7f748000c990 comp rx=0 tx=0).stop 2023-11-24T06:30:49.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 shutdown_connections 2023-11-24T06:30:49.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7474066500 0x7f74740689c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7490144a10 0x7f7490071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7490144420 0x7f7490142e10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 --2- 172.21.15.143:0/622682630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74900b1190 0x7f74900ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:49.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 >> 172.21.15.143:0/622682630 conn(0x7f74900cb840 msgr2=0x7f7490143700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:49.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 shutdown_connections 2023-11-24T06:30:49.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:49.979+0000 7f74970d3640 1 -- 172.21.15.143:0/622682630 wait complete. 2023-11-24T06:30:50.002 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:50.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.135+0000 7f6c0b854640 1 Processor -- start 2023-11-24T06:30:50.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.135+0000 7f6c0b854640 1 -- start start 2023-11-24T06:30:50.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c0b854640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c0415a320 0x7f6c040b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c0b854640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c04070da0 0x7f6c040711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c0b854640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0415a700 con 0x7f6c040b36c0 2023-11-24T06:30:50.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c0b854640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040b2430 con 0x7f6c0415a320 2023-11-24T06:30:50.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c0b854640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040b2620 con 0x7f6c04070da0 2023-11-24T06:30:50.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c0415a320 0x7f6c040b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c0415a320 0x7f6c040b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40976/0 (socket says 172.21.15.143:40976) 2023-11-24T06:30:50.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 -- 172.21.15.143:0/1999913442 learned_addr learned my addr 172.21.15.143:0/1999913442 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:50.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 -- 172.21.15.143:0/1999913442 >> v2:172.21.15.146:3300/0 conn(0x7f6c04070da0 msgr2=0x7f6c040711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:50.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 --2- 172.21.15.143:0/1999913442 >> v2:172.21.15.146:3300/0 conn(0x7f6c04070da0 0x7f6c040711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 -- 172.21.15.143:0/1999913442 >> v1:172.21.15.146:6789/0 conn(0x7f6c040b36c0 legacy=0x7f6c04070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:50.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.139+0000 7f6c095f0640 1 -- 172.21.15.143:0/1999913442 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040b2900 con 0x7f6c0415a320 2023-11-24T06:30:50.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c095f0640 1 --2- 172.21.15.143:0/1999913442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c0415a320 0x7f6c040b1ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6c0406c2d0 tx=0x7f6c0001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceab56146a96c3e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6bfbfff640 1 -- 172.21.15.143:0/1999913442 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000aa5f0 con 0x7f6c0415a320 2023-11-24T06:30:50.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6bfbfff640 1 -- 172.21.15.143:0/1999913442 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c000aa750 con 0x7f6c0415a320 2023-11-24T06:30:50.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6bfbfff640 1 -- 172.21.15.143:0/1999913442 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000aaae0 con 0x7f6c0415a320 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 -- 172.21.15.143:0/1999913442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c0415a320 msgr2=0x7f6c040b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 --2- 172.21.15.143:0/1999913442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c0415a320 0x7f6c040b1ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6c0406c2d0 tx=0x7f6c0001c490 comp rx=0 tx=0).stop 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 -- 172.21.15.143:0/1999913442 shutdown_connections 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 --2- 172.21.15.143:0/1999913442 >> v2:172.21.15.146:3300/0 conn(0x7f6c04070da0 0x7f6c040711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 --2- 172.21.15.143:0/1999913442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c0415a320 0x7f6c040b1ef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 -- 172.21.15.143:0/1999913442 >> 172.21.15.143:0/1999913442 conn(0x7f6c040b0bf0 msgr2=0x7f6c040b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 -- 172.21.15.143:0/1999913442 shutdown_connections 2023-11-24T06:30:50.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 -- 172.21.15.143:0/1999913442 wait complete. 2023-11-24T06:30:50.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 Processor -- start 2023-11-24T06:30:50.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.143+0000 7f6c0b854640 1 -- start start 2023-11-24T06:30:50.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c04070da0 0x7f6c04149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 0x7f6c04161df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0415a320 0x7f6c0409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04159430 con 0x7f6c040b36c0 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04160d50 con 0x7f6c0415a320 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04161030 con 0x7f6c04070da0 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 0x7f6c04161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 0x7f6c04161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40984/0 (socket says 172.21.15.143:40984) 2023-11-24T06:30:50.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 -- 172.21.15.143:0/2514608789 learned_addr learned my addr 172.21.15.143:0/2514608789 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:50.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 -- 172.21.15.143:0/2514608789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c04070da0 msgr2=0x7f6c04149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c04070da0 0x7f6c04149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 -- 172.21.15.143:0/2514608789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0415a320 msgr2=0x7f6c0409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0415a320 0x7f6c0409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 -- 172.21.15.143:0/2514608789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000094d0 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c08def640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 0x7f6c04161df0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c490 tx=0x7f6bf4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4003600 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4003780 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c04161310 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4003b70 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c041618d0 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04161ac0 con 0x7f6c040b36c0 2023-11-24T06:30:50.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.147+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f6bf4003cd0 con 0x7f6c040b36c0 2023-11-24T06:30:50.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.151+0000 7f6bf9ffb640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6be8066500 0x7f6be80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.151+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bf40830a0 con 0x7f6c040b36c0 2023-11-24T06:30:50.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.151+0000 7f6c095f0640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6be8066500 0x7f6be80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.151+0000 7f6c095f0640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6be8066500 0x7f6be80689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c000ae000 tx=0x7f6c00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.155+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bf40505c0 con 0x7f6c040b36c0 2023-11-24T06:30:50.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.307+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c04067520 con 0x7f6c040b36c0 2023-11-24T06:30:50.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.307+0000 7f6bf9ffb640 1 -- 172.21.15.143:0/2514608789 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f6bf4017090 con 0x7f6c040b36c0 2023-11-24T06:30:50.312 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:50.312 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:34.165701+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:50.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6be8066500 msgr2=0x7f6be80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6be8066500 0x7f6be80689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c000ae000 tx=0x7f6c00008040 comp rx=0 tx=0).stop 2023-11-24T06:30:50.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 msgr2=0x7f6c04161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 0x7f6c04161df0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c490 tx=0x7f6bf4001e80 comp rx=0 tx=0).stop 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 shutdown_connections 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6be8066500 0x7f6be80689c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0415a320 0x7f6c0409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040b36c0 0x7f6c04161df0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 --2- 172.21.15.143:0/2514608789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c04070da0 0x7f6c04149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 >> 172.21.15.143:0/2514608789 conn(0x7f6c040b0bf0 msgr2=0x7f6c040aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:50.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 shutdown_connections 2023-11-24T06:30:50.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.311+0000 7f6c0b854640 1 -- 172.21.15.143:0/2514608789 wait complete. 2023-11-24T06:30:50.335 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:30:50.335 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:50.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 Processor -- start 2023-11-24T06:30:50.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 -- start start 2023-11-24T06:30:50.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f648c15d720 0x7f648c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c06d050 con 0x7f648c0b25c0 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0d2240 con 0x7f648c15d720 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f64943f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c06d4e0 con 0x7f648c0d3a50 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6492191640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f648c15d720 0x7f648c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6491990640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f648c0b25c0 0x7f648c0d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44298/0 (socket says 172.21.15.143:44298) 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6491990640 1 -- 172.21.15.143:0/3236258968 learned_addr learned my addr 172.21.15.143:0/3236258968 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6492992640 1 --2- 172.21.15.143:0/3236258968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6492191640 1 -- 172.21.15.143:0/3236258968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 msgr2=0x7f648c0cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6492191640 1 --2- 172.21.15.143:0/3236258968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6492191640 1 -- 172.21.15.143:0/3236258968 >> v1:172.21.15.143:6789/0 conn(0x7f648c0b25c0 legacy=0x7f648c0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f6492191640 1 -- 172.21.15.143:0/3236258968 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c06c720 con 0x7f648c15d720 2023-11-24T06:30:50.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.471+0000 7f649118f640 1 -- 172.21.15.143:0/3236258968 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605424768 0 0) 0x7f648c06d050 con 0x7f648c0b25c0 2023-11-24T06:30:50.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f6492191640 1 --2- 172.21.15.143:0/3236258968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0d1a10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6488009820 tx=0x7f648801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc1f8ab12551702 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f649118f640 1 -- 172.21.15.143:0/3236258968 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880a7070 con 0x7f648c15d720 2023-11-24T06:30:50.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f649118f640 1 -- 172.21.15.143:0/3236258968 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880ab430 con 0x7f648c15d720 2023-11-24T06:30:50.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f649118f640 1 -- 172.21.15.143:0/3236258968 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880ab7c0 con 0x7f648c15d720 2023-11-24T06:30:50.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 -- 172.21.15.143:0/3236258968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 msgr2=0x7f648c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 --2- 172.21.15.143:0/3236258968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0d1a10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6488009820 tx=0x7f648801c430 comp rx=0 tx=0).stop 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 -- 172.21.15.143:0/3236258968 shutdown_connections 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 --2- 172.21.15.143:0/3236258968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 --2- 172.21.15.143:0/3236258968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0d1a10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 -- 172.21.15.143:0/3236258968 >> 172.21.15.143:0/3236258968 conn(0x7f648c08af70 msgr2=0x7f648c09c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 -- 172.21.15.143:0/3236258968 shutdown_connections 2023-11-24T06:30:50.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.475+0000 7f64943f5640 1 -- 172.21.15.143:0/3236258968 wait complete. 2023-11-24T06:30:50.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 Processor -- start 2023-11-24T06:30:50.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 -- start start 2023-11-24T06:30:50.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f648c0b25c0 0x7f648c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c152bf0 con 0x7f648c15d720 2023-11-24T06:30:50.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c1586f0 con 0x7f648c0b25c0 2023-11-24T06:30:50.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c7100 con 0x7f648c0d3a50 2023-11-24T06:30:50.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41004/0 (socket says 172.21.15.143:41004) 2023-11-24T06:30:50.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 -- 172.21.15.143:0/3441896937 learned_addr learned my addr 172.21.15.143:0/3441896937 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:50.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6491990640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 -- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 msgr2=0x7f648c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492191640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f648c0b25c0 0x7f648c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 -- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f648c0b25c0 msgr2=0x7f648c152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f648c0b25c0 0x7f648c152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 -- 172.21.15.143:0/3441896937 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488009420 con 0x7f648c15d720 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6491990640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492191640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f648c0b25c0 0x7f648c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6492992640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0ca500 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6484009fd0 tx=0x7f648400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484014420 con 0x7f648c15d720 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840145a0 con 0x7f648c15d720 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484014950 con 0x7f648c15d720 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c0c73e0 con 0x7f648c15d720 2023-11-24T06:30:50.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.479+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c0caa40 con 0x7f648c15d720 2023-11-24T06:30:50.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.483+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c0b9380 con 0x7f648c15d720 2023-11-24T06:30:50.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.483+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f6484014ab0 con 0x7f648c15d720 2023-11-24T06:30:50.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.483+0000 7f6482ffd640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6470066500 0x7f64700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.483+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6484084800 con 0x7f648c15d720 2023-11-24T06:30:50.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.483+0000 7f6492191640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6470066500 0x7f64700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.483+0000 7f6492191640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6470066500 0x7f64700689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f64880af000 tx=0x7f6488008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.487+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6484051c20 con 0x7f648c15d720 2023-11-24T06:30:50.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.667+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f648c067520 con 0x7f648c15d720 2023-11-24T06:30:50.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.667+0000 7f6482ffd640 1 -- 172.21.15.143:0/3441896937 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f6484055240 con 0x7f648c15d720 2023-11-24T06:30:50.673 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:50.673 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:30:32.535019+0000","modified":"2023-11-24T06:30:35.578491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4939":{"gid":4939,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/3105261355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3105261355},{"type":"v1","addr":"172.21.15.146:6834","nonce":3105261355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:30:50.673 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 18 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6470066500 msgr2=0x7f64700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6470066500 0x7f64700689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f64880af000 tx=0x7f6488008040 comp rx=0 tx=0).stop 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 msgr2=0x7f648c0ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0ca500 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6484009fd0 tx=0x7f648400e4b0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 shutdown_connections 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6470066500 0x7f64700689c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f648c15d720 0x7f648c0ca500 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f648c0d3a50 0x7f648c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 --2- 172.21.15.143:0/3441896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f648c0b25c0 0x7f648c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 >> 172.21.15.143:0/3441896937 conn(0x7f648c08af70 msgr2=0x7f648c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:50.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 shutdown_connections 2023-11-24T06:30:50.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.671+0000 7f64943f5640 1 -- 172.21.15.143:0/3441896937 wait complete. 2023-11-24T06:30:50.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:50.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 Processor -- start 2023-11-24T06:30:50.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 -- start start 2023-11-24T06:30:50.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 0x7f27140d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27140ce8b0 0x7f27140ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271406c0e0 con 0x7f271415d570 2023-11-24T06:30:50.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140d39c0 con 0x7f27140ce8b0 2023-11-24T06:30:50.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f2719965640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140d1cc0 con 0x7f27140d3020 2023-11-24T06:30:50.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 0x7f27140d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 0x7f27140d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:35656/0 (socket says 172.21.15.143:35656) 2023-11-24T06:30:50.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 -- 172.21.15.143:0/2346362759 learned_addr learned my addr 172.21.15.143:0/2346362759 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:50.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27137fe640 1 --2- 172.21.15.143:0/2346362759 >> v2:172.21.15.146:3300/0 conn(0x7f27140ce8b0 0x7f27140ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 -- 172.21.15.143:0/2346362759 >> v2:172.21.15.146:3300/0 conn(0x7f27140ce8b0 msgr2=0x7f27140ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:50.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 --2- 172.21.15.143:0/2346362759 >> v2:172.21.15.146:3300/0 conn(0x7f27140ce8b0 0x7f27140ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 -- 172.21.15.143:0/2346362759 >> v1:172.21.15.146:6789/0 conn(0x7f271415d570 legacy=0x7f271406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.827+0000 7f27127fc640 1 -- 172.21.15.143:0/2346362759 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140d1fa0 con 0x7f27140d3020 2023-11-24T06:30:50.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f27127fc640 1 --2- 172.21.15.143:0/2346362759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 0x7f27140d3480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2704009870 tx=0x7f270401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8a83e447882de7f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2711ffb640 1 -- 172.21.15.143:0/2346362759 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040aa670 con 0x7f27140d3020 2023-11-24T06:30:50.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2711ffb640 1 -- 172.21.15.143:0/2346362759 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27040aa7d0 con 0x7f27140d3020 2023-11-24T06:30:50.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2711ffb640 1 -- 172.21.15.143:0/2346362759 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040aab60 con 0x7f27140d3020 2023-11-24T06:30:50.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 -- 172.21.15.143:0/2346362759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 msgr2=0x7f27140d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 --2- 172.21.15.143:0/2346362759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 0x7f27140d3480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2704009870 tx=0x7f270401c510 comp rx=0 tx=0).stop 2023-11-24T06:30:50.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 -- 172.21.15.143:0/2346362759 shutdown_connections 2023-11-24T06:30:50.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 --2- 172.21.15.143:0/2346362759 >> v2:172.21.15.146:3300/0 conn(0x7f27140ce8b0 0x7f27140ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 --2- 172.21.15.143:0/2346362759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140d3020 0x7f27140d3480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 -- 172.21.15.143:0/2346362759 >> 172.21.15.143:0/2346362759 conn(0x7f271408ceb0 msgr2=0x7f271409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:50.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 -- 172.21.15.143:0/2346362759 shutdown_connections 2023-11-24T06:30:50.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.831+0000 7f2719965640 1 -- 172.21.15.143:0/2346362759 wait complete. 2023-11-24T06:30:50.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 Processor -- start 2023-11-24T06:30:50.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 -- start start 2023-11-24T06:30:50.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140ce8b0 0x7f271415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 0x7f27140c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271415d570 0x7f27140cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271415ec60 con 0x7f27140d3020 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c7060 con 0x7f271415d570 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c7300 con 0x7f27140ce8b0 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 0x7f27140c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 0x7f27140c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41014/0 (socket says 172.21.15.143:41014) 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 -- 172.21.15.143:0/4127780517 learned_addr learned my addr 172.21.15.143:0/4127780517 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:50.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2712ffd640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140ce8b0 0x7f271415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27137fe640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271415d570 0x7f27140cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 -- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140ce8b0 msgr2=0x7f271415e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140ce8b0 0x7f271415e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 -- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271415d570 msgr2=0x7f27140cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:50.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271415d570 0x7f27140cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:50.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 -- 172.21.15.143:0/4127780517 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040094d0 con 0x7f27140d3020 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f27127fc640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 0x7f27140c9410 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f27040ac040 tx=0x7f270401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040b3800 con 0x7f27140d3020 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27040b3980 con 0x7f27140d3020 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040b3d30 con 0x7f27140d3020 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140c75e0 con 0x7f27140d3020 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.835+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27140ccbc0 con 0x7f27140d3020 2023-11-24T06:30:50.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.839+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140c7b00 con 0x7f27140d3020 2023-11-24T06:30:50.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.839+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f27040b2380 con 0x7f27140d3020 2023-11-24T06:30:50.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.839+0000 7f270bfff640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26f4066500 0x7f26f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:50.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.839+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f270411e800 con 0x7f27140d3020 2023-11-24T06:30:50.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.839+0000 7f2712ffd640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26f4066500 0x7f26f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:50.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.839+0000 7f2712ffd640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26f4066500 0x7f26f40689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f26fc007fd0 tx=0x7f26fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:50.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:50.843+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27140c7b00 con 0x7f27140d3020 2023-11-24T06:30:51.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.023+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27140c7b00 con 0x7f27140d3020 2023-11-24T06:30:51.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.023+0000 7f270bfff640 1 -- 172.21.15.143:0/4127780517 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f27140c7b00 con 0x7f27140d3020 2023-11-24T06:30:51.030 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:51.030 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:30:32.535019+0000","modified":"2023-11-24T06:30:35.578491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4939":{"gid":4939,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/3105261355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3105261355},{"type":"v1","addr":"172.21.15.146:6834","nonce":3105261355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 18 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26f4066500 msgr2=0x7f26f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26f4066500 0x7f26f40689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f26fc007fd0 tx=0x7f26fc009040 comp rx=0 tx=0).stop 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 msgr2=0x7f27140c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 0x7f27140c9410 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f27040ac040 tx=0x7f270401ad50 comp rx=0 tx=0).stop 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 shutdown_connections 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26f4066500 0x7f26f40689c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271415d570 0x7f27140cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27140d3020 0x7f27140c9410 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 --2- 172.21.15.143:0/4127780517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27140ce8b0 0x7f271415e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 >> 172.21.15.143:0/4127780517 conn(0x7f271408ceb0 msgr2=0x7f27140b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:51.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 shutdown_connections 2023-11-24T06:30:51.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.027+0000 7f2719965640 1 -- 172.21.15.143:0/4127780517 wait complete. 2023-11-24T06:30:51.049 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:51.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 Processor -- start 2023-11-24T06:30:51.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 -- start start 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c2415d570 0x7f7c2406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c240d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c240ce8b0 0x7f7c240ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240d39c0 con 0x7f7c2415d570 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240d1cc0 con 0x7f7c240ce8b0 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2bbb8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240d1fa0 con 0x7f7c240d3020 2023-11-24T06:30:51.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c2415d570 0x7f7c2406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c2415d570 0x7f7c2406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41024/0 (socket says 172.21.15.143:41024) 2023-11-24T06:30:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 -- 172.21.15.143:0/2575929134 learned_addr learned my addr 172.21.15.143:0/2575929134 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29153640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c240d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2a155640 1 --2- 172.21.15.143:0/2575929134 >> v2:172.21.15.146:3300/0 conn(0x7f7c240ce8b0 0x7f7c240ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 -- 172.21.15.143:0/2575929134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 msgr2=0x7f7c240d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c240d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 -- 172.21.15.143:0/2575929134 >> v2:172.21.15.146:3300/0 conn(0x7f7c240ce8b0 msgr2=0x7f7c240ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 --2- 172.21.15.143:0/2575929134 >> v2:172.21.15.146:3300/0 conn(0x7f7c240ce8b0 0x7f7c240ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29954640 1 -- 172.21.15.143:0/2575929134 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240ce0b0 con 0x7f7c2415d570 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c29153640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c240d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:51.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.183+0000 7f7c2a155640 1 --2- 172.21.15.143:0/2575929134 >> v2:172.21.15.146:3300/0 conn(0x7f7c240ce8b0 0x7f7c240ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c29954640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c2415d570 0x7f7c2406b9d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7c240c6e60 tx=0x7f7c2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb8d91b38889816 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c28952640 1 -- 172.21.15.143:0/2575929134 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200aa610 con 0x7f7c2415d570 2023-11-24T06:30:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c28952640 1 -- 172.21.15.143:0/2575929134 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c200a6040 con 0x7f7c2415d570 2023-11-24T06:30:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c28952640 1 -- 172.21.15.143:0/2575929134 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200aa990 con 0x7f7c2415d570 2023-11-24T06:30:51.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2575929134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c2415d570 msgr2=0x7f7c2406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c2415d570 0x7f7c2406b9d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7c240c6e60 tx=0x7f7c2001c4d0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2575929134 shutdown_connections 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2575929134 >> v2:172.21.15.146:3300/0 conn(0x7f7c240ce8b0 0x7f7c240ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c240d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2575929134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c2415d570 0x7f7c2406b9d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2575929134 >> 172.21.15.143:0/2575929134 conn(0x7f7c2408ceb0 msgr2=0x7f7c2409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2575929134 shutdown_connections 2023-11-24T06:30:51.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.187+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2575929134 wait complete. 2023-11-24T06:30:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 Processor -- start 2023-11-24T06:30:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- start start 2023-11-24T06:30:51.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 0x7f7c24157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c24158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c2415d570 0x7f7c240b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240c70d0 con 0x7f7c240ce8b0 2023-11-24T06:30:51.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240c73b0 con 0x7f7c2415d570 2023-11-24T06:30:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240c7690 con 0x7f7c240d3020 2023-11-24T06:30:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 0x7f7c24157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 0x7f7c24157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41028/0 (socket says 172.21.15.143:41028) 2023-11-24T06:30:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 -- 172.21.15.143:0/2534844722 learned_addr learned my addr 172.21.15.143:0/2534844722 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29153640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c24158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2a155640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c2415d570 0x7f7c240b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 -- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 msgr2=0x7f7c24158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c24158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 -- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c2415d570 msgr2=0x7f7c240b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c2415d570 0x7f7c240b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 -- 172.21.15.143:0/2534844722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200094d0 con 0x7f7c240ce8b0 2023-11-24T06:30:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29153640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c24158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c29954640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 0x7f7c24157a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c200ac040 tx=0x7f7c2001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200b3800 con 0x7f7c240ce8b0 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c200b3980 con 0x7f7c240ce8b0 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200b3d30 con 0x7f7c240ce8b0 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c240c7970 con 0x7f7c240ce8b0 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c24159a00 con 0x7f7c240ce8b0 2023-11-24T06:30:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.191+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c24067520 con 0x7f7c240ce8b0 2023-11-24T06:30:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.195+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f7c200b2380 con 0x7f7c240ce8b0 2023-11-24T06:30:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.195+0000 7f7c1a7fc640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c08066500 0x7f7c080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.195+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c2011e630 con 0x7f7c240ce8b0 2023-11-24T06:30:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.195+0000 7f7c29153640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c08066500 0x7f7c080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.195+0000 7f7c29153640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c08066500 0x7f7c080689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c14006fd0 tx=0x7f7c14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.199+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c200eb960 con 0x7f7c240ce8b0 2023-11-24T06:30:51.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.351+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c240c7210 con 0x7f7c240ce8b0 2023-11-24T06:30:51.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.351+0000 7f7c1a7fc640 1 -- 172.21.15.143:0/2534844722 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f7c240c7210 con 0x7f7c240ce8b0 2023-11-24T06:30:51.357 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:51.357 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:34.165701+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:30:30.193542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:30:31.535544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:51.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c08066500 msgr2=0x7f7c080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c08066500 0x7f7c080689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c14006fd0 tx=0x7f7c14008040 comp rx=0 tx=0).stop 2023-11-24T06:30:51.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 msgr2=0x7f7c24157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 0x7f7c24157a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c200ac040 tx=0x7f7c2001ad10 comp rx=0 tx=0).stop 2023-11-24T06:30:51.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 shutdown_connections 2023-11-24T06:30:51.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c08066500 0x7f7c080689c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c2415d570 0x7f7c240b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c240d3020 0x7f7c24158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 --2- 172.21.15.143:0/2534844722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c240ce8b0 0x7f7c24157a60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 >> 172.21.15.143:0/2534844722 conn(0x7f7c2408ceb0 msgr2=0x7f7c240b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:51.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 shutdown_connections 2023-11-24T06:30:51.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.355+0000 7f7c2bbb8640 1 -- 172.21.15.143:0/2534844722 wait complete. 2023-11-24T06:30:51.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:30:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f4512668640 1 Processor -- start 2023-11-24T06:30:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f4512668640 1 -- start start 2023-11-24T06:30:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f4512668640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c15a4d0 0x7f450c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f4512668640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c15a8b0 con 0x7f450c0cad20 2023-11-24T06:30:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f4512668640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c0c9c30 con 0x7f450c06d740 2023-11-24T06:30:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f4512668640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c9f60 con 0x7f450c15a4d0 2023-11-24T06:30:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450b7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f450c0cad20 0x7f450c15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44300/0 (socket says 172.21.15.143:44300) 2023-11-24T06:30:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450b7fe640 1 -- 172.21.15.143:0/43438078 learned_addr learned my addr 172.21.15.143:0/43438078 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450bfff640 1 --2- 172.21.15.143:0/43438078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c15a4d0 0x7f450c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450affd640 1 -- 172.21.15.143:0/43438078 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624354249 0 0) 0x7f450c15a8b0 con 0x7f450c0cad20 2023-11-24T06:30:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450affd640 1 -- 172.21.15.143:0/43438078 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f4003530 con 0x7f450c0cad20 2023-11-24T06:30:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450affd640 1 -- 172.21.15.143:0/43438078 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133506690 0 0) 0x7f450c0c9c30 con 0x7f450c06d740 2023-11-24T06:30:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450bfff640 1 -- 172.21.15.143:0/43438078 >> v1:172.21.15.146:6789/0 conn(0x7f450c06d740 legacy=0x7f450c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450bfff640 1 -- 172.21.15.143:0/43438078 >> v1:172.21.15.143:6789/0 conn(0x7f450c0cad20 legacy=0x7f450c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.515+0000 7f450bfff640 1 -- 172.21.15.143:0/43438078 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0ca240 con 0x7f450c15a4d0 2023-11-24T06:30:51.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f450bfff640 1 --2- 172.21.15.143:0/43438078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c15a4d0 0x7f450c0c9650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0097f0 tx=0x7f44fc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ce6fe178ee0dfd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f450affd640 1 -- 172.21.15.143:0/43438078 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0ab600 con 0x7f450c15a4d0 2023-11-24T06:30:51.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f450affd640 1 -- 172.21.15.143:0/43438078 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc0ab760 con 0x7f450c15a4d0 2023-11-24T06:30:51.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f450affd640 1 -- 172.21.15.143:0/43438078 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0abaf0 con 0x7f450c15a4d0 2023-11-24T06:30:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 -- 172.21.15.143:0/43438078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c15a4d0 msgr2=0x7f450c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 --2- 172.21.15.143:0/43438078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c15a4d0 0x7f450c0c9650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0097f0 tx=0x7f44fc01c400 comp rx=0 tx=0).stop 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 -- 172.21.15.143:0/43438078 shutdown_connections 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 --2- 172.21.15.143:0/43438078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c15a4d0 0x7f450c0c9650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 -- 172.21.15.143:0/43438078 >> 172.21.15.143:0/43438078 conn(0x7f450c0b0bf0 msgr2=0x7f450c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 -- 172.21.15.143:0/43438078 shutdown_connections 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.519+0000 7f4512668640 1 -- 172.21.15.143:0/43438078 wait complete. 2023-11-24T06:30:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 Processor -- start 2023-11-24T06:30:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 -- start start 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c06d740 0x7f450c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c0cad20 0x7f450c0715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 0x7f450c0c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c151e60 con 0x7f450c15a4d0 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c151500 con 0x7f450c06d740 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c38f0 con 0x7f450c0cad20 2023-11-24T06:30:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 0x7f450c0c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 0x7f450c0c2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41032/0 (socket says 172.21.15.143:41032) 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 -- 172.21.15.143:0/835566676 learned_addr learned my addr 172.21.15.143:0/835566676 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f450bfff640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c06d740 0x7f450c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f450b7fe640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c0cad20 0x7f450c0715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 -- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c0cad20 msgr2=0x7f450c0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c0cad20 0x7f450c0715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 -- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c06d740 msgr2=0x7f450c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c06d740 0x7f450c152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 -- 172.21.15.143:0/835566676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc009420 con 0x7f450c15a4d0 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f450b7fe640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c0cad20 0x7f450c0715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:51.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4510c05640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 0x7f450c0c2ba0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4504002240 tx=0x7f450400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504003db0 con 0x7f450c15a4d0 2023-11-24T06:30:51.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400ce30 con 0x7f450c15a4d0 2023-11-24T06:30:51.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504005270 con 0x7f450c15a4d0 2023-11-24T06:30:51.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c1517a0 con 0x7f450c15a4d0 2023-11-24T06:30:51.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.523+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c071ae0 con 0x7f450c15a4d0 2023-11-24T06:30:51.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.527+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c151fa0 con 0x7f450c15a4d0 2023-11-24T06:30:51.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.527+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f45040053d0 con 0x7f450c15a4d0 2023-11-24T06:30:51.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.527+0000 7f4508ff9640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44f8066500 0x7f44f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.527+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4504083600 con 0x7f450c15a4d0 2023-11-24T06:30:51.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.527+0000 7f450bfff640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44f8066500 0x7f44f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.527+0000 7f450bfff640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44f8066500 0x7f44f80689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0af000 tx=0x7f44fc0b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.531+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f450c151fa0 con 0x7f450c15a4d0 2023-11-24T06:30:51.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.711+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f450c151fa0 con 0x7f450c15a4d0 2023-11-24T06:30:51.716 INFO:tasks.ceph.mon.a.smithi143.stderr:2023-11-24T06:30:51.711+0000 7f12a8d9d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:30:51.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.715+0000 7f4508ff9640 1 -- 172.21.15.143:0/835566676 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f450c151fa0 con 0x7f450c15a4d0 2023-11-24T06:30:51.720 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:30:51.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44f8066500 msgr2=0x7f44f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44f8066500 0x7f44f80689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0af000 tx=0x7f44fc0b6040 comp rx=0 tx=0).stop 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 msgr2=0x7f450c0c2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 0x7f450c0c2ba0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4504002240 tx=0x7f450400cbe0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 shutdown_connections 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44f8066500 0x7f44f80689c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f450c15a4d0 0x7f450c0c2ba0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450c0cad20 0x7f450c0715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 --2- 172.21.15.143:0/835566676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c06d740 0x7f450c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 >> 172.21.15.143:0/835566676 conn(0x7f450c0b0bf0 msgr2=0x7f450c0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:51.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 shutdown_connections 2023-11-24T06:30:51.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.719+0000 7f4512668640 1 -- 172.21.15.143:0/835566676 wait complete. 2023-11-24T06:30:51.731 INFO:tasks.ceph.mds.b.smithi146.stderr: -4107> 2023-11-24T06:30:36.129+0000 7f448113a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:30:51.744 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:30:51.781 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:30:51.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.879+0000 7f34ff501640 1 Processor -- start 2023-11-24T06:30:51.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.879+0000 7f34ff501640 1 -- start start 2023-11-24T06:30:51.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34ff501640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34f80ccef0 0x7f34f8071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34ff501640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34f80cd380 0x7f34f80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34ff501640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80723c0 con 0x7f34f81624f0 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34ff501640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f8072980 con 0x7f34f80cd380 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34ff501640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80726a0 con 0x7f34f80ccef0 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34f80cd380 0x7f34f80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34f80cd380 0x7f34f80cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41044/0 (socket says 172.21.15.143:41044) 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 -- 172.21.15.143:0/2597729941 learned_addr learned my addr 172.21.15.143:0/2597729941 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fca9c640 1 --2- 172.21.15.143:0/2597729941 >> v2:172.21.15.146:3300/0 conn(0x7f34f80ccef0 0x7f34f8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 -- 172.21.15.143:0/2597729941 >> v2:172.21.15.146:3300/0 conn(0x7f34f80ccef0 msgr2=0x7f34f8071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 --2- 172.21.15.143:0/2597729941 >> v2:172.21.15.146:3300/0 conn(0x7f34f80ccef0 0x7f34f8071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 -- 172.21.15.143:0/2597729941 >> v1:172.21.15.146:6789/0 conn(0x7f34f81624f0 legacy=0x7f34f81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 -- 172.21.15.143:0/2597729941 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f806c7e0 con 0x7f34f80cd380 2023-11-24T06:30:51.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34fda9e640 1 --2- 172.21.15.143:0/2597729941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f80cd380 0x7f34f80cb9e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f34f80ceea0 tx=0x7f34f001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5314ce9d29bf6c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.883+0000 7f34effff640 1 -- 172.21.15.143:0/2597729941 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a57f0 con 0x7f34f80cd380 2023-11-24T06:30:51.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34effff640 1 -- 172.21.15.143:0/2597729941 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f00a5950 con 0x7f34f80cd380 2023-11-24T06:30:51.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34effff640 1 -- 172.21.15.143:0/2597729941 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5ce0 con 0x7f34f80cd380 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- 172.21.15.143:0/2597729941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f80cd380 msgr2=0x7f34f80cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 --2- 172.21.15.143:0/2597729941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f80cd380 0x7f34f80cb9e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f34f80ceea0 tx=0x7f34f001c910 comp rx=0 tx=0).stop 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- 172.21.15.143:0/2597729941 shutdown_connections 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 --2- 172.21.15.143:0/2597729941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f80cd380 0x7f34f80cb9e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 --2- 172.21.15.143:0/2597729941 >> v2:172.21.15.146:3300/0 conn(0x7f34f80ccef0 0x7f34f8071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- 172.21.15.143:0/2597729941 >> 172.21.15.143:0/2597729941 conn(0x7f34f80b0c80 msgr2=0x7f34f80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- 172.21.15.143:0/2597729941 shutdown_connections 2023-11-24T06:30:51.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- 172.21.15.143:0/2597729941 wait complete. 2023-11-24T06:30:51.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 Processor -- start 2023-11-24T06:30:51.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- start start 2023-11-24T06:30:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34f80ccef0 0x7f34f81ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34f80cd380 0x7f34f8160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 0x7f34f80ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815ffd0 con 0x7f34f81624f0 2023-11-24T06:30:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80ae120 con 0x7f34f80ccef0 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34ff501640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815f6a0 con 0x7f34f80cd380 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34fda9e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 0x7f34f80ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34fda9e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 0x7f34f80ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41058/0 (socket says 172.21.15.143:41058) 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34fda9e640 1 -- 172.21.15.143:0/3770449584 learned_addr learned my addr 172.21.15.143:0/3770449584 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34fd29d640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34f80ccef0 0x7f34f81ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.887+0000 7f34fca9c640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34f80cd380 0x7f34f8160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34fda9e640 1 -- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34f80cd380 msgr2=0x7f34f8160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34fda9e640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34f80cd380 0x7f34f8160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34fda9e640 1 -- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34f80ccef0 msgr2=0x7f34f81ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34fda9e640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34f80ccef0 0x7f34f81ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34fda9e640 1 -- 172.21.15.143:0/3770449584 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009b30 con 0x7f34f81624f0 2023-11-24T06:30:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34fda9e640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 0x7f34f80ad8c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f34f001a540 tx=0x7f34f00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00b8670 con 0x7f34f81624f0 2023-11-24T06:30:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f00b87d0 con 0x7f34f81624f0 2023-11-24T06:30:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f815f980 con 0x7f34f81624f0 2023-11-24T06:30:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00b8b80 con 0x7f34f81624f0 2023-11-24T06:30:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f81609a0 con 0x7f34f81624f0 2023-11-24T06:30:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f8160180 con 0x7f34f81624f0 2023-11-24T06:30:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f34f00b8ce0 con 0x7f34f81624f0 2023-11-24T06:30:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34edffb640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f34dc066500 0x7f34dc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.891+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f34f011f420 con 0x7f34f81624f0 2023-11-24T06:30:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.895+0000 7f34fd29d640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f34dc066500 0x7f34dc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.895+0000 7f34fd29d640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f34dc066500 0x7f34dc0689c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f34f4007fd0 tx=0x7f34f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:51.895+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34f8160180 con 0x7f34f81624f0 2023-11-24T06:30:52.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.075+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f34f8160180 con 0x7f34f81624f0 2023-11-24T06:30:52.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.723+0000 7f34edffb640 1 -- 172.21.15.143:0/3770449584 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34f8160180 con 0x7f34f81624f0 2023-11-24T06:30:52.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f34dc066500 msgr2=0x7f34dc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:52.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f34dc066500 0x7f34dc0689c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f34f4007fd0 tx=0x7f34f4009040 comp rx=0 tx=0).stop 2023-11-24T06:30:52.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 msgr2=0x7f34f80ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:52.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 0x7f34f80ad8c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f34f001a540 tx=0x7f34f00196b0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 shutdown_connections 2023-11-24T06:30:52.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f34dc066500 0x7f34dc0689c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f81624f0 0x7f34f80ad8c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34f80cd380 0x7f34f8160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 --2- 172.21.15.143:0/3770449584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34f80ccef0 0x7f34f81ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 >> 172.21.15.143:0/3770449584 conn(0x7f34f80b0c80 msgr2=0x7f34f80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:52.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 shutdown_connections 2023-11-24T06:30:52.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.727+0000 7f34ff501640 1 -- 172.21.15.143:0/3770449584 wait complete. 2023-11-24T06:30:52.752 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:30:52.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.891+0000 7f882edc1640 1 Processor -- start 2023-11-24T06:30:52.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.891+0000 7f882edc1640 1 -- start start 2023-11-24T06:30:52.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882edc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:52.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882edc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f88280709c0 0x7f8828070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:52.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882edc1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882806d8b0 con 0x7f8828144030 2023-11-24T06:30:52.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882edc1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8828145020 con 0x7f88280709c0 2023-11-24T06:30:52.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882edc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8828071390 con 0x7f882806c650 2023-11-24T06:30:52.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f88280709c0 0x7f8828070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:52.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f88280709c0 0x7f8828070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41068/0 (socket says 172.21.15.143:41068) 2023-11-24T06:30:52.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 -- 172.21.15.143:0/1029226352 learned_addr learned my addr 172.21.15.143:0/1029226352 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:52.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f8827fff640 1 --2- 172.21.15.143:0/1029226352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:52.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 -- 172.21.15.143:0/1029226352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 msgr2=0x7f882809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:52.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 --2- 172.21.15.143:0/1029226352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 -- 172.21.15.143:0/1029226352 >> v1:172.21.15.146:6789/0 conn(0x7f8828144030 legacy=0x7f882806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:52.900 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.895+0000 7f882d35e640 1 -- 172.21.15.143:0/1029226352 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882806cca0 con 0x7f88280709c0 2023-11-24T06:30:52.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882d35e640 1 --2- 172.21.15.143:0/1029226352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88280709c0 0x7f8828070e50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8820009e50 tx=0x7f882001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316dba6e701f2571 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:52.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f88277fe640 1 -- 172.21.15.143:0/1029226352 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200a57d0 con 0x7f88280709c0 2023-11-24T06:30:52.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f88277fe640 1 -- 172.21.15.143:0/1029226352 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88200a5930 con 0x7f88280709c0 2023-11-24T06:30:52.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f88277fe640 1 -- 172.21.15.143:0/1029226352 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200a5cc0 con 0x7f88280709c0 2023-11-24T06:30:52.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 -- 172.21.15.143:0/1029226352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88280709c0 msgr2=0x7f8828070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:52.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 --2- 172.21.15.143:0/1029226352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88280709c0 0x7f8828070e50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8820009e50 tx=0x7f882001ca10 comp rx=0 tx=0).stop 2023-11-24T06:30:52.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 -- 172.21.15.143:0/1029226352 shutdown_connections 2023-11-24T06:30:52.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 --2- 172.21.15.143:0/1029226352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88280709c0 0x7f8828070e50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 --2- 172.21.15.143:0/1029226352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 -- 172.21.15.143:0/1029226352 >> 172.21.15.143:0/1029226352 conn(0x7f88280b0bf0 msgr2=0x7f88280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:52.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 -- 172.21.15.143:0/1029226352 shutdown_connections 2023-11-24T06:30:52.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 -- 172.21.15.143:0/1029226352 wait complete. 2023-11-24T06:30:52.908 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 Processor -- start 2023-11-24T06:30:52.908 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.899+0000 7f882edc1640 1 -- start start 2023-11-24T06:30:52.908 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882814dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:52.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88280709c0 0x7f882813bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:52.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 0x7f882813c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:52.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88281f6650 con 0x7f8828144030 2023-11-24T06:30:52.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88281f6360 con 0x7f88280709c0 2023-11-24T06:30:52.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882814e010 con 0x7f882806c650 2023-11-24T06:30:52.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 0x7f882813c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:52.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f8827fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88280709c0 0x7f882813bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:52.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f8827fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88280709c0 0x7f882813bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:43584/0 (socket says 172.21.15.143:43584) 2023-11-24T06:30:52.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 0x7f882813c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41084/0 (socket says 172.21.15.143:41084) 2023-11-24T06:30:52.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f8827fff640 1 -- 172.21.15.143:0/1628921021 learned_addr learned my addr 172.21.15.143:0/1628921021 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:52.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882cb5d640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882814dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:52.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 -- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 msgr2=0x7f882814dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:52.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882814dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 -- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88280709c0 msgr2=0x7f882813bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:52.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88280709c0 0x7f882813bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:52.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 -- 172.21.15.143:0/1628921021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820009b30 con 0x7f8828144030 2023-11-24T06:30:52.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882d35e640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 0x7f882813c490 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f88200ab000 tx=0x7f88200197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:52.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200bd070 con 0x7f8828144030 2023-11-24T06:30:52.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820009510 con 0x7f8828144030 2023-11-24T06:30:52.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200b8690 con 0x7f8828144030 2023-11-24T06:30:52.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882813cac0 con 0x7f8828144030 2023-11-24T06:30:52.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882813d080 con 0x7f8828144030 2023-11-24T06:30:52.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88281f6790 con 0x7f8828144030 2023-11-24T06:30:52.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.903+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f88200b87f0 con 0x7f8828144030 2023-11-24T06:30:52.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.907+0000 7f88257fa640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f880c066500 0x7f880c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:52.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.907+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f882011ec10 con 0x7f8828144030 2023-11-24T06:30:52.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.907+0000 7f882cb5d640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f880c066500 0x7f880c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:52.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.907+0000 7f882cb5d640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f880c066500 0x7f880c0689c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f881c007fd0 tx=0x7f881c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:52.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:52.911+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88281f6790 con 0x7f8828144030 2023-11-24T06:30:53.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.063+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f88281f6790 con 0x7f8828144030 2023-11-24T06:30:53.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.723+0000 7f88257fa640 1 -- 172.21.15.143:0/1628921021 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f88281f6790 con 0x7f8828144030 2023-11-24T06:30:53.729 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:30:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f880c066500 msgr2=0x7f880c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f880c066500 0x7f880c0689c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f881c007fd0 tx=0x7f881c009040 comp rx=0 tx=0).stop 2023-11-24T06:30:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 msgr2=0x7f882813c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 0x7f882813c490 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f88200ab000 tx=0x7f88200197b0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 shutdown_connections 2023-11-24T06:30:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f880c066500 0x7f880c0689c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8828144030 0x7f882813c490 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88280709c0 0x7f882813bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 --2- 172.21.15.143:0/1628921021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f882806c650 0x7f882814dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 >> 172.21.15.143:0/1628921021 conn(0x7f88280b0bf0 msgr2=0x7f88280b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 shutdown_connections 2023-11-24T06:30:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.727+0000 7f882edc1640 1 -- 172.21.15.143:0/1628921021 wait complete. 2023-11-24T06:30:53.761 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:30:53.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 Processor -- start 2023-11-24T06:30:53.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 -- start start 2023-11-24T06:30:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb500160be0 0x7fb50015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb50015e250 0x7fb5000b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50015e680 con 0x7fb5000b37b0 2023-11-24T06:30:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50006c650 con 0x7fb500160be0 2023-11-24T06:30:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb506079640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000b4180 con 0x7fb50015e250 2023-11-24T06:30:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4ff7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb500160be0 0x7fb50015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:53.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4feffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb5000b37b0 0x7fb50015db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44304/0 (socket says 172.21.15.143:44304) 2023-11-24T06:30:53.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4feffd640 1 -- 172.21.15.143:0/4113381979 learned_addr learned my addr 172.21.15.143:0/4113381979 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:53.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4fffff640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb50015e250 0x7fb5000b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:53.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4ff7fe640 1 -- 172.21.15.143:0/4113381979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb50015e250 msgr2=0x7fb5000b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:53.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4ff7fe640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb50015e250 0x7fb5000b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4ff7fe640 1 -- 172.21.15.143:0/4113381979 >> v1:172.21.15.143:6789/0 conn(0x7fb5000b37b0 legacy=0x7fb50015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:53.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4ff7fe640 1 -- 172.21.15.143:0/4113381979 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50015e900 con 0x7fb500160be0 2023-11-24T06:30:53.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4fe7fc640 1 -- 172.21.15.143:0/4113381979 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221925673 0 0) 0x7fb50015e680 con 0x7fb5000b37b0 2023-11-24T06:30:53.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.899+0000 7fb4fffff640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb50015e250 0x7fb5000b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:53.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb4ff7fe640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb500160be0 0x7fb50015ed00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00097c0 tx=0x7fb4f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7795ba522fa1d642 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:53.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb4fe7fc640 1 -- 172.21.15.143:0/4113381979 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00ab650 con 0x7fb500160be0 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb4fe7fc640 1 -- 172.21.15.143:0/4113381979 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f00ab7b0 con 0x7fb500160be0 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb4fe7fc640 1 -- 172.21.15.143:0/4113381979 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00abb40 con 0x7fb500160be0 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 -- 172.21.15.143:0/4113381979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb500160be0 msgr2=0x7fb50015ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb500160be0 0x7fb50015ed00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00097c0 tx=0x7fb4f001c450 comp rx=0 tx=0).stop 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 -- 172.21.15.143:0/4113381979 shutdown_connections 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb50015e250 0x7fb5000b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 --2- 172.21.15.143:0/4113381979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb500160be0 0x7fb50015ed00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 -- 172.21.15.143:0/4113381979 >> 172.21.15.143:0/4113381979 conn(0x7fb5000b0bf0 msgr2=0x7fb5000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 -- 172.21.15.143:0/4113381979 shutdown_connections 2023-11-24T06:30:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 -- 172.21.15.143:0/4113381979 wait complete. 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.903+0000 7fb506079640 1 Processor -- start 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- start start 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5000b37b0 0x7fb50014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 0x7fb5000999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb500160be0 0x7fb50009b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb500158c90 con 0x7fb50015e250 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50009b810 con 0x7fb500160be0 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5001570d0 con 0x7fb5000b37b0 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 0x7fb5000999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 0x7fb5000999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41106/0 (socket says 172.21.15.143:41106) 2023-11-24T06:30:53.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 -- 172.21.15.143:0/996117260 learned_addr learned my addr 172.21.15.143:0/996117260 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:53.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4ff7fe640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5000b37b0 0x7fb50014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4fffff640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb500160be0 0x7fb50009b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 -- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5000b37b0 msgr2=0x7fb50014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5000b37b0 0x7fb50014a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 -- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb500160be0 msgr2=0x7fb50009b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb500160be0 0x7fb50009b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 -- 172.21.15.143:0/996117260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0009420 con 0x7fb50015e250 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4ff7fe640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5000b37b0 0x7fb50014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4feffd640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 0x7fb5000999e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40011f0 tx=0x7fb4f400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40074e0 con 0x7fb50015e250 2023-11-24T06:30:53.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f4007640 con 0x7fb50015e250 2023-11-24T06:30:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4004a10 con 0x7fb50015e250 2023-11-24T06:30:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5001573b0 con 0x7fb50015e250 2023-11-24T06:30:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50015b070 con 0x7fb50015e250 2023-11-24T06:30:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.907+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb500067520 con 0x7fb50015e250 2023-11-24T06:30:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.911+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fb4f4004b70 con 0x7fb50015e250 2023-11-24T06:30:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.911+0000 7fb4e7fff640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ec066500 0x7fb4ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:53.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.911+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb4f4083140 con 0x7fb50015e250 2023-11-24T06:30:53.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.911+0000 7fb4ff7fe640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ec066500 0x7fb4ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:53.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.911+0000 7fb4ff7fe640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ec066500 0x7fb4ec0689c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00af000 tx=0x7fb4f00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:53.915+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4f4050630 con 0x7fb50015e250 2023-11-24T06:30:54.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.063+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb50015dd00 con 0x7fb50015e250 2023-11-24T06:30:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.731+0000 7fb4e7fff640 1 -- 172.21.15.143:0/996117260 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb4f40180d0 con 0x7fb50015e250 2023-11-24T06:30:54.736 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2023-11-24T06:30:54.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ec066500 msgr2=0x7fb4ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ec066500 0x7fb4ec0689c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00af000 tx=0x7fb4f00a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 msgr2=0x7fb5000999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 0x7fb5000999e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40011f0 tx=0x7fb4f400c9b0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 shutdown_connections 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ec066500 0x7fb4ec0689c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb500160be0 0x7fb50009b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb50015e250 0x7fb5000999e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 --2- 172.21.15.143:0/996117260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5000b37b0 0x7fb50014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.735+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 >> 172.21.15.143:0/996117260 conn(0x7fb5000b0bf0 msgr2=0x7fb500070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:54.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.739+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 shutdown_connections 2023-11-24T06:30:54.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.739+0000 7fb506079640 1 -- 172.21.15.143:0/996117260 wait complete. 2023-11-24T06:30:54.771 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:30:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 Processor -- start 2023-11-24T06:30:54.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 -- start start 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f89b815a290 0x7f89b80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89b815ec60 0x7f89b80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b8071170 con 0x7f89b80cc6b0 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80cb690 con 0x7f89b815ec60 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89bd654640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80cb970 con 0x7f89b815a290 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89ae7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89b815ec60 0x7f89b80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89b77fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f89b80cc6b0 0x7f89b80b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44310/0 (socket says 172.21.15.143:44310) 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89b77fe640 1 -- 172.21.15.143:0/1569784335 learned_addr learned my addr 172.21.15.143:0/1569784335 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89b6ffd640 1 --2- 172.21.15.143:0/1569784335 >> v2:172.21.15.146:3300/0 conn(0x7f89b815a290 0x7f89b80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89ae7fc640 1 -- 172.21.15.143:0/1569784335 >> v2:172.21.15.146:3300/0 conn(0x7f89b815a290 msgr2=0x7f89b80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:54.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89ae7fc640 1 --2- 172.21.15.143:0/1569784335 >> v2:172.21.15.146:3300/0 conn(0x7f89b815a290 0x7f89b80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89ae7fc640 1 -- 172.21.15.143:0/1569784335 >> v1:172.21.15.143:6789/0 conn(0x7f89b80cc6b0 legacy=0x7f89b80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:54.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89b67fc640 1 -- 172.21.15.143:0/1569784335 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997008607 0 0) 0x7f89b8071170 con 0x7f89b80cc6b0 2023-11-24T06:30:54.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89ae7fc640 1 -- 172.21.15.143:0/1569784335 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80cbc50 con 0x7f89b815ec60 2023-11-24T06:30:54.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.907+0000 7f89b6ffd640 1 --2- 172.21.15.143:0/1569784335 >> v2:172.21.15.146:3300/0 conn(0x7f89b815a290 0x7f89b80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:54.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89ae7fc640 1 --2- 172.21.15.143:0/1569784335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b815ec60 0x7f89b80cc170 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89b806c0d0 tx=0x7f89a001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4575d0cb5e621e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:54.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89b67fc640 1 -- 172.21.15.143:0/1569784335 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00a5960 con 0x7f89b815ec60 2023-11-24T06:30:54.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89b67fc640 1 -- 172.21.15.143:0/1569784335 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a00a5ac0 con 0x7f89b815ec60 2023-11-24T06:30:54.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89b67fc640 1 -- 172.21.15.143:0/1569784335 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00a5e50 con 0x7f89b815ec60 2023-11-24T06:30:54.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 -- 172.21.15.143:0/1569784335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b815ec60 msgr2=0x7f89b80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:54.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 --2- 172.21.15.143:0/1569784335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b815ec60 0x7f89b80cc170 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89b806c0d0 tx=0x7f89a001c880 comp rx=0 tx=0).stop 2023-11-24T06:30:54.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 -- 172.21.15.143:0/1569784335 shutdown_connections 2023-11-24T06:30:54.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 --2- 172.21.15.143:0/1569784335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b815ec60 0x7f89b80cc170 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 --2- 172.21.15.143:0/1569784335 >> v2:172.21.15.146:3300/0 conn(0x7f89b815a290 0x7f89b80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 -- 172.21.15.143:0/1569784335 >> 172.21.15.143:0/1569784335 conn(0x7f89b80b0c80 msgr2=0x7f89b80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:54.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 -- 172.21.15.143:0/1569784335 shutdown_connections 2023-11-24T06:30:54.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.911+0000 7f89bd654640 1 -- 172.21.15.143:0/1569784335 wait complete. 2023-11-24T06:30:54.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 Processor -- start 2023-11-24T06:30:54.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 -- start start 2023-11-24T06:30:54.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 0x7f89b815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:54.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89b815a290 0x7f89b81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:54.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89b815ec60 0x7f89b81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:54.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b815c9c0 con 0x7f89b80cc6b0 2023-11-24T06:30:54.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b815cc40 con 0x7f89b815ec60 2023-11-24T06:30:54.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80ad2e0 con 0x7f89b815a290 2023-11-24T06:30:54.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 0x7f89b815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:54.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 0x7f89b815d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41138/0 (socket says 172.21.15.143:41138) 2023-11-24T06:30:54.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 -- 172.21.15.143:0/1435244396 learned_addr learned my addr 172.21.15.143:0/1435244396 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:54.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b77fe640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89b815ec60 0x7f89b81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:54.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89ae7fc640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89b815a290 0x7f89b81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 -- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89b815a290 msgr2=0x7f89b81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89b815a290 0x7f89b81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 -- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89b815ec60 msgr2=0x7f89b81530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89b815ec60 0x7f89b81530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 -- 172.21.15.143:0/1435244396 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0009a70 con 0x7f89b80cc6b0 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89b6ffd640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 0x7f89b815d0d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89a800c7c0 tx=0x7f89a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:54.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8007a30 con 0x7f89b80cc6b0 2023-11-24T06:30:54.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8007b90 con 0x7f89b80cc6b0 2023-11-24T06:30:54.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b80b1dd0 con 0x7f89b80cc6b0 2023-11-24T06:30:54.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800ce70 con 0x7f89b80cc6b0 2023-11-24T06:30:54.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.915+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b8152e10 con 0x7f89b80cc6b0 2023-11-24T06:30:54.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.919+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80b22f0 con 0x7f89b80cc6b0 2023-11-24T06:30:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.919+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f89a80113f0 con 0x7f89b80cc6b0 2023-11-24T06:30:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.919+0000 7f89affff640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8998066500 0x7f89980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.919+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f89a8084200 con 0x7f89b80cc6b0 2023-11-24T06:30:54.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.919+0000 7f89ae7fc640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8998066500 0x7f89980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:54.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.919+0000 7f89ae7fc640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8998066500 0x7f89980689c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f89a00af000 tx=0x7f89a00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:54.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:54.923+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89a8051830 con 0x7f89b80cc6b0 2023-11-24T06:30:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.071+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f89b804e8c0 con 0x7f89b80cc6b0 2023-11-24T06:30:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.075+0000 7f89affff640 1 -- 172.21.15.143:0/1435244396 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89a8054e50 con 0x7f89b80cc6b0 2023-11-24T06:30:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8998066500 msgr2=0x7f89980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8998066500 0x7f89980689c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f89a00af000 tx=0x7f89a00a7070 comp rx=0 tx=0).stop 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 msgr2=0x7f89b815d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 0x7f89b815d0d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89a800c7c0 tx=0x7f89a800cc80 comp rx=0 tx=0).stop 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 shutdown_connections 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8998066500 0x7f89980689c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89b815ec60 0x7f89b81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89b815a290 0x7f89b81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 --2- 172.21.15.143:0/1435244396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89b80cc6b0 0x7f89b815d0d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 >> 172.21.15.143:0/1435244396 conn(0x7f89b80b0c80 msgr2=0x7f89b8157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 shutdown_connections 2023-11-24T06:30:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.079+0000 7f89bd654640 1 -- 172.21.15.143:0/1435244396 wait complete. 2023-11-24T06:30:55.103 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2023-11-24T06:30:55.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa953f2a640 1 Processor -- start 2023-11-24T06:30:55.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa953f2a640 1 -- start start 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa953f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa94c0ce8b0 0x7fa94c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa953f2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c06c0e0 con 0x7fa94c0d3020 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa953f2a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0d1cc0 con 0x7fa94c15d570 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa953f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c0d1fa0 con 0x7fa94c0ce8b0 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.251+0000 7fa9524c7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa94c0ce8b0 0x7fa94c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa9514c5640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa94c0d3020 0x7fa94c0d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:44318/0 (socket says 172.21.15.143:44318) 2023-11-24T06:30:55.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa9514c5640 1 -- 172.21.15.143:0/1808780931 learned_addr learned my addr 172.21.15.143:0/1808780931 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa9524c7640 1 -- 172.21.15.143:0/1808780931 >> v1:172.21.15.146:6789/0 conn(0x7fa94c15d570 legacy=0x7fa94c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa9524c7640 1 -- 172.21.15.143:0/1808780931 >> v1:172.21.15.143:6789/0 conn(0x7fa94c0d3020 legacy=0x7fa94c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa9524c7640 1 -- 172.21.15.143:0/1808780931 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0ce0b0 con 0x7fa94c0ce8b0 2023-11-24T06:30:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa950cc4640 1 -- 172.21.15.143:0/1808780931 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43217755 0 0) 0x7fa94c06c0e0 con 0x7fa94c0d3020 2023-11-24T06:30:55.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa9524c7640 1 --2- 172.21.15.143:0/1808780931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c0ced60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa944009d90 tx=0x7fa94401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9351e53f7dfe2583 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:55.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa950cc4640 1 -- 172.21.15.143:0/1808780931 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440a59e0 con 0x7fa94c0ce8b0 2023-11-24T06:30:55.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa950cc4640 1 -- 172.21.15.143:0/1808780931 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440a5b40 con 0x7fa94c0ce8b0 2023-11-24T06:30:55.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.255+0000 7fa950cc4640 1 -- 172.21.15.143:0/1808780931 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ad440 con 0x7fa94c0ce8b0 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- 172.21.15.143:0/1808780931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c0ce8b0 msgr2=0x7fa94c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 --2- 172.21.15.143:0/1808780931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c0ced60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa944009d90 tx=0x7fa94401c920 comp rx=0 tx=0).stop 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- 172.21.15.143:0/1808780931 shutdown_connections 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 --2- 172.21.15.143:0/1808780931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c0ced60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- 172.21.15.143:0/1808780931 >> 172.21.15.143:0/1808780931 conn(0x7fa94c08ceb0 msgr2=0x7fa94c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- 172.21.15.143:0/1808780931 shutdown_connections 2023-11-24T06:30:55.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- 172.21.15.143:0/1808780931 wait complete. 2023-11-24T06:30:55.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 Processor -- start 2023-11-24T06:30:55.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- start start 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c1f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94c0d3020 0x7fa94c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 0x7fa94c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1f7240 con 0x7fa94c15d570 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1f6770 con 0x7fa94c0ce8b0 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa953f2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c153d90 con 0x7fa94c0d3020 2023-11-24T06:30:55.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 0x7fa94c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 0x7fa94c157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41152/0 (socket says 172.21.15.143:41152) 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 -- 172.21.15.143:0/3944559430 learned_addr learned my addr 172.21.15.143:0/3944559430 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9514c5640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94c0d3020 0x7fa94c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa951cc6640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c1f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 -- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94c0d3020 msgr2=0x7fa94c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94c0d3020 0x7fa94c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 -- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94c0ce8b0 msgr2=0x7fa94c1f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.259+0000 7fa9524c7640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c1f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9524c7640 1 -- 172.21.15.143:0/3944559430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944009a70 con 0x7fa94c15d570 2023-11-24T06:30:55.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9524c7640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 0x7fa94c157b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa9440b0040 tx=0x7fa9440196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:55.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440add90 con 0x7fa94c15d570 2023-11-24T06:30:55.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440b9450 con 0x7fa94c15d570 2023-11-24T06:30:55.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b9800 con 0x7fa94c15d570 2023-11-24T06:30:55.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa953f2a640 1 -- 172.21.15.143:0/3944559430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c1f69a0 con 0x7fa94c15d570 2023-11-24T06:30:55.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa953f2a640 1 -- 172.21.15.143:0/3944559430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c1f6f60 con 0x7fa94c15d570 2023-11-24T06:30:55.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa928005260 con 0x7fa94c15d570 2023-11-24T06:30:55.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fa9440b9960 con 0x7fa94c15d570 2023-11-24T06:30:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9427fc640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa930066500 0x7fa9300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.263+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa94411f3a0 con 0x7fa94c15d570 2023-11-24T06:30:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.267+0000 7fa951cc6640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa930066500 0x7fa9300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.267+0000 7fa951cc6640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa930066500 0x7fa9300689c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa94c160d50 tx=0x7fa948009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.271+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9440ecba0 con 0x7fa94c15d570 2023-11-24T06:30:55.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.479+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) v1 -- 0x7fa928005510 con 0x7fa94c15d570 2023-11-24T06:30:55.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa9427fc640 1 -- 172.21.15.143:0/3944559430 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa9440f01c0 con 0x7fa94c15d570 2023-11-24T06:30:55.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa930066500 msgr2=0x7fa9300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa930066500 0x7fa9300689c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa94c160d50 tx=0x7fa948009040 comp rx=0 tx=0).stop 2023-11-24T06:30:55.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 msgr2=0x7fa94c157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 0x7fa94c157b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa9440b0040 tx=0x7fa9440196c0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 shutdown_connections 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa930066500 0x7fa9300689c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94c15d570 0x7fa94c157b40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94c0d3020 0x7fa94c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 --2- 172.21.15.143:0/3944559430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94c0ce8b0 0x7fa94c1f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 >> 172.21.15.143:0/3944559430 conn(0x7fa94c08ceb0 msgr2=0x7fa94c0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 shutdown_connections 2023-11-24T06:30:55.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.735+0000 7fa92ffff640 1 -- 172.21.15.143:0/3944559430 wait complete. 2023-11-24T06:30:55.760 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... ok 2023-11-24T06:30:55.760 INFO:tasks.cephfs_test_runner:Starting test: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) Validate cleaning of stale subvolume snapshot metadata. 2023-11-24T06:30:55.761 INFO:tasks.cephfs_test_runner:test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:30:55.761 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:30:55.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 Processor -- start 2023-11-24T06:30:55.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 -- start start 2023-11-24T06:30:55.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c0b36c0 0x7f9b5c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b5c070da0 0x7f9b5c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c15a700 con 0x7f9b5c15a320 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b2430 con 0x7f9b5c070da0 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b6210e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b2620 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b5c070da0 0x7f9b5c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b5c070da0 0x7f9b5c15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41160/0 (socket says 172.21.15.143:41160) 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 -- 172.21.15.143:0/2423641436 learned_addr learned my addr 172.21.15.143:0/2423641436 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 -- 172.21.15.143:0/2423641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c0b36c0 msgr2=0x7f9b5c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b53fff640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c0b36c0 0x7f9b5c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c0b36c0 0x7f9b5c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 -- 172.21.15.143:0/2423641436 >> v1:172.21.15.146:6789/0 conn(0x7f9b5c15a320 legacy=0x7f9b5c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:55.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b5bfff640 1 -- 172.21.15.143:0/2423641436 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0b2900 con 0x7f9b5c070da0 2023-11-24T06:30:55.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.895+0000 7f9b53fff640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c0b36c0 0x7f9b5c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:30:55.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b5bfff640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c070da0 0x7f9b5c15ddd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e50 tx=0x7f9b5401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5678fbcee9553c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:55.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b5affd640 1 -- 172.21.15.143:0/2423641436 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540a5840 con 0x7f9b5c070da0 2023-11-24T06:30:55.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b5affd640 1 -- 172.21.15.143:0/2423641436 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b540a59a0 con 0x7f9b5c070da0 2023-11-24T06:30:55.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b5affd640 1 -- 172.21.15.143:0/2423641436 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540a5d30 con 0x7f9b5c070da0 2023-11-24T06:30:55.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 -- 172.21.15.143:0/2423641436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c070da0 msgr2=0x7f9b5c15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c070da0 0x7f9b5c15ddd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e50 tx=0x7f9b5401c9a0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 -- 172.21.15.143:0/2423641436 shutdown_connections 2023-11-24T06:30:55.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c070da0 0x7f9b5c15ddd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 --2- 172.21.15.143:0/2423641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c0b36c0 0x7f9b5c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 -- 172.21.15.143:0/2423641436 >> 172.21.15.143:0/2423641436 conn(0x7f9b5c0b0bf0 msgr2=0x7f9b5c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:55.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 -- 172.21.15.143:0/2423641436 shutdown_connections 2023-11-24T06:30:55.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.899+0000 7f9b6210e640 1 -- 172.21.15.143:0/2423641436 wait complete. 2023-11-24T06:30:55.907 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 Processor -- start 2023-11-24T06:30:55.907 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 -- start start 2023-11-24T06:30:55.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c070da0 0x7f9b5c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 0x7f9b5c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b5c15a320 0x7f9b5c06cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c15b7b0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0cb800 con 0x7f9b5c15a320 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c152d30 con 0x7f9b5c070da0 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 0x7f9b5c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 0x7f9b5c15b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41170/0 (socket says 172.21.15.143:41170) 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 -- 172.21.15.143:0/1814142109 learned_addr learned my addr 172.21.15.143:0/1814142109 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b5b7fe640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c070da0 0x7f9b5c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b5bfff640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b5c15a320 0x7f9b5c06cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 -- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c070da0 msgr2=0x7f9b5c1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c070da0 0x7f9b5c1526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 -- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b5c15a320 msgr2=0x7f9b5c06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b5c15a320 0x7f9b5c06cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 -- 172.21.15.143:0/1814142109 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009b30 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b5bfff640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b5c15a320 0x7f9b5c06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b5b7fe640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c070da0 0x7f9b5c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b53fff640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 0x7f9b5c15b270 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c7f0 tx=0x7f9b4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400cea0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44007a30 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c1596a0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44007dc0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.903+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c1581a0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.907+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0ae4d0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.907+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f9b440113f0 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.907+0000 7f9b58ff9640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9b3c066500 0x7f9b3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:55.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.907+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b44083e90 con 0x7f9b5c0b36c0 2023-11-24T06:30:55.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.907+0000 7f9b5b7fe640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9b3c066500 0x7f9b3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:55.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.907+0000 7f9b5b7fe640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9b3c066500 0x7f9b3c0689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0098b0 tx=0x7f9b4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:55.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:55.911+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b440514a0 con 0x7f9b5c0b36c0 2023-11-24T06:30:56.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.063+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b5c067520 con 0x7f9b5c0b36c0 2023-11-24T06:30:56.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.063+0000 7f9b58ff9640 1 -- 172.21.15.143:0/1814142109 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13036 (secure 0 0 0) 0x7f9b4401f090 con 0x7f9b5c0b36c0 2023-11-24T06:30:56.069 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:56.069 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":35,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:30:54.728604+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/3105261355":"2023-11-25T06:30:51.715342+0000","172.21.15.146:6832/3105261355":"2023-11-25T06:30:51.715342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9b3c066500 msgr2=0x7f9b3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9b3c066500 0x7f9b3c0689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0098b0 tx=0x7f9b4c008040 comp rx=0 tx=0).stop 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 msgr2=0x7f9b5c15b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 0x7f9b5c15b270 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c7f0 tx=0x7f9b4400ccb0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 shutdown_connections 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9b3c066500 0x7f9b3c0689c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b5c15a320 0x7f9b5c06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b5c0b36c0 0x7f9b5c15b270 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 --2- 172.21.15.143:0/1814142109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b5c070da0 0x7f9b5c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 >> 172.21.15.143:0/1814142109 conn(0x7f9b5c0b0bf0 msgr2=0x7f9b5c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:56.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 shutdown_connections 2023-11-24T06:30:56.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.067+0000 7f9b6210e640 1 -- 172.21.15.143:0/1814142109 wait complete. 2023-11-24T06:30:56.090 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:30:56.091 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:30:56.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.227+0000 7faf286ea640 1 Processor -- start 2023-11-24T06:30:56.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.227+0000 7faf286ea640 1 -- start start 2023-11-24T06:30:56.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf286ea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf2015d7f0 0x7faf200d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf286ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf200d37e0 0x7faf200b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf286ea640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200d3c60 con 0x7faf200b1630 2023-11-24T06:30:56.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf286ea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2006b980 con 0x7faf2015d7f0 2023-11-24T06:30:56.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf286ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200b0090 con 0x7faf200d37e0 2023-11-24T06:30:56.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf2015d7f0 0x7faf200d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf2015d7f0 0x7faf200d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41182/0 (socket says 172.21.15.143:41182) 2023-11-24T06:30:56.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 -- 172.21.15.143:0/3056966453 learned_addr learned my addr 172.21.15.143:0/3056966453 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:56.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf25c85640 1 --2- 172.21.15.143:0/3056966453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf200d37e0 0x7faf200b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 -- 172.21.15.143:0/3056966453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf200d37e0 msgr2=0x7faf200b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:56.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 --2- 172.21.15.143:0/3056966453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf200d37e0 0x7faf200b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 -- 172.21.15.143:0/3056966453 >> v1:172.21.15.146:6789/0 conn(0x7faf200b1630 legacy=0x7faf200b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.231+0000 7faf26486640 1 -- 172.21.15.143:0/3056966453 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200b0330 con 0x7faf2015d7f0 2023-11-24T06:30:56.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf26486640 1 --2- 172.21.15.143:0/3056966453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf2015d7f0 0x7faf200d32a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009870 tx=0x7faf1c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf0d2b4af709a2b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:56.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf25484640 1 -- 172.21.15.143:0/3056966453 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0a7070 con 0x7faf2015d7f0 2023-11-24T06:30:56.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf25484640 1 -- 172.21.15.143:0/3056966453 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c0ab430 con 0x7faf2015d7f0 2023-11-24T06:30:56.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf25484640 1 -- 172.21.15.143:0/3056966453 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0ab7c0 con 0x7faf2015d7f0 2023-11-24T06:30:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 -- 172.21.15.143:0/3056966453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf2015d7f0 msgr2=0x7faf200d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 --2- 172.21.15.143:0/3056966453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf2015d7f0 0x7faf200d32a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009870 tx=0x7faf1c01c540 comp rx=0 tx=0).stop 2023-11-24T06:30:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 -- 172.21.15.143:0/3056966453 shutdown_connections 2023-11-24T06:30:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 --2- 172.21.15.143:0/3056966453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf200d37e0 0x7faf200b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 --2- 172.21.15.143:0/3056966453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf2015d7f0 0x7faf200d32a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 -- 172.21.15.143:0/3056966453 >> 172.21.15.143:0/3056966453 conn(0x7faf2009c790 msgr2=0x7faf2008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 -- 172.21.15.143:0/3056966453 shutdown_connections 2023-11-24T06:30:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 -- 172.21.15.143:0/3056966453 wait complete. 2023-11-24T06:30:56.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 Processor -- start 2023-11-24T06:30:56.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.235+0000 7faf286ea640 1 -- start start 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 0x7faf2014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf200d37e0 0x7faf20150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf2015d7f0 0x7faf20150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2014e090 con 0x7faf200b1630 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200b71f0 con 0x7faf200d37e0 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200b42f0 con 0x7faf2015d7f0 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 0x7faf2014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 0x7faf2014db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41188/0 (socket says 172.21.15.143:41188) 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 -- 172.21.15.143:0/2367428231 learned_addr learned my addr 172.21.15.143:0/2367428231 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf25c85640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf200d37e0 0x7faf20150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26c87640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf2015d7f0 0x7faf20150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 -- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf2015d7f0 msgr2=0x7faf20150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf2015d7f0 0x7faf20150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 -- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf200d37e0 msgr2=0x7faf20150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf200d37e0 0x7faf20150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 -- 172.21.15.143:0/2367428231 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c0094d0 con 0x7faf200b1630 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf26486640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 0x7faf2014db50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0ad040 tx=0x7faf1c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0b4620 con 0x7faf200b1630 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c0b4780 con 0x7faf200b1630 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf200b3a50 con 0x7faf200b1630 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0b4b30 con 0x7faf200b1630 2023-11-24T06:30:56.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf200b4010 con 0x7faf200b1630 2023-11-24T06:30:56.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2004e8c0 con 0x7faf200b1630 2023-11-24T06:30:56.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.239+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7faf1c0b4c90 con 0x7faf200b1630 2023-11-24T06:30:56.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.243+0000 7faf16ffd640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faf04066500 0x7faf040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.243+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf1c11dfb0 con 0x7faf200b1630 2023-11-24T06:30:56.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.243+0000 7faf25c85640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faf04066500 0x7faf040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.243+0000 7faf25c85640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faf04066500 0x7faf040689c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf20151480 tx=0x7faf10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:56.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.247+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf1c0eb5e0 con 0x7faf200b1630 2023-11-24T06:30:56.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.399+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf200d13c0 con 0x7faf200b1630 2023-11-24T06:30:56.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.399+0000 7faf16ffd640 1 -- 172.21.15.143:0/2367428231 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf1c0eec00 con 0x7faf200b1630 2023-11-24T06:30:56.404 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faf04066500 msgr2=0x7faf040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faf04066500 0x7faf040689c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf20151480 tx=0x7faf10008040 comp rx=0 tx=0).stop 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 msgr2=0x7faf2014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 0x7faf2014db50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0ad040 tx=0x7faf1c0192e0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 shutdown_connections 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faf04066500 0x7faf040689c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf2015d7f0 0x7faf20150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf200d37e0 0x7faf20150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 --2- 172.21.15.143:0/2367428231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf200b1630 0x7faf2014db50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 >> 172.21.15.143:0/2367428231 conn(0x7faf2009c790 msgr2=0x7faf200d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:56.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 shutdown_connections 2023-11-24T06:30:56.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.403+0000 7faf286ea640 1 -- 172.21.15.143:0/2367428231 wait complete. 2023-11-24T06:30:56.426 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2023-11-24T06:30:56.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 Processor -- start 2023-11-24T06:30:56.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 -- start start 2023-11-24T06:30:56.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbe74144030 0x7fbe7406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe740709c0 0x7fbe74070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7406d8b0 con 0x7fbe7409cc20 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe74145020 con 0x7fbe74144030 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe79c06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7409d0a0 con 0x7fbe740709c0 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbe74144030 0x7fbe7406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbe74144030 0x7fbe7406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41190/0 (socket says 172.21.15.143:41190) 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 -- 172.21.15.143:0/3322366155 learned_addr learned my addr 172.21.15.143:0/3322366155 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe73fff640 1 --2- 172.21.15.143:0/3322366155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe740709c0 0x7fbe74070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 -- 172.21.15.143:0/3322366155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe740709c0 msgr2=0x7fbe74070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 --2- 172.21.15.143:0/3322366155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe740709c0 0x7fbe74070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 -- 172.21.15.143:0/3322366155 >> v1:172.21.15.146:6789/0 conn(0x7fbe7409cc20 legacy=0x7fbe7406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.559+0000 7fbe737fe640 1 -- 172.21.15.143:0/3322366155 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74071390 con 0x7fbe74144030 2023-11-24T06:30:56.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe737fe640 1 --2- 172.21.15.143:0/3322366155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe74144030 0x7fbe7406c650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009870 tx=0x7fbe6401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cb716089d796c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:56.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe727fc640 1 -- 172.21.15.143:0/3322366155 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640aa670 con 0x7fbe74144030 2023-11-24T06:30:56.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe727fc640 1 -- 172.21.15.143:0/3322366155 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640aa7d0 con 0x7fbe74144030 2023-11-24T06:30:56.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe727fc640 1 -- 172.21.15.143:0/3322366155 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640aab60 con 0x7fbe74144030 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 -- 172.21.15.143:0/3322366155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe74144030 msgr2=0x7fbe7406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 --2- 172.21.15.143:0/3322366155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe74144030 0x7fbe7406c650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009870 tx=0x7fbe6401c510 comp rx=0 tx=0).stop 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 -- 172.21.15.143:0/3322366155 shutdown_connections 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 --2- 172.21.15.143:0/3322366155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe740709c0 0x7fbe74070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 --2- 172.21.15.143:0/3322366155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe74144030 0x7fbe7406c650 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 -- 172.21.15.143:0/3322366155 >> 172.21.15.143:0/3322366155 conn(0x7fbe740b0bf0 msgr2=0x7fbe740b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 -- 172.21.15.143:0/3322366155 shutdown_connections 2023-11-24T06:30:56.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.563+0000 7fbe79c06640 1 -- 172.21.15.143:0/3322366155 wait complete. 2023-11-24T06:30:56.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 Processor -- start 2023-11-24T06:30:56.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 -- start start 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 0x7fbe741564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe7409cc20 0x7fbe74137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe74144030 0x7fbe74142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74138240 con 0x7fbe740709c0 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740ae6d0 con 0x7fbe74144030 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740ae9b0 con 0x7fbe7409cc20 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 0x7fbe741564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 0x7fbe741564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41196/0 (socket says 172.21.15.143:41196) 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 -- 172.21.15.143:0/1427150794 learned_addr learned my addr 172.21.15.143:0/1427150794 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe73fff640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe74144030 0x7fbe74142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe72ffd640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe7409cc20 0x7fbe74137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 -- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe7409cc20 msgr2=0x7fbe74137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe7409cc20 0x7fbe74137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 -- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe74144030 msgr2=0x7fbe74142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe74144030 0x7fbe74142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 -- 172.21.15.143:0/1427150794 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640094d0 con 0x7fbe740709c0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe73fff640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe74144030 0x7fbe74142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe737fe640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 0x7fbe741564d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ac040 tx=0x7fbe6401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640b3800 con 0x7fbe740709c0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640b3980 con 0x7fbe740709c0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640b3d30 con 0x7fbe740709c0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.567+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe74141e30 con 0x7fbe740709c0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe741423f0 con 0x7fbe740709c0 2023-11-24T06:30:56.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe741425e0 con 0x7fbe740709c0 2023-11-24T06:30:56.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fbe640b2380 con 0x7fbe740709c0 2023-11-24T06:30:56.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe5bfff640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbe60066500 0x7fbe600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:56.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbe6411e4f0 con 0x7fbe740709c0 2023-11-24T06:30:56.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe72ffd640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbe60066500 0x7fbe600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:56.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.571+0000 7fbe72ffd640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbe60066500 0x7fbe600689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe7406f0c0 tx=0x7fbe68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.575+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe640ebc20 con 0x7fbe740709c0 2023-11-24T06:30:56.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:56.779+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) v1 -- 0x7fbe74067520 con 0x7fbe740709c0 2023-11-24T06:30:57.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.743+0000 7fbe5bfff640 1 -- 172.21.15.143:0/1427150794 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v101) v1 ==== 175+0+0 (secure 0 0 0) 0x7fbe640ef240 con 0x7fbe740709c0 2023-11-24T06:30:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbe60066500 msgr2=0x7fbe600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbe60066500 0x7fbe600689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe7406f0c0 tx=0x7fbe68009040 comp rx=0 tx=0).stop 2023-11-24T06:30:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 msgr2=0x7fbe741564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 0x7fbe741564d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ac040 tx=0x7fbe6401ad50 comp rx=0 tx=0).stop 2023-11-24T06:30:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 shutdown_connections 2023-11-24T06:30:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbe60066500 0x7fbe600689c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe74144030 0x7fbe74142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe7409cc20 0x7fbe74137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 --2- 172.21.15.143:0/1427150794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe740709c0 0x7fbe741564d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 >> 172.21.15.143:0/1427150794 conn(0x7fbe740b0bf0 msgr2=0x7fbe7406dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 shutdown_connections 2023-11-24T06:30:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.747+0000 7fbe79c06640 1 -- 172.21.15.143:0/1427150794 wait complete. 2023-11-24T06:30:57.775 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:30:57.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc5549df640 1 Processor -- start 2023-11-24T06:30:57.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc5549df640 1 -- start start 2023-11-24T06:30:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc5549df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc55006dac0 0x7fc5500ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc5549df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55006b460 con 0x7fc55006b8f0 2023-11-24T06:30:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc5549df640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55006a5b0 con 0x7fc55015d450 2023-11-24T06:30:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc5549df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55006a850 con 0x7fc55006dac0 2023-11-24T06:30:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc54ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc55006dac0 0x7fc5500ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:57.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc545d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc55006b8f0 0x7fc55006d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52420/0 (socket says 172.21.15.143:52420) 2023-11-24T06:30:57.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc545d9b640 1 -- 172.21.15.143:0/601121179 learned_addr learned my addr 172.21.15.143:0/601121179 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:57.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc54ed9d640 1 -- 172.21.15.143:0/601121179 >> v1:172.21.15.146:6789/0 conn(0x7fc55015d450 legacy=0x7fc550161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc54ed9d640 1 -- 172.21.15.143:0/601121179 >> v1:172.21.15.143:6789/0 conn(0x7fc55006b8f0 legacy=0x7fc55006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.915+0000 7fc54ed9d640 1 -- 172.21.15.143:0/601121179 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55006ab30 con 0x7fc55006dac0 2023-11-24T06:30:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc54ed9d640 1 --2- 172.21.15.143:0/601121179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500ac850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5480097c0 tx=0x7fc54801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932c4e87b700add2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc54dd9b640 1 -- 172.21.15.143:0/601121179 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480ab650 con 0x7fc55006dac0 2023-11-24T06:30:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc54dd9b640 1 -- 172.21.15.143:0/601121179 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5480ab7b0 con 0x7fc55006dac0 2023-11-24T06:30:57.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc54dd9b640 1 -- 172.21.15.143:0/601121179 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480abb40 con 0x7fc55006dac0 2023-11-24T06:30:57.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 -- 172.21.15.143:0/601121179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 msgr2=0x7fc5500ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 --2- 172.21.15.143:0/601121179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500ac850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5480097c0 tx=0x7fc54801c450 comp rx=0 tx=0).stop 2023-11-24T06:30:57.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 -- 172.21.15.143:0/601121179 shutdown_connections 2023-11-24T06:30:57.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 --2- 172.21.15.143:0/601121179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500ac850 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 -- 172.21.15.143:0/601121179 >> 172.21.15.143:0/601121179 conn(0x7fc5500cf8f0 msgr2=0x7fc5500cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:57.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 -- 172.21.15.143:0/601121179 shutdown_connections 2023-11-24T06:30:57.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.919+0000 7fc5549df640 1 -- 172.21.15.143:0/601121179 wait complete. 2023-11-24T06:30:57.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 Processor -- start 2023-11-24T06:30:57.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 -- start start 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc55006b8f0 0x7fc55014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55015d450 0x7fc5500afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55015a300 con 0x7fc55006dac0 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55015b850 con 0x7fc55015d450 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500cee50 con 0x7fc55006b8f0 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57942/0 (socket says 172.21.15.143:57942) 2023-11-24T06:30:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 -- 172.21.15.143:0/3394097948 learned_addr learned my addr 172.21.15.143:0/3394097948 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc54e59c640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc55006b8f0 0x7fc55014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc54ed9d640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55015d450 0x7fc5500afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 -- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc55006b8f0 msgr2=0x7fc55014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc55006b8f0 0x7fc55014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 -- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55015d450 msgr2=0x7fc5500afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55015d450 0x7fc5500afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 -- 172.21.15.143:0/3394097948 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548009420 con 0x7fc55006dac0 2023-11-24T06:30:57.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc545d9b640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500af590 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c500 tx=0x7fc53800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:57.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538005cf0 con 0x7fc55006dac0 2023-11-24T06:30:57.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538005e50 con 0x7fc55006dac0 2023-11-24T06:30:57.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55015abd0 con 0x7fc55006dac0 2023-11-24T06:30:57.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380072f0 con 0x7fc55006dac0 2023-11-24T06:30:57.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.923+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55015b190 con 0x7fc55006dac0 2023-11-24T06:30:57.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.927+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55015b990 con 0x7fc55006dac0 2023-11-24T06:30:57.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.927+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fc538007450 con 0x7fc55006dac0 2023-11-24T06:30:57.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.927+0000 7fc5477fe640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc530066500 0x7fc5300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:57.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.927+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc5380830b0 con 0x7fc55006dac0 2023-11-24T06:30:57.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.927+0000 7fc54e59c640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc530066500 0x7fc5300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:57.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.927+0000 7fc54e59c640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc530066500 0x7fc5300689c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc550158b30 tx=0x7fc540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:57.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:57.931+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc55015b990 con 0x7fc55006dac0 2023-11-24T06:30:58.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.079+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc55015b990 con 0x7fc55006dac0 2023-11-24T06:30:58.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5477fe640 1 -- 172.21.15.143:0/3394097948 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc55015b990 con 0x7fc55006dac0 2023-11-24T06:30:58.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc530066500 msgr2=0x7fc5300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc530066500 0x7fc5300689c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc550158b30 tx=0x7fc540009040 comp rx=0 tx=0).stop 2023-11-24T06:30:58.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 msgr2=0x7fc5500af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500af590 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c500 tx=0x7fc53800c9c0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 shutdown_connections 2023-11-24T06:30:58.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc530066500 0x7fc5300689c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55015d450 0x7fc5500afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc55006dac0 0x7fc5500af590 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 --2- 172.21.15.143:0/3394097948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc55006b8f0 0x7fc55014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 >> 172.21.15.143:0/3394097948 conn(0x7fc5500cf8f0 msgr2=0x7fc550154480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:58.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 shutdown_connections 2023-11-24T06:30:58.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.087+0000 7fc5549df640 1 -- 172.21.15.143:0/3394097948 wait complete. 2023-11-24T06:30:58.111 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:30:58.112 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:30:58.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:30:58.309 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:30:58.309 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:58.309 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:58.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:30:58.318 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:58.318 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:58.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:30:58.330 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:30:58.330 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:58.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:30:58.374 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:30:58.374 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:30:58.383 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:30:58.383 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:30:58.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:30:58.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 Processor -- start 2023-11-24T06:30:58.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 -- start start 2023-11-24T06:30:58.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f087815d570 0x7f087806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:58.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08780d3020 0x7f08780d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:58.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780d39f0 con 0x7f08780ce8b0 2023-11-24T06:30:58.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780d1cc0 con 0x7f087815d570 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f087db80640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780d1fa0 con 0x7f08780d3020 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f0877fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f08780ce8b0 0x7f08780ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52436/0 (socket says 172.21.15.143:52436) 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f0877fff640 1 -- 172.21.15.143:0/2363698207 learned_addr learned my addr 172.21.15.143:0/2363698207 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f08777fe640 1 --2- 172.21.15.143:0/2363698207 >> v2:172.21.15.143:3300/0 conn(0x7f087815d570 0x7f087806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f086ffff640 1 --2- 172.21.15.143:0/2363698207 >> v2:172.21.15.146:3300/0 conn(0x7f08780d3020 0x7f08780d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f0876ffd640 1 -- 172.21.15.143:0/2363698207 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248390751 0 0) 0x7f08780d39f0 con 0x7f08780ce8b0 2023-11-24T06:30:58.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f08777fe640 1 -- 172.21.15.143:0/2363698207 >> v2:172.21.15.146:3300/0 conn(0x7f08780d3020 msgr2=0x7f08780d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:58.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f08777fe640 1 --2- 172.21.15.143:0/2363698207 >> v2:172.21.15.146:3300/0 conn(0x7f08780d3020 0x7f08780d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f08777fe640 1 -- 172.21.15.143:0/2363698207 >> v1:172.21.15.143:6789/0 conn(0x7f08780ce8b0 legacy=0x7f08780ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.551+0000 7f08777fe640 1 -- 172.21.15.143:0/2363698207 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08780ce0b0 con 0x7f087815d570 2023-11-24T06:30:58.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f08777fe640 1 --2- 172.21.15.143:0/2363698207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f087806b9d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f08780b5f00 tx=0x7f086801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45150aa63c895371 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:58.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f0876ffd640 1 -- 172.21.15.143:0/2363698207 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08680ab650 con 0x7f087815d570 2023-11-24T06:30:58.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f0876ffd640 1 -- 172.21.15.143:0/2363698207 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08680ab7b0 con 0x7f087815d570 2023-11-24T06:30:58.560 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f0876ffd640 1 -- 172.21.15.143:0/2363698207 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08680abb40 con 0x7f087815d570 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 -- 172.21.15.143:0/2363698207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 msgr2=0x7f087806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 --2- 172.21.15.143:0/2363698207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f087806b9d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f08780b5f00 tx=0x7f086801c430 comp rx=0 tx=0).stop 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 -- 172.21.15.143:0/2363698207 shutdown_connections 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 --2- 172.21.15.143:0/2363698207 >> v2:172.21.15.146:3300/0 conn(0x7f08780d3020 0x7f08780d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 --2- 172.21.15.143:0/2363698207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f087806b9d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 -- 172.21.15.143:0/2363698207 >> 172.21.15.143:0/2363698207 conn(0x7f087808ceb0 msgr2=0x7f087809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 -- 172.21.15.143:0/2363698207 shutdown_connections 2023-11-24T06:30:58.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.555+0000 7f087db80640 1 -- 172.21.15.143:0/2363698207 wait complete. 2023-11-24T06:30:58.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 Processor -- start 2023-11-24T06:30:58.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 -- start start 2023-11-24T06:30:58.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08780ce8b0 0x7f087815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:58.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08780d3020 0x7f0878152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:58.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f08780c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:58.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0878153150 con 0x7f087815d570 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780c9d50 con 0x7f08780ce8b0 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780cd1b0 con 0x7f08780d3020 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f08780c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f08780c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57946/0 (socket says 172.21.15.143:57946) 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 -- 172.21.15.143:0/1489457805 learned_addr learned my addr 172.21.15.143:0/1489457805 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f08777fe640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08780ce8b0 0x7f087815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f086ffff640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08780d3020 0x7f0878152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 -- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08780d3020 msgr2=0x7f0878152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08780d3020 0x7f0878152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 -- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08780ce8b0 msgr2=0x7f087815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08780ce8b0 0x7f087815db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 -- 172.21.15.143:0/1489457805 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009420 con 0x7f087815d570 2023-11-24T06:30:58.566 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f086ffff640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08780d3020 0x7f0878152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:58.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0877fff640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f08780c9810 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0870001570 tx=0x7f087000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:58.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000cea0 con 0x7f087815d570 2023-11-24T06:30:58.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000a5e0 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780c7260 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000a990 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.559+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08780c7820 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.563+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08780c70c0 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.563+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f087000aaf0 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.563+0000 7f0874ff9640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0858066500 0x7f08580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.563+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0870082f80 con 0x7f087815d570 2023-11-24T06:30:58.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.563+0000 7f08777fe640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0858066500 0x7f08580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:58.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.563+0000 7f08777fe640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0858066500 0x7f08580689c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08680af000 tx=0x7f08680a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:58.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.567+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08780c70c0 con 0x7f087815d570 2023-11-24T06:30:58.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.755+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08780c70c0 con 0x7f087815d570 2023-11-24T06:30:58.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.755+0000 7f0874ff9640 1 -- 172.21.15.143:0/1489457805 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f08780c70c0 con 0x7f087815d570 2023-11-24T06:30:58.761 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:30:58.762 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/4022849248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4022849248},{"type":"v1","addr":"172.21.15.146:6835","nonce":4022849248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3201323513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3201323513},{"type":"v1","addr":"172.21.15.143:6836","nonce":3201323513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3100371827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3100371827},{"type":"v1","addr":"172.21.15.143:6837","nonce":3100371827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/704033990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":704033990},{"type":"v1","addr":"172.21.15.146:6834","nonce":704033990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-11-24T06:30:58.762 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 20 2023-11-24T06:30:58.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0858066500 msgr2=0x7f08580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0858066500 0x7f08580689c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08680af000 tx=0x7f08680a7000 comp rx=0 tx=0).stop 2023-11-24T06:30:58.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 msgr2=0x7f08780c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:58.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f08780c9810 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0870001570 tx=0x7f087000cc50 comp rx=0 tx=0).stop 2023-11-24T06:30:58.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 shutdown_connections 2023-11-24T06:30:58.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0858066500 0x7f08580689c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f087815d570 0x7f08780c9810 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08780d3020 0x7f0878152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 --2- 172.21.15.143:0/1489457805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08780ce8b0 0x7f087815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:58.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 >> 172.21.15.143:0/1489457805 conn(0x7f087808ceb0 msgr2=0x7f08780b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:58.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 shutdown_connections 2023-11-24T06:30:58.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.759+0000 7f087db80640 1 -- 172.21.15.143:0/1489457805 wait complete. 2023-11-24T06:30:58.783 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:30:58.783 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:30:58.783 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:30:58.783 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:58.784 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:30:58.784 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:30:58.784 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:30:58.784 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:58.785 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:30:58.785 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:30:58.785 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:30:58.785 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:58.786 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:30:58.786 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:30:58.786 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:30:58.787 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:30:58.799 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:30:58.800 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:30:58.802 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:30:58.802 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:30:58.803 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:30:58.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:30:58.804 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:30:58.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:30:58.850 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:30:58.850 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:58.851 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:30:58.852 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:58.854 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:30:58.854 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:58.856 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:30:58.856 DEBUG:teuthology.parallel:result is None 2023-11-24T06:30:58.856 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:30:58.937 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:30:58.938 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:30:58.946 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-11-24T06:30:58.947 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:30:59.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 Processor -- start 2023-11-24T06:30:59.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 -- start start 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f50680b3af0 0x7f50680cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50680cf3b0 0x7f50680b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5068071350 con 0x7f50680b3af0 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680cf7e0 con 0x7f50680cf3b0 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:58.999+0000 7f506d2c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5068071580 con 0x7f5068143960 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f50680b3af0 0x7f50680cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f50680b3af0 0x7f50680cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57982/0 (socket says 172.21.15.143:57982) 2023-11-24T06:30:59.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 -- 172.21.15.143:0/170649308 learned_addr learned my addr 172.21.15.143:0/170649308 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f50677fe640 1 --2- 172.21.15.143:0/170649308 >> v2:172.21.15.146:3300/0 conn(0x7f50680cf3b0 0x7f50680b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f5066ffd640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 -- 172.21.15.143:0/170649308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 msgr2=0x7f5068070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 -- 172.21.15.143:0/170649308 >> v2:172.21.15.146:3300/0 conn(0x7f50680cf3b0 msgr2=0x7f50680b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 --2- 172.21.15.143:0/170649308 >> v2:172.21.15.146:3300/0 conn(0x7f50680cf3b0 0x7f50680b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 -- 172.21.15.143:0/170649308 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680ccb50 con 0x7f50680b3af0 2023-11-24T06:30:59.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f5066ffd640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:30:59.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f505ffff640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680b3af0 0x7f50680cee70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f50680cfa30 tx=0x7f505001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a465454fd7c06d4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:59.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f50667fc640 1 -- 172.21.15.143:0/170649308 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500ab600 con 0x7f50680b3af0 2023-11-24T06:30:59.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f50667fc640 1 -- 172.21.15.143:0/170649308 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500a7050 con 0x7f50680b3af0 2023-11-24T06:30:59.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.003+0000 7f50667fc640 1 -- 172.21.15.143:0/170649308 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500ab980 con 0x7f50680b3af0 2023-11-24T06:30:59.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- 172.21.15.143:0/170649308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680b3af0 msgr2=0x7f50680cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:59.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680b3af0 0x7f50680cee70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f50680cfa30 tx=0x7f505001c210 comp rx=0 tx=0).stop 2023-11-24T06:30:59.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- 172.21.15.143:0/170649308 shutdown_connections 2023-11-24T06:30:59.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- 172.21.15.143:0/170649308 >> v2:172.21.15.146:3300/0 conn(0x7f50680cf3b0 0x7f50680b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680b3af0 0x7f50680cee70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- 172.21.15.143:0/170649308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- 172.21.15.143:0/170649308 >> 172.21.15.143:0/170649308 conn(0x7f506806dcc0 msgr2=0x7f506806a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:30:59.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- 172.21.15.143:0/170649308 shutdown_connections 2023-11-24T06:30:59.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- 172.21.15.143:0/170649308 wait complete. 2023-11-24T06:30:59.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 Processor -- start 2023-11-24T06:30:59.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- start start 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50680b3af0 0x7f5068159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 0x7f50680cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5068164500 con 0x7f50680cf3b0 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5068158560 con 0x7f50680b3af0 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f506d2c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5068158840 con 0x7f5068143960 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 0x7f50680cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 0x7f50680cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57986/0 (socket says 172.21.15.143:57986) 2023-11-24T06:30:59.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 -- 172.21.15.143:0/3383731686 learned_addr learned my addr 172.21.15.143:0/3383731686 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:30:59.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f5066ffd640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50680b3af0 0x7f5068159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f50677fe640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 -- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 msgr2=0x7f5068163ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:59.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068163ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 -- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50680b3af0 msgr2=0x7f5068159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50680b3af0 0x7f5068159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.007+0000 7f505ffff640 1 -- 172.21.15.143:0/3383731686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500094d0 con 0x7f50680cf3b0 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505ffff640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 0x7f50680cea10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f505001a8c0 tx=0x7f5050018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500b4420 con 0x7f50680cf3b0 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500b4580 con 0x7f50680cf3b0 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500b4930 con 0x7f50680cf3b0 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5068158b20 con 0x7f50680cf3b0 2023-11-24T06:30:59.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50681421b0 con 0x7f50680cf3b0 2023-11-24T06:30:59.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50680ce580 con 0x7f50680cf3b0 2023-11-24T06:30:59.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f50500b2070 con 0x7f50680cf3b0 2023-11-24T06:30:59.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505f7fe640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5048066500 0x7f50480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:30:59.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f505011cc90 con 0x7f50680cf3b0 2023-11-24T06:30:59.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.011+0000 7f5066ffd640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5048066500 0x7f50480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:30:59.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.015+0000 7f5066ffd640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5048066500 0x7f50480689c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50681f97a0 tx=0x7f5058008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:30:59.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.015+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50500ea2c0 con 0x7f50680cf3b0 2023-11-24T06:30:59.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:30:59.183+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f506804e850 con 0x7f50680cf3b0 2023-11-24T06:31:00.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f505f7fe640 1 -- 172.21.15.143:0/3383731686 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7f50500b0080 con 0x7f50680cf3b0 2023-11-24T06:31:00.106 INFO:teuthology.orchestra.run.smithi143.stderr: removed all blocklist entries 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5048066500 msgr2=0x7f50480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5048066500 0x7f50480689c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50681f97a0 tx=0x7f5058008040 comp rx=0 tx=0).stop 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 msgr2=0x7f50680cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 0x7f50680cea10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f505001a8c0 tx=0x7f5050018fb0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 shutdown_connections 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5048066500 0x7f50480689c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.103+0000 7f506d2c9640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5068143960 0x7f5068163ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.107+0000 7f506d2c9640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50680cf3b0 0x7f50680cea10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.107+0000 7f506d2c9640 1 --2- 172.21.15.143:0/3383731686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50680b3af0 0x7f5068159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.107+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 >> 172.21.15.143:0/3383731686 conn(0x7f506806dcc0 msgr2=0x7f506815a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:00.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.107+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 shutdown_connections 2023-11-24T06:31:00.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.107+0000 7f506d2c9640 1 -- 172.21.15.143:0/3383731686 wait complete. 2023-11-24T06:31:00.129 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:31:00.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.263+0000 7f13bfbf5640 1 Processor -- start 2023-11-24T06:31:00.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.263+0000 7f13bfbf5640 1 -- start start 2023-11-24T06:31:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bfbf5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b8070ea0 0x7f13b80b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bfbf5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13b8071280 0x7f13b806e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bfbf5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13b806d670 0x7f13b806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bfbf5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b80cd7b0 con 0x7f13b806d670 2023-11-24T06:31:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bfbf5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b806cc20 con 0x7f13b8071280 2023-11-24T06:31:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bfbf5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b806d1e0 con 0x7f13b8070ea0 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13b806d670 0x7f13b806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bd190640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13b8071280 0x7f13b806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bd991640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b8070ea0 0x7f13b80b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13b806d670 0x7f13b806db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57992/0 (socket says 172.21.15.143:57992) 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 -- 172.21.15.143:0/1074507610 learned_addr learned my addr 172.21.15.143:0/1074507610 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13bd190640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13b8071280 0x7f13b806e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:52124/0 (socket says 172.21.15.143:52124) 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 -- 172.21.15.143:0/1074507610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b8070ea0 msgr2=0x7f13b80b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 --2- 172.21.15.143:0/1074507610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b8070ea0 0x7f13b80b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 -- 172.21.15.143:0/1074507610 >> v2:172.21.15.146:3300/0 conn(0x7f13b8071280 msgr2=0x7f13b806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 --2- 172.21.15.143:0/1074507610 >> v2:172.21.15.146:3300/0 conn(0x7f13b8071280 0x7f13b806e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.267+0000 7f13be192640 1 -- 172.21.15.143:0/1074507610 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b80aed30 con 0x7f13b806d670 2023-11-24T06:31:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13be192640 1 --2- 172.21.15.143:0/1074507610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b806d670 0x7f13b806db00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f13b8061ad0 tx=0x7f13b001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4639ee4a71b04fab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bc98f640 1 -- 172.21.15.143:0/1074507610 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00a56e0 con 0x7f13b806d670 2023-11-24T06:31:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bc98f640 1 -- 172.21.15.143:0/1074507610 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00a5840 con 0x7f13b806d670 2023-11-24T06:31:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bc98f640 1 -- 172.21.15.143:0/1074507610 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00a5bd0 con 0x7f13b806d670 2023-11-24T06:31:00.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 -- 172.21.15.143:0/1074507610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b806d670 msgr2=0x7f13b806db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/1074507610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b806d670 0x7f13b806db00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f13b8061ad0 tx=0x7f13b001c9d0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 -- 172.21.15.143:0/1074507610 shutdown_connections 2023-11-24T06:31:00.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/1074507610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b806d670 0x7f13b806db00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/1074507610 >> v2:172.21.15.146:3300/0 conn(0x7f13b8071280 0x7f13b806e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/1074507610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b8070ea0 0x7f13b80b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.271+0000 7f13bfbf5640 1 -- 172.21.15.143:0/1074507610 >> 172.21.15.143:0/1074507610 conn(0x7f13b80cc330 msgr2=0x7f13b80cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:00.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 -- 172.21.15.143:0/1074507610 shutdown_connections 2023-11-24T06:31:00.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 -- 172.21.15.143:0/1074507610 wait complete. 2023-11-24T06:31:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 Processor -- start 2023-11-24T06:31:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 -- start start 2023-11-24T06:31:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b806d670 0x7f13b814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b8070ea0 0x7f13b80c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8071280 0x7f13b80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b81527d0 con 0x7f13b8070ea0 2023-11-24T06:31:00.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8158c80 con 0x7f13b8071280 2023-11-24T06:31:00.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bfbf5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8151b50 con 0x7f13b806d670 2023-11-24T06:31:00.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b8070ea0 0x7f13b80c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd991640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b806d670 0x7f13b814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd991640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b806d670 0x7f13b814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:51810/0 (socket says 172.21.15.143:51810) 2023-11-24T06:31:00.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd991640 1 -- 172.21.15.143:0/2837756147 learned_addr learned my addr 172.21.15.143:0/2837756147 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13be192640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8071280 0x7f13b80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 -- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b806d670 msgr2=0x7f13b814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b806d670 0x7f13b814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 -- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8071280 msgr2=0x7f13b80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8071280 0x7f13b80c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 -- 172.21.15.143:0/2837756147 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009b30 con 0x7f13b8070ea0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.275+0000 7f13bd190640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b8070ea0 0x7f13b80c5210 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f13a800e910 tx=0x7f13a800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800cc40 con 0x7f13b8070ea0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800cda0 con 0x7f13b8070ea0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b8151e30 con 0x7f13b8070ea0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80115f0 con 0x7f13b8070ea0 2023-11-24T06:31:00.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b81523f0 con 0x7f13b8070ea0 2023-11-24T06:31:00.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b8152910 con 0x7f13b8070ea0 2023-11-24T06:31:00.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f13a8011750 con 0x7f13b8070ea0 2023-11-24T06:31:00.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13ae7fc640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f139c066500 0x7f139c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13a8083850 con 0x7f13b8070ea0 2023-11-24T06:31:00.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.279+0000 7f13bd991640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f139c066500 0x7f139c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.283+0000 7f13bd991640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f139c066500 0x7f139c0689c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009ba0 tx=0x7f13b4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.287+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13b8152910 con 0x7f13b8070ea0 2023-11-24T06:31:00.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.487+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f13b8152910 con 0x7f13b8070ea0 2023-11-24T06:31:00.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.487+0000 7f13ae7fc640 1 -- 172.21.15.143:0/2837756147 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f13b8152910 con 0x7f13b8070ea0 2023-11-24T06:31:00.493 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:00.493 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:31:00.493 INFO:teuthology.orchestra.run.smithi143.stdout: "auth_dump": [ 2023-11-24T06:31:00.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.494 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.a", 2023-11-24T06:31:00.494 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA==", 2023-11-24T06:31:00.494 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.494 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.494 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:00.495 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:00.495 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.495 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.496 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.b", 2023-11-24T06:31:00.496 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA==", 2023-11-24T06:31:00.496 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.496 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.496 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:00.496 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:00.497 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.497 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.497 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.c", 2023-11-24T06:31:00.497 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg==", 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.d", 2023-11-24T06:31:00.498 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ==", 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.0", 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg==", 2023-11-24T06:31:00.499 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.1", 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg==", 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.500 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.2", 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA==", 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.502 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.3", 2023-11-24T06:31:00.502 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw==", 2023-11-24T06:31:00.502 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.502 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.502 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.4", 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew==", 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.503 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.5", 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ==", 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.504 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.6", 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ==", 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.7", 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA==", 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.505 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.0", 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA==", 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow r", 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:31:00.506 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.1", 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w==", 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.2", 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw==", 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.3", 2023-11-24T06:31:00.508 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw==", 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.admin", 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlFbv3BRAAPWkl+V8uDy+7+/Qdzjn9Fw==", 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.509 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.x", 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ==", 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:31:00.510 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.y", 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw==", 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.511 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:00.512 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2023-11-24T06:31:00.512 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f139c066500 msgr2=0x7f139c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f139c066500 0x7f139c0689c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009ba0 tx=0x7f13b4009190 comp rx=0 tx=0).stop 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b8070ea0 msgr2=0x7f13b80c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b8070ea0 0x7f13b80c5210 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f13a800e910 tx=0x7f13a800edd0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 shutdown_connections 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f139c066500 0x7f139c0689c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8071280 0x7f13b80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13b8070ea0 0x7f13b80c5210 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 --2- 172.21.15.143:0/2837756147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13b806d670 0x7f13b814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 >> 172.21.15.143:0/2837756147 conn(0x7f13b80cc330 msgr2=0x7f13b80b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:00.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 shutdown_connections 2023-11-24T06:31:00.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.491+0000 7f13bfbf5640 1 -- 172.21.15.143:0/2837756147 wait complete. 2023-11-24T06:31:00.515 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:00.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 Processor -- start 2023-11-24T06:31:00.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 -- start start 2023-11-24T06:31:00.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cb015d570 0x7f7cb006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7cb00d3020 0x7f7cb00d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb00d39f0 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb00d1cc0 con 0x7f7cb00d3020 2023-11-24T06:31:00.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb770e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb00d1fa0 con 0x7f7cb015d570 2023-11-24T06:31:00.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb4ca9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7cb00d3020 0x7f7cb00d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb5cab640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7cb00ce8b0 0x7f7cb00ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52454/0 (socket says 172.21.15.143:52454) 2023-11-24T06:31:00.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb5cab640 1 -- 172.21.15.143:0/1778668471 learned_addr learned my addr 172.21.15.143:0/1778668471 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:00.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb54aa640 1 --2- 172.21.15.143:0/1778668471 >> v2:172.21.15.146:3300/0 conn(0x7f7cb015d570 0x7f7cb006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb4ca9640 1 -- 172.21.15.143:0/1778668471 >> v2:172.21.15.146:3300/0 conn(0x7f7cb015d570 msgr2=0x7f7cb006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:00.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb4ca9640 1 --2- 172.21.15.143:0/1778668471 >> v2:172.21.15.146:3300/0 conn(0x7f7cb015d570 0x7f7cb006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb4ca9640 1 -- 172.21.15.143:0/1778668471 >> v1:172.21.15.143:6789/0 conn(0x7f7cb00ce8b0 legacy=0x7f7cb00ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7cb4ca9640 1 -- 172.21.15.143:0/1778668471 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00ce0b0 con 0x7f7cb00d3020 2023-11-24T06:31:00.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.651+0000 7f7ca7fff640 1 -- 172.21.15.143:0/1778668471 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293499316 0 0) 0x7f7cb00d39f0 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb4ca9640 1 --2- 172.21.15.143:0/1778668471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00d3020 0x7f7cb00d34b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00d0eb0 tx=0x7f7ca001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64ff2a3dc497bba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7ca7fff640 1 -- 172.21.15.143:0/1778668471 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00ab650 con 0x7f7cb00d3020 2023-11-24T06:31:00.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7ca7fff640 1 -- 172.21.15.143:0/1778668471 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca00ab7b0 con 0x7f7cb00d3020 2023-11-24T06:31:00.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7ca7fff640 1 -- 172.21.15.143:0/1778668471 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00abb40 con 0x7f7cb00d3020 2023-11-24T06:31:00.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 -- 172.21.15.143:0/1778668471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00d3020 msgr2=0x7f7cb00d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 --2- 172.21.15.143:0/1778668471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00d3020 0x7f7cb00d34b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00d0eb0 tx=0x7f7ca001c430 comp rx=0 tx=0).stop 2023-11-24T06:31:00.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 -- 172.21.15.143:0/1778668471 shutdown_connections 2023-11-24T06:31:00.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 --2- 172.21.15.143:0/1778668471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00d3020 0x7f7cb00d34b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 --2- 172.21.15.143:0/1778668471 >> v2:172.21.15.146:3300/0 conn(0x7f7cb015d570 0x7f7cb006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 -- 172.21.15.143:0/1778668471 >> 172.21.15.143:0/1778668471 conn(0x7f7cb008ceb0 msgr2=0x7f7cb009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:00.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 -- 172.21.15.143:0/1778668471 shutdown_connections 2023-11-24T06:31:00.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.655+0000 7f7cb770e640 1 -- 172.21.15.143:0/1778668471 wait complete. 2023-11-24T06:31:00.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 Processor -- start 2023-11-24T06:31:00.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 -- start start 2023-11-24T06:31:00.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 0x7f7cb01607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d3020 0x7f7cb0154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7cb015d570 0x7f7cb015e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0154c90 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0154e40 con 0x7f7cb00d3020 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb015ed50 con 0x7f7cb015d570 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 0x7f7cb01607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 0x7f7cb01607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58022/0 (socket says 172.21.15.143:58022) 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 -- 172.21.15.143:0/2379531512 learned_addr learned my addr 172.21.15.143:0/2379531512 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb4ca9640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d3020 0x7f7cb0154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb5cab640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7cb015d570 0x7f7cb015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 -- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7cb015d570 msgr2=0x7f7cb015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7cb015d570 0x7f7cb015e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 -- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d3020 msgr2=0x7f7cb0154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d3020 0x7f7cb0154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 -- 172.21.15.143:0/2379531512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca0009420 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb5cab640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7cb015d570 0x7f7cb015e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb54aa640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 0x7f7cb01607d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00e8a0 tx=0x7f7cac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac009510 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00c940 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00ccb0 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb015efd0 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.659+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb0155370 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.663+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb0067520 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.663+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f7cac013470 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.663+0000 7f7ca5ffb640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c94066500 0x7f7c940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.663+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cac083be0 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.663+0000 7f7cb4ca9640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c94066500 0x7f7c940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.663+0000 7f7cb4ca9640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c94066500 0x7f7c940689c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00af000 tx=0x7f7ca00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.667+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cac051400 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cb0156e40 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7ca5ffb640 1 -- 172.21.15.143:0/2379531512 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12905 (secure 0 0 0) 0x7f7cac054a20 con 0x7f7cb00ce8b0 2023-11-24T06:31:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:00.823 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":40,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:00.102621+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:00.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c94066500 msgr2=0x7f7c940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c94066500 0x7f7c940689c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00af000 tx=0x7f7ca00a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:00.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 msgr2=0x7f7cb01607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 0x7f7cb01607d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00e8a0 tx=0x7f7cac00eca0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 shutdown_connections 2023-11-24T06:31:00.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7c94066500 0x7f7c940689c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7cb015d570 0x7f7cb015e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d3020 0x7f7cb0154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 --2- 172.21.15.143:0/2379531512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cb00ce8b0 0x7f7cb01607d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 >> 172.21.15.143:0/2379531512 conn(0x7f7cb008ceb0 msgr2=0x7f7cb00b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:00.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 shutdown_connections 2023-11-24T06:31:00.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.819+0000 7f7cb770e640 1 -- 172.21.15.143:0/2379531512 wait complete. 2023-11-24T06:31:00.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:31:00.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:31:00.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 Processor -- start 2023-11-24T06:31:00.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 -- start start 2023-11-24T06:31:00.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 0x7f645406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64540ce220 0x7f645406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6454161280 con 0x7f64540cb850 2023-11-24T06:31:00.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6454161560 con 0x7f64540ce220 2023-11-24T06:31:00.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6459757640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454161840 con 0x7f6454140590 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 0x7f645406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f64537fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64540ce220 0x7f645406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 0x7f645406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:51834/0 (socket says 172.21.15.143:51834) 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 -- 172.21.15.143:0/1011043234 learned_addr learned my addr 172.21.15.143:0/1011043234 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 -- 172.21.15.143:0/1011043234 >> v2:172.21.15.146:3300/0 conn(0x7f64540ce220 msgr2=0x7f645406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 --2- 172.21.15.143:0/1011043234 >> v2:172.21.15.146:3300/0 conn(0x7f64540ce220 0x7f645406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 -- 172.21.15.143:0/1011043234 >> v1:172.21.15.146:6789/0 conn(0x7f64540cb850 legacy=0x7f64540cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.983+0000 7f6452ffd640 1 -- 172.21.15.143:0/1011043234 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454161b20 con 0x7f6454140590 2023-11-24T06:31:00.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6452ffd640 1 --2- 172.21.15.143:0/1011043234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 0x7f645406b6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6444009870 tx=0x7f644401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb0d99f3e7b95ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6451ffb640 1 -- 172.21.15.143:0/1011043234 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440ac620 con 0x7f6454140590 2023-11-24T06:31:00.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6451ffb640 1 -- 172.21.15.143:0/1011043234 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440ac780 con 0x7f6454140590 2023-11-24T06:31:00.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6451ffb640 1 -- 172.21.15.143:0/1011043234 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440acb10 con 0x7f6454140590 2023-11-24T06:31:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 -- 172.21.15.143:0/1011043234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 msgr2=0x7f645406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 --2- 172.21.15.143:0/1011043234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 0x7f645406b6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6444009870 tx=0x7f644401c4b0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 -- 172.21.15.143:0/1011043234 shutdown_connections 2023-11-24T06:31:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 --2- 172.21.15.143:0/1011043234 >> v2:172.21.15.146:3300/0 conn(0x7f64540ce220 0x7f645406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 --2- 172.21.15.143:0/1011043234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6454140590 0x7f645406b6c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 -- 172.21.15.143:0/1011043234 >> 172.21.15.143:0/1011043234 conn(0x7f64540b2e50 msgr2=0x7f64540b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:00.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 -- 172.21.15.143:0/1011043234 shutdown_connections 2023-11-24T06:31:00.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.987+0000 7f6459757640 1 -- 172.21.15.143:0/1011043234 wait complete. 2023-11-24T06:31:00.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 Processor -- start 2023-11-24T06:31:00.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 -- start start 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64540cb850 0x7f6454156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64540ce220 0x7f64540cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 0x7f64540c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64541401d0 con 0x7f6454140590 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64540b4920 con 0x7f64540cb850 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540b4b70 con 0x7f64540ce220 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 0x7f64540c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 0x7f64540c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58036/0 (socket says 172.21.15.143:58036) 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 -- 172.21.15.143:0/147033332 learned_addr learned my addr 172.21.15.143:0/147033332 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:00.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6452ffd640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64540cb850 0x7f6454156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64527fc640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64540ce220 0x7f64540cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 -- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64540ce220 msgr2=0x7f64540cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64540ce220 0x7f64540cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 -- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64540cb850 msgr2=0x7f6454156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64540cb850 0x7f6454156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 -- 172.21.15.143:0/147033332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440094d0 con 0x7f6454140590 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f64537fe640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 0x7f64540c8700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f644c00ec10 tx=0x7f644c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c00cd20 con 0x7f6454140590 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c00f040 con 0x7f6454140590 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0146c0 con 0x7f6454140590 2023-11-24T06:31:00.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64540b4e50 con 0x7f6454140590 2023-11-24T06:31:00.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.991+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540b5410 con 0x7f6454140590 2023-11-24T06:31:00.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.995+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645404e8c0 con 0x7f6454140590 2023-11-24T06:31:00.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.995+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f644c014a30 con 0x7f6454140590 2023-11-24T06:31:01.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.995+0000 7f643b7fe640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6440066500 0x7f64400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.995+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f644c084b10 con 0x7f6454140590 2023-11-24T06:31:01.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.995+0000 7f6452ffd640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6440066500 0x7f64400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.995+0000 7f6452ffd640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6440066500 0x7f64400689c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f64440ae000 tx=0x7f64440a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:00.999+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f644c0521a0 con 0x7f6454140590 2023-11-24T06:31:01.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64540cf130 con 0x7f6454140590 2023-11-24T06:31:01.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f643b7fe640 1 -- 172.21.15.143:0/147033332 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f644c0557c0 con 0x7f6454140590 2023-11-24T06:31:01.155 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:31:01.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6440066500 msgr2=0x7f64400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6440066500 0x7f64400689c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f64440ae000 tx=0x7f64440a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:01.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 msgr2=0x7f64540c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 0x7f64540c8700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f644c00ec10 tx=0x7f644c00c490 comp rx=0 tx=0).stop 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 shutdown_connections 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6440066500 0x7f64400689c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6454140590 0x7f64540c8700 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64540ce220 0x7f64540cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 --2- 172.21.15.143:0/147033332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64540cb850 0x7f6454156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.151+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 >> 172.21.15.143:0/147033332 conn(0x7f64540b2e50 msgr2=0x7f64540cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.155+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 shutdown_connections 2023-11-24T06:31:01.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.155+0000 7f6459757640 1 -- 172.21.15.143:0/147033332 wait complete. 2023-11-24T06:31:01.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:31:01.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef3f80640 1 Processor -- start 2023-11-24T06:31:01.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef3f80640 1 -- start start 2023-11-24T06:31:01.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef3f80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec158a50 0x7f0eec06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef3f80640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec06dc20 con 0x7f0eec06e340 2023-11-24T06:31:01.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef3f80640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0b3620 con 0x7f0eec06cb90 2023-11-24T06:31:01.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef3f80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec06e0b0 con 0x7f0eec158a50 2023-11-24T06:31:01.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef151b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0eec06e340 0x7f0eec0707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52470/0 (socket says 172.21.15.143:52470) 2023-11-24T06:31:01.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef151b640 1 -- 172.21.15.143:0/3175367665 learned_addr learned my addr 172.21.15.143:0/3175367665 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:01.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef1d1c640 1 --2- 172.21.15.143:0/3175367665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec158a50 0x7f0eec06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef0d1a640 1 -- 172.21.15.143:0/3175367665 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844276349 0 0) 0x7f0eec06dc20 con 0x7f0eec06e340 2023-11-24T06:31:01.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef0d1a640 1 -- 172.21.15.143:0/3175367665 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed8003530 con 0x7f0eec06e340 2023-11-24T06:31:01.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef1d1c640 1 -- 172.21.15.143:0/3175367665 >> v1:172.21.15.146:6789/0 conn(0x7f0eec06cb90 legacy=0x7f0eec0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef0d1a640 1 -- 172.21.15.143:0/3175367665 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237341483 0 0) 0x7f0eec0b3620 con 0x7f0eec06cb90 2023-11-24T06:31:01.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef1d1c640 1 -- 172.21.15.143:0/3175367665 >> v1:172.21.15.143:6789/0 conn(0x7f0eec06e340 legacy=0x7f0eec0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.311+0000 7f0ef1d1c640 1 -- 172.21.15.143:0/3175367665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec158e30 con 0x7f0eec158a50 2023-11-24T06:31:01.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef1d1c640 1 --2- 172.21.15.143:0/3175367665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec158a50 0x7f0eec06c650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097f0 tx=0x7f0ee801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d176bf9e50890f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef0d1a640 1 -- 172.21.15.143:0/3175367665 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80aa5f0 con 0x7f0eec158a50 2023-11-24T06:31:01.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef0d1a640 1 -- 172.21.15.143:0/3175367665 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee80aa750 con 0x7f0eec158a50 2023-11-24T06:31:01.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef0d1a640 1 -- 172.21.15.143:0/3175367665 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80aaae0 con 0x7f0eec158a50 2023-11-24T06:31:01.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3175367665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec158a50 msgr2=0x7f0eec06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3175367665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec158a50 0x7f0eec06c650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097f0 tx=0x7f0ee801c490 comp rx=0 tx=0).stop 2023-11-24T06:31:01.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3175367665 shutdown_connections 2023-11-24T06:31:01.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3175367665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec158a50 0x7f0eec06c650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3175367665 >> 172.21.15.143:0/3175367665 conn(0x7f0eec0b0bf0 msgr2=0x7f0eec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:01.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3175367665 shutdown_connections 2023-11-24T06:31:01.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.315+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3175367665 wait complete. 2023-11-24T06:31:01.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 Processor -- start 2023-11-24T06:31:01.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 -- start start 2023-11-24T06:31:01.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec06cb90 0x7f0eec151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec06e340 0x7f0eec153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 0x7f0eec154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec153130 con 0x7f0eec158a50 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec152dc0 con 0x7f0eec06cb90 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec15bd80 con 0x7f0eec06e340 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 0x7f0eec154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 0x7f0eec154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58038/0 (socket says 172.21.15.143:58038) 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 -- 172.21.15.143:0/3387857427 learned_addr learned my addr 172.21.15.143:0/3387857427 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef151b640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec06e340 0x7f0eec153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef1d1c640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec06cb90 0x7f0eec151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 -- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec06e340 msgr2=0x7f0eec153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec06e340 0x7f0eec153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 -- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec06cb90 msgr2=0x7f0eec151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec06cb90 0x7f0eec151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 -- 172.21.15.143:0/3387857427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009420 con 0x7f0eec158a50 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef151b640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec06e340 0x7f0eec153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef251d640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 0x7f0eec154700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400c730 tx=0x7f0ee400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4003db0 con 0x7f0eec158a50 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400ce40 con 0x7f0eec158a50 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4005310 con 0x7f0eec158a50 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec15c060 con 0x7f0eec158a50 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.319+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec153a90 con 0x7f0eec158a50 2023-11-24T06:31:01.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.323+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec153270 con 0x7f0eec158a50 2023-11-24T06:31:01.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.323+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f0ee4005470 con 0x7f0eec158a50 2023-11-24T06:31:01.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.323+0000 7f0ee27fc640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ed0066500 0x7f0ed00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.323+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ee4083380 con 0x7f0eec158a50 2023-11-24T06:31:01.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.323+0000 7f0ef1d1c640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ed0066500 0x7f0ed00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.323+0000 7f0ef1d1c640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ed0066500 0x7f0ed00689c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80ae000 tx=0x7f0ee80b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.327+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0eec153270 con 0x7f0eec158a50 2023-11-24T06:31:01.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0eec153270 con 0x7f0eec158a50 2023-11-24T06:31:01.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ee27fc640 1 -- 172.21.15.143:0/3387857427 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0eec153270 con 0x7f0eec158a50 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:01.483 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:31:01.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ed0066500 msgr2=0x7f0ed00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ed0066500 0x7f0ed00689c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80ae000 tx=0x7f0ee80b5040 comp rx=0 tx=0).stop 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 msgr2=0x7f0eec154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 0x7f0eec154700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400c730 tx=0x7f0ee400cbf0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 shutdown_connections 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ed0066500 0x7f0ed00689c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0eec158a50 0x7f0eec154700 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0eec06e340 0x7f0eec153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 --2- 172.21.15.143:0/3387857427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec06cb90 0x7f0eec151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 >> 172.21.15.143:0/3387857427 conn(0x7f0eec0b0bf0 msgr2=0x7f0eec0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 shutdown_connections 2023-11-24T06:31:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.479+0000 7f0ef3f80640 1 -- 172.21.15.143:0/3387857427 wait complete. 2023-11-24T06:31:01.504 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:31:01.504 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:31:01.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.639+0000 7f4a2ff2a640 1 Processor -- start 2023-11-24T06:31:01.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.639+0000 7f4a2ff2a640 1 -- start start 2023-11-24T06:31:01.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2ff2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a280b1ef0 0x7f4a28164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2ff2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2815a700 con 0x7f4a280b36c0 2023-11-24T06:31:01.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2ff2a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a280b2620 con 0x7f4a2815a320 2023-11-24T06:31:01.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2ff2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280b2900 con 0x7f4a280b1ef0 2023-11-24T06:31:01.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2d4c5640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4a280b36c0 0x7f4a28070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52482/0 (socket says 172.21.15.143:52482) 2023-11-24T06:31:01.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2d4c5640 1 -- 172.21.15.143:0/2688588614 learned_addr learned my addr 172.21.15.143:0/2688588614 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:01.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2e4c7640 1 --2- 172.21.15.143:0/2688588614 >> v2:172.21.15.143:3300/0 conn(0x7f4a280b1ef0 0x7f4a28164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2ccc4640 1 -- 172.21.15.143:0/2688588614 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690594173 0 0) 0x7f4a2815a700 con 0x7f4a280b36c0 2023-11-24T06:31:01.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2ccc4640 1 -- 172.21.15.143:0/2688588614 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a14005740 con 0x7f4a280b36c0 2023-11-24T06:31:01.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2e4c7640 1 -- 172.21.15.143:0/2688588614 >> v1:172.21.15.146:6789/0 conn(0x7f4a2815a320 legacy=0x7f4a28070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:01.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2e4c7640 1 -- 172.21.15.143:0/2688588614 >> v1:172.21.15.143:6789/0 conn(0x7f4a280b36c0 legacy=0x7f4a28070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.643+0000 7f4a2e4c7640 1 -- 172.21.15.143:0/2688588614 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280b2be0 con 0x7f4a280b1ef0 2023-11-24T06:31:01.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2e4c7640 1 --2- 172.21.15.143:0/2688588614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a280b1ef0 0x7f4a28164f50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009d90 tx=0x7f4a2001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7270d5fed2211658 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ccc4640 1 -- 172.21.15.143:0/2688588614 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200a5910 con 0x7f4a280b1ef0 2023-11-24T06:31:01.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ccc4640 1 -- 172.21.15.143:0/2688588614 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a200a5a70 con 0x7f4a280b1ef0 2023-11-24T06:31:01.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ccc4640 1 -- 172.21.15.143:0/2688588614 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200a5de0 con 0x7f4a280b1ef0 2023-11-24T06:31:01.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2688588614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a280b1ef0 msgr2=0x7f4a28164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2688588614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a280b1ef0 0x7f4a28164f50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009d90 tx=0x7f4a2001c950 comp rx=0 tx=0).stop 2023-11-24T06:31:01.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2688588614 shutdown_connections 2023-11-24T06:31:01.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2688588614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a280b1ef0 0x7f4a28164f50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2688588614 >> 172.21.15.143:0/2688588614 conn(0x7f4a280b0bf0 msgr2=0x7f4a280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:01.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2688588614 shutdown_connections 2023-11-24T06:31:01.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2688588614 wait complete. 2023-11-24T06:31:01.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 Processor -- start 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.647+0000 7f4a2ff2a640 1 -- start start 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 0x7f4a28150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a280b36c0 0x7f4a28163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a2815a320 0x7f4a28099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28151310 con 0x7f4a2815a320 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28164620 con 0x7f4a280b36c0 2023-11-24T06:31:01.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28164900 con 0x7f4a280b1ef0 2023-11-24T06:31:01.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 0x7f4a28150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2e4c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a2815a320 0x7f4a28099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 0x7f4a28150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:51872/0 (socket says 172.21.15.143:51872) 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 -- 172.21.15.143:0/2905316268 learned_addr learned my addr 172.21.15.143:0/2905316268 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2d4c5640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a280b36c0 0x7f4a28163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 -- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a280b36c0 msgr2=0x7f4a28163d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a280b36c0 0x7f4a28163d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 -- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a2815a320 msgr2=0x7f4a28099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a2815a320 0x7f4a28099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 -- 172.21.15.143:0/2905316268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20009a70 con 0x7f4a280b1ef0 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2e4c7640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a2815a320 0x7f4a28099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2dcc6640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 0x7f4a28150dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c370 tx=0x7f4a2400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a240052d0 con 0x7f4a280b1ef0 2023-11-24T06:31:01.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24005430 con 0x7f4a280b1ef0 2023-11-24T06:31:01.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007260 con 0x7f4a280b1ef0 2023-11-24T06:31:01.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a28164be0 con 0x7f4a280b1ef0 2023-11-24T06:31:01.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a28158130 con 0x7f4a280b1ef0 2023-11-24T06:31:01.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28067520 con 0x7f4a280b1ef0 2023-11-24T06:31:01.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.651+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f4a240073c0 con 0x7f4a280b1ef0 2023-11-24T06:31:01.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.655+0000 7f4a1e7fc640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4a0c066500 0x7f4a0c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:01.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.655+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a24082f50 con 0x7f4a280b1ef0 2023-11-24T06:31:01.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.655+0000 7f4a2d4c5640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4a0c066500 0x7f4a0c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:01.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.655+0000 7f4a2d4c5640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4a0c066500 0x7f4a0c0689c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a28164f20 tx=0x7f4a18007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:01.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.659+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a240506e0 con 0x7f4a280b1ef0 2023-11-24T06:31:01.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:01.811+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4a280adca0 con 0x7f4a280b1ef0 2023-11-24T06:31:02.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.767+0000 7f4a1e7fc640 1 -- 172.21.15.143:0/2905316268 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4a24053d00 con 0x7f4a280b1ef0 2023-11-24T06:31:02.773 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2023-11-24T06:31:02.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4a0c066500 msgr2=0x7f4a0c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:02.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4a0c066500 0x7f4a0c0689c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a28164f20 tx=0x7f4a18007d40 comp rx=0 tx=0).stop 2023-11-24T06:31:02.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 msgr2=0x7f4a28150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:02.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 0x7f4a28150dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c370 tx=0x7f4a2400c830 comp rx=0 tx=0).stop 2023-11-24T06:31:02.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 shutdown_connections 2023-11-24T06:31:02.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4a0c066500 0x7f4a0c0689c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a2815a320 0x7f4a28099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a280b36c0 0x7f4a28163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 --2- 172.21.15.143:0/2905316268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a280b1ef0 0x7f4a28150dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.771+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 >> 172.21.15.143:0/2905316268 conn(0x7f4a280b0bf0 msgr2=0x7f4a28153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:02.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.775+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 shutdown_connections 2023-11-24T06:31:02.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.775+0000 7f4a2ff2a640 1 -- 172.21.15.143:0/2905316268 wait complete. 2023-11-24T06:31:02.800 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:31:02.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 Processor -- start 2023-11-24T06:31:02.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 -- start start 2023-11-24T06:31:02.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00400cad20 0x7f00400c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:02.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f004006d740 0x7f004006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:02.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004015a8b0 con 0x7f004015a4d0 2023-11-24T06:31:02.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00400c9c30 con 0x7f004006d740 2023-11-24T06:31:02.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f0045032640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004006e090 con 0x7f00400cad20 2023-11-24T06:31:02.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f003f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f004006d740 0x7f004006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:02.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f003f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f004006d740 0x7f004006db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58070/0 (socket says 172.21.15.143:58070) 2023-11-24T06:31:02.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f003f59e640 1 -- 172.21.15.143:0/3929644123 learned_addr learned my addr 172.21.15.143:0/3929644123 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:02.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.943+0000 7f003e59c640 1 --2- 172.21.15.143:0/3929644123 >> v2:172.21.15.146:3300/0 conn(0x7f00400cad20 0x7f00400c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:02.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003f59e640 1 -- 172.21.15.143:0/3929644123 >> v2:172.21.15.146:3300/0 conn(0x7f00400cad20 msgr2=0x7f00400c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:02.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003f59e640 1 --2- 172.21.15.143:0/3929644123 >> v2:172.21.15.146:3300/0 conn(0x7f00400cad20 0x7f00400c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003f59e640 1 -- 172.21.15.143:0/3929644123 >> v1:172.21.15.146:6789/0 conn(0x7f004015a4d0 legacy=0x7f004015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:02.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003f59e640 1 -- 172.21.15.143:0/3929644123 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400c9f60 con 0x7f004006d740 2023-11-24T06:31:02.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003f59e640 1 --2- 172.21.15.143:0/3929644123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f004006d740 0x7f004006db50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f00400cb9a0 tx=0x7f003801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee39b6e0655f1c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:02.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003dd9b640 1 -- 172.21.15.143:0/3929644123 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800b2d0 con 0x7f004006d740 2023-11-24T06:31:02.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003dd9b640 1 -- 172.21.15.143:0/3929644123 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800b430 con 0x7f004006d740 2023-11-24T06:31:02.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f003dd9b640 1 -- 172.21.15.143:0/3929644123 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380a7c00 con 0x7f004006d740 2023-11-24T06:31:02.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f0045032640 1 -- 172.21.15.143:0/3929644123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f004006d740 msgr2=0x7f004006db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:02.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f0045032640 1 --2- 172.21.15.143:0/3929644123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f004006d740 0x7f004006db50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f00400cb9a0 tx=0x7f003801eb10 comp rx=0 tx=0).stop 2023-11-24T06:31:02.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f0045032640 1 -- 172.21.15.143:0/3929644123 shutdown_connections 2023-11-24T06:31:02.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f0045032640 1 --2- 172.21.15.143:0/3929644123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f004006d740 0x7f004006db50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f0045032640 1 --2- 172.21.15.143:0/3929644123 >> v2:172.21.15.146:3300/0 conn(0x7f00400cad20 0x7f00400c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.947+0000 7f0045032640 1 -- 172.21.15.143:0/3929644123 >> 172.21.15.143:0/3929644123 conn(0x7f00400b0bf0 msgr2=0x7f00400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:02.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 -- 172.21.15.143:0/3929644123 shutdown_connections 2023-11-24T06:31:02.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 -- 172.21.15.143:0/3929644123 wait complete. 2023-11-24T06:31:02.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 Processor -- start 2023-11-24T06:31:02.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 -- start start 2023-11-24T06:31:02.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f004006d740 0x7f00401514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:02.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 0x7f00400abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:02.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f004015a4d0 0x7f00400ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0040165120 con 0x7f00400cad20 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00401f9cc0 con 0x7f004015a4d0 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f0045032640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0040099c10 con 0x7f004006d740 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 0x7f00400abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 0x7f00400abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58078/0 (socket says 172.21.15.143:58078) 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 -- 172.21.15.143:0/1345164868 learned_addr learned my addr 172.21.15.143:0/1345164868 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003ed9d640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f004006d740 0x7f00401514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003f59e640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f004015a4d0 0x7f00400ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 -- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f004006d740 msgr2=0x7f00401514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f004006d740 0x7f00401514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 -- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f004015a4d0 msgr2=0x7f00400ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:02.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f004015a4d0 0x7f00400ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:02.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.951+0000 7f003e59c640 1 -- 172.21.15.143:0/1345164868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003800bd40 con 0x7f00400cad20 2023-11-24T06:31:02.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f003e59c640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 0x7f00400abed0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f003400e960 tx=0x7f003400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:02.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034009690 con 0x7f00400cad20 2023-11-24T06:31:02.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003400ca00 con 0x7f00400cad20 2023-11-24T06:31:02.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040164880 con 0x7f00400cad20 2023-11-24T06:31:02.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400cd70 con 0x7f00400cad20 2023-11-24T06:31:02.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0040164e40 con 0x7f00400cad20 2023-11-24T06:31:02.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00400999e0 con 0x7f00400cad20 2023-11-24T06:31:02.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f0034013470 con 0x7f00400cad20 2023-11-24T06:31:02.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.955+0000 7f00277fe640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f002c066500 0x7f002c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:02.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.959+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0034083ea0 con 0x7f00400cad20 2023-11-24T06:31:02.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.959+0000 7f003ed9d640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f002c066500 0x7f002c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:02.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.959+0000 7f003ed9d640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f002c066500 0x7f002c0689c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0030001770 tx=0x7f0030009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:02.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:02.963+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00400999e0 con 0x7f00400cad20 2023-11-24T06:31:03.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.111+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f00400999e0 con 0x7f00400cad20 2023-11-24T06:31:03.779 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.775+0000 7f00277fe640 1 -- 172.21.15.143:0/1345164868 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f00400999e0 con 0x7f00400cad20 2023-11-24T06:31:03.779 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2023-11-24T06:31:03.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.775+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f002c066500 msgr2=0x7f002c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:03.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.775+0000 7f0045032640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f002c066500 0x7f002c0689c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0030001770 tx=0x7f0030009040 comp rx=0 tx=0).stop 2023-11-24T06:31:03.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.775+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 msgr2=0x7f00400abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:03.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.775+0000 7f0045032640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 0x7f00400abed0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f003400e960 tx=0x7f003400ee20 comp rx=0 tx=0).stop 2023-11-24T06:31:03.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 shutdown_connections 2023-11-24T06:31:03.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f002c066500 0x7f002c0689c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f004015a4d0 0x7f00400ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00400cad20 0x7f00400abed0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 --2- 172.21.15.143:0/1345164868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f004006d740 0x7f00401514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 >> 172.21.15.143:0/1345164868 conn(0x7f00400b0bf0 msgr2=0x7f004006c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:03.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 shutdown_connections 2023-11-24T06:31:03.783 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.779+0000 7f0045032640 1 -- 172.21.15.143:0/1345164868 wait complete. 2023-11-24T06:31:03.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:31:03.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.955+0000 7f018186b640 1 Processor -- start 2023-11-24T06:31:03.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.955+0000 7f018186b640 1 -- start start 2023-11-24T06:31:03.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f018186b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f017c0d0880 0x7f017c0d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:03.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f018186b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f017c0cea60 0x7f017c0ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:03.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f018186b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017c0ce5d0 con 0x7f017c15d8a0 2023-11-24T06:31:03.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f018186b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c0d3880 con 0x7f017c0d0880 2023-11-24T06:31:03.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f018186b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c0d0ce0 con 0x7f017c0cea60 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f017c0d0880 0x7f017c0d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f017c0d0880 0x7f017c0d3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58080/0 (socket says 172.21.15.143:58080) 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 -- 172.21.15.143:0/153826335 learned_addr learned my addr 172.21.15.143:0/153826335 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f017b7fe640 1 --2- 172.21.15.143:0/153826335 >> v2:172.21.15.146:3300/0 conn(0x7f017c0cea60 0x7f017c0ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 -- 172.21.15.143:0/153826335 >> v2:172.21.15.146:3300/0 conn(0x7f017c0cea60 msgr2=0x7f017c0ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 --2- 172.21.15.143:0/153826335 >> v2:172.21.15.146:3300/0 conn(0x7f017c0cea60 0x7f017c0ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 -- 172.21.15.143:0/153826335 >> v1:172.21.15.146:6789/0 conn(0x7f017c15d8a0 legacy=0x7f017c06b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:03.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.959+0000 7f01727fc640 1 -- 172.21.15.143:0/153826335 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0d3ae0 con 0x7f017c0d0880 2023-11-24T06:31:03.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f01727fc640 1 --2- 172.21.15.143:0/153826335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c0d3340 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f017c08be00 tx=0x7f016401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8ec59a8e658cf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:03.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f017a7fc640 1 -- 172.21.15.143:0/153826335 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640ac410 con 0x7f017c0d0880 2023-11-24T06:31:03.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f017a7fc640 1 -- 172.21.15.143:0/153826335 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01640ac570 con 0x7f017c0d0880 2023-11-24T06:31:03.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f017a7fc640 1 -- 172.21.15.143:0/153826335 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640ac900 con 0x7f017c0d0880 2023-11-24T06:31:03.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 -- 172.21.15.143:0/153826335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 msgr2=0x7f017c0d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:03.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 --2- 172.21.15.143:0/153826335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c0d3340 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f017c08be00 tx=0x7f016401c3b0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 -- 172.21.15.143:0/153826335 shutdown_connections 2023-11-24T06:31:03.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 --2- 172.21.15.143:0/153826335 >> v2:172.21.15.146:3300/0 conn(0x7f017c0cea60 0x7f017c0ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 --2- 172.21.15.143:0/153826335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c0d3340 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 -- 172.21.15.143:0/153826335 >> 172.21.15.143:0/153826335 conn(0x7f017c09c790 msgr2=0x7f017c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:03.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 -- 172.21.15.143:0/153826335 shutdown_connections 2023-11-24T06:31:03.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 -- 172.21.15.143:0/153826335 wait complete. 2023-11-24T06:31:03.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 Processor -- start 2023-11-24T06:31:03.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.963+0000 7f018186b640 1 -- start start 2023-11-24T06:31:03.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f017c0cea60 0x7f017c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f017c15d8a0 0x7f017c0b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c158a80 con 0x7f017c0d0880 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0b6c00 con 0x7f017c0cea60 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0b7740 con 0x7f017c15d8a0 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c14ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58086/0 (socket says 172.21.15.143:58086) 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 -- 172.21.15.143:0/13790368 learned_addr learned my addr 172.21.15.143:0/13790368 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f017affd640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f017c0cea60 0x7f017c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f017b7fe640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f017c15d8a0 0x7f017c0b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:03.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 -- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f017c15d8a0 msgr2=0x7f017c0b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:03.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f017c15d8a0 0x7f017c0b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 -- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f017c0cea60 msgr2=0x7f017c0b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:03.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f017c0cea60 0x7f017c0b8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:03.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 -- 172.21.15.143:0/13790368 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640094d0 con 0x7f017c0d0880 2023-11-24T06:31:03.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f01727fc640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c14ada0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0164018fc0 tx=0x7f0164019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:03.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640ac410 con 0x7f017c0d0880 2023-11-24T06:31:03.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01640ace90 con 0x7f017c0d0880 2023-11-24T06:31:03.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640b6830 con 0x7f017c0d0880 2023-11-24T06:31:03.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c14b2e0 con 0x7f017c0d0880 2023-11-24T06:31:03.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c0b70f0 con 0x7f017c0d0880 2023-11-24T06:31:03.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.967+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c04e8c0 con 0x7f017c0d0880 2023-11-24T06:31:03.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.971+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f01640b6990 con 0x7f017c0d0880 2023-11-24T06:31:03.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.971+0000 7f0178ff9640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f015c066500 0x7f015c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:03.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.971+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f016411ef20 con 0x7f017c0d0880 2023-11-24T06:31:03.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.971+0000 7f017affd640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f015c066500 0x7f015c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:03.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.971+0000 7f017affd640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f015c066500 0x7f015c0689c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f016c0012f0 tx=0x7f016c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:03.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:03.975+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01640ec6f0 con 0x7f017c0d0880 2023-11-24T06:31:04.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.155+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f017c0d4130 con 0x7f017c0d0880 2023-11-24T06:31:04.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.799+0000 7f0178ff9640 1 -- 172.21.15.143:0/13790368 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f01640efd10 con 0x7f017c0d0880 2023-11-24T06:31:04.805 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 6 and data pool 7 2023-11-24T06:31:04.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f015c066500 msgr2=0x7f015c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f015c066500 0x7f015c0689c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f016c0012f0 tx=0x7f016c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:04.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 msgr2=0x7f017c14ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c14ada0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0164018fc0 tx=0x7f0164019150 comp rx=0 tx=0).stop 2023-11-24T06:31:04.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 shutdown_connections 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f015c066500 0x7f015c0689c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f017c15d8a0 0x7f017c0b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f017c0d0880 0x7f017c14ada0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 --2- 172.21.15.143:0/13790368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f017c0cea60 0x7f017c0b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 >> 172.21.15.143:0/13790368 conn(0x7f017c09c790 msgr2=0x7f017c156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 shutdown_connections 2023-11-24T06:31:04.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.807+0000 7f018186b640 1 -- 172.21.15.143:0/13790368 wait complete. 2023-11-24T06:31:04.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:04.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483e901640 1 Processor -- start 2023-11-24T06:31:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483e901640 1 -- start start 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483e901640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f48380ce8b0 0x7f48380ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483e901640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483806c0e0 con 0x7f483815d570 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483e901640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48380d1cc0 con 0x7f48380d3020 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483e901640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48380d1fa0 con 0x7f48380ce8b0 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f4837fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f483815d570 0x7f483806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52490/0 (socket says 172.21.15.143:52490) 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f4837fff640 1 -- 172.21.15.143:0/2906197320 learned_addr learned my addr 172.21.15.143:0/2906197320 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483ce9e640 1 --2- 172.21.15.143:0/2906197320 >> v2:172.21.15.143:3300/0 conn(0x7f48380ce8b0 0x7f48380ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f4836ffd640 1 -- 172.21.15.143:0/2906197320 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877849561 0 0) 0x7f483806c0e0 con 0x7f483815d570 2023-11-24T06:31:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f4836ffd640 1 -- 172.21.15.143:0/2906197320 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4820003530 con 0x7f483815d570 2023-11-24T06:31:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483ce9e640 1 -- 172.21.15.143:0/2906197320 >> v1:172.21.15.146:6789/0 conn(0x7f48380d3020 legacy=0x7f48380d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f4836ffd640 1 -- 172.21.15.143:0/2906197320 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377038094 0 0) 0x7f48380d1cc0 con 0x7f48380d3020 2023-11-24T06:31:04.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483ce9e640 1 -- 172.21.15.143:0/2906197320 >> v1:172.21.15.143:6789/0 conn(0x7f483815d570 legacy=0x7f483806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.979+0000 7f483ce9e640 1 -- 172.21.15.143:0/2906197320 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380ce0b0 con 0x7f48380ce8b0 2023-11-24T06:31:04.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483ce9e640 1 --2- 172.21.15.143:0/2906197320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380ce8b0 0x7f48380ced60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4830009d90 tx=0x7f483001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925724c165020616 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f4836ffd640 1 -- 172.21.15.143:0/2906197320 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300a59e0 con 0x7f48380ce8b0 2023-11-24T06:31:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f4836ffd640 1 -- 172.21.15.143:0/2906197320 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300a5b40 con 0x7f48380ce8b0 2023-11-24T06:31:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f4836ffd640 1 -- 172.21.15.143:0/2906197320 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ad440 con 0x7f48380ce8b0 2023-11-24T06:31:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 -- 172.21.15.143:0/2906197320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380ce8b0 msgr2=0x7f48380ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 --2- 172.21.15.143:0/2906197320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380ce8b0 0x7f48380ced60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4830009d90 tx=0x7f483001c920 comp rx=0 tx=0).stop 2023-11-24T06:31:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 -- 172.21.15.143:0/2906197320 shutdown_connections 2023-11-24T06:31:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 --2- 172.21.15.143:0/2906197320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380ce8b0 0x7f48380ced60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 -- 172.21.15.143:0/2906197320 >> 172.21.15.143:0/2906197320 conn(0x7f483808ceb0 msgr2=0x7f483809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 -- 172.21.15.143:0/2906197320 shutdown_connections 2023-11-24T06:31:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.983+0000 7f483e901640 1 -- 172.21.15.143:0/2906197320 wait complete. 2023-11-24T06:31:04.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 Processor -- start 2023-11-24T06:31:04.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 -- start start 2023-11-24T06:31:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48380ce8b0 0x7f48380c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 0x7f4838159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f483815d570 0x7f4838160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48380c9080 con 0x7f48380d3020 2023-11-24T06:31:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48380c9a50 con 0x7f483815d570 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4838159aa0 con 0x7f48380ce8b0 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 0x7f4838159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 0x7f4838159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58106/0 (socket says 172.21.15.143:58106) 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 -- 172.21.15.143:0/1201605934 learned_addr learned my addr 172.21.15.143:0/1201605934 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 -- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48380ce8b0 msgr2=0x7f48380c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f4837fff640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48380ce8b0 0x7f48380c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483ce9e640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f483815d570 0x7f4838160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48380ce8b0 0x7f48380c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 -- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f483815d570 msgr2=0x7f4838160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f483815d570 0x7f4838160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 -- 172.21.15.143:0/1201605934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830009a70 con 0x7f48380d3020 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483ce9e640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f483815d570 0x7f4838160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f4837fff640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48380ce8b0 0x7f48380c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f48377fe640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 0x7f4838159560 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f482c00c520 tx=0x7f482c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c003600 con 0x7f48380d3020 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c003780 con 0x7f48380d3020 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483815c370 con 0x7f48380d3020 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c003b30 con 0x7f48380d3020 2023-11-24T06:31:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.987+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380c8a30 con 0x7f48380d3020 2023-11-24T06:31:04.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.991+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48380c6d80 con 0x7f48380d3020 2023-11-24T06:31:04.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.991+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f482c003c90 con 0x7f48380d3020 2023-11-24T06:31:04.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.991+0000 7f4834ff9640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4824066530 0x7f48240689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:04.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.991+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f482c083550 con 0x7f48380d3020 2023-11-24T06:31:04.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.991+0000 7f4837fff640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4824066530 0x7f48240689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:04.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.991+0000 7f4837fff640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4824066530 0x7f48240689f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4828005890 tx=0x7f4828009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:04.995+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f482c050970 con 0x7f48380d3020 2023-11-24T06:31:05.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.147+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4838067520 con 0x7f48380d3020 2023-11-24T06:31:05.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f4834ff9640 1 -- 172.21.15.143:0/1201605934 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16574 (secure 0 0 0) 0x7f482c017090 con 0x7f48380d3020 2023-11-24T06:31:05.154 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:05.154 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":43,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:04.158988+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:05.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4824066530 msgr2=0x7f48240689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4824066530 0x7f48240689f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4828005890 tx=0x7f4828009040 comp rx=0 tx=0).stop 2023-11-24T06:31:05.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 msgr2=0x7f4838159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 0x7f4838159560 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f482c00c520 tx=0x7f482c00c9e0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 shutdown_connections 2023-11-24T06:31:05.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4824066530 0x7f48240689f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f483815d570 0x7f4838160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48380d3020 0x7f4838159560 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 --2- 172.21.15.143:0/1201605934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48380ce8b0 0x7f48380c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 >> 172.21.15.143:0/1201605934 conn(0x7f483808ceb0 msgr2=0x7f48380cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:05.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 shutdown_connections 2023-11-24T06:31:05.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.151+0000 7f483e901640 1 -- 172.21.15.143:0/1201605934 wait complete. 2023-11-24T06:31:05.177 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:05.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 Processor -- start 2023-11-24T06:31:05.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 -- start start 2023-11-24T06:31:05.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff12c15d5e0 0x7ff12c0d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d1ed0 0x7ff12c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c15d9c0 con 0x7ff12c0d3ee0 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0d1190 con 0x7ff12c15d5e0 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff132a2f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0d1470 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff12c15d5e0 0x7ff12c0d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff12c15d5e0 0x7ff12c0d39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58114/0 (socket says 172.21.15.143:58114) 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 -- 172.21.15.143:0/3787864872 learned_addr learned my addr 172.21.15.143:0/3787864872 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 -- 172.21.15.143:0/3787864872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d1ed0 msgr2=0x7ff12c0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 --2- 172.21.15.143:0/3787864872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d1ed0 0x7ff12c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 -- 172.21.15.143:0/3787864872 >> v1:172.21.15.146:6789/0 conn(0x7ff12c0d3ee0 legacy=0x7ff12c0d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:05.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.311+0000 7ff131a2d640 1 -- 172.21.15.143:0/3787864872 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0b2a80 con 0x7ff12c15d5e0 2023-11-24T06:31:05.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff131a2d640 1 --2- 172.21.15.143:0/3787864872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c15d5e0 0x7ff12c0d39a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff128009870 tx=0x7ff12801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87d85898fa0c0ad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff130a2b640 1 -- 172.21.15.143:0/3787864872 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280aa610 con 0x7ff12c15d5e0 2023-11-24T06:31:05.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff130a2b640 1 -- 172.21.15.143:0/3787864872 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1280a6040 con 0x7ff12c15d5e0 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff130a2b640 1 -- 172.21.15.143:0/3787864872 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280aa990 con 0x7ff12c15d5e0 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 -- 172.21.15.143:0/3787864872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c15d5e0 msgr2=0x7ff12c0d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3787864872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c15d5e0 0x7ff12c0d39a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff128009870 tx=0x7ff12801c4f0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 -- 172.21.15.143:0/3787864872 shutdown_connections 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3787864872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d1ed0 0x7ff12c0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3787864872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c15d5e0 0x7ff12c0d39a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 -- 172.21.15.143:0/3787864872 >> 172.21.15.143:0/3787864872 conn(0x7ff12c09c520 msgr2=0x7ff12c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 -- 172.21.15.143:0/3787864872 shutdown_connections 2023-11-24T06:31:05.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.315+0000 7ff132a2f640 1 -- 172.21.15.143:0/3787864872 wait complete. 2023-11-24T06:31:05.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 Processor -- start 2023-11-24T06:31:05.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 -- start start 2023-11-24T06:31:05.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 0x7ff12c0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d3ee0 0x7ff12c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c15d5e0 0x7ff12c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c15f5c0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0cc6c0 con 0x7ff12c15d5e0 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c15ecd0 con 0x7ff12c0d3ee0 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 0x7ff12c0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 0x7ff12c0c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58122/0 (socket says 172.21.15.143:58122) 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 -- 172.21.15.143:0/3709025851 learned_addr learned my addr 172.21.15.143:0/3709025851 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 -- 172.21.15.143:0/3709025851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d3ee0 msgr2=0x7ff12c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d3ee0 0x7ff12c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 -- 172.21.15.143:0/3709025851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c15d5e0 msgr2=0x7ff12c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c15d5e0 0x7ff12c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 -- 172.21.15.143:0/3709025851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280094d0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff131a2d640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 0x7ff12c0c6b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff1280ac040 tx=0x7ff12801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280bd5f0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1280bd770 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280bdb20 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c15ef70 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.319+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c0c70a0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.323+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c04e850 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.323+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7ff1280b33f0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.323+0000 7ff1227fc640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff110066500 0x7ff1100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.323+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff12811ee10 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.323+0000 7ff13122c640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff110066500 0x7ff1100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.323+0000 7ff13122c640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff110066500 0x7ff1100689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0cad50 tx=0x7ff11c0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.327+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1280ec1d0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.479+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff12c0d1b60 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.479+0000 7ff1227fc640 1 -- 172.21.15.143:0/3709025851 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16574 (secure 0 0 0) 0x7ff1280ef7f0 con 0x7ff12c0d1ed0 2023-11-24T06:31:05.484 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:05.484 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":43,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:04.158988+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:05.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff110066500 msgr2=0x7ff1100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff110066500 0x7ff1100689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0cad50 tx=0x7ff11c0079c0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 msgr2=0x7ff12c0c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 0x7ff12c0c6b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff1280ac040 tx=0x7ff12801ad30 comp rx=0 tx=0).stop 2023-11-24T06:31:05.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 shutdown_connections 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff110066500 0x7ff1100689c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c15d5e0 0x7ff12c155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff12c0d3ee0 0x7ff12c0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 --2- 172.21.15.143:0/3709025851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff12c0d1ed0 0x7ff12c0c6b60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 >> 172.21.15.143:0/3709025851 conn(0x7ff12c09c520 msgr2=0x7ff12c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 shutdown_connections 2023-11-24T06:31:05.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.483+0000 7ff132a2f640 1 -- 172.21.15.143:0/3709025851 wait complete. 2023-11-24T06:31:05.505 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:31:05.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e9e6b640 1 Processor -- start 2023-11-24T06:31:05.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e9e6b640 1 -- start start 2023-11-24T06:31:05.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e9e6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 0x7f91e4168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e9e6b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e40b0090 con 0x7f91e40d39b0 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e9e6b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e40b0330 con 0x7f91e415d7f0 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e9e6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e406b980 con 0x7f91e406d3f0 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e2ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f91e40d39b0 0x7f91e406bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52502/0 (socket says 172.21.15.143:52502) 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e2ffd640 1 -- 172.21.15.143:0/1520085513 learned_addr learned my addr 172.21.15.143:0/1520085513 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121077021 0 0) 0x7f91e40b0090 con 0x7f91e40d39b0 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc003530 con 0x7f91e40d39b0 2023-11-24T06:31:05.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e3fff640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 0x7f91e4168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92609501 0 0) 0x7f91cc003530 con 0x7f91e40d39b0 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 msgr2=0x7f91e4168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 0x7f91e4168220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 >> v1:172.21.15.146:6789/0 conn(0x7f91e415d7f0 legacy=0x7f91e40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40b0610 con 0x7f91e40d39b0 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f91d8001680 con 0x7f91e40d39b0 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 >> v1:172.21.15.143:6789/0 conn(0x7f91e40d39b0 legacy=0x7f91e406bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.643+0000 7f91e27fc640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0039b0 0x7f91cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91cc0047d0 0x7f91cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 0x7f91cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e406b980 con 0x7f91cc0047d0 2023-11-24T06:31:05.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc00ba40 con 0x7f91cc0039b0 2023-11-24T06:31:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc00bc00 con 0x7f91e406d3f0 2023-11-24T06:31:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91cc0047d0 0x7f91cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e37fe640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0039b0 0x7f91cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e3fff640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 0x7f91cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 -- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 msgr2=0x7f91cc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e406d3f0 0x7f91cc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 -- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0039b0 msgr2=0x7f91cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0039b0 0x7f91cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 -- 172.21.15.143:0/1520085513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc003530 con 0x7f91cc0047d0 2023-11-24T06:31:05.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91cc0047d0 0x7f91cc004c50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c210 tx=0x7f91d801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96adf88294af6e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8005ae0 con 0x7f91cc0047d0 2023-11-24T06:31:05.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d80ab070 con 0x7f91cc0047d0 2023-11-24T06:31:05.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.647+0000 7f91e27fc640 1 -- 172.21.15.143:0/1520085513 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8007070 con 0x7f91cc0047d0 2023-11-24T06:31:05.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- 172.21.15.143:0/1520085513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91cc0047d0 msgr2=0x7f91cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/1520085513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91cc0047d0 0x7f91cc004c50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c210 tx=0x7f91d801f350 comp rx=0 tx=0).stop 2023-11-24T06:31:05.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e3fff640 1 -- 172.21.15.143:0/1520085513 reap_dead start 2023-11-24T06:31:05.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- 172.21.15.143:0/1520085513 shutdown_connections 2023-11-24T06:31:05.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- 172.21.15.143:0/1520085513 >> 172.21.15.143:0/1520085513 conn(0x7f91e409c790 msgr2=0x7f91e408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:05.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- 172.21.15.143:0/1520085513 shutdown_connections 2023-11-24T06:31:05.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- 172.21.15.143:0/1520085513 wait complete. 2023-11-24T06:31:05.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 Processor -- start 2023-11-24T06:31:05.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- start start 2023-11-24T06:31:05.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0047d0 0x7f91e41f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 0x7f91e40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e40b6610 0x7f91e415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40cf1a0 con 0x7f91e40d0520 2023-11-24T06:31:05.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40cf480 con 0x7f91cc0047d0 2023-11-24T06:31:05.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e9e6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40cf760 con 0x7f91e40b6610 2023-11-24T06:31:05.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 0x7f91e40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 0x7f91e40b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58140/0 (socket says 172.21.15.143:58140) 2023-11-24T06:31:05.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 -- 172.21.15.143:0/602874763 learned_addr learned my addr 172.21.15.143:0/602874763 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:05.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e37fe640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0047d0 0x7f91e41f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e3fff640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e40b6610 0x7f91e415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 -- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e40b6610 msgr2=0x7f91e415b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e40b6610 0x7f91e415b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 -- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0047d0 msgr2=0x7f91e41f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:05.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0047d0 0x7f91e41f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.651+0000 7f91e2ffd640 1 -- 172.21.15.143:0/602874763 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40cfa40 con 0x7f91e40d0520 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91e2ffd640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 0x7f91e40b60d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c210 tx=0x7f91cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8001640 con 0x7f91e40d0520 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8007070 con 0x7f91e40d0520 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8007400 con 0x7f91e40d0520 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e40cfd20 con 0x7f91e40d0520 2023-11-24T06:31:05.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e41f30f0 con 0x7f91e40d0520 2023-11-24T06:31:05.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e40ccf60 con 0x7f91e40d0520 2023-11-24T06:31:05.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f91d8007560 con 0x7f91e40d0520 2023-11-24T06:31:05.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91cbfff640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91d0066500 0x7f91d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:05.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91d80b7040 con 0x7f91e40d0520 2023-11-24T06:31:05.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.655+0000 7f91e37fe640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91d0066500 0x7f91d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:05.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.659+0000 7f91e37fe640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91d0066500 0x7f91d00689c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f91d4000c10 tx=0x7f91d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:05.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.659+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91d80ee800 con 0x7f91e40d0520 2023-11-24T06:31:05.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:05.843+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91e404e8c0 con 0x7f91e40d0520 2023-11-24T06:31:06.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.803+0000 7f91cbfff640 1 -- 172.21.15.143:0/602874763 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91d80f1e20 con 0x7f91e40d0520 2023-11-24T06:31:06.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.803+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91d0066500 msgr2=0x7f91d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91d0066500 0x7f91d00689c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f91d4000c10 tx=0x7f91d4009040 comp rx=0 tx=0).stop 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 msgr2=0x7f91e40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 0x7f91e40b60d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c210 tx=0x7f91cc005800 comp rx=0 tx=0).stop 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 shutdown_connections 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91d0066500 0x7f91d00689c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e40b6610 0x7f91e415b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e40d0520 0x7f91e40b60d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 --2- 172.21.15.143:0/602874763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91cc0047d0 0x7f91e41f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 >> 172.21.15.143:0/602874763 conn(0x7f91e409c790 msgr2=0x7f91e40ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 shutdown_connections 2023-11-24T06:31:06.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.807+0000 7f91e9e6b640 1 -- 172.21.15.143:0/602874763 wait complete. 2023-11-24T06:31:06.834 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:31:06.834 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:31:06.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.971+0000 7f58e8b2a640 1 Processor -- start 2023-11-24T06:31:06.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.971+0000 7f58e8b2a640 1 -- start start 2023-11-24T06:31:06.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e8b2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 0x7f58e4164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e8b2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e415a050 con 0x7f58e40ccef0 2023-11-24T06:31:06.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e8b2a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e406e150 con 0x7f58e40ce2e0 2023-11-24T06:31:06.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e8b2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40722e0 con 0x7f58e40b1f80 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f58e40ccef0 0x7f58e406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52514/0 (socket says 172.21.15.143:52514) 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e259c640 1 -- 172.21.15.143:0/1970200616 learned_addr learned my addr 172.21.15.143:0/1970200616 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 0x7f58e4164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778902964 0 0) 0x7f58e415a050 con 0x7f58e40ccef0 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d0005740 con 0x7f58e40ccef0 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449197991 0 0) 0x7f58e406e150 con 0x7f58e40ce2e0 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e415a050 con 0x7f58e40ce2e0 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2618701746 0 0) 0x7f58d0005740 con 0x7f58e40ccef0 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 msgr2=0x7f58e4164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 0x7f58e4164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 >> v1:172.21.15.146:6789/0 conn(0x7f58e40ce2e0 legacy=0x7f58e406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4072860 con 0x7f58e40ccef0 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f58d4001680 con 0x7f58e40ccef0 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 >> v1:172.21.15.143:6789/0 conn(0x7f58e40ccef0 legacy=0x7f58e406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d0005d50 0x7f58d0006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 0x7f58d00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58d00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40722e0 con 0x7f58d0006f20 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d000dc50 con 0x7f58d0005d50 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d000ddc0 con 0x7f58e40b1f80 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58d00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e259c640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d0005d50 0x7f58d0006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:06.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58dbfff640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 0x7f58d00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:06.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 -- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 msgr2=0x7f58d00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:06.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e40b1f80 0x7f58d00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 -- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d0005d50 msgr2=0x7f58d0006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:06.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d0005d50 0x7f58d0006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.975+0000 7f58e2d9d640 1 -- 172.21.15.143:0/1970200616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0005740 con 0x7f58d0006f20 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e2d9d640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58d00073a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009fc0 tx=0x7f58dc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a127e80781479b2a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4007ea0 con 0x7f58d0006f20 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00f040 con 0x7f58d0006f20 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e1d9b640 1 -- 172.21.15.143:0/1970200616 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0a5da0 con 0x7f58d0006f20 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1970200616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 msgr2=0x7f58d00073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1970200616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58d00073a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009fc0 tx=0x7f58dc01cc60 comp rx=0 tx=0).stop 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e2d9d640 1 -- 172.21.15.143:0/1970200616 reap_dead start 2023-11-24T06:31:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1970200616 shutdown_connections 2023-11-24T06:31:06.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1970200616 >> 172.21.15.143:0/1970200616 conn(0x7f58e40b0c80 msgr2=0x7f58e40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:06.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1970200616 shutdown_connections 2023-11-24T06:31:06.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1970200616 wait complete. 2023-11-24T06:31:06.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 Processor -- start 2023-11-24T06:31:06.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.979+0000 7f58e8b2a640 1 -- start start 2023-11-24T06:31:06.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58e414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e415a200 0x7f58e4155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58e4155940 0x7f58e40ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4153c80 con 0x7f58d0006f20 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4154b40 con 0x7f58e4155940 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4158620 con 0x7f58e415a200 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58e414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58e414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58160/0 (socket says 172.21.15.143:58160) 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 -- 172.21.15.143:0/1948740715 learned_addr learned my addr 172.21.15.143:0/1948740715 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 -- 172.21.15.143:0/1948740715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e415a200 msgr2=0x7f58e4155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e415a200 0x7f58e4155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 -- 172.21.15.143:0/1948740715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58e4155940 msgr2=0x7f58e40ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58e4155940 0x7f58e40ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 -- 172.21.15.143:0/1948740715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e415d490 con 0x7f58d0006f20 2023-11-24T06:31:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e259c640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58e414aff0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f58d4012540 tx=0x7f58d4012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:06.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4014750 con 0x7f58d0006f20 2023-11-24T06:31:06.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d40148b0 con 0x7f58d0006f20 2023-11-24T06:31:06.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e4157a10 con 0x7f58d0006f20 2023-11-24T06:31:06.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4014c60 con 0x7f58d0006f20 2023-11-24T06:31:06.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e4157fd0 con 0x7f58d0006f20 2023-11-24T06:31:06.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e404e8c0 con 0x7f58d0006f20 2023-11-24T06:31:06.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.983+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f58d40153e0 con 0x7f58d0006f20 2023-11-24T06:31:06.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.987+0000 7f58daffd640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f58c4066530 0x7f58c40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:06.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.987+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58d40866c0 con 0x7f58d0006f20 2023-11-24T06:31:06.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.987+0000 7f58dbfff640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f58c4066530 0x7f58c40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:06.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.987+0000 7f58dbfff640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f58c4066530 0x7f58c40689f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f58e409d2b0 tx=0x7f58cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:06.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:06.991+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58d4053a50 con 0x7f58d0006f20 2023-11-24T06:31:07.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.175+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58e406e900 con 0x7f58d0006f20 2023-11-24T06:31:07.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.807+0000 7f58daffd640 1 -- 172.21.15.143:0/1948740715 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58d4057070 con 0x7f58d0006f20 2023-11-24T06:31:07.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f58c4066530 msgr2=0x7f58c40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f58c4066530 0x7f58c40689f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f58e409d2b0 tx=0x7f58cc009040 comp rx=0 tx=0).stop 2023-11-24T06:31:07.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 msgr2=0x7f58e414aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58e414aff0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f58d4012540 tx=0x7f58d4012a00 comp rx=0 tx=0).stop 2023-11-24T06:31:07.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 shutdown_connections 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f58c4066530 0x7f58c40689f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58e4155940 0x7f58e40ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58e415a200 0x7f58e4155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 --2- 172.21.15.143:0/1948740715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58d0006f20 0x7f58e414aff0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 >> 172.21.15.143:0/1948740715 conn(0x7f58e40b0c80 msgr2=0x7f58e40ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 shutdown_connections 2023-11-24T06:31:07.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.811+0000 7f58e8b2a640 1 -- 172.21.15.143:0/1948740715 wait complete. 2023-11-24T06:31:07.835 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:31:07.836 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:07.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5eeda91640 1 Processor -- start 2023-11-24T06:31:07.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5eeda91640 1 -- start start 2023-11-24T06:31:07.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5eeda91640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ee815d570 0x7f5ee806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:07.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5eeda91640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80d1cc0 con 0x7f5ee80d3020 2023-11-24T06:31:07.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5eeda91640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80d1fa0 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5eeda91640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80ce0b0 con 0x7f5ee815d570 2023-11-24T06:31:07.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5ee80d3020 0x7f5ee80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57884/0 (socket says 172.21.15.143:57884) 2023-11-24T06:31:07.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee6ffd640 1 -- 172.21.15.143:0/898235870 learned_addr learned my addr 172.21.15.143:0/898235870 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:07.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee77fe640 1 --2- 172.21.15.143:0/898235870 >> v2:172.21.15.146:3300/0 conn(0x7f5ee815d570 0x7f5ee806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:07.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee67fc640 1 -- 172.21.15.143:0/898235870 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600430652 0 0) 0x7f5ee80d1cc0 con 0x7f5ee80d3020 2023-11-24T06:31:07.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee67fc640 1 -- 172.21.15.143:0/898235870 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed0003530 con 0x7f5ee80d3020 2023-11-24T06:31:07.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee77fe640 1 -- 172.21.15.143:0/898235870 >> v1:172.21.15.146:6789/0 conn(0x7f5ee80ce8b0 legacy=0x7f5ee80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee77fe640 1 -- 172.21.15.143:0/898235870 >> v1:172.21.15.143:6789/0 conn(0x7f5ee80d3020 legacy=0x7f5ee80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.971+0000 7f5ee77fe640 1 -- 172.21.15.143:0/898235870 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80ce390 con 0x7f5ee815d570 2023-11-24T06:31:07.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5ee77fe640 1 --2- 172.21.15.143:0/898235870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee815d570 0x7f5ee806b9d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80097c0 tx=0x7f5ed801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf6822e63e0c27c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:07.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5ee67fc640 1 -- 172.21.15.143:0/898235870 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80a8050 con 0x7f5ee815d570 2023-11-24T06:31:07.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5ee67fc640 1 -- 172.21.15.143:0/898235870 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed80ac5f0 con 0x7f5ee815d570 2023-11-24T06:31:07.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5ee67fc640 1 -- 172.21.15.143:0/898235870 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80ac980 con 0x7f5ee815d570 2023-11-24T06:31:07.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 -- 172.21.15.143:0/898235870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee815d570 msgr2=0x7f5ee806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 --2- 172.21.15.143:0/898235870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee815d570 0x7f5ee806b9d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80097c0 tx=0x7f5ed801c480 comp rx=0 tx=0).stop 2023-11-24T06:31:07.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 -- 172.21.15.143:0/898235870 shutdown_connections 2023-11-24T06:31:07.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 --2- 172.21.15.143:0/898235870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee815d570 0x7f5ee806b9d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 -- 172.21.15.143:0/898235870 >> 172.21.15.143:0/898235870 conn(0x7f5ee808ceb0 msgr2=0x7f5ee809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:07.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 -- 172.21.15.143:0/898235870 shutdown_connections 2023-11-24T06:31:07.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.975+0000 7f5eeda91640 1 -- 172.21.15.143:0/898235870 wait complete. 2023-11-24T06:31:07.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 Processor -- start 2023-11-24T06:31:07.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 -- start start 2023-11-24T06:31:07.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 0x7f5ee80b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee80d3020 0x7f5ee815dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ee815d570 0x7f5ee815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b9210 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c87d0 con 0x7f5ee80d3020 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c8ab0 con 0x7f5ee815d570 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 0x7f5ee80b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 0x7f5ee80b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43054/0 (socket says 172.21.15.143:43054) 2023-11-24T06:31:07.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 -- 172.21.15.143:0/960516477 learned_addr learned my addr 172.21.15.143:0/960516477 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:07.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee6ffd640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee80d3020 0x7f5ee815dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee7fff640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ee815d570 0x7f5ee815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 -- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ee815d570 msgr2=0x7f5ee815e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ee815d570 0x7f5ee815e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 -- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee80d3020 msgr2=0x7f5ee815dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee80d3020 0x7f5ee815dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 -- 172.21.15.143:0/960516477 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8009420 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee7fff640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ee815d570 0x7f5ee815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee6ffd640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee80d3020 0x7f5ee815dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ee77fe640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 0x7f5ee80b8cd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80af040 tx=0x7f5ed801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:07.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8006e20 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed80b8660 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80b8a30 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80c8d90 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.979+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80b6020 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.983+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee8067520 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.983+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f5ed80b8b90 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.983+0000 7f5ecffff640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ed4066500 0x7f5ed40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:07.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.983+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ed811e510 con 0x7f5ee80ce8b0 2023-11-24T06:31:07.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.983+0000 7f5ee6ffd640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ed4066500 0x7f5ed40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:07.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.983+0000 7f5ee6ffd640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ed4066500 0x7f5ed40689c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ee815a0e0 tx=0x7f5edc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:07.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:07.987+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ed80eb700 con 0x7f5ee80ce8b0 2023-11-24T06:31:08.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee806b7b0 con 0x7f5ee80ce8b0 2023-11-24T06:31:08.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5ecffff640 1 -- 172.21.15.143:0/960516477 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5ed80eed20 con 0x7f5ee80ce8b0 2023-11-24T06:31:08.171 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:08.171 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:04.159303+0000","modified":"2023-11-24T06:31:07.177660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3877501822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3877501822},{"type":"v1","addr":"172.21.15.143:6837","nonce":3877501822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:31:08.171 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 25 2023-11-24T06:31:08.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ed4066500 msgr2=0x7f5ed40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ed4066500 0x7f5ed40689c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ee815a0e0 tx=0x7f5edc009040 comp rx=0 tx=0).stop 2023-11-24T06:31:08.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 msgr2=0x7f5ee80b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 0x7f5ee80b8cd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80af040 tx=0x7f5ed801acc0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 shutdown_connections 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5ed4066500 0x7f5ed40689c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ee815d570 0x7f5ee815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ee80d3020 0x7f5ee815dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 --2- 172.21.15.143:0/960516477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ee80ce8b0 0x7f5ee80b8cd0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 >> 172.21.15.143:0/960516477 conn(0x7f5ee808ceb0 msgr2=0x7f5ee80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 shutdown_connections 2023-11-24T06:31:08.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.167+0000 7f5eeda91640 1 -- 172.21.15.143:0/960516477 wait complete. 2023-11-24T06:31:08.192 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:08.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:31:08.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:31:08.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.327+0000 7fc001172640 1 Processor -- start 2023-11-24T06:31:08.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.327+0000 7fc001172640 1 -- start start 2023-11-24T06:31:08.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fc001172640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbffc0d3020 0x7fbffc0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fc001172640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbffc0ce8b0 0x7fbffc0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fc001172640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc06c0e0 con 0x7fbffc15d570 2023-11-24T06:31:08.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fc001172640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0d39f0 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fc001172640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0d1cc0 con 0x7fbffc0d3020 2023-11-24T06:31:08.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbffc0ce8b0 0x7fbffc0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbffc0ce8b0 0x7fbffc0ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43062/0 (socket says 172.21.15.143:43062) 2023-11-24T06:31:08.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 -- 172.21.15.143:0/227429593 learned_addr learned my addr 172.21.15.143:0/227429593 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:08.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbff3fff640 1 --2- 172.21.15.143:0/227429593 >> v2:172.21.15.146:3300/0 conn(0x7fbffc0d3020 0x7fbffc0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 -- 172.21.15.143:0/227429593 >> v2:172.21.15.146:3300/0 conn(0x7fbffc0d3020 msgr2=0x7fbffc0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:08.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 --2- 172.21.15.143:0/227429593 >> v2:172.21.15.146:3300/0 conn(0x7fbffc0d3020 0x7fbffc0d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 -- 172.21.15.143:0/227429593 >> v1:172.21.15.146:6789/0 conn(0x7fbffc15d570 legacy=0x7fbffc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:08.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 -- 172.21.15.143:0/227429593 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc0d1fa0 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.331+0000 7fbffb59e640 1 --2- 172.21.15.143:0/227429593 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0ced20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0b5f00 tx=0x7fbff401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618689d9896fd1a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:08.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fbffa59c640 1 -- 172.21.15.143:0/227429593 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff40a5820 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fbffa59c640 1 -- 172.21.15.143:0/227429593 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff40a5980 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fbffa59c640 1 -- 172.21.15.143:0/227429593 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff40a5d10 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 -- 172.21.15.143:0/227429593 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 msgr2=0x7fbffc0ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 --2- 172.21.15.143:0/227429593 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0ced20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0b5f00 tx=0x7fbff401c960 comp rx=0 tx=0).stop 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 -- 172.21.15.143:0/227429593 shutdown_connections 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 --2- 172.21.15.143:0/227429593 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0ced20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 --2- 172.21.15.143:0/227429593 >> v2:172.21.15.146:3300/0 conn(0x7fbffc0d3020 0x7fbffc0d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 -- 172.21.15.143:0/227429593 >> 172.21.15.143:0/227429593 conn(0x7fbffc08ceb0 msgr2=0x7fbffc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 -- 172.21.15.143:0/227429593 shutdown_connections 2023-11-24T06:31:08.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 -- 172.21.15.143:0/227429593 wait complete. 2023-11-24T06:31:08.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 Processor -- start 2023-11-24T06:31:08.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.335+0000 7fc001172640 1 -- start start 2023-11-24T06:31:08.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbffc0d3020 0x7fbffc0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbffc15d570 0x7fbffc15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0c84c0 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc15dc70 con 0x7fbffc15d570 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc15de80 con 0x7fbffc0d3020 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43078/0 (socket says 172.21.15.143:43078) 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 -- 172.21.15.143:0/776998979 learned_addr learned my addr 172.21.15.143:0/776998979 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbff3fff640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbffc0d3020 0x7fbffc0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffb59e640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbffc15d570 0x7fbffc15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 -- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbffc0d3020 msgr2=0x7fbffc0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbffc0d3020 0x7fbffc0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 -- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbffc15d570 msgr2=0x7fbffc15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbffc15d570 0x7fbffc15ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 -- 172.21.15.143:0/776998979 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4009b30 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbff3fff640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbffc0d3020 0x7fbffc0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffb59e640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbffc15d570 0x7fbffc15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbffad9d640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0c9960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00b410 tx=0x7fbfec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec004020 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec004180 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc15e160 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec011630 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc15e720 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc067520 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.339+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fbfec011790 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.343+0000 7fbff37fe640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbfdc066530 0x7fbfdc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.343+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfec083c00 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.343+0000 7fbff3fff640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbfdc066530 0x7fbfdc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.343+0000 7fbff3fff640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbfdc066530 0x7fbfdc0689f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0cd2e0 tx=0x7fbfe4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:08.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.347+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbfec051020 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.495+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbffc0cd830 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.495+0000 7fbff37fe640 1 -- 172.21.15.143:0/776998979 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16561 (secure 0 0 0) 0x7fbfec054640 con 0x7fbffc0ce8b0 2023-11-24T06:31:08.501 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:08.501 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":44,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:05.779870+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbfdc066530 msgr2=0x7fbfdc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbfdc066530 0x7fbfdc0689f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0cd2e0 tx=0x7fbfe4008040 comp rx=0 tx=0).stop 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 msgr2=0x7fbffc0c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0c9960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00b410 tx=0x7fbfec00b8d0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 shutdown_connections 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbfdc066530 0x7fbfdc0689f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbffc15d570 0x7fbffc15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbffc0d3020 0x7fbffc0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 --2- 172.21.15.143:0/776998979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbffc0ce8b0 0x7fbffc0c9960 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 >> 172.21.15.143:0/776998979 conn(0x7fbffc08ceb0 msgr2=0x7fbffc06cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:08.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 shutdown_connections 2023-11-24T06:31:08.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.499+0000 7fc001172640 1 -- 172.21.15.143:0/776998979 wait complete. 2023-11-24T06:31:08.522 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:31:08.522 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:08.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.695+0000 7f019e52a640 1 Processor -- start 2023-11-24T06:31:08.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019e52a640 1 -- start start 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019e52a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0198159a80 0x7f019806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019e52a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 0x7f019806d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019e52a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01980ae950 con 0x7f01980b2660 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019e52a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b1ef0 con 0x7f019806cee0 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019e52a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980adca0 con 0x7f0198159a80 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f01977fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 0x7f019806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f0197fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0198159a80 0x7f019806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f01977fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 0x7f019806d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:37832/0 (socket says 172.21.15.143:37832) 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f01977fe640 1 -- 172.21.15.143:0/3877390100 learned_addr learned my addr 172.21.15.143:0/3877390100 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:08.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f019cac7640 1 --1- 172.21.15.143:0/3877390100 >> v1:172.21.15.146:6789/0 conn(0x7f01980b2660 0x7f01980b2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:49676/0 (socket says 172.21.15.143:49676) 2023-11-24T06:31:08.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f0197fff640 1 -- 172.21.15.143:0/3877390100 >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 msgr2=0x7f019806d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:08.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f0197fff640 1 --2- 172.21.15.143:0/3877390100 >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 0x7f019806d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f0197fff640 1 -- 172.21.15.143:0/3877390100 >> v1:172.21.15.146:6789/0 conn(0x7f01980b2660 legacy=0x7f01980b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f0197fff640 1 -- 172.21.15.143:0/3877390100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019806d880 con 0x7f0198159a80 2023-11-24T06:31:08.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.699+0000 7f01977fe640 1 --2- 172.21.15.143:0/3877390100 >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 0x7f019806d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:08.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f0197fff640 1 --2- 172.21.15.143:0/3877390100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0198159a80 0x7f019806de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01880097c0 tx=0x7f018801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60b26add40806d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:08.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f0196ffd640 1 -- 172.21.15.143:0/3877390100 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880ab5f0 con 0x7f0198159a80 2023-11-24T06:31:08.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f0196ffd640 1 -- 172.21.15.143:0/3877390100 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01880ab750 con 0x7f0198159a80 2023-11-24T06:31:08.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f0196ffd640 1 -- 172.21.15.143:0/3877390100 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880abae0 con 0x7f0198159a80 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 -- 172.21.15.143:0/3877390100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0198159a80 msgr2=0x7f019806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 --2- 172.21.15.143:0/3877390100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0198159a80 0x7f019806de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01880097c0 tx=0x7f018801c450 comp rx=0 tx=0).stop 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 -- 172.21.15.143:0/3877390100 shutdown_connections 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 --2- 172.21.15.143:0/3877390100 >> v2:172.21.15.146:3300/0 conn(0x7f019806cee0 0x7f019806d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 --2- 172.21.15.143:0/3877390100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0198159a80 0x7f019806de50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 -- 172.21.15.143:0/3877390100 >> 172.21.15.143:0/3877390100 conn(0x7f01980b0bf0 msgr2=0x7f01980b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 -- 172.21.15.143:0/3877390100 shutdown_connections 2023-11-24T06:31:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.703+0000 7f019e52a640 1 -- 172.21.15.143:0/3877390100 wait complete. 2023-11-24T06:31:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 Processor -- start 2023-11-24T06:31:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 -- start start 2023-11-24T06:31:08.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019806cee0 0x7f019815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01980b2660 0x7f0198150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 0x7f01981507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019815cf10 con 0x7f0198159a80 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019814e5e0 con 0x7f019806cee0 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019814e8c0 con 0x7f01980b2660 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 0x7f01981507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 0x7f01981507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43092/0 (socket says 172.21.15.143:43092) 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 -- 172.21.15.143:0/1544187288 learned_addr learned my addr 172.21.15.143:0/1544187288 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f0197fff640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019806cee0 0x7f019815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f01977fe640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01980b2660 0x7f0198150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 -- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01980b2660 msgr2=0x7f0198150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01980b2660 0x7f0198150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 -- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019806cee0 msgr2=0x7f019815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019806cee0 0x7f019815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 -- 172.21.15.143:0/1544187288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c00a670 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019cac7640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 0x7f01981507b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f019000c7a0 tx=0x7f019000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000a640 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000a7a0 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188009420 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000ab10 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.707+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0198156340 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.711+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198067520 con 0x7f0198159a80 2023-11-24T06:31:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.711+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f019000ac70 con 0x7f0198159a80 2023-11-24T06:31:08.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.711+0000 7f0194ff9640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0184066530 0x7f01840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:08.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.711+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01900836b0 con 0x7f0198159a80 2023-11-24T06:31:08.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.711+0000 7f0197fff640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0184066530 0x7f01840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:08.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.711+0000 7f0197fff640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0184066530 0x7f01840689f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01880af000 tx=0x7f01880b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:08.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.715+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0190050af0 con 0x7f0198159a80 2023-11-24T06:31:08.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.863+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0198159e60 con 0x7f0184066530 2023-11-24T06:31:08.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.871+0000 7f0194ff9640 1 -- 172.21.15.143:0/1544187288 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276775 (secure 0 0 0) 0x7f01880ab4f0 con 0x7f0184066530 2023-11-24T06:31:08.880 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:08.881 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0184066530 msgr2=0x7f01840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0184066530 0x7f01840689f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01880af000 tx=0x7f01880b6040 comp rx=0 tx=0).stop 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 msgr2=0x7f01981507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 0x7f01981507b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f019000c7a0 tx=0x7f019000cc60 comp rx=0 tx=0).stop 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 shutdown_connections 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0184066530 0x7f01840689f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0198159a80 0x7f01981507b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01980b2660 0x7f0198150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 --2- 172.21.15.143:0/1544187288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019806cee0 0x7f019815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:08.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 >> 172.21.15.143:0/1544187288 conn(0x7f01980b0bf0 msgr2=0x7f01980b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:08.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 shutdown_connections 2023-11-24T06:31:08.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:08.875+0000 7f019e52a640 1 -- 172.21.15.143:0/1544187288 wait complete. 2023-11-24T06:31:08.900 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-11-24T06:31:08.222726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221056,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4956160,"data_stored":2668410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454257"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772924+0000","last_change":"2023-11-24T06:31:02.772924+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772924+0000","last_undegraded":"2023-11-24T06:31:02.772924+0000","last_fullsized":"2023-11-24T06:31:02.772924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777010+0000","last_change":"2023-11-24T06:31:02.777010+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777010+0000","last_undegraded":"2023-11-24T06:31:02.777010+0000","last_fullsized":"2023-11-24T06:31:02.777010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769778+0000","last_change":"2023-11-24T06:31:02.769778+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769778+0000","last_undegraded":"2023-11-24T06:31:02.769778+0000","last_fullsized":"2023-11-24T06:31:02.769778+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769990+0000","last_change":"2023-11-24T06:31:02.769990+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769990+0000","last_undegraded":"2023-11-24T06:31:02.769990+0000","last_fullsized":"2023-11-24T06:31:02.769990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773755+0000","last_change":"2023-11-24T06:31:02.773755+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773755+0000","last_undegraded":"2023-11-24T06:31:02.773755+0000","last_fullsized":"2023-11-24T06:31:02.773755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777179+0000","last_change":"2023-11-24T06:31:02.777179+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777179+0000","last_undegraded":"2023-11-24T06:31:02.777179+0000","last_fullsized":"2023-11-24T06:31:02.777179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773597+0000","last_change":"2023-11-24T06:31:02.773597+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773597+0000","last_undegraded":"2023-11-24T06:31:02.773597+0000","last_fullsized":"2023-11-24T06:31:02.773597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.778493+0000","last_change":"2023-11-24T06:31:02.778493+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.778493+0000","last_undegraded":"2023-11-24T06:31:02.778493+0000","last_fullsized":"2023-11-24T06:31:02.778493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777446+0000","last_change":"2023-11-24T06:31:02.777446+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777446+0000","last_undegraded":"2023-11-24T06:31:02.777446+0000","last_fullsized":"2023-11-24T06:31:02.777446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777493+0000","last_change":"2023-11-24T06:31:02.777493+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777493+0000","last_undegraded":"2023-11-24T06:31:02.777493+0000","last_fullsized":"2023-11-24T06:31:02.777493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770643+0000","last_change":"2023-11-24T06:31:02.770643+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770643+0000","last_undegraded":"2023-11-24T06:31:02.770643+0000","last_fullsized":"2023-11-24T06:31:02.770643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.775533+0000","last_change":"2023-11-24T06:31:02.775533+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.775533+0000","last_undegraded":"2023-11-24T06:31:02.775533+0000","last_fullsized":"2023-11-24T06:31:02.775533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773241+0000","last_change":"2023-11-24T06:31:02.773241+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773241+0000","last_undegraded":"2023-11-24T06:31:02.773241+0000","last_fullsized":"2023-11-24T06:31:02.773241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769990+0000","last_change":"2023-11-24T06:31:02.769990+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769990+0000","last_undegraded":"2023-11-24T06:31:02.769990+0000","last_fullsized":"2023-11-24T06:31:02.769990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772716+0000","last_change":"2023-11-24T06:31:02.772716+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772716+0000","last_undegraded":"2023-11-24T06:31:02.772716+0000","last_fullsized":"2023-11-24T06:31:02.772716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777998+0000","last_change":"2023-11-24T06:31:02.777998+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777998+0000","last_undegraded":"2023-11-24T06:31:02.777998+0000","last_fullsized":"2023-11-24T06:31:02.777998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.775541+0000","last_change":"2023-11-24T06:31:02.775541+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.775541+0000","last_undegraded":"2023-11-24T06:31:02.775541+0000","last_fullsized":"2023-11-24T06:31:02.775541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.776501+0000","last_change":"2023-11-24T06:31:02.776501+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.776501+0000","last_undegraded":"2023-11-24T06:31:02.776501+0000","last_fullsized":"2023-11-24T06:31:02.776501+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773762+0000","last_change":"2023-11-24T06:31:02.773762+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773762+0000","last_undegraded":"2023-11-24T06:31:02.773762+0000","last_fullsized":"2023-11-24T06:31:02.773762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772686+0000","last_change":"2023-11-24T06:31:02.772686+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772686+0000","last_undegraded":"2023-11-24T06:31:02.772686+0000","last_fullsized":"2023-11-24T06:31:02.772686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772579+0000","last_change":"2023-11-24T06:31:02.772579+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772579+0000","last_undegraded":"2023-11-24T06:31:02.772579+0000","last_fullsized":"2023-11-24T06:31:02.772579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.774095+0000","last_change":"2023-11-24T06:31:02.774095+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.774095+0000","last_undegraded":"2023-11-24T06:31:02.774095+0000","last_fullsized":"2023-11-24T06:31:02.774095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777174+0000","last_change":"2023-11-24T06:31:02.777174+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777174+0000","last_undegraded":"2023-11-24T06:31:02.777174+0000","last_fullsized":"2023-11-24T06:31:02.777174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770440+0000","last_change":"2023-11-24T06:31:02.770440+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770440+0000","last_undegraded":"2023-11-24T06:31:02.770440+0000","last_fullsized":"2023-11-24T06:31:02.770440+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773057+0000","last_change":"2023-11-24T06:31:02.773057+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773057+0000","last_undegraded":"2023-11-24T06:31:02.773057+0000","last_fullsized":"2023-11-24T06:31:02.773057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770023+0000","last_change":"2023-11-24T06:31:02.770023+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770023+0000","last_undegraded":"2023-11-24T06:31:02.770023+0000","last_fullsized":"2023-11-24T06:31:02.770023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769523+0000","last_change":"2023-11-24T06:31:02.769523+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769523+0000","last_undegraded":"2023-11-24T06:31:02.769523+0000","last_fullsized":"2023-11-24T06:31:02.769523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770129+0000","last_change":"2023-11-24T06:31:02.770129+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770129+0000","last_undegraded":"2023-11-24T06:31:02.770129+0000","last_fullsized":"2023-11-24T06:31:02.770129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.776366+0000","last_change":"2023-11-24T06:31:02.776366+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.776366+0000","last_undegraded":"2023-11-24T06:31:02.776366+0000","last_fullsized":"2023-11-24T06:31:02.776366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769523+0000","last_change":"2023-11-24T06:31:02.769523+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769523+0000","last_undegraded":"2023-11-24T06:31:02.769523+0000","last_fullsized":"2023-11-24T06:31:02.769523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777573+0000","last_change":"2023-11-24T06:31:02.777573+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777573+0000","last_undegraded":"2023-11-24T06:31:02.777573+0000","last_fullsized":"2023-11-24T06:31:02.777573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773570+0000","last_change":"2023-11-24T06:31:02.773570+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773570+0000","last_undegraded":"2023-11-24T06:31:02.773570+0000","last_fullsized":"2023-11-24T06:31:02.773570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-24T06:31:00.286059+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:00.286059+0000","last_peered":"2023-11-24T06:31:00.286059+0000","last_clean":"2023-11-24T06:31:00.286059+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:00.286059+0000","last_undegraded":"2023-11-24T06:31:00.286059+0000","last_fullsized":"2023-11-24T06:31:00.286059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.497},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.624}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.421},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.04}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.343},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.3160000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.443}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.377}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.747},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.747}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.872}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":779115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:08.906 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 Processor -- start 2023-11-24T06:31:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 -- start start 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36ac15a320 0x7f36ac0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac0b36c0 0x7f36ac070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36ac070bd0 0x7f36ac071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0b2430 con 0x7f36ac070bd0 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac15a700 con 0x7f36ac15a320 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36b225a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac071580 con 0x7f36ac0b36c0 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36ac070bd0 0x7f36ac071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36ac070bd0 0x7f36ac071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43094/0 (socket says 172.21.15.143:43094) 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 -- 172.21.15.143:0/3325596394 learned_addr learned my addr 172.21.15.143:0/3325596394 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36aaffd640 1 --2- 172.21.15.143:0/3325596394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac0b36c0 0x7f36ac070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36ab7fe640 1 --2- 172.21.15.143:0/3325596394 >> v2:172.21.15.146:3300/0 conn(0x7f36ac15a320 0x7f36ac0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 -- 172.21.15.143:0/3325596394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac0b36c0 msgr2=0x7f36ac070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:09.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 --2- 172.21.15.143:0/3325596394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac0b36c0 0x7f36ac070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 -- 172.21.15.143:0/3325596394 >> v2:172.21.15.146:3300/0 conn(0x7f36ac15a320 msgr2=0x7f36ac0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:09.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 --2- 172.21.15.143:0/3325596394 >> v2:172.21.15.146:3300/0 conn(0x7f36ac15a320 0x7f36ac0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.075+0000 7f36abfff640 1 -- 172.21.15.143:0/3325596394 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0b2620 con 0x7f36ac070bd0 2023-11-24T06:31:09.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36abfff640 1 --2- 172.21.15.143:0/3325596394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac070bd0 0x7f36ac071040 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f36ac06c0c0 tx=0x7f36a401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6630598947ccadaa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36aa7fc640 1 -- 172.21.15.143:0/3325596394 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40a5720 con 0x7f36ac070bd0 2023-11-24T06:31:09.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36aa7fc640 1 -- 172.21.15.143:0/3325596394 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a40a5880 con 0x7f36ac070bd0 2023-11-24T06:31:09.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36aa7fc640 1 -- 172.21.15.143:0/3325596394 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40a5c10 con 0x7f36ac070bd0 2023-11-24T06:31:09.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 -- 172.21.15.143:0/3325596394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac070bd0 msgr2=0x7f36ac071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 --2- 172.21.15.143:0/3325596394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac070bd0 0x7f36ac071040 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f36ac06c0c0 tx=0x7f36a401c9a0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 -- 172.21.15.143:0/3325596394 shutdown_connections 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 --2- 172.21.15.143:0/3325596394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac070bd0 0x7f36ac071040 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 --2- 172.21.15.143:0/3325596394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac0b36c0 0x7f36ac070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 --2- 172.21.15.143:0/3325596394 >> v2:172.21.15.146:3300/0 conn(0x7f36ac15a320 0x7f36ac0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 -- 172.21.15.143:0/3325596394 >> 172.21.15.143:0/3325596394 conn(0x7f36ac0b0bf0 msgr2=0x7f36ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 -- 172.21.15.143:0/3325596394 shutdown_connections 2023-11-24T06:31:09.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.079+0000 7f36b225a640 1 -- 172.21.15.143:0/3325596394 wait complete. 2023-11-24T06:31:09.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 Processor -- start 2023-11-24T06:31:09.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 -- start start 2023-11-24T06:31:09.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36ac070bd0 0x7f36ac14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 0x7f36ac155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac15a320 0x7f36ac09b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1501e0 con 0x7f36ac0b36c0 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac15bd70 con 0x7f36ac070bd0 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac156490 con 0x7f36ac15a320 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 0x7f36ac155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 0x7f36ac155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43096/0 (socket says 172.21.15.143:43096) 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 -- 172.21.15.143:0/1051780390 learned_addr learned my addr 172.21.15.143:0/1051780390 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36abfff640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac15a320 0x7f36ac09b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36ab7fe640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36ac070bd0 0x7f36ac14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 -- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac15a320 msgr2=0x7f36ac09b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac15a320 0x7f36ac09b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 -- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36ac070bd0 msgr2=0x7f36ac14fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36ac070bd0 0x7f36ac14fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 -- 172.21.15.143:0/1051780390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009b30 con 0x7f36ac0b36c0 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36ab7fe640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36ac070bd0 0x7f36ac14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36aaffd640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 0x7f36ac155f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f36a0008650 tx=0x7f36a0008b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0009d00 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0009e60 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0017610 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac09c0d0 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.083+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac09c690 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.087+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac15bf20 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.087+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f36a0017770 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.087+0000 7f3693fff640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3698066500 0x7f36980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.087+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36a0083df0 con 0x7f36ac0b36c0 2023-11-24T06:31:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.087+0000 7f36ab7fe640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3698066500 0x7f36980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.087+0000 7f36ab7fe640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3698066500 0x7f36980689c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f369c009b10 tx=0x7f369c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.091+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36ac15bf20 con 0x7f36ac0b36c0 2023-11-24T06:31:09.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.239+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36ac0b31a0 con 0x7f3698066500 2023-11-24T06:31:09.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.243+0000 7f3693fff640 1 -- 172.21.15.143:0/1051780390 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276775 (secure 0 0 0) 0x7f369c004030 con 0x7f3698066500 2023-11-24T06:31:09.251 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:09.253 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:09.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3698066500 msgr2=0x7f36980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3698066500 0x7f36980689c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f369c009b10 tx=0x7f369c008040 comp rx=0 tx=0).stop 2023-11-24T06:31:09.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 msgr2=0x7f36ac155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 0x7f36ac155f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f36a0008650 tx=0x7f36a0008b10 comp rx=0 tx=0).stop 2023-11-24T06:31:09.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 shutdown_connections 2023-11-24T06:31:09.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3698066500 0x7f36980689c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36ac15a320 0x7f36ac09b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36ac0b36c0 0x7f36ac155f50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 --2- 172.21.15.143:0/1051780390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36ac070bd0 0x7f36ac14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 >> 172.21.15.143:0/1051780390 conn(0x7f36ac0b0bf0 msgr2=0x7f36ac099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:09.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 shutdown_connections 2023-11-24T06:31:09.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.247+0000 7f36b225a640 1 -- 172.21.15.143:0/1051780390 wait complete. 2023-11-24T06:31:09.272 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-11-24T06:31:08.222726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221056,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4956160,"data_stored":2668410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454257"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772924+0000","last_change":"2023-11-24T06:31:02.772924+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772924+0000","last_undegraded":"2023-11-24T06:31:02.772924+0000","last_fullsized":"2023-11-24T06:31:02.772924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777010+0000","last_change":"2023-11-24T06:31:02.777010+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777010+0000","last_undegraded":"2023-11-24T06:31:02.777010+0000","last_fullsized":"2023-11-24T06:31:02.777010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769778+0000","last_change":"2023-11-24T06:31:02.769778+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769778+0000","last_undegraded":"2023-11-24T06:31:02.769778+0000","last_fullsized":"2023-11-24T06:31:02.769778+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769990+0000","last_change":"2023-11-24T06:31:02.769990+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769990+0000","last_undegraded":"2023-11-24T06:31:02.769990+0000","last_fullsized":"2023-11-24T06:31:02.769990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773755+0000","last_change":"2023-11-24T06:31:02.773755+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773755+0000","last_undegraded":"2023-11-24T06:31:02.773755+0000","last_fullsized":"2023-11-24T06:31:02.773755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777179+0000","last_change":"2023-11-24T06:31:02.777179+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777179+0000","last_undegraded":"2023-11-24T06:31:02.777179+0000","last_fullsized":"2023-11-24T06:31:02.777179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773597+0000","last_change":"2023-11-24T06:31:02.773597+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773597+0000","last_undegraded":"2023-11-24T06:31:02.773597+0000","last_fullsized":"2023-11-24T06:31:02.773597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.778493+0000","last_change":"2023-11-24T06:31:02.778493+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.778493+0000","last_undegraded":"2023-11-24T06:31:02.778493+0000","last_fullsized":"2023-11-24T06:31:02.778493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777446+0000","last_change":"2023-11-24T06:31:02.777446+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777446+0000","last_undegraded":"2023-11-24T06:31:02.777446+0000","last_fullsized":"2023-11-24T06:31:02.777446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777493+0000","last_change":"2023-11-24T06:31:02.777493+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777493+0000","last_undegraded":"2023-11-24T06:31:02.777493+0000","last_fullsized":"2023-11-24T06:31:02.777493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770643+0000","last_change":"2023-11-24T06:31:02.770643+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770643+0000","last_undegraded":"2023-11-24T06:31:02.770643+0000","last_fullsized":"2023-11-24T06:31:02.770643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.775533+0000","last_change":"2023-11-24T06:31:02.775533+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.775533+0000","last_undegraded":"2023-11-24T06:31:02.775533+0000","last_fullsized":"2023-11-24T06:31:02.775533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773241+0000","last_change":"2023-11-24T06:31:02.773241+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773241+0000","last_undegraded":"2023-11-24T06:31:02.773241+0000","last_fullsized":"2023-11-24T06:31:02.773241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769990+0000","last_change":"2023-11-24T06:31:02.769990+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769990+0000","last_undegraded":"2023-11-24T06:31:02.769990+0000","last_fullsized":"2023-11-24T06:31:02.769990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772716+0000","last_change":"2023-11-24T06:31:02.772716+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772716+0000","last_undegraded":"2023-11-24T06:31:02.772716+0000","last_fullsized":"2023-11-24T06:31:02.772716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777998+0000","last_change":"2023-11-24T06:31:02.777998+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777998+0000","last_undegraded":"2023-11-24T06:31:02.777998+0000","last_fullsized":"2023-11-24T06:31:02.777998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.775541+0000","last_change":"2023-11-24T06:31:02.775541+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.775541+0000","last_undegraded":"2023-11-24T06:31:02.775541+0000","last_fullsized":"2023-11-24T06:31:02.775541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.776501+0000","last_change":"2023-11-24T06:31:02.776501+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.776501+0000","last_undegraded":"2023-11-24T06:31:02.776501+0000","last_fullsized":"2023-11-24T06:31:02.776501+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773762+0000","last_change":"2023-11-24T06:31:02.773762+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773762+0000","last_undegraded":"2023-11-24T06:31:02.773762+0000","last_fullsized":"2023-11-24T06:31:02.773762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772686+0000","last_change":"2023-11-24T06:31:02.772686+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772686+0000","last_undegraded":"2023-11-24T06:31:02.772686+0000","last_fullsized":"2023-11-24T06:31:02.772686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772579+0000","last_change":"2023-11-24T06:31:02.772579+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772579+0000","last_undegraded":"2023-11-24T06:31:02.772579+0000","last_fullsized":"2023-11-24T06:31:02.772579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.774095+0000","last_change":"2023-11-24T06:31:02.774095+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.774095+0000","last_undegraded":"2023-11-24T06:31:02.774095+0000","last_fullsized":"2023-11-24T06:31:02.774095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777174+0000","last_change":"2023-11-24T06:31:02.777174+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777174+0000","last_undegraded":"2023-11-24T06:31:02.777174+0000","last_fullsized":"2023-11-24T06:31:02.777174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770440+0000","last_change":"2023-11-24T06:31:02.770440+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770440+0000","last_undegraded":"2023-11-24T06:31:02.770440+0000","last_fullsized":"2023-11-24T06:31:02.770440+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773057+0000","last_change":"2023-11-24T06:31:02.773057+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773057+0000","last_undegraded":"2023-11-24T06:31:02.773057+0000","last_fullsized":"2023-11-24T06:31:02.773057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770023+0000","last_change":"2023-11-24T06:31:02.770023+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770023+0000","last_undegraded":"2023-11-24T06:31:02.770023+0000","last_fullsized":"2023-11-24T06:31:02.770023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769523+0000","last_change":"2023-11-24T06:31:02.769523+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769523+0000","last_undegraded":"2023-11-24T06:31:02.769523+0000","last_fullsized":"2023-11-24T06:31:02.769523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770129+0000","last_change":"2023-11-24T06:31:02.770129+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770129+0000","last_undegraded":"2023-11-24T06:31:02.770129+0000","last_fullsized":"2023-11-24T06:31:02.770129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.776366+0000","last_change":"2023-11-24T06:31:02.776366+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.776366+0000","last_undegraded":"2023-11-24T06:31:02.776366+0000","last_fullsized":"2023-11-24T06:31:02.776366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769523+0000","last_change":"2023-11-24T06:31:02.769523+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769523+0000","last_undegraded":"2023-11-24T06:31:02.769523+0000","last_fullsized":"2023-11-24T06:31:02.769523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777573+0000","last_change":"2023-11-24T06:31:02.777573+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777573+0000","last_undegraded":"2023-11-24T06:31:02.777573+0000","last_fullsized":"2023-11-24T06:31:02.777573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773570+0000","last_change":"2023-11-24T06:31:02.773570+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773570+0000","last_undegraded":"2023-11-24T06:31:02.773570+0000","last_fullsized":"2023-11-24T06:31:02.773570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-24T06:31:00.286059+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:00.286059+0000","last_peered":"2023-11-24T06:31:00.286059+0000","last_clean":"2023-11-24T06:31:00.286059+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:00.286059+0000","last_undegraded":"2023-11-24T06:31:00.286059+0000","last_fullsized":"2023-11-24T06:31:00.286059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.497},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.624}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.421},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.04}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.343},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.3160000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.443}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.377}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.747},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.747}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.872}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":779115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:09.277 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:09.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.447+0000 7f434d69a640 1 Processor -- start 2023-11-24T06:31:09.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f434d69a640 1 -- start start 2023-11-24T06:31:09.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f434d69a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4348147020 0x7f43480d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f434d69a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43480b3560 0x7f434806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f434d69a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43480cee60 con 0x7f43480d01e0 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f434d69a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43480cf140 con 0x7f4348147020 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f434d69a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43480cf420 con 0x7f43480b3560 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f43467fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f43480d01e0 0x7f43480b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57898/0 (socket says 172.21.15.143:57898) 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f43467fc640 1 -- 172.21.15.143:0/960658052 learned_addr learned my addr 172.21.15.143:0/960658052 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4346ffd640 1 --2- 172.21.15.143:0/960658052 >> v2:172.21.15.143:3300/0 conn(0x7f4348147020 0x7f43480d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f43477fe640 1 --2- 172.21.15.143:0/960658052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43480b3560 0x7f434806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4345ffb640 1 -- 172.21.15.143:0/960658052 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335420373 0 0) 0x7f43480cee60 con 0x7f43480d01e0 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4345ffb640 1 -- 172.21.15.143:0/960658052 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4330003530 con 0x7f43480d01e0 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4346ffd640 1 -- 172.21.15.143:0/960658052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43480b3560 msgr2=0x7f434806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:09.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4346ffd640 1 --2- 172.21.15.143:0/960658052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43480b3560 0x7f434806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4346ffd640 1 -- 172.21.15.143:0/960658052 >> v1:172.21.15.143:6789/0 conn(0x7f43480d01e0 legacy=0x7f43480b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.451+0000 7f4346ffd640 1 -- 172.21.15.143:0/960658052 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480cf700 con 0x7f4348147020 2023-11-24T06:31:09.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f4346ffd640 1 --2- 172.21.15.143:0/960658052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4348147020 0x7f43480d1a90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f43380097c0 tx=0x7f433801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a109c4c60c86e59c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f4345ffb640 1 -- 172.21.15.143:0/960658052 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380ab650 con 0x7f4348147020 2023-11-24T06:31:09.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f4345ffb640 1 -- 172.21.15.143:0/960658052 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43380ab7b0 con 0x7f4348147020 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f4345ffb640 1 -- 172.21.15.143:0/960658052 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380abb20 con 0x7f4348147020 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 -- 172.21.15.143:0/960658052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4348147020 msgr2=0x7f43480d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 --2- 172.21.15.143:0/960658052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4348147020 0x7f43480d1a90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f43380097c0 tx=0x7f433801c450 comp rx=0 tx=0).stop 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 -- 172.21.15.143:0/960658052 shutdown_connections 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 --2- 172.21.15.143:0/960658052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43480b3560 0x7f434806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 --2- 172.21.15.143:0/960658052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4348147020 0x7f43480d1a90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 -- 172.21.15.143:0/960658052 >> 172.21.15.143:0/960658052 conn(0x7f4348060fd0 msgr2=0x7f43480613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 -- 172.21.15.143:0/960658052 shutdown_connections 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 -- 172.21.15.143:0/960658052 wait complete. 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 Processor -- start 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.455+0000 7f434d69a640 1 -- start start 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 0x7f434815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43480d01e0 0x7f4348160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4348147020 0x7f434813f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434815bd40 con 0x7f43480b3560 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434815e810 con 0x7f43480d01e0 2023-11-24T06:31:09.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434815eaf0 con 0x7f4348147020 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 0x7f434815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 0x7f434815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43122/0 (socket says 172.21.15.143:43122) 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 -- 172.21.15.143:0/2839485505 learned_addr learned my addr 172.21.15.143:0/2839485505 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f43477fe640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4348147020 0x7f434813f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 -- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4348147020 msgr2=0x7f434813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4348147020 0x7f434813f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 -- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43480d01e0 msgr2=0x7f4348160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43480d01e0 0x7f4348160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 -- 172.21.15.143:0/2839485505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338009420 con 0x7f43480b3560 2023-11-24T06:31:09.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f43477fe640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4348147020 0x7f434813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f4346ffd640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 0x7f434815b800 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f43380ad040 tx=0x7f433801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380bf610 con 0x7f43480b3560 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43380bf770 con 0x7f43480b3560 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434815fa70 con 0x7f43480b3560 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380bfae0 con 0x7f43480b3560 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43481607b0 con 0x7f43480b3560 2023-11-24T06:31:09.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.459+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348067520 con 0x7f43480b3560 2023-11-24T06:31:09.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.463+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f43380bfc40 con 0x7f43480b3560 2023-11-24T06:31:09.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.463+0000 7f432f7fe640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4334066500 0x7f43340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.463+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f433811ea20 con 0x7f43480b3560 2023-11-24T06:31:09.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.463+0000 7f43467fc640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4334066500 0x7f43340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.463+0000 7f43467fc640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4334066500 0x7f43340689c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f433c007fd0 tx=0x7f433c007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.467+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43380ebe40 con 0x7f43480b3560 2023-11-24T06:31:09.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.619+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f434815f8f0 con 0x7f4334066500 2023-11-24T06:31:09.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.627+0000 7f432f7fe640 1 -- 172.21.15.143:0/2839485505 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276775 (secure 0 0 0) 0x7f433c0058a0 con 0x7f4334066500 2023-11-24T06:31:09.634 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:09.636 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:09.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4334066500 msgr2=0x7f43340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4334066500 0x7f43340689c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f433c007fd0 tx=0x7f433c007900 comp rx=0 tx=0).stop 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 msgr2=0x7f434815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 0x7f434815b800 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f43380ad040 tx=0x7f433801ac90 comp rx=0 tx=0).stop 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 shutdown_connections 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4334066500 0x7f43340689c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4348147020 0x7f434813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43480d01e0 0x7f4348160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 --2- 172.21.15.143:0/2839485505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43480b3560 0x7f434815b800 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 >> 172.21.15.143:0/2839485505 conn(0x7f4348060fd0 msgr2=0x7f43480cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:09.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 shutdown_connections 2023-11-24T06:31:09.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.631+0000 7f434d69a640 1 -- 172.21.15.143:0/2839485505 wait complete. 2023-11-24T06:31:09.655 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-11-24T06:31:08.222726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221056,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4956160,"data_stored":2668410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454257"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772924+0000","last_change":"2023-11-24T06:31:02.772924+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772924+0000","last_undegraded":"2023-11-24T06:31:02.772924+0000","last_fullsized":"2023-11-24T06:31:02.772924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777010+0000","last_change":"2023-11-24T06:31:02.777010+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777010+0000","last_undegraded":"2023-11-24T06:31:02.777010+0000","last_fullsized":"2023-11-24T06:31:02.777010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769778+0000","last_change":"2023-11-24T06:31:02.769778+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769778+0000","last_undegraded":"2023-11-24T06:31:02.769778+0000","last_fullsized":"2023-11-24T06:31:02.769778+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769990+0000","last_change":"2023-11-24T06:31:02.769990+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769990+0000","last_undegraded":"2023-11-24T06:31:02.769990+0000","last_fullsized":"2023-11-24T06:31:02.769990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773755+0000","last_change":"2023-11-24T06:31:02.773755+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773755+0000","last_undegraded":"2023-11-24T06:31:02.773755+0000","last_fullsized":"2023-11-24T06:31:02.773755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777179+0000","last_change":"2023-11-24T06:31:02.777179+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777179+0000","last_undegraded":"2023-11-24T06:31:02.777179+0000","last_fullsized":"2023-11-24T06:31:02.777179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773597+0000","last_change":"2023-11-24T06:31:02.773597+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773597+0000","last_undegraded":"2023-11-24T06:31:02.773597+0000","last_fullsized":"2023-11-24T06:31:02.773597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.778493+0000","last_change":"2023-11-24T06:31:02.778493+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.778493+0000","last_undegraded":"2023-11-24T06:31:02.778493+0000","last_fullsized":"2023-11-24T06:31:02.778493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777446+0000","last_change":"2023-11-24T06:31:02.777446+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777446+0000","last_undegraded":"2023-11-24T06:31:02.777446+0000","last_fullsized":"2023-11-24T06:31:02.777446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777493+0000","last_change":"2023-11-24T06:31:02.777493+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777493+0000","last_undegraded":"2023-11-24T06:31:02.777493+0000","last_fullsized":"2023-11-24T06:31:02.777493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770643+0000","last_change":"2023-11-24T06:31:02.770643+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770643+0000","last_undegraded":"2023-11-24T06:31:02.770643+0000","last_fullsized":"2023-11-24T06:31:02.770643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.775533+0000","last_change":"2023-11-24T06:31:02.775533+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.775533+0000","last_undegraded":"2023-11-24T06:31:02.775533+0000","last_fullsized":"2023-11-24T06:31:02.775533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773241+0000","last_change":"2023-11-24T06:31:02.773241+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773241+0000","last_undegraded":"2023-11-24T06:31:02.773241+0000","last_fullsized":"2023-11-24T06:31:02.773241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769990+0000","last_change":"2023-11-24T06:31:02.769990+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769990+0000","last_undegraded":"2023-11-24T06:31:02.769990+0000","last_fullsized":"2023-11-24T06:31:02.769990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772716+0000","last_change":"2023-11-24T06:31:02.772716+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772716+0000","last_undegraded":"2023-11-24T06:31:02.772716+0000","last_fullsized":"2023-11-24T06:31:02.772716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777998+0000","last_change":"2023-11-24T06:31:02.777998+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777998+0000","last_undegraded":"2023-11-24T06:31:02.777998+0000","last_fullsized":"2023-11-24T06:31:02.777998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.775541+0000","last_change":"2023-11-24T06:31:02.775541+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.775541+0000","last_undegraded":"2023-11-24T06:31:02.775541+0000","last_fullsized":"2023-11-24T06:31:02.775541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.776501+0000","last_change":"2023-11-24T06:31:02.776501+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.776501+0000","last_undegraded":"2023-11-24T06:31:02.776501+0000","last_fullsized":"2023-11-24T06:31:02.776501+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773762+0000","last_change":"2023-11-24T06:31:02.773762+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773762+0000","last_undegraded":"2023-11-24T06:31:02.773762+0000","last_fullsized":"2023-11-24T06:31:02.773762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772686+0000","last_change":"2023-11-24T06:31:02.772686+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772686+0000","last_undegraded":"2023-11-24T06:31:02.772686+0000","last_fullsized":"2023-11-24T06:31:02.772686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.772579+0000","last_change":"2023-11-24T06:31:02.772579+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.772579+0000","last_undegraded":"2023-11-24T06:31:02.772579+0000","last_fullsized":"2023-11-24T06:31:02.772579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.774095+0000","last_change":"2023-11-24T06:31:02.774095+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.774095+0000","last_undegraded":"2023-11-24T06:31:02.774095+0000","last_fullsized":"2023-11-24T06:31:02.774095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777174+0000","last_change":"2023-11-24T06:31:02.777174+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777174+0000","last_undegraded":"2023-11-24T06:31:02.777174+0000","last_fullsized":"2023-11-24T06:31:02.777174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770440+0000","last_change":"2023-11-24T06:31:02.770440+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770440+0000","last_undegraded":"2023-11-24T06:31:02.770440+0000","last_fullsized":"2023-11-24T06:31:02.770440+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773057+0000","last_change":"2023-11-24T06:31:02.773057+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773057+0000","last_undegraded":"2023-11-24T06:31:02.773057+0000","last_fullsized":"2023-11-24T06:31:02.773057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770023+0000","last_change":"2023-11-24T06:31:02.770023+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770023+0000","last_undegraded":"2023-11-24T06:31:02.770023+0000","last_fullsized":"2023-11-24T06:31:02.770023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769523+0000","last_change":"2023-11-24T06:31:02.769523+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769523+0000","last_undegraded":"2023-11-24T06:31:02.769523+0000","last_fullsized":"2023-11-24T06:31:02.769523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.770129+0000","last_change":"2023-11-24T06:31:02.770129+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.770129+0000","last_undegraded":"2023-11-24T06:31:02.770129+0000","last_fullsized":"2023-11-24T06:31:02.770129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.776366+0000","last_change":"2023-11-24T06:31:02.776366+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.776366+0000","last_undegraded":"2023-11-24T06:31:02.776366+0000","last_fullsized":"2023-11-24T06:31:02.776366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.769523+0000","last_change":"2023-11-24T06:31:02.769523+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.769523+0000","last_undegraded":"2023-11-24T06:31:02.769523+0000","last_fullsized":"2023-11-24T06:31:02.769523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.777573+0000","last_change":"2023-11-24T06:31:02.777573+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.777573+0000","last_undegraded":"2023-11-24T06:31:02.777573+0000","last_fullsized":"2023-11-24T06:31:02.777573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:03.766384+0000","last_change":"2023-11-24T06:31:03.766384+0000","last_active":"2023-11-24T06:31:03.766384+0000","last_peered":"2023-11-24T06:31:03.766384+0000","last_clean":"2023-11-24T06:31:03.766384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:03.766384+0000","last_undegraded":"2023-11-24T06:31:03.766384+0000","last_fullsized":"2023-11-24T06:31:03.766384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-24T06:31:02.773570+0000","last_change":"2023-11-24T06:31:02.773570+0000","last_active":"2023-11-24T06:31:02.759964+0000","last_peered":"2023-11-24T06:31:02.759964+0000","last_clean":"2023-11-24T06:31:02.759964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:02.773570+0000","last_undegraded":"2023-11-24T06:31:02.773570+0000","last_fullsized":"2023-11-24T06:31:02.773570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-24T06:31:00.286059+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:00.286059+0000","last_peered":"2023-11-24T06:31:00.286059+0000","last_clean":"2023-11-24T06:31:00.286059+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:00.286059+0000","last_undegraded":"2023-11-24T06:31:00.286059+0000","last_fullsized":"2023-11-24T06:31:00.286059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.497},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.624}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.421},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.04}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.343},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.3160000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.443}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.377}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.747},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":466944,"data_stored":183899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.747}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.872}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":779115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:09.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-11-24T06:31:09.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-11-24T06:31:09.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-11-24T06:31:09.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-11-24T06:31:09.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-11-24T06:31:09.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-11-24T06:31:09.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-11-24T06:31:09.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-11-24T06:31:09.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-24T06:31:09.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-24T06:31:09.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.772924+0000', 'last_change': '2023-11-24T06:31:02.772924+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.772924+0000', 'last_undegraded': '2023-11-24T06:31:02.772924+0000', 'last_fullsized': '2023-11-24T06:31:02.772924+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-24T06:31:09.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777010+0000', 'last_change': '2023-11-24T06:31:02.777010+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777010+0000', 'last_undegraded': '2023-11-24T06:31:02.777010+0000', 'last_fullsized': '2023-11-24T06:31:02.777010+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.769778+0000', 'last_change': '2023-11-24T06:31:02.769778+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.769778+0000', 'last_undegraded': '2023-11-24T06:31:02.769778+0000', 'last_fullsized': '2023-11-24T06:31:02.769778+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.769990+0000', 'last_change': '2023-11-24T06:31:02.769990+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.769990+0000', 'last_undegraded': '2023-11-24T06:31:02.769990+0000', 'last_fullsized': '2023-11-24T06:31:02.769990+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:31:09.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.773755+0000', 'last_change': '2023-11-24T06:31:02.773755+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.773755+0000', 'last_undegraded': '2023-11-24T06:31:02.773755+0000', 'last_fullsized': '2023-11-24T06:31:02.773755+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777179+0000', 'last_change': '2023-11-24T06:31:02.777179+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777179+0000', 'last_undegraded': '2023-11-24T06:31:02.777179+0000', 'last_fullsized': '2023-11-24T06:31:02.777179+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-24T06:31:09.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.773597+0000', 'last_change': '2023-11-24T06:31:02.773597+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.773597+0000', 'last_undegraded': '2023-11-24T06:31:02.773597+0000', 'last_fullsized': '2023-11-24T06:31:02.773597+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.778493+0000', 'last_change': '2023-11-24T06:31:02.778493+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.778493+0000', 'last_undegraded': '2023-11-24T06:31:02.778493+0000', 'last_fullsized': '2023-11-24T06:31:02.778493+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777446+0000', 'last_change': '2023-11-24T06:31:02.777446+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777446+0000', 'last_undegraded': '2023-11-24T06:31:02.777446+0000', 'last_fullsized': '2023-11-24T06:31:02.777446+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-11-24T06:31:09.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777493+0000', 'last_change': '2023-11-24T06:31:02.777493+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777493+0000', 'last_undegraded': '2023-11-24T06:31:02.777493+0000', 'last_fullsized': '2023-11-24T06:31:02.777493+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.770643+0000', 'last_change': '2023-11-24T06:31:02.770643+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.770643+0000', 'last_undegraded': '2023-11-24T06:31:02.770643+0000', 'last_fullsized': '2023-11-24T06:31:02.770643+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-24T06:31:09.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.775533+0000', 'last_change': '2023-11-24T06:31:02.775533+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.775533+0000', 'last_undegraded': '2023-11-24T06:31:02.775533+0000', 'last_fullsized': '2023-11-24T06:31:02.775533+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.773241+0000', 'last_change': '2023-11-24T06:31:02.773241+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.773241+0000', 'last_undegraded': '2023-11-24T06:31:02.773241+0000', 'last_fullsized': '2023-11-24T06:31:02.773241+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-24T06:31:09.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.769990+0000', 'last_change': '2023-11-24T06:31:02.769990+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.769990+0000', 'last_undegraded': '2023-11-24T06:31:02.769990+0000', 'last_fullsized': '2023-11-24T06:31:02.769990+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:31:09.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-24T06:31:09.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.772716+0000', 'last_change': '2023-11-24T06:31:02.772716+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.772716+0000', 'last_undegraded': '2023-11-24T06:31:02.772716+0000', 'last_fullsized': '2023-11-24T06:31:02.772716+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777998+0000', 'last_change': '2023-11-24T06:31:02.777998+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777998+0000', 'last_undegraded': '2023-11-24T06:31:02.777998+0000', 'last_fullsized': '2023-11-24T06:31:02.777998+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.775541+0000', 'last_change': '2023-11-24T06:31:02.775541+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.775541+0000', 'last_undegraded': '2023-11-24T06:31:02.775541+0000', 'last_fullsized': '2023-11-24T06:31:02.775541+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-24T06:31:09.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.776501+0000', 'last_change': '2023-11-24T06:31:02.776501+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.776501+0000', 'last_undegraded': '2023-11-24T06:31:02.776501+0000', 'last_fullsized': '2023-11-24T06:31:02.776501+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.773762+0000', 'last_change': '2023-11-24T06:31:02.773762+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.773762+0000', 'last_undegraded': '2023-11-24T06:31:02.773762+0000', 'last_fullsized': '2023-11-24T06:31:02.773762+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-24T06:31:09.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.772686+0000', 'last_change': '2023-11-24T06:31:02.772686+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.772686+0000', 'last_undegraded': '2023-11-24T06:31:02.772686+0000', 'last_fullsized': '2023-11-24T06:31:02.772686+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.772579+0000', 'last_change': '2023-11-24T06:31:02.772579+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.772579+0000', 'last_undegraded': '2023-11-24T06:31:02.772579+0000', 'last_fullsized': '2023-11-24T06:31:02.772579+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.774095+0000', 'last_change': '2023-11-24T06:31:02.774095+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.774095+0000', 'last_undegraded': '2023-11-24T06:31:02.774095+0000', 'last_fullsized': '2023-11-24T06:31:02.774095+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777174+0000', 'last_change': '2023-11-24T06:31:02.777174+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777174+0000', 'last_undegraded': '2023-11-24T06:31:02.777174+0000', 'last_fullsized': '2023-11-24T06:31:02.777174+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.770440+0000', 'last_change': '2023-11-24T06:31:02.770440+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.770440+0000', 'last_undegraded': '2023-11-24T06:31:02.770440+0000', 'last_fullsized': '2023-11-24T06:31:02.770440+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.773057+0000', 'last_change': '2023-11-24T06:31:02.773057+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.773057+0000', 'last_undegraded': '2023-11-24T06:31:02.773057+0000', 'last_fullsized': '2023-11-24T06:31:02.773057+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-24T06:31:09.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.770023+0000', 'last_change': '2023-11-24T06:31:02.770023+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.770023+0000', 'last_undegraded': '2023-11-24T06:31:02.770023+0000', 'last_fullsized': '2023-11-24T06:31:02.770023+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.769523+0000', 'last_change': '2023-11-24T06:31:02.769523+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.769523+0000', 'last_undegraded': '2023-11-24T06:31:02.769523+0000', 'last_fullsized': '2023-11-24T06:31:02.769523+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-24T06:31:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.770129+0000', 'last_change': '2023-11-24T06:31:02.770129+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.770129+0000', 'last_undegraded': '2023-11-24T06:31:02.770129+0000', 'last_fullsized': '2023-11-24T06:31:02.770129+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.776366+0000', 'last_change': '2023-11-24T06:31:02.776366+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.776366+0000', 'last_undegraded': '2023-11-24T06:31:02.776366+0000', 'last_fullsized': '2023-11-24T06:31:02.776366+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.769523+0000', 'last_change': '2023-11-24T06:31:02.769523+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.769523+0000', 'last_undegraded': '2023-11-24T06:31:02.769523+0000', 'last_fullsized': '2023-11-24T06:31:02.769523+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-24T06:31:09.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-24T06:31:09.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.777573+0000', 'last_change': '2023-11-24T06:31:02.777573+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.777573+0000', 'last_undegraded': '2023-11-24T06:31:02.777573+0000', 'last_fullsized': '2023-11-24T06:31:02.777573+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:31:09.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-24T06:31:09.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:31:03.766384+0000', 'last_change': '2023-11-24T06:31:03.766384+0000', 'last_active': '2023-11-24T06:31:03.766384+0000', 'last_peered': '2023-11-24T06:31:03.766384+0000', 'last_clean': '2023-11-24T06:31:03.766384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:03.766384+0000', 'last_undegraded': '2023-11-24T06:31:03.766384+0000', 'last_fullsized': '2023-11-24T06:31:03.766384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:03.766384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:31:09.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-24T06:31:09.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:31:02.773570+0000', 'last_change': '2023-11-24T06:31:02.773570+0000', 'last_active': '2023-11-24T06:31:02.759964+0000', 'last_peered': '2023-11-24T06:31:02.759964+0000', 'last_clean': '2023-11-24T06:31:02.759964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:31:02.773570+0000', 'last_undegraded': '2023-11-24T06:31:02.773570+0000', 'last_fullsized': '2023-11-24T06:31:02.773570+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'last_clean_scrub_stamp': '2023-11-24T06:31:02.759964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:31:09.681 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T06:31:09.764 INFO:tasks.ceph.mds.c.smithi143.stderr:2023-11-24T06:31:09.759+0000 7f9468164640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:31:09.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.831+0000 7fbc5a38a640 1 Processor -- start 2023-11-24T06:31:09.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.831+0000 7fbc5a38a640 1 -- start start 2023-11-24T06:31:09.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.831+0000 7fbc5a38a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbc54161550 0x7fbc540ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.831+0000 7fbc5a38a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc54161c70 con 0x7fbc5406d960 2023-11-24T06:31:09.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.831+0000 7fbc5a38a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5406a5b0 con 0x7fbc5415d170 2023-11-24T06:31:09.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.831+0000 7fbc5a38a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5406b410 con 0x7fbc54161550 2023-11-24T06:31:09.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc59b89640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbc54161550 0x7fbc540ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc58b87640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fbc5406d960 0x7fbc54160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57906/0 (socket says 172.21.15.143:57906) 2023-11-24T06:31:09.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc58b87640 1 -- 172.21.15.143:0/2492415985 learned_addr learned my addr 172.21.15.143:0/2492415985 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:09.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc4bfff640 1 -- 172.21.15.143:0/2492415985 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641645733 0 0) 0x7fbc54161c70 con 0x7fbc5406d960 2023-11-24T06:31:09.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc4bfff640 1 -- 172.21.15.143:0/2492415985 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc40003530 con 0x7fbc5406d960 2023-11-24T06:31:09.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc59b89640 1 -- 172.21.15.143:0/2492415985 >> v1:172.21.15.146:6789/0 conn(0x7fbc5415d170 legacy=0x7fbc5406b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc4bfff640 1 -- 172.21.15.143:0/2492415985 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982211705 0 0) 0x7fbc5406a5b0 con 0x7fbc5415d170 2023-11-24T06:31:09.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc59b89640 1 -- 172.21.15.143:0/2492415985 >> v1:172.21.15.143:6789/0 conn(0x7fbc5406d960 legacy=0x7fbc54160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc59b89640 1 -- 172.21.15.143:0/2492415985 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5406bfb0 con 0x7fbc54161550 2023-11-24T06:31:09.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc59b89640 1 --2- 172.21.15.143:0/2492415985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc54161550 0x7fbc540ac850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009dc0 tx=0x7fbc4c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5c3e62869a348e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc4bfff640 1 -- 172.21.15.143:0/2492415985 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0a59c0 con 0x7fbc54161550 2023-11-24T06:31:09.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc4bfff640 1 -- 172.21.15.143:0/2492415985 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c0a5b20 con 0x7fbc54161550 2023-11-24T06:31:09.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.835+0000 7fbc4bfff640 1 -- 172.21.15.143:0/2492415985 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0ad440 con 0x7fbc54161550 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- 172.21.15.143:0/2492415985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc54161550 msgr2=0x7fbc540ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/2492415985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc54161550 0x7fbc540ac850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009dc0 tx=0x7fbc4c01c900 comp rx=0 tx=0).stop 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- 172.21.15.143:0/2492415985 shutdown_connections 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/2492415985 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc54161550 0x7fbc540ac850 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- 172.21.15.143:0/2492415985 >> 172.21.15.143:0/2492415985 conn(0x7fbc540cf610 msgr2=0x7fbc540cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- 172.21.15.143:0/2492415985 shutdown_connections 2023-11-24T06:31:09.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- 172.21.15.143:0/2492415985 wait complete. 2023-11-24T06:31:09.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 Processor -- start 2023-11-24T06:31:09.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- start start 2023-11-24T06:31:09.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 0x7fbc54155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc5415d170 0x7fbc54156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc54161550 0x7fbc540ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc54157500 con 0x7fbc5406d960 2023-11-24T06:31:09.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc54156b30 con 0x7fbc54161550 2023-11-24T06:31:09.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc5a38a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540cf410 con 0x7fbc5415d170 2023-11-24T06:31:09.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 0x7fbc54155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 0x7fbc54155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43146/0 (socket says 172.21.15.143:43146) 2023-11-24T06:31:09.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 -- 172.21.15.143:0/384201390 learned_addr learned my addr 172.21.15.143:0/384201390 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:09.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59b89640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc54161550 0x7fbc540ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc58b87640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc5415d170 0x7fbc54156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 -- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc5415d170 msgr2=0x7fbc54156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc5415d170 0x7fbc54156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 -- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc54161550 msgr2=0x7fbc540ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:09.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc54161550 0x7fbc540ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:09.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 -- 172.21.15.143:0/384201390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c009a70 con 0x7fbc5406d960 2023-11-24T06:31:09.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59b89640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc54161550 0x7fbc540ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:09.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.839+0000 7fbc59388640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 0x7fbc54155890 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c4d0 tx=0x7fbc5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50005480 con 0x7fbc5406d960 2023-11-24T06:31:09.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc50003600 con 0x7fbc5406d960 2023-11-24T06:31:09.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc54155f20 con 0x7fbc5406d960 2023-11-24T06:31:09.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500039b0 con 0x7fbc5406d960 2023-11-24T06:31:09.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc541564e0 con 0x7fbc5406d960 2023-11-24T06:31:09.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc54067a40 con 0x7fbc5406d960 2023-11-24T06:31:09.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fbc50003b10 con 0x7fbc5406d960 2023-11-24T06:31:09.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc49ffb640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbc38066580 0x7fbc38068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:09.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc50083500 con 0x7fbc5406d960 2023-11-24T06:31:09.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.843+0000 7fbc58b87640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbc38066580 0x7fbc38068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:09.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.847+0000 7fbc58b87640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbc38066580 0x7fbc38068a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc5415cb90 tx=0x7fbc44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:09.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:09.847+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc500509d0 con 0x7fbc5406d960 2023-11-24T06:31:10.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.051+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbc5404e850 con 0x7fbc5406d960 2023-11-24T06:31:10.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.051+0000 7fbc49ffb640 1 -- 172.21.15.143:0/384201390 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1527 (secure 0 0 0) 0x7fbc50017610 con 0x7fbc5406d960 2023-11-24T06:31:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:10.057 INFO:teuthology.orchestra.run.smithi143.stdout:{"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":114,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1700807367,"num_in_osds":8,"osd_in_since":1700807357,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226361344,"bytes_avail":772867751936,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5610}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-24T06:30:52.220041+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-24T06:31:10.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbc38066580 msgr2=0x7fbc38068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbc38066580 0x7fbc38068a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc5415cb90 tx=0x7fbc44009040 comp rx=0 tx=0).stop 2023-11-24T06:31:10.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 msgr2=0x7fbc54155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 0x7fbc54155890 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c4d0 tx=0x7fbc5000c990 comp rx=0 tx=0).stop 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 shutdown_connections 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbc38066580 0x7fbc38068a40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc54161550 0x7fbc540ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc5415d170 0x7fbc54156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 --2- 172.21.15.143:0/384201390 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc5406d960 0x7fbc54155890 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 >> 172.21.15.143:0/384201390 conn(0x7fbc540cf610 msgr2=0x7fbc540ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 shutdown_connections 2023-11-24T06:31:10.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.055+0000 7fbc5a38a640 1 -- 172.21.15.143:0/384201390 wait complete. 2023-11-24T06:31:10.078 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T06:31:10.079 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 Processor -- start 2023-11-24T06:31:10.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 -- start start 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89d8159a80 0x7f89d806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d806d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80ae950 con 0x7f89d806cee0 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d806d8b0 con 0x7f89d8159a80 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.211+0000 7f89de157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80b1ef0 con 0x7f89d80ad5e0 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89d8159a80 0x7f89d806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89d8159a80 0x7f89d806de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43162/0 (socket says 172.21.15.143:43162) 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 -- 172.21.15.143:0/2397286440 learned_addr learned my addr 172.21.15.143:0/2397286440 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d7fff640 1 --2- 172.21.15.143:0/2397286440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 -- 172.21.15.143:0/2397286440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 msgr2=0x7f89d806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:10.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 --2- 172.21.15.143:0/2397286440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d806d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 -- 172.21.15.143:0/2397286440 >> v1:172.21.15.146:6789/0 conn(0x7f89d806cee0 legacy=0x7f89d80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 -- 172.21.15.143:0/2397286440 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80ada70 con 0x7f89d8159a80 2023-11-24T06:31:10.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d77fe640 1 --2- 172.21.15.143:0/2397286440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d806de50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009870 tx=0x7f89c801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec019c2d8b6631df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:10.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d67fc640 1 -- 172.21.15.143:0/2397286440 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80ad680 con 0x7f89d8159a80 2023-11-24T06:31:10.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d67fc640 1 -- 172.21.15.143:0/2397286440 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c80ad7e0 con 0x7f89d8159a80 2023-11-24T06:31:10.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.215+0000 7f89d67fc640 1 -- 172.21.15.143:0/2397286440 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80adb70 con 0x7f89d8159a80 2023-11-24T06:31:10.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- 172.21.15.143:0/2397286440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 msgr2=0x7f89d806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 --2- 172.21.15.143:0/2397286440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d806de50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009870 tx=0x7f89c801c510 comp rx=0 tx=0).stop 2023-11-24T06:31:10.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- 172.21.15.143:0/2397286440 shutdown_connections 2023-11-24T06:31:10.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 --2- 172.21.15.143:0/2397286440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d806d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 --2- 172.21.15.143:0/2397286440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d806de50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- 172.21.15.143:0/2397286440 >> 172.21.15.143:0/2397286440 conn(0x7f89d80b0bf0 msgr2=0x7f89d80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:10.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- 172.21.15.143:0/2397286440 shutdown_connections 2023-11-24T06:31:10.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- 172.21.15.143:0/2397286440 wait complete. 2023-11-24T06:31:10.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 Processor -- start 2023-11-24T06:31:10.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- start start 2023-11-24T06:31:10.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d806cee0 0x7f89d81452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:10.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d81573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:10.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d8150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:10.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d8158900 con 0x7f89d8159a80 2023-11-24T06:31:10.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d8157d80 con 0x7f89d806cee0 2023-11-24T06:31:10.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89de157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d8158060 con 0x7f89d80ad5e0 2023-11-24T06:31:10.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d8150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:10.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d806cee0 0x7f89d81452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:10.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d8150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43170/0 (socket says 172.21.15.143:43170) 2023-11-24T06:31:10.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89d7fff640 1 -- 172.21.15.143:0/3389428522 learned_addr learned my addr 172.21.15.143:0/3389428522 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:10.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.219+0000 7f89d6ffd640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d81573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:10.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89d7fff640 1 -- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 msgr2=0x7f89d81573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89d7fff640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d81573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89d7fff640 1 -- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d806cee0 msgr2=0x7f89d81452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89d7fff640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d806cee0 0x7f89d81452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89d7fff640 1 -- 172.21.15.143:0/3389428522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80094d0 con 0x7f89d8159a80 2023-11-24T06:31:10.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89d7fff640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d8150ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f89d000efc0 tx=0x7f89d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:10.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0014480 con 0x7f89d8159a80 2023-11-24T06:31:10.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d000f040 con 0x7f89d8159a80 2023-11-24T06:31:10.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0014820 con 0x7f89d8159a80 2023-11-24T06:31:10.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d8158340 con 0x7f89d8159a80 2023-11-24T06:31:10.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8145810 con 0x7f89d8159a80 2023-11-24T06:31:10.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d8146cd0 con 0x7f89d8159a80 2023-11-24T06:31:10.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f89d0014980 con 0x7f89d8159a80 2023-11-24T06:31:10.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89bffff640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89c4066500 0x7f89c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:10.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.223+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89d0084ae0 con 0x7f89d8159a80 2023-11-24T06:31:10.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.227+0000 7f89d77fe640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89c4066500 0x7f89c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:10.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.227+0000 7f89d77fe640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89c4066500 0x7f89c40689c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89c80af000 tx=0x7f89c80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:10.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.231+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89d8146cd0 con 0x7f89d8159a80 2023-11-24T06:31:10.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.379+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89d81581d0 con 0x7f89c4066500 2023-11-24T06:31:10.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.387+0000 7f89bffff640 1 -- 172.21.15.143:0/3389428522 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288875 (secure 0 0 0) 0x7f89d81581d0 con 0x7f89c4066500 2023-11-24T06:31:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:10.395 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:10.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89c4066500 msgr2=0x7f89c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89c4066500 0x7f89c40689c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89c80af000 tx=0x7f89c80a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 msgr2=0x7f89d8150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d8150ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f89d000efc0 tx=0x7f89d000c490 comp rx=0 tx=0).stop 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 shutdown_connections 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89c4066500 0x7f89c40689c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89d8159a80 0x7f89d8150ba0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89d80ad5e0 0x7f89d81573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 --2- 172.21.15.143:0/3389428522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d806cee0 0x7f89d81452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 >> 172.21.15.143:0/3389428522 conn(0x7f89d80b0bf0 msgr2=0x7f89d8151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 shutdown_connections 2023-11-24T06:31:10.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:10.391+0000 7f89de157640 1 -- 172.21.15.143:0/3389428522 wait complete. 2023-11-24T06:31:10.414 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-24T06:31:10.223019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221428,"kb_used_data":5252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753292,"statfs":{"total":773094113280,"available":772867371008,"internally_reserved":0,"allocated":5378048,"data_stored":2857051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.444843"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051459+0000","last_change":"2023-11-24T06:31:04.808749+0000","last_active":"2023-11-24T06:31:06.051459+0000","last_peered":"2023-11-24T06:31:06.051459+0000","last_clean":"2023-11-24T06:31:06.051459+0000","last_became_active":"2023-11-24T06:31:04.808357+0000","last_became_peered":"2023-11-24T06:31:04.808357+0000","last_unstale":"2023-11-24T06:31:06.051459+0000","last_undegraded":"2023-11-24T06:31:06.051459+0000","last_fullsized":"2023-11-24T06:31:06.051459+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:55.547711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052787+0000","last_change":"2023-11-24T06:31:04.801206+0000","last_active":"2023-11-24T06:31:06.052787+0000","last_peered":"2023-11-24T06:31:06.052787+0000","last_clean":"2023-11-24T06:31:06.052787+0000","last_became_active":"2023-11-24T06:31:04.800897+0000","last_became_peered":"2023-11-24T06:31:04.800897+0000","last_unstale":"2023-11-24T06:31:06.052787+0000","last_undegraded":"2023-11-24T06:31:06.052787+0000","last_fullsized":"2023-11-24T06:31:06.052787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.963771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051188+0000","last_change":"2023-11-24T06:31:04.810578+0000","last_active":"2023-11-24T06:31:06.051188+0000","last_peered":"2023-11-24T06:31:06.051188+0000","last_clean":"2023-11-24T06:31:06.051188+0000","last_became_active":"2023-11-24T06:31:04.808404+0000","last_became_peered":"2023-11-24T06:31:04.808404+0000","last_unstale":"2023-11-24T06:31:06.051188+0000","last_undegraded":"2023-11-24T06:31:06.051188+0000","last_fullsized":"2023-11-24T06:31:06.051188+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:56.604961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050601+0000","last_change":"2023-11-24T06:31:04.823771+0000","last_active":"2023-11-24T06:31:06.050601+0000","last_peered":"2023-11-24T06:31:06.050601+0000","last_clean":"2023-11-24T06:31:06.050601+0000","last_became_active":"2023-11-24T06:31:04.823446+0000","last_became_peered":"2023-11-24T06:31:04.823446+0000","last_unstale":"2023-11-24T06:31:06.050601+0000","last_undegraded":"2023-11-24T06:31:06.050601+0000","last_fullsized":"2023-11-24T06:31:06.050601+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:31.701834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052549+0000","last_change":"2023-11-24T06:31:04.825324+0000","last_active":"2023-11-24T06:31:06.052549+0000","last_peered":"2023-11-24T06:31:06.052549+0000","last_clean":"2023-11-24T06:31:06.052549+0000","last_became_active":"2023-11-24T06:31:04.825018+0000","last_became_peered":"2023-11-24T06:31:04.825018+0000","last_unstale":"2023-11-24T06:31:06.052549+0000","last_undegraded":"2023-11-24T06:31:06.052549+0000","last_fullsized":"2023-11-24T06:31:06.052549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:12.750721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785409+0000","last_change":"2023-11-24T06:31:04.797374+0000","last_active":"2023-11-24T06:31:05.785409+0000","last_peered":"2023-11-24T06:31:05.785409+0000","last_clean":"2023-11-24T06:31:05.785409+0000","last_became_active":"2023-11-24T06:31:04.797102+0000","last_became_peered":"2023-11-24T06:31:04.797102+0000","last_unstale":"2023-11-24T06:31:05.785409+0000","last_undegraded":"2023-11-24T06:31:05.785409+0000","last_fullsized":"2023-11-24T06:31:05.785409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:21.391572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051690+0000","last_change":"2023-11-24T06:31:04.810775+0000","last_active":"2023-11-24T06:31:06.051690+0000","last_peered":"2023-11-24T06:31:06.051690+0000","last_clean":"2023-11-24T06:31:06.051690+0000","last_became_active":"2023-11-24T06:31:04.810436+0000","last_became_peered":"2023-11-24T06:31:04.810436+0000","last_unstale":"2023-11-24T06:31:06.051690+0000","last_undegraded":"2023-11-24T06:31:06.051690+0000","last_fullsized":"2023-11-24T06:31:06.051690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:31.701834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050038+0000","last_change":"2023-11-24T06:31:04.821607+0000","last_active":"2023-11-24T06:31:06.050038+0000","last_peered":"2023-11-24T06:31:06.050038+0000","last_clean":"2023-11-24T06:31:06.050038+0000","last_became_active":"2023-11-24T06:31:04.821218+0000","last_became_peered":"2023-11-24T06:31:04.821218+0000","last_unstale":"2023-11-24T06:31:06.050038+0000","last_undegraded":"2023-11-24T06:31:06.050038+0000","last_fullsized":"2023-11-24T06:31:06.050038+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:13.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051028+0000","last_change":"2023-11-24T06:31:04.798829+0000","last_active":"2023-11-24T06:31:06.051028+0000","last_peered":"2023-11-24T06:31:06.051028+0000","last_clean":"2023-11-24T06:31:06.051028+0000","last_became_active":"2023-11-24T06:31:04.797941+0000","last_became_peered":"2023-11-24T06:31:04.797941+0000","last_unstale":"2023-11-24T06:31:06.051028+0000","last_undegraded":"2023-11-24T06:31:06.051028+0000","last_fullsized":"2023-11-24T06:31:06.051028+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:37:50.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050964+0000","last_change":"2023-11-24T06:31:04.811708+0000","last_active":"2023-11-24T06:31:06.050964+0000","last_peered":"2023-11-24T06:31:06.050964+0000","last_clean":"2023-11-24T06:31:06.050964+0000","last_became_active":"2023-11-24T06:31:04.810905+0000","last_became_peered":"2023-11-24T06:31:04.810905+0000","last_unstale":"2023-11-24T06:31:06.050964+0000","last_undegraded":"2023-11-24T06:31:06.050964+0000","last_fullsized":"2023-11-24T06:31:06.050964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:38.530757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050817+0000","last_change":"2023-11-24T06:31:04.805538+0000","last_active":"2023-11-24T06:31:06.050817+0000","last_peered":"2023-11-24T06:31:06.050817+0000","last_clean":"2023-11-24T06:31:06.050817+0000","last_became_active":"2023-11-24T06:31:04.801975+0000","last_became_peered":"2023-11-24T06:31:04.801975+0000","last_unstale":"2023-11-24T06:31:06.050817+0000","last_undegraded":"2023-11-24T06:31:06.050817+0000","last_fullsized":"2023-11-24T06:31:06.050817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:10.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052639+0000","last_change":"2023-11-24T06:31:04.805141+0000","last_active":"2023-11-24T06:31:06.052639+0000","last_peered":"2023-11-24T06:31:06.052639+0000","last_clean":"2023-11-24T06:31:06.052639+0000","last_became_active":"2023-11-24T06:31:04.804666+0000","last_became_peered":"2023-11-24T06:31:04.804666+0000","last_unstale":"2023-11-24T06:31:06.052639+0000","last_undegraded":"2023-11-24T06:31:06.052639+0000","last_fullsized":"2023-11-24T06:31:06.052639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:00.492991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050098+0000","last_change":"2023-11-24T06:31:04.807947+0000","last_active":"2023-11-24T06:31:06.050098+0000","last_peered":"2023-11-24T06:31:06.050098+0000","last_clean":"2023-11-24T06:31:06.050098+0000","last_became_active":"2023-11-24T06:31:04.807646+0000","last_became_peered":"2023-11-24T06:31:04.807646+0000","last_unstale":"2023-11-24T06:31:06.050098+0000","last_undegraded":"2023-11-24T06:31:06.050098+0000","last_fullsized":"2023-11-24T06:31:06.050098+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:17.420423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050498+0000","last_change":"2023-11-24T06:31:04.802200+0000","last_active":"2023-11-24T06:31:06.050498+0000","last_peered":"2023-11-24T06:31:06.050498+0000","last_clean":"2023-11-24T06:31:06.050498+0000","last_became_active":"2023-11-24T06:31:04.801922+0000","last_became_peered":"2023-11-24T06:31:04.801922+0000","last_unstale":"2023-11-24T06:31:06.050498+0000","last_undegraded":"2023-11-24T06:31:06.050498+0000","last_fullsized":"2023-11-24T06:31:06.050498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:21.632487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785252+0000","last_change":"2023-11-24T06:31:04.799096+0000","last_active":"2023-11-24T06:31:05.785252+0000","last_peered":"2023-11-24T06:31:05.785252+0000","last_clean":"2023-11-24T06:31:05.785252+0000","last_became_active":"2023-11-24T06:31:04.798820+0000","last_became_peered":"2023-11-24T06:31:04.798820+0000","last_unstale":"2023-11-24T06:31:05.785252+0000","last_undegraded":"2023-11-24T06:31:05.785252+0000","last_fullsized":"2023-11-24T06:31:05.785252+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:55.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786724+0000","last_change":"2023-11-24T06:31:04.811422+0000","last_active":"2023-11-24T06:31:05.786724+0000","last_peered":"2023-11-24T06:31:05.786724+0000","last_clean":"2023-11-24T06:31:05.786724+0000","last_became_active":"2023-11-24T06:31:04.807340+0000","last_became_peered":"2023-11-24T06:31:04.807340+0000","last_unstale":"2023-11-24T06:31:05.786724+0000","last_undegraded":"2023-11-24T06:31:05.786724+0000","last_fullsized":"2023-11-24T06:31:05.786724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:27.110779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052094+0000","last_change":"2023-11-24T06:31:04.808355+0000","last_active":"2023-11-24T06:31:06.052094+0000","last_peered":"2023-11-24T06:31:06.052094+0000","last_clean":"2023-11-24T06:31:06.052094+0000","last_became_active":"2023-11-24T06:31:04.808041+0000","last_became_peered":"2023-11-24T06:31:04.808041+0000","last_unstale":"2023-11-24T06:31:06.052094+0000","last_undegraded":"2023-11-24T06:31:06.052094+0000","last_fullsized":"2023-11-24T06:31:06.052094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:47.039826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051307+0000","last_change":"2023-11-24T06:31:04.804745+0000","last_active":"2023-11-24T06:31:06.051307+0000","last_peered":"2023-11-24T06:31:06.051307+0000","last_clean":"2023-11-24T06:31:06.051307+0000","last_became_active":"2023-11-24T06:31:04.804397+0000","last_became_peered":"2023-11-24T06:31:04.804397+0000","last_unstale":"2023-11-24T06:31:06.051307+0000","last_undegraded":"2023-11-24T06:31:06.051307+0000","last_fullsized":"2023-11-24T06:31:06.051307+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:38.764900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787030+0000","last_change":"2023-11-24T06:31:04.810560+0000","last_active":"2023-11-24T06:31:05.787030+0000","last_peered":"2023-11-24T06:31:05.787030+0000","last_clean":"2023-11-24T06:31:05.787030+0000","last_became_active":"2023-11-24T06:31:04.807293+0000","last_became_peered":"2023-11-24T06:31:04.807293+0000","last_unstale":"2023-11-24T06:31:05.787030+0000","last_undegraded":"2023-11-24T06:31:05.787030+0000","last_fullsized":"2023-11-24T06:31:05.787030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:56.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050288+0000","last_change":"2023-11-24T06:31:04.802832+0000","last_active":"2023-11-24T06:31:06.050288+0000","last_peered":"2023-11-24T06:31:06.050288+0000","last_clean":"2023-11-24T06:31:06.050288+0000","last_became_active":"2023-11-24T06:31:04.799650+0000","last_became_peered":"2023-11-24T06:31:04.799650+0000","last_unstale":"2023-11-24T06:31:06.050288+0000","last_undegraded":"2023-11-24T06:31:06.050288+0000","last_fullsized":"2023-11-24T06:31:06.050288+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:32.139638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785409+0000","last_change":"2023-11-24T06:31:04.819197+0000","last_active":"2023-11-24T06:31:05.785409+0000","last_peered":"2023-11-24T06:31:05.785409+0000","last_clean":"2023-11-24T06:31:05.785409+0000","last_became_active":"2023-11-24T06:31:04.818943+0000","last_became_peered":"2023-11-24T06:31:04.818943+0000","last_unstale":"2023-11-24T06:31:05.785409+0000","last_undegraded":"2023-11-24T06:31:05.785409+0000","last_fullsized":"2023-11-24T06:31:05.785409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:27.457469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050580+0000","last_change":"2023-11-24T06:31:04.812075+0000","last_active":"2023-11-24T06:31:06.050580+0000","last_peered":"2023-11-24T06:31:06.050580+0000","last_clean":"2023-11-24T06:31:06.050580+0000","last_became_active":"2023-11-24T06:31:04.811798+0000","last_became_peered":"2023-11-24T06:31:04.811798+0000","last_unstale":"2023-11-24T06:31:06.050580+0000","last_undegraded":"2023-11-24T06:31:06.050580+0000","last_fullsized":"2023-11-24T06:31:06.050580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.963771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786545+0000","last_change":"2023-11-24T06:31:04.813796+0000","last_active":"2023-11-24T06:31:05.786545+0000","last_peered":"2023-11-24T06:31:05.786545+0000","last_clean":"2023-11-24T06:31:05.786545+0000","last_became_active":"2023-11-24T06:31:04.813495+0000","last_became_peered":"2023-11-24T06:31:04.813495+0000","last_unstale":"2023-11-24T06:31:05.786545+0000","last_undegraded":"2023-11-24T06:31:05.786545+0000","last_fullsized":"2023-11-24T06:31:05.786545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:15.775231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786895+0000","last_change":"2023-11-24T06:31:04.815957+0000","last_active":"2023-11-24T06:31:05.786895+0000","last_peered":"2023-11-24T06:31:05.786895+0000","last_clean":"2023-11-24T06:31:05.786895+0000","last_became_active":"2023-11-24T06:31:04.815665+0000","last_became_peered":"2023-11-24T06:31:04.815665+0000","last_unstale":"2023-11-24T06:31:05.786895+0000","last_undegraded":"2023-11-24T06:31:05.786895+0000","last_fullsized":"2023-11-24T06:31:05.786895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:36.162099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786895+0000","last_change":"2023-11-24T06:31:04.813606+0000","last_active":"2023-11-24T06:31:05.786895+0000","last_peered":"2023-11-24T06:31:05.786895+0000","last_clean":"2023-11-24T06:31:05.786895+0000","last_became_active":"2023-11-24T06:31:04.813331+0000","last_became_peered":"2023-11-24T06:31:04.813331+0000","last_unstale":"2023-11-24T06:31:05.786895+0000","last_undegraded":"2023-11-24T06:31:05.786895+0000","last_fullsized":"2023-11-24T06:31:05.786895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:44:51.603596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050304+0000","last_change":"2023-11-24T06:31:04.812554+0000","last_active":"2023-11-24T06:31:06.050304+0000","last_peered":"2023-11-24T06:31:06.050304+0000","last_clean":"2023-11-24T06:31:06.050304+0000","last_became_active":"2023-11-24T06:31:04.810849+0000","last_became_peered":"2023-11-24T06:31:04.810849+0000","last_unstale":"2023-11-24T06:31:06.050304+0000","last_undegraded":"2023-11-24T06:31:06.050304+0000","last_fullsized":"2023-11-24T06:31:06.050304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:33:17.219549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051356+0000","last_change":"2023-11-24T06:31:04.808335+0000","last_active":"2023-11-24T06:31:06.051356+0000","last_peered":"2023-11-24T06:31:06.051356+0000","last_clean":"2023-11-24T06:31:06.051356+0000","last_became_active":"2023-11-24T06:31:04.807956+0000","last_became_peered":"2023-11-24T06:31:04.807956+0000","last_unstale":"2023-11-24T06:31:06.051356+0000","last_undegraded":"2023-11-24T06:31:06.051356+0000","last_fullsized":"2023-11-24T06:31:06.051356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:09.368923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052665+0000","last_change":"2023-11-24T06:31:04.804930+0000","last_active":"2023-11-24T06:31:06.052665+0000","last_peered":"2023-11-24T06:31:06.052665+0000","last_clean":"2023-11-24T06:31:06.052665+0000","last_became_active":"2023-11-24T06:31:04.804305+0000","last_became_peered":"2023-11-24T06:31:04.804305+0000","last_unstale":"2023-11-24T06:31:06.052665+0000","last_undegraded":"2023-11-24T06:31:06.052665+0000","last_fullsized":"2023-11-24T06:31:06.052665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:21.632487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786990+0000","last_change":"2023-11-24T06:31:04.811657+0000","last_active":"2023-11-24T06:31:05.786990+0000","last_peered":"2023-11-24T06:31:05.786990+0000","last_clean":"2023-11-24T06:31:05.786990+0000","last_became_active":"2023-11-24T06:31:04.807427+0000","last_became_peered":"2023-11-24T06:31:04.807427+0000","last_unstale":"2023-11-24T06:31:05.786990+0000","last_undegraded":"2023-11-24T06:31:05.786990+0000","last_fullsized":"2023-11-24T06:31:05.786990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:44.347785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051323+0000","last_change":"2023-11-24T06:31:04.813486+0000","last_active":"2023-11-24T06:31:06.051323+0000","last_peered":"2023-11-24T06:31:06.051323+0000","last_clean":"2023-11-24T06:31:06.051323+0000","last_became_active":"2023-11-24T06:31:04.813077+0000","last_became_peered":"2023-11-24T06:31:04.813077+0000","last_unstale":"2023-11-24T06:31:06.051323+0000","last_undegraded":"2023-11-24T06:31:06.051323+0000","last_fullsized":"2023-11-24T06:31:06.051323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:19.871124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785255+0000","last_change":"2023-11-24T06:31:04.802365+0000","last_active":"2023-11-24T06:31:05.785255+0000","last_peered":"2023-11-24T06:31:05.785255+0000","last_clean":"2023-11-24T06:31:05.785255+0000","last_became_active":"2023-11-24T06:31:04.801307+0000","last_became_peered":"2023-11-24T06:31:04.801307+0000","last_unstale":"2023-11-24T06:31:05.785255+0000","last_undegraded":"2023-11-24T06:31:05.785255+0000","last_fullsized":"2023-11-24T06:31:05.785255+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:22:55.144592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050558+0000","last_change":"2023-11-24T06:31:04.801172+0000","last_active":"2023-11-24T06:31:06.050558+0000","last_peered":"2023-11-24T06:31:06.050558+0000","last_clean":"2023-11-24T06:31:06.050558+0000","last_became_active":"2023-11-24T06:31:04.800003+0000","last_became_peered":"2023-11-24T06:31:04.800003+0000","last_unstale":"2023-11-24T06:31:06.050558+0000","last_undegraded":"2023-11-24T06:31:06.050558+0000","last_fullsized":"2023-11-24T06:31:06.050558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:43:09.979433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786711+0000","last_change":"2023-11-24T06:31:04.795033+0000","last_active":"2023-11-24T06:31:05.786711+0000","last_peered":"2023-11-24T06:31:05.786711+0000","last_clean":"2023-11-24T06:31:05.786711+0000","last_became_active":"2023-11-24T06:31:04.794776+0000","last_became_peered":"2023-11-24T06:31:04.794776+0000","last_unstale":"2023-11-24T06:31:05.786711+0000","last_undegraded":"2023-11-24T06:31:05.786711+0000","last_fullsized":"2023-11-24T06:31:05.786711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:56.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826973+0000","last_change":"2023-11-24T06:31:03.797084+0000","last_active":"2023-11-24T06:31:04.826973+0000","last_peered":"2023-11-24T06:31:04.826973+0000","last_clean":"2023-11-24T06:31:04.826973+0000","last_became_active":"2023-11-24T06:31:03.796775+0000","last_became_peered":"2023-11-24T06:31:03.796775+0000","last_unstale":"2023-11-24T06:31:04.826973+0000","last_undegraded":"2023-11-24T06:31:04.826973+0000","last_fullsized":"2023-11-24T06:31:04.826973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:21.050211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787036+0000","last_change":"2023-11-24T06:31:04.810481+0000","last_active":"2023-11-24T06:31:05.787036+0000","last_peered":"2023-11-24T06:31:05.787036+0000","last_clean":"2023-11-24T06:31:05.787036+0000","last_became_active":"2023-11-24T06:31:04.806701+0000","last_became_peered":"2023-11-24T06:31:04.806701+0000","last_unstale":"2023-11-24T06:31:05.787036+0000","last_undegraded":"2023-11-24T06:31:05.787036+0000","last_fullsized":"2023-11-24T06:31:05.787036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:46.519446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.829761+0000","last_change":"2023-11-24T06:31:03.805039+0000","last_active":"2023-11-24T06:31:04.829761+0000","last_peered":"2023-11-24T06:31:04.829761+0000","last_clean":"2023-11-24T06:31:04.829761+0000","last_became_active":"2023-11-24T06:31:03.804728+0000","last_became_peered":"2023-11-24T06:31:03.804728+0000","last_unstale":"2023-11-24T06:31:04.829761+0000","last_undegraded":"2023-11-24T06:31:04.829761+0000","last_fullsized":"2023-11-24T06:31:04.829761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:26.104360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052827+0000","last_change":"2023-11-24T06:31:04.811971+0000","last_active":"2023-11-24T06:31:06.052827+0000","last_peered":"2023-11-24T06:31:06.052827+0000","last_clean":"2023-11-24T06:31:06.052827+0000","last_became_active":"2023-11-24T06:31:04.811571+0000","last_became_peered":"2023-11-24T06:31:04.811571+0000","last_unstale":"2023-11-24T06:31:06.052827+0000","last_undegraded":"2023-11-24T06:31:06.052827+0000","last_fullsized":"2023-11-24T06:31:06.052827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:55.547711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.824567+0000","last_change":"2023-11-24T06:31:03.796384+0000","last_active":"2023-11-24T06:31:04.824567+0000","last_peered":"2023-11-24T06:31:04.824567+0000","last_clean":"2023-11-24T06:31:04.824567+0000","last_became_active":"2023-11-24T06:31:03.795918+0000","last_became_peered":"2023-11-24T06:31:03.795918+0000","last_unstale":"2023-11-24T06:31:04.824567+0000","last_undegraded":"2023-11-24T06:31:04.824567+0000","last_fullsized":"2023-11-24T06:31:04.824567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:35.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786772+0000","last_change":"2023-11-24T06:31:04.814458+0000","last_active":"2023-11-24T06:31:05.786772+0000","last_peered":"2023-11-24T06:31:05.786772+0000","last_clean":"2023-11-24T06:31:05.786772+0000","last_became_active":"2023-11-24T06:31:04.814228+0000","last_became_peered":"2023-11-24T06:31:04.814228+0000","last_unstale":"2023-11-24T06:31:05.786772+0000","last_undegraded":"2023-11-24T06:31:05.786772+0000","last_fullsized":"2023-11-24T06:31:05.786772+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:46.519446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.822909+0000","last_change":"2023-11-24T06:31:03.803229+0000","last_active":"2023-11-24T06:31:04.822909+0000","last_peered":"2023-11-24T06:31:04.822909+0000","last_clean":"2023-11-24T06:31:04.822909+0000","last_became_active":"2023-11-24T06:31:03.802878+0000","last_became_peered":"2023-11-24T06:31:03.802878+0000","last_unstale":"2023-11-24T06:31:04.822909+0000","last_undegraded":"2023-11-24T06:31:04.822909+0000","last_fullsized":"2023-11-24T06:31:04.822909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:08.362504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051491+0000","last_change":"2023-11-24T06:31:04.814531+0000","last_active":"2023-11-24T06:31:06.051491+0000","last_peered":"2023-11-24T06:31:06.051491+0000","last_clean":"2023-11-24T06:31:06.051491+0000","last_became_active":"2023-11-24T06:31:04.814249+0000","last_became_peered":"2023-11-24T06:31:04.814249+0000","last_unstale":"2023-11-24T06:31:06.051491+0000","last_undegraded":"2023-11-24T06:31:06.051491+0000","last_fullsized":"2023-11-24T06:31:06.051491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:43:00.149592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.827011+0000","last_change":"2023-11-24T06:31:03.802597+0000","last_active":"2023-11-24T06:31:04.827011+0000","last_peered":"2023-11-24T06:31:04.827011+0000","last_clean":"2023-11-24T06:31:04.827011+0000","last_became_active":"2023-11-24T06:31:03.802297+0000","last_became_peered":"2023-11-24T06:31:03.802297+0000","last_unstale":"2023-11-24T06:31:04.827011+0000","last_undegraded":"2023-11-24T06:31:04.827011+0000","last_fullsized":"2023-11-24T06:31:04.827011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:54.541292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050622+0000","last_change":"2023-11-24T06:31:04.811060+0000","last_active":"2023-11-24T06:31:06.050622+0000","last_peered":"2023-11-24T06:31:06.050622+0000","last_clean":"2023-11-24T06:31:06.050622+0000","last_became_active":"2023-11-24T06:31:04.810178+0000","last_became_peered":"2023-11-24T06:31:04.810178+0000","last_unstale":"2023-11-24T06:31:06.050622+0000","last_undegraded":"2023-11-24T06:31:06.050622+0000","last_fullsized":"2023-11-24T06:31:06.050622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:55.547711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.829115+0000","last_change":"2023-11-24T06:31:03.805478+0000","last_active":"2023-11-24T06:31:04.829115+0000","last_peered":"2023-11-24T06:31:04.829115+0000","last_clean":"2023-11-24T06:31:04.829115+0000","last_became_active":"2023-11-24T06:31:03.805096+0000","last_became_peered":"2023-11-24T06:31:03.805096+0000","last_unstale":"2023-11-24T06:31:04.829115+0000","last_undegraded":"2023-11-24T06:31:04.829115+0000","last_fullsized":"2023-11-24T06:31:04.829115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:35.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050141+0000","last_change":"2023-11-24T06:31:04.821458+0000","last_active":"2023-11-24T06:31:06.050141+0000","last_peered":"2023-11-24T06:31:06.050141+0000","last_clean":"2023-11-24T06:31:06.050141+0000","last_became_active":"2023-11-24T06:31:04.820906+0000","last_became_peered":"2023-11-24T06:31:04.820906+0000","last_unstale":"2023-11-24T06:31:06.050141+0000","last_undegraded":"2023-11-24T06:31:06.050141+0000","last_fullsized":"2023-11-24T06:31:06.050141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:12.750721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.789416+0000","last_change":"2023-11-24T06:31:03.797719+0000","last_active":"2023-11-24T06:31:04.789416+0000","last_peered":"2023-11-24T06:31:04.789416+0000","last_clean":"2023-11-24T06:31:04.789416+0000","last_became_active":"2023-11-24T06:31:03.797375+0000","last_became_peered":"2023-11-24T06:31:03.797375+0000","last_unstale":"2023-11-24T06:31:04.789416+0000","last_undegraded":"2023-11-24T06:31:04.789416+0000","last_fullsized":"2023-11-24T06:31:04.789416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:37.758481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786501+0000","last_change":"2023-11-24T06:31:04.807100+0000","last_active":"2023-11-24T06:31:05.786501+0000","last_peered":"2023-11-24T06:31:05.786501+0000","last_clean":"2023-11-24T06:31:05.786501+0000","last_became_active":"2023-11-24T06:31:04.806716+0000","last_became_peered":"2023-11-24T06:31:04.806716+0000","last_unstale":"2023-11-24T06:31:05.786501+0000","last_undegraded":"2023-11-24T06:31:05.786501+0000","last_fullsized":"2023-11-24T06:31:05.786501+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:32:07.773188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.791342+0000","last_change":"2023-11-24T06:31:03.797822+0000","last_active":"2023-11-24T06:31:04.791342+0000","last_peered":"2023-11-24T06:31:04.791342+0000","last_clean":"2023-11-24T06:31:04.791342+0000","last_became_active":"2023-11-24T06:31:03.797521+0000","last_became_peered":"2023-11-24T06:31:03.797521+0000","last_unstale":"2023-11-24T06:31:04.791342+0000","last_undegraded":"2023-11-24T06:31:04.791342+0000","last_fullsized":"2023-11-24T06:31:04.791342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:04:03.625854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051461+0000","last_change":"2023-11-24T06:31:04.803742+0000","last_active":"2023-11-24T06:31:06.051461+0000","last_peered":"2023-11-24T06:31:06.051461+0000","last_clean":"2023-11-24T06:31:06.051461+0000","last_became_active":"2023-11-24T06:31:04.803229+0000","last_became_peered":"2023-11-24T06:31:04.803229+0000","last_unstale":"2023-11-24T06:31:06.051461+0000","last_undegraded":"2023-11-24T06:31:06.051461+0000","last_fullsized":"2023-11-24T06:31:06.051461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:04:04.632273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.792877+0000","last_change":"2023-11-24T06:31:03.803899+0000","last_active":"2023-11-24T06:31:04.792877+0000","last_peered":"2023-11-24T06:31:04.792877+0000","last_clean":"2023-11-24T06:31:04.792877+0000","last_became_active":"2023-11-24T06:31:03.803582+0000","last_became_peered":"2023-11-24T06:31:03.803582+0000","last_unstale":"2023-11-24T06:31:04.792877+0000","last_undegraded":"2023-11-24T06:31:04.792877+0000","last_fullsized":"2023-11-24T06:31:04.792877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:45.513027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051642+0000","last_change":"2023-11-24T06:31:04.804968+0000","last_active":"2023-11-24T06:31:06.051642+0000","last_peered":"2023-11-24T06:31:06.051642+0000","last_clean":"2023-11-24T06:31:06.051642+0000","last_became_active":"2023-11-24T06:31:04.804747+0000","last_became_peered":"2023-11-24T06:31:04.804747+0000","last_unstale":"2023-11-24T06:31:06.051642+0000","last_undegraded":"2023-11-24T06:31:06.051642+0000","last_fullsized":"2023-11-24T06:31:06.051642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:22.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.792918+0000","last_change":"2023-11-24T06:31:03.802893+0000","last_active":"2023-11-24T06:31:04.792918+0000","last_peered":"2023-11-24T06:31:04.792918+0000","last_clean":"2023-11-24T06:31:04.792918+0000","last_became_active":"2023-11-24T06:31:03.802606+0000","last_became_peered":"2023-11-24T06:31:03.802606+0000","last_unstale":"2023-11-24T06:31:04.792918+0000","last_undegraded":"2023-11-24T06:31:04.792918+0000","last_fullsized":"2023-11-24T06:31:04.792918+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:46.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785485+0000","last_change":"2023-11-24T06:31:04.801275+0000","last_active":"2023-11-24T06:31:05.785485+0000","last_peered":"2023-11-24T06:31:05.785485+0000","last_clean":"2023-11-24T06:31:05.785485+0000","last_became_active":"2023-11-24T06:31:04.800956+0000","last_became_peered":"2023-11-24T06:31:04.800956+0000","last_unstale":"2023-11-24T06:31:05.785485+0000","last_undegraded":"2023-11-24T06:31:05.785485+0000","last_fullsized":"2023-11-24T06:31:05.785485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:13.883718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.827449+0000","last_change":"2023-11-24T06:31:03.804485+0000","last_active":"2023-11-24T06:31:04.827449+0000","last_peered":"2023-11-24T06:31:04.827449+0000","last_clean":"2023-11-24T06:31:04.827449+0000","last_became_active":"2023-11-24T06:31:03.804157+0000","last_became_peered":"2023-11-24T06:31:03.804157+0000","last_unstale":"2023-11-24T06:31:04.827449+0000","last_undegraded":"2023-11-24T06:31:04.827449+0000","last_fullsized":"2023-11-24T06:31:04.827449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:46.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051823+0000","last_change":"2023-11-24T06:31:04.808676+0000","last_active":"2023-11-24T06:31:06.051823+0000","last_peered":"2023-11-24T06:31:06.051823+0000","last_clean":"2023-11-24T06:31:06.051823+0000","last_became_active":"2023-11-24T06:31:04.808379+0000","last_became_peered":"2023-11-24T06:31:04.808379+0000","last_unstale":"2023-11-24T06:31:06.051823+0000","last_undegraded":"2023-11-24T06:31:06.051823+0000","last_fullsized":"2023-11-24T06:31:06.051823+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:10.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.832115+0000","last_change":"2023-11-24T06:31:03.800094+0000","last_active":"2023-11-24T06:31:04.832115+0000","last_peered":"2023-11-24T06:31:04.832115+0000","last_clean":"2023-11-24T06:31:04.832115+0000","last_became_active":"2023-11-24T06:31:03.799842+0000","last_became_peered":"2023-11-24T06:31:03.799842+0000","last_unstale":"2023-11-24T06:31:04.832115+0000","last_undegraded":"2023-11-24T06:31:04.832115+0000","last_fullsized":"2023-11-24T06:31:04.832115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:33:37.768508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787154+0000","last_change":"2023-11-24T06:31:04.810924+0000","last_active":"2023-11-24T06:31:05.787154+0000","last_peered":"2023-11-24T06:31:05.787154+0000","last_clean":"2023-11-24T06:31:05.787154+0000","last_became_active":"2023-11-24T06:31:04.810553+0000","last_became_peered":"2023-11-24T06:31:04.810553+0000","last_unstale":"2023-11-24T06:31:05.787154+0000","last_undegraded":"2023-11-24T06:31:05.787154+0000","last_fullsized":"2023-11-24T06:31:05.787154+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:56.604961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826922+0000","last_change":"2023-11-24T06:31:03.801487+0000","last_active":"2023-11-24T06:31:04.826922+0000","last_peered":"2023-11-24T06:31:04.826922+0000","last_clean":"2023-11-24T06:31:04.826922+0000","last_became_active":"2023-11-24T06:31:03.801106+0000","last_became_peered":"2023-11-24T06:31:03.801106+0000","last_unstale":"2023-11-24T06:31:04.826922+0000","last_undegraded":"2023-11-24T06:31:04.826922+0000","last_fullsized":"2023-11-24T06:31:04.826922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:37.524338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050654+0000","last_change":"2023-11-24T06:31:04.813508+0000","last_active":"2023-11-24T06:31:06.050654+0000","last_peered":"2023-11-24T06:31:06.050654+0000","last_clean":"2023-11-24T06:31:06.050654+0000","last_became_active":"2023-11-24T06:31:04.813194+0000","last_became_peered":"2023-11-24T06:31:04.813194+0000","last_unstale":"2023-11-24T06:31:06.050654+0000","last_undegraded":"2023-11-24T06:31:06.050654+0000","last_fullsized":"2023-11-24T06:31:06.050654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:22.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.794344+0000","last_change":"2023-11-24T06:31:03.800024+0000","last_active":"2023-11-24T06:31:04.794344+0000","last_peered":"2023-11-24T06:31:04.794344+0000","last_clean":"2023-11-24T06:31:04.794344+0000","last_became_active":"2023-11-24T06:31:03.799715+0000","last_became_peered":"2023-11-24T06:31:03.799715+0000","last_unstale":"2023-11-24T06:31:04.794344+0000","last_undegraded":"2023-11-24T06:31:04.794344+0000","last_fullsized":"2023-11-24T06:31:04.794344+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:37.758481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785021+0000","last_change":"2023-11-24T06:31:04.795024+0000","last_active":"2023-11-24T06:31:05.785021+0000","last_peered":"2023-11-24T06:31:05.785021+0000","last_clean":"2023-11-24T06:31:05.785021+0000","last_became_active":"2023-11-24T06:31:04.794731+0000","last_became_peered":"2023-11-24T06:31:04.794731+0000","last_unstale":"2023-11-24T06:31:05.785021+0000","last_undegraded":"2023-11-24T06:31:05.785021+0000","last_fullsized":"2023-11-24T06:31:05.785021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:33.554360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.784837+0000","last_change":"2023-11-24T06:31:03.798848+0000","last_active":"2023-11-24T06:31:04.784837+0000","last_peered":"2023-11-24T06:31:04.784837+0000","last_clean":"2023-11-24T06:31:04.784837+0000","last_became_active":"2023-11-24T06:31:03.798524+0000","last_became_peered":"2023-11-24T06:31:03.798524+0000","last_unstale":"2023-11-24T06:31:04.784837+0000","last_undegraded":"2023-11-24T06:31:04.784837+0000","last_fullsized":"2023-11-24T06:31:04.784837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:13.473933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051753+0000","last_change":"2023-11-24T06:31:04.818993+0000","last_active":"2023-11-24T06:31:06.051753+0000","last_peered":"2023-11-24T06:31:06.051753+0000","last_clean":"2023-11-24T06:31:06.051753+0000","last_became_active":"2023-11-24T06:31:04.818390+0000","last_became_peered":"2023-11-24T06:31:04.818390+0000","last_unstale":"2023-11-24T06:31:06.051753+0000","last_undegraded":"2023-11-24T06:31:06.051753+0000","last_fullsized":"2023-11-24T06:31:06.051753+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:21.097556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.834458+0000","last_change":"2023-11-24T06:31:03.797247+0000","last_active":"2023-11-24T06:31:04.834458+0000","last_peered":"2023-11-24T06:31:04.834458+0000","last_clean":"2023-11-24T06:31:04.834458+0000","last_became_active":"2023-11-24T06:31:03.796778+0000","last_became_peered":"2023-11-24T06:31:03.796778+0000","last_unstale":"2023-11-24T06:31:04.834458+0000","last_undegraded":"2023-11-24T06:31:04.834458+0000","last_fullsized":"2023-11-24T06:31:04.834458+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:42:59.143173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050432+0000","last_change":"2023-11-24T06:31:04.803276+0000","last_active":"2023-11-24T06:31:06.050432+0000","last_peered":"2023-11-24T06:31:06.050432+0000","last_clean":"2023-11-24T06:31:06.050432+0000","last_became_active":"2023-11-24T06:31:04.803012+0000","last_became_peered":"2023-11-24T06:31:04.803012+0000","last_unstale":"2023-11-24T06:31:06.050432+0000","last_undegraded":"2023-11-24T06:31:06.050432+0000","last_fullsized":"2023-11-24T06:31:06.050432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:27:11.595239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.825383+0000","last_change":"2023-11-24T06:31:03.796670+0000","last_active":"2023-11-24T06:31:04.825383+0000","last_peered":"2023-11-24T06:31:04.825383+0000","last_clean":"2023-11-24T06:31:04.825383+0000","last_became_active":"2023-11-24T06:31:03.796415+0000","last_became_peered":"2023-11-24T06:31:03.796415+0000","last_unstale":"2023-11-24T06:31:04.825383+0000","last_undegraded":"2023-11-24T06:31:04.825383+0000","last_fullsized":"2023-11-24T06:31:04.825383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:45.167537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051016+0000","last_change":"2023-11-24T06:31:04.798468+0000","last_active":"2023-11-24T06:31:06.051016+0000","last_peered":"2023-11-24T06:31:06.051016+0000","last_clean":"2023-11-24T06:31:06.051016+0000","last_became_active":"2023-11-24T06:31:04.798218+0000","last_became_peered":"2023-11-24T06:31:04.798218+0000","last_unstale":"2023-11-24T06:31:06.051016+0000","last_undegraded":"2023-11-24T06:31:06.051016+0000","last_fullsized":"2023-11-24T06:31:06.051016+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:14.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.829544+0000","last_change":"2023-11-24T06:31:03.800104+0000","last_active":"2023-11-24T06:31:04.829544+0000","last_peered":"2023-11-24T06:31:04.829544+0000","last_clean":"2023-11-24T06:31:04.829544+0000","last_became_active":"2023-11-24T06:31:03.799837+0000","last_became_peered":"2023-11-24T06:31:03.799837+0000","last_unstale":"2023-11-24T06:31:04.829544+0000","last_undegraded":"2023-11-24T06:31:04.829544+0000","last_fullsized":"2023-11-24T06:31:04.829544+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:43.341366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786809+0000","last_change":"2023-11-24T06:31:04.811393+0000","last_active":"2023-11-24T06:31:05.786809+0000","last_peered":"2023-11-24T06:31:05.786809+0000","last_clean":"2023-11-24T06:31:05.786809+0000","last_became_active":"2023-11-24T06:31:04.811136+0000","last_became_peered":"2023-11-24T06:31:04.811136+0000","last_unstale":"2023-11-24T06:31:05.786809+0000","last_undegraded":"2023-11-24T06:31:05.786809+0000","last_fullsized":"2023-11-24T06:31:05.786809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:08.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826008+0000","last_change":"2023-11-24T06:31:03.800550+0000","last_active":"2023-11-24T06:31:04.826008+0000","last_peered":"2023-11-24T06:31:04.826008+0000","last_clean":"2023-11-24T06:31:04.826008+0000","last_became_active":"2023-11-24T06:31:03.800252+0000","last_became_peered":"2023-11-24T06:31:03.800252+0000","last_unstale":"2023-11-24T06:31:04.826008+0000","last_undegraded":"2023-11-24T06:31:04.826008+0000","last_fullsized":"2023-11-24T06:31:04.826008+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:42:59.143173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786997+0000","last_change":"2023-11-24T06:31:04.811900+0000","last_active":"2023-11-24T06:31:05.786997+0000","last_peered":"2023-11-24T06:31:05.786997+0000","last_clean":"2023-11-24T06:31:05.786997+0000","last_became_active":"2023-11-24T06:31:04.806789+0000","last_became_peered":"2023-11-24T06:31:04.806789+0000","last_unstale":"2023-11-24T06:31:05.786997+0000","last_undegraded":"2023-11-24T06:31:05.786997+0000","last_fullsized":"2023-11-24T06:31:05.786997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:46.182837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.783762+0000","last_change":"2023-11-24T06:31:03.797298+0000","last_active":"2023-11-24T06:31:04.783762+0000","last_peered":"2023-11-24T06:31:04.783762+0000","last_clean":"2023-11-24T06:31:04.783762+0000","last_became_active":"2023-11-24T06:31:03.797047+0000","last_became_peered":"2023-11-24T06:31:03.797047+0000","last_unstale":"2023-11-24T06:31:04.783762+0000","last_undegraded":"2023-11-24T06:31:04.783762+0000","last_fullsized":"2023-11-24T06:31:04.783762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:17.957352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785458+0000","last_change":"2023-11-24T06:31:04.801168+0000","last_active":"2023-11-24T06:31:05.785458+0000","last_peered":"2023-11-24T06:31:05.785458+0000","last_clean":"2023-11-24T06:31:05.785458+0000","last_became_active":"2023-11-24T06:31:04.800836+0000","last_became_peered":"2023-11-24T06:31:04.800836+0000","last_unstale":"2023-11-24T06:31:05.785458+0000","last_undegraded":"2023-11-24T06:31:05.785458+0000","last_fullsized":"2023-11-24T06:31:05.785458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:42:37.561025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.827095+0000","last_change":"2023-11-24T06:31:03.802498+0000","last_active":"2023-11-24T06:31:04.827095+0000","last_peered":"2023-11-24T06:31:04.827095+0000","last_clean":"2023-11-24T06:31:04.827095+0000","last_became_active":"2023-11-24T06:31:03.802233+0000","last_became_peered":"2023-11-24T06:31:03.802233+0000","last_unstale":"2023-11-24T06:31:04.827095+0000","last_undegraded":"2023-11-24T06:31:04.827095+0000","last_fullsized":"2023-11-24T06:31:04.827095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:30.695415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786507+0000","last_change":"2023-11-24T06:31:04.801916+0000","last_active":"2023-11-24T06:31:05.786507+0000","last_peered":"2023-11-24T06:31:05.786507+0000","last_clean":"2023-11-24T06:31:05.786507+0000","last_became_active":"2023-11-24T06:31:04.801627+0000","last_became_peered":"2023-11-24T06:31:04.801627+0000","last_unstale":"2023-11-24T06:31:05.786507+0000","last_undegraded":"2023-11-24T06:31:05.786507+0000","last_fullsized":"2023-11-24T06:31:05.786507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:46.182837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.789471+0000","last_change":"2023-11-24T06:31:03.797774+0000","last_active":"2023-11-24T06:31:04.789471+0000","last_peered":"2023-11-24T06:31:04.789471+0000","last_clean":"2023-11-24T06:31:04.789471+0000","last_became_active":"2023-11-24T06:31:03.797455+0000","last_became_peered":"2023-11-24T06:31:03.797455+0000","last_unstale":"2023-11-24T06:31:04.789471+0000","last_undegraded":"2023-11-24T06:31:04.789471+0000","last_fullsized":"2023-11-24T06:31:04.789471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:18.864705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050690+0000","last_change":"2023-11-24T06:31:04.816669+0000","last_active":"2023-11-24T06:31:06.050690+0000","last_peered":"2023-11-24T06:31:06.050690+0000","last_clean":"2023-11-24T06:31:06.050690+0000","last_became_active":"2023-11-24T06:31:04.816369+0000","last_became_peered":"2023-11-24T06:31:04.816369+0000","last_unstale":"2023-11-24T06:31:06.050690+0000","last_undegraded":"2023-11-24T06:31:06.050690+0000","last_fullsized":"2023-11-24T06:31:06.050690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:58.821104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.791068+0000","last_change":"2023-11-24T06:31:03.803086+0000","last_active":"2023-11-24T06:31:04.791068+0000","last_peered":"2023-11-24T06:31:04.791068+0000","last_clean":"2023-11-24T06:31:04.791068+0000","last_became_active":"2023-11-24T06:31:03.802569+0000","last_became_peered":"2023-11-24T06:31:03.802569+0000","last_unstale":"2023-11-24T06:31:04.791068+0000","last_undegraded":"2023-11-24T06:31:04.791068+0000","last_fullsized":"2023-11-24T06:31:04.791068+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:08.362504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050227+0000","last_change":"2023-11-24T06:31:04.793260+0000","last_active":"2023-11-24T06:31:06.050227+0000","last_peered":"2023-11-24T06:31:06.050227+0000","last_clean":"2023-11-24T06:31:06.050227+0000","last_became_active":"2023-11-24T06:31:04.792979+0000","last_became_peered":"2023-11-24T06:31:04.792979+0000","last_unstale":"2023-11-24T06:31:06.050227+0000","last_undegraded":"2023-11-24T06:31:06.050227+0000","last_fullsized":"2023-11-24T06:31:06.050227+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:00.492991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.798107+0000","last_change":"2023-11-24T06:31:03.799508+0000","last_active":"2023-11-24T06:31:04.798107+0000","last_peered":"2023-11-24T06:31:04.798107+0000","last_clean":"2023-11-24T06:31:04.798107+0000","last_became_active":"2023-11-24T06:31:03.799312+0000","last_became_peered":"2023-11-24T06:31:03.799312+0000","last_unstale":"2023-11-24T06:31:04.798107+0000","last_undegraded":"2023-11-24T06:31:04.798107+0000","last_fullsized":"2023-11-24T06:31:04.798107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:59.486572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787100+0000","last_change":"2023-11-24T06:31:04.807404+0000","last_active":"2023-11-24T06:31:05.787100+0000","last_peered":"2023-11-24T06:31:05.787100+0000","last_clean":"2023-11-24T06:31:05.787100+0000","last_became_active":"2023-11-24T06:31:04.807122+0000","last_became_peered":"2023-11-24T06:31:04.807122+0000","last_unstale":"2023-11-24T06:31:05.787100+0000","last_undegraded":"2023-11-24T06:31:05.787100+0000","last_fullsized":"2023-11-24T06:31:05.787100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:12.880888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.784319+0000","last_change":"2023-11-24T06:31:03.805983+0000","last_active":"2023-11-24T06:31:04.784319+0000","last_peered":"2023-11-24T06:31:04.784319+0000","last_clean":"2023-11-24T06:31:04.784319+0000","last_became_active":"2023-11-24T06:31:03.805360+0000","last_became_peered":"2023-11-24T06:31:03.805360+0000","last_unstale":"2023-11-24T06:31:04.784319+0000","last_undegraded":"2023-11-24T06:31:04.784319+0000","last_fullsized":"2023-11-24T06:31:04.784319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:09.203545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050663+0000","last_change":"2023-11-24T06:31:04.800369+0000","last_active":"2023-11-24T06:31:06.050663+0000","last_peered":"2023-11-24T06:31:06.050663+0000","last_clean":"2023-11-24T06:31:06.050663+0000","last_became_active":"2023-11-24T06:31:04.799962+0000","last_became_peered":"2023-11-24T06:31:04.799962+0000","last_unstale":"2023-11-24T06:31:06.050663+0000","last_undegraded":"2023-11-24T06:31:06.050663+0000","last_fullsized":"2023-11-24T06:31:06.050663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:21.097556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.795667+0000","last_change":"2023-11-24T06:31:03.804481+0000","last_active":"2023-11-24T06:31:04.795667+0000","last_peered":"2023-11-24T06:31:04.795667+0000","last_clean":"2023-11-24T06:31:04.795667+0000","last_became_active":"2023-11-24T06:31:03.804159+0000","last_became_peered":"2023-11-24T06:31:03.804159+0000","last_unstale":"2023-11-24T06:31:04.795667+0000","last_undegraded":"2023-11-24T06:31:04.795667+0000","last_fullsized":"2023-11-24T06:31:04.795667+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:11.744302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051867+0000","last_change":"2023-11-24T06:31:04.809473+0000","last_active":"2023-11-24T06:31:06.051867+0000","last_peered":"2023-11-24T06:31:06.051867+0000","last_clean":"2023-11-24T06:31:06.051867+0000","last_became_active":"2023-11-24T06:31:04.809188+0000","last_became_peered":"2023-11-24T06:31:04.809188+0000","last_unstale":"2023-11-24T06:31:06.051867+0000","last_undegraded":"2023-11-24T06:31:06.051867+0000","last_fullsized":"2023-11-24T06:31:06.051867+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:38.530757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.786747+0000","last_change":"2023-11-24T06:31:03.796217+0000","last_active":"2023-11-24T06:31:04.786747+0000","last_peered":"2023-11-24T06:31:04.786747+0000","last_clean":"2023-11-24T06:31:04.786747+0000","last_became_active":"2023-11-24T06:31:03.795905+0000","last_became_peered":"2023-11-24T06:31:03.795905+0000","last_unstale":"2023-11-24T06:31:04.786747+0000","last_undegraded":"2023-11-24T06:31:04.786747+0000","last_fullsized":"2023-11-24T06:31:04.786747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:44:50.597177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785548+0000","last_change":"2023-11-24T06:31:04.796411+0000","last_active":"2023-11-24T06:31:05.785548+0000","last_peered":"2023-11-24T06:31:05.785548+0000","last_clean":"2023-11-24T06:31:05.785548+0000","last_became_active":"2023-11-24T06:31:04.796084+0000","last_became_peered":"2023-11-24T06:31:04.796084+0000","last_unstale":"2023-11-24T06:31:05.785548+0000","last_undegraded":"2023-11-24T06:31:05.785548+0000","last_fullsized":"2023-11-24T06:31:05.785548+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:11:10.210512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.795158+0000","last_change":"2023-11-24T06:31:03.809752+0000","last_active":"2023-11-24T06:31:04.795158+0000","last_peered":"2023-11-24T06:31:04.795158+0000","last_clean":"2023-11-24T06:31:04.795158+0000","last_became_active":"2023-11-24T06:31:03.809477+0000","last_became_peered":"2023-11-24T06:31:03.809477+0000","last_unstale":"2023-11-24T06:31:04.795158+0000","last_undegraded":"2023-11-24T06:31:04.795158+0000","last_fullsized":"2023-11-24T06:31:04.795158+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:04:03.625854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785567+0000","last_change":"2023-11-24T06:31:04.811818+0000","last_active":"2023-11-24T06:31:05.785567+0000","last_peered":"2023-11-24T06:31:05.785567+0000","last_clean":"2023-11-24T06:31:05.785567+0000","last_became_active":"2023-11-24T06:31:04.811507+0000","last_became_peered":"2023-11-24T06:31:04.811507+0000","last_unstale":"2023-11-24T06:31:05.785567+0000","last_undegraded":"2023-11-24T06:31:05.785567+0000","last_fullsized":"2023-11-24T06:31:05.785567+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:46.675550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.792258+0000","last_change":"2023-11-24T06:31:03.804921+0000","last_active":"2023-11-24T06:31:04.792258+0000","last_peered":"2023-11-24T06:31:04.792258+0000","last_clean":"2023-11-24T06:31:04.792258+0000","last_became_active":"2023-11-24T06:31:03.804596+0000","last_became_peered":"2023-11-24T06:31:03.804596+0000","last_unstale":"2023-11-24T06:31:04.792258+0000","last_undegraded":"2023-11-24T06:31:04.792258+0000","last_fullsized":"2023-11-24T06:31:04.792258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:45.176418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052297+0000","last_change":"2023-11-24T06:31:04.803938+0000","last_active":"2023-11-24T06:31:06.052297+0000","last_peered":"2023-11-24T06:31:06.052297+0000","last_clean":"2023-11-24T06:31:06.052297+0000","last_became_active":"2023-11-24T06:31:04.803648+0000","last_became_peered":"2023-11-24T06:31:04.803648+0000","last_unstale":"2023-11-24T06:31:06.052297+0000","last_undegraded":"2023-11-24T06:31:06.052297+0000","last_fullsized":"2023-11-24T06:31:06.052297+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:13.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.786561+0000","last_change":"2023-11-24T06:31:03.796465+0000","last_active":"2023-11-24T06:31:04.786561+0000","last_peered":"2023-11-24T06:31:04.786561+0000","last_clean":"2023-11-24T06:31:04.786561+0000","last_became_active":"2023-11-24T06:31:03.796194+0000","last_became_peered":"2023-11-24T06:31:03.796194+0000","last_unstale":"2023-11-24T06:31:04.786561+0000","last_undegraded":"2023-11-24T06:31:04.786561+0000","last_fullsized":"2023-11-24T06:31:04.786561+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:07.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051971+0000","last_change":"2023-11-24T06:31:04.812246+0000","last_active":"2023-11-24T06:31:06.051971+0000","last_peered":"2023-11-24T06:31:06.051971+0000","last_clean":"2023-11-24T06:31:06.051971+0000","last_became_active":"2023-11-24T06:31:04.811872+0000","last_became_peered":"2023-11-24T06:31:04.811872+0000","last_unstale":"2023-11-24T06:31:06.051971+0000","last_undegraded":"2023-11-24T06:31:06.051971+0000","last_fullsized":"2023-11-24T06:31:06.051971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:44.377467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.791594+0000","last_change":"2023-11-24T06:31:03.799041+0000","last_active":"2023-11-24T06:31:04.791594+0000","last_peered":"2023-11-24T06:31:04.791594+0000","last_clean":"2023-11-24T06:31:04.791594+0000","last_became_active":"2023-11-24T06:31:03.798401+0000","last_became_peered":"2023-11-24T06:31:03.798401+0000","last_unstale":"2023-11-24T06:31:04.791594+0000","last_undegraded":"2023-11-24T06:31:04.791594+0000","last_fullsized":"2023-11-24T06:31:04.791594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:43.371048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050974+0000","last_change":"2023-11-24T06:31:04.815105+0000","last_active":"2023-11-24T06:31:06.050974+0000","last_peered":"2023-11-24T06:31:06.050974+0000","last_clean":"2023-11-24T06:31:06.050974+0000","last_became_active":"2023-11-24T06:31:04.814850+0000","last_became_peered":"2023-11-24T06:31:04.814850+0000","last_unstale":"2023-11-24T06:31:06.050974+0000","last_undegraded":"2023-11-24T06:31:06.050974+0000","last_fullsized":"2023-11-24T06:31:06.050974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:10.209964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826031+0000","last_change":"2023-11-24T06:31:03.802227+0000","last_active":"2023-11-24T06:31:04.826031+0000","last_peered":"2023-11-24T06:31:04.826031+0000","last_clean":"2023-11-24T06:31:04.826031+0000","last_became_active":"2023-11-24T06:31:03.801927+0000","last_became_peered":"2023-11-24T06:31:03.801927+0000","last_unstale":"2023-11-24T06:31:04.826031+0000","last_undegraded":"2023-11-24T06:31:04.826031+0000","last_fullsized":"2023-11-24T06:31:04.826031+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:46.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.798249+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:04.798249+0000","last_peered":"2023-11-24T06:31:04.798249+0000","last_clean":"2023-11-24T06:31:04.798249+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:04.798249+0000","last_undegraded":"2023-11-24T06:31:04.798249+0000","last_fullsized":"2023-11-24T06:31:04.798249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":799516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.622}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.755}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":209730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.745}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":209128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.752},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":210670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.749},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":209696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.62},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.81599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":210692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.75},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":209128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.25},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.375},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.501},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":798491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.38}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.629}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:13.421 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:13.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.562+0000 7fce5dc9a640 1 Processor -- start 2023-11-24T06:31:13.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.562+0000 7fce5dc9a640 1 -- start start 2023-11-24T06:31:13.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce5dc9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce5809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce5dc9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5806d8b0 con 0x7fce58144030 2023-11-24T06:31:13.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce5dc9a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5806cca0 con 0x7fce5806c650 2023-11-24T06:31:13.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce5dc9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce58145020 con 0x7fce580710d0 2023-11-24T06:31:13.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce577fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fce58144030 0x7fce5806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57920/0 (socket says 172.21.15.143:57920) 2023-11-24T06:31:13.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce577fe640 1 -- 172.21.15.143:0/1115020224 learned_addr learned my addr 172.21.15.143:0/1115020224 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce57fff640 1 --2- 172.21.15.143:0/1115020224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce5809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367529563 0 0) 0x7fce5806d8b0 con 0x7fce58144030 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce44003530 con 0x7fce58144030 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637565534 0 0) 0x7fce5806cca0 con 0x7fce5806c650 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce5806d8b0 con 0x7fce5806c650 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce57fff640 1 -- 172.21.15.143:0/1115020224 >> v1:172.21.15.146:6789/0 conn(0x7fce5806c650 legacy=0x7fce580709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce57fff640 1 -- 172.21.15.143:0/1115020224 >> v1:172.21.15.143:6789/0 conn(0x7fce58144030 legacy=0x7fce5806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165879156 0 0) 0x7fce44003530 con 0x7fce58144030 2023-11-24T06:31:13.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.566+0000 7fce57fff640 1 -- 172.21.15.143:0/1115020224 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5806cf80 con 0x7fce580710d0 2023-11-24T06:31:13.574 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce57fff640 1 --2- 172.21.15.143:0/1115020224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce5809cc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce50009dc0 tx=0x7fce5001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3f14784fb6fca1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:13.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48001680 con 0x7fce580710d0 2023-11-24T06:31:13.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce500a55c0 con 0x7fce580710d0 2023-11-24T06:31:13.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce56ffd640 1 -- 172.21.15.143:0/1115020224 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500a5950 con 0x7fce580710d0 2023-11-24T06:31:13.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 -- 172.21.15.143:0/1115020224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 msgr2=0x7fce5809cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/1115020224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce5809cc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce50009dc0 tx=0x7fce5001c890 comp rx=0 tx=0).stop 2023-11-24T06:31:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 -- 172.21.15.143:0/1115020224 shutdown_connections 2023-11-24T06:31:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/1115020224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce5809cc20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 -- 172.21.15.143:0/1115020224 >> 172.21.15.143:0/1115020224 conn(0x7fce580b0bf0 msgr2=0x7fce580b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 -- 172.21.15.143:0/1115020224 shutdown_connections 2023-11-24T06:31:13.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.570+0000 7fce5dc9a640 1 -- 172.21.15.143:0/1115020224 wait complete. 2023-11-24T06:31:13.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 Processor -- start 2023-11-24T06:31:13.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- start start 2023-11-24T06:31:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce5806c650 0x7fce58156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce581584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 0x7fce58139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5809c220 con 0x7fce58144030 2023-11-24T06:31:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5809b350 con 0x7fce5806c650 2023-11-24T06:31:13.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5809b5a0 con 0x7fce580710d0 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 0x7fce58139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 0x7fce58139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43174/0 (socket says 172.21.15.143:43174) 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 -- 172.21.15.143:0/211070758 learned_addr learned my addr 172.21.15.143:0/211070758 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce577fe640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce5806c650 0x7fce58156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce4ffff640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce581584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 -- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 msgr2=0x7fce581584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce581584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 -- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce5806c650 msgr2=0x7fce58156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce5806c650 0x7fce58156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 -- 172.21.15.143:0/211070758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009a70 con 0x7fce58144030 2023-11-24T06:31:13.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce57fff640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 0x7fce58139370 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fce5001af40 tx=0x7fce50019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:13.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500ad440 con 0x7fce58144030 2023-11-24T06:31:13.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce500ad5a0 con 0x7fce58144030 2023-11-24T06:31:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500ad950 con 0x7fce58144030 2023-11-24T06:31:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5809b880 con 0x7fce58144030 2023-11-24T06:31:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5809be40 con 0x7fce58144030 2023-11-24T06:31:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.574+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5809c360 con 0x7fce58144030 2023-11-24T06:31:13.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.578+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fce500adab0 con 0x7fce58144030 2023-11-24T06:31:13.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.578+0000 7fce54ff9640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce38066500 0x7fce380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.578+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce5011ef60 con 0x7fce58144030 2023-11-24T06:31:13.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.578+0000 7fce577fe640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce38066500 0x7fce380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.578+0000 7fce577fe640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce38066500 0x7fce380689c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fce48000fe0 tx=0x7fce4800f1d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:13.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.582+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce5809c360 con 0x7fce58144030 2023-11-24T06:31:13.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.730+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce580ae6d0 con 0x7fce38066500 2023-11-24T06:31:13.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.738+0000 7fce54ff9640 1 -- 172.21.15.143:0/211070758 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288875 (secure 0 0 0) 0x7fce48005990 con 0x7fce38066500 2023-11-24T06:31:13.744 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:13.746 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce38066500 msgr2=0x7fce380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce38066500 0x7fce380689c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fce48000fe0 tx=0x7fce4800f1d0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 msgr2=0x7fce58139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 0x7fce58139370 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fce5001af40 tx=0x7fce50019630 comp rx=0 tx=0).stop 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 shutdown_connections 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fce38066500 0x7fce380689c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce58144030 0x7fce58139370 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce580710d0 0x7fce581584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 --2- 172.21.15.143:0/211070758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce5806c650 0x7fce58156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 >> 172.21.15.143:0/211070758 conn(0x7fce580b0bf0 msgr2=0x7fce580b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 shutdown_connections 2023-11-24T06:31:13.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.742+0000 7fce5dc9a640 1 -- 172.21.15.143:0/211070758 wait complete. 2023-11-24T06:31:13.765 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-11-24T06:31:12.223444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221428,"kb_used_data":5252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753292,"statfs":{"total":773094113280,"available":772867371008,"internally_reserved":0,"allocated":5378048,"data_stored":2857051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001433"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051459+0000","last_change":"2023-11-24T06:31:04.808749+0000","last_active":"2023-11-24T06:31:06.051459+0000","last_peered":"2023-11-24T06:31:06.051459+0000","last_clean":"2023-11-24T06:31:06.051459+0000","last_became_active":"2023-11-24T06:31:04.808357+0000","last_became_peered":"2023-11-24T06:31:04.808357+0000","last_unstale":"2023-11-24T06:31:06.051459+0000","last_undegraded":"2023-11-24T06:31:06.051459+0000","last_fullsized":"2023-11-24T06:31:06.051459+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:55.547711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052787+0000","last_change":"2023-11-24T06:31:04.801206+0000","last_active":"2023-11-24T06:31:06.052787+0000","last_peered":"2023-11-24T06:31:06.052787+0000","last_clean":"2023-11-24T06:31:06.052787+0000","last_became_active":"2023-11-24T06:31:04.800897+0000","last_became_peered":"2023-11-24T06:31:04.800897+0000","last_unstale":"2023-11-24T06:31:06.052787+0000","last_undegraded":"2023-11-24T06:31:06.052787+0000","last_fullsized":"2023-11-24T06:31:06.052787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.963771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051188+0000","last_change":"2023-11-24T06:31:04.810578+0000","last_active":"2023-11-24T06:31:06.051188+0000","last_peered":"2023-11-24T06:31:06.051188+0000","last_clean":"2023-11-24T06:31:06.051188+0000","last_became_active":"2023-11-24T06:31:04.808404+0000","last_became_peered":"2023-11-24T06:31:04.808404+0000","last_unstale":"2023-11-24T06:31:06.051188+0000","last_undegraded":"2023-11-24T06:31:06.051188+0000","last_fullsized":"2023-11-24T06:31:06.051188+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:56.604961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050601+0000","last_change":"2023-11-24T06:31:04.823771+0000","last_active":"2023-11-24T06:31:06.050601+0000","last_peered":"2023-11-24T06:31:06.050601+0000","last_clean":"2023-11-24T06:31:06.050601+0000","last_became_active":"2023-11-24T06:31:04.823446+0000","last_became_peered":"2023-11-24T06:31:04.823446+0000","last_unstale":"2023-11-24T06:31:06.050601+0000","last_undegraded":"2023-11-24T06:31:06.050601+0000","last_fullsized":"2023-11-24T06:31:06.050601+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:31.701834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052549+0000","last_change":"2023-11-24T06:31:04.825324+0000","last_active":"2023-11-24T06:31:06.052549+0000","last_peered":"2023-11-24T06:31:06.052549+0000","last_clean":"2023-11-24T06:31:06.052549+0000","last_became_active":"2023-11-24T06:31:04.825018+0000","last_became_peered":"2023-11-24T06:31:04.825018+0000","last_unstale":"2023-11-24T06:31:06.052549+0000","last_undegraded":"2023-11-24T06:31:06.052549+0000","last_fullsized":"2023-11-24T06:31:06.052549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:12.750721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785409+0000","last_change":"2023-11-24T06:31:04.797374+0000","last_active":"2023-11-24T06:31:05.785409+0000","last_peered":"2023-11-24T06:31:05.785409+0000","last_clean":"2023-11-24T06:31:05.785409+0000","last_became_active":"2023-11-24T06:31:04.797102+0000","last_became_peered":"2023-11-24T06:31:04.797102+0000","last_unstale":"2023-11-24T06:31:05.785409+0000","last_undegraded":"2023-11-24T06:31:05.785409+0000","last_fullsized":"2023-11-24T06:31:05.785409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:21.391572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051690+0000","last_change":"2023-11-24T06:31:04.810775+0000","last_active":"2023-11-24T06:31:06.051690+0000","last_peered":"2023-11-24T06:31:06.051690+0000","last_clean":"2023-11-24T06:31:06.051690+0000","last_became_active":"2023-11-24T06:31:04.810436+0000","last_became_peered":"2023-11-24T06:31:04.810436+0000","last_unstale":"2023-11-24T06:31:06.051690+0000","last_undegraded":"2023-11-24T06:31:06.051690+0000","last_fullsized":"2023-11-24T06:31:06.051690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:31.701834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050038+0000","last_change":"2023-11-24T06:31:04.821607+0000","last_active":"2023-11-24T06:31:06.050038+0000","last_peered":"2023-11-24T06:31:06.050038+0000","last_clean":"2023-11-24T06:31:06.050038+0000","last_became_active":"2023-11-24T06:31:04.821218+0000","last_became_peered":"2023-11-24T06:31:04.821218+0000","last_unstale":"2023-11-24T06:31:06.050038+0000","last_undegraded":"2023-11-24T06:31:06.050038+0000","last_fullsized":"2023-11-24T06:31:06.050038+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:13.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051028+0000","last_change":"2023-11-24T06:31:04.798829+0000","last_active":"2023-11-24T06:31:06.051028+0000","last_peered":"2023-11-24T06:31:06.051028+0000","last_clean":"2023-11-24T06:31:06.051028+0000","last_became_active":"2023-11-24T06:31:04.797941+0000","last_became_peered":"2023-11-24T06:31:04.797941+0000","last_unstale":"2023-11-24T06:31:06.051028+0000","last_undegraded":"2023-11-24T06:31:06.051028+0000","last_fullsized":"2023-11-24T06:31:06.051028+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:37:50.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050964+0000","last_change":"2023-11-24T06:31:04.811708+0000","last_active":"2023-11-24T06:31:06.050964+0000","last_peered":"2023-11-24T06:31:06.050964+0000","last_clean":"2023-11-24T06:31:06.050964+0000","last_became_active":"2023-11-24T06:31:04.810905+0000","last_became_peered":"2023-11-24T06:31:04.810905+0000","last_unstale":"2023-11-24T06:31:06.050964+0000","last_undegraded":"2023-11-24T06:31:06.050964+0000","last_fullsized":"2023-11-24T06:31:06.050964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:38.530757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050817+0000","last_change":"2023-11-24T06:31:04.805538+0000","last_active":"2023-11-24T06:31:06.050817+0000","last_peered":"2023-11-24T06:31:06.050817+0000","last_clean":"2023-11-24T06:31:06.050817+0000","last_became_active":"2023-11-24T06:31:04.801975+0000","last_became_peered":"2023-11-24T06:31:04.801975+0000","last_unstale":"2023-11-24T06:31:06.050817+0000","last_undegraded":"2023-11-24T06:31:06.050817+0000","last_fullsized":"2023-11-24T06:31:06.050817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:10.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052639+0000","last_change":"2023-11-24T06:31:04.805141+0000","last_active":"2023-11-24T06:31:06.052639+0000","last_peered":"2023-11-24T06:31:06.052639+0000","last_clean":"2023-11-24T06:31:06.052639+0000","last_became_active":"2023-11-24T06:31:04.804666+0000","last_became_peered":"2023-11-24T06:31:04.804666+0000","last_unstale":"2023-11-24T06:31:06.052639+0000","last_undegraded":"2023-11-24T06:31:06.052639+0000","last_fullsized":"2023-11-24T06:31:06.052639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:00.492991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050098+0000","last_change":"2023-11-24T06:31:04.807947+0000","last_active":"2023-11-24T06:31:06.050098+0000","last_peered":"2023-11-24T06:31:06.050098+0000","last_clean":"2023-11-24T06:31:06.050098+0000","last_became_active":"2023-11-24T06:31:04.807646+0000","last_became_peered":"2023-11-24T06:31:04.807646+0000","last_unstale":"2023-11-24T06:31:06.050098+0000","last_undegraded":"2023-11-24T06:31:06.050098+0000","last_fullsized":"2023-11-24T06:31:06.050098+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:17.420423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050498+0000","last_change":"2023-11-24T06:31:04.802200+0000","last_active":"2023-11-24T06:31:06.050498+0000","last_peered":"2023-11-24T06:31:06.050498+0000","last_clean":"2023-11-24T06:31:06.050498+0000","last_became_active":"2023-11-24T06:31:04.801922+0000","last_became_peered":"2023-11-24T06:31:04.801922+0000","last_unstale":"2023-11-24T06:31:06.050498+0000","last_undegraded":"2023-11-24T06:31:06.050498+0000","last_fullsized":"2023-11-24T06:31:06.050498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:21.632487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785252+0000","last_change":"2023-11-24T06:31:04.799096+0000","last_active":"2023-11-24T06:31:05.785252+0000","last_peered":"2023-11-24T06:31:05.785252+0000","last_clean":"2023-11-24T06:31:05.785252+0000","last_became_active":"2023-11-24T06:31:04.798820+0000","last_became_peered":"2023-11-24T06:31:04.798820+0000","last_unstale":"2023-11-24T06:31:05.785252+0000","last_undegraded":"2023-11-24T06:31:05.785252+0000","last_fullsized":"2023-11-24T06:31:05.785252+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:55.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786724+0000","last_change":"2023-11-24T06:31:04.811422+0000","last_active":"2023-11-24T06:31:05.786724+0000","last_peered":"2023-11-24T06:31:05.786724+0000","last_clean":"2023-11-24T06:31:05.786724+0000","last_became_active":"2023-11-24T06:31:04.807340+0000","last_became_peered":"2023-11-24T06:31:04.807340+0000","last_unstale":"2023-11-24T06:31:05.786724+0000","last_undegraded":"2023-11-24T06:31:05.786724+0000","last_fullsized":"2023-11-24T06:31:05.786724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:27.110779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052094+0000","last_change":"2023-11-24T06:31:04.808355+0000","last_active":"2023-11-24T06:31:06.052094+0000","last_peered":"2023-11-24T06:31:06.052094+0000","last_clean":"2023-11-24T06:31:06.052094+0000","last_became_active":"2023-11-24T06:31:04.808041+0000","last_became_peered":"2023-11-24T06:31:04.808041+0000","last_unstale":"2023-11-24T06:31:06.052094+0000","last_undegraded":"2023-11-24T06:31:06.052094+0000","last_fullsized":"2023-11-24T06:31:06.052094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:47.039826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051307+0000","last_change":"2023-11-24T06:31:04.804745+0000","last_active":"2023-11-24T06:31:06.051307+0000","last_peered":"2023-11-24T06:31:06.051307+0000","last_clean":"2023-11-24T06:31:06.051307+0000","last_became_active":"2023-11-24T06:31:04.804397+0000","last_became_peered":"2023-11-24T06:31:04.804397+0000","last_unstale":"2023-11-24T06:31:06.051307+0000","last_undegraded":"2023-11-24T06:31:06.051307+0000","last_fullsized":"2023-11-24T06:31:06.051307+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:38.764900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787030+0000","last_change":"2023-11-24T06:31:04.810560+0000","last_active":"2023-11-24T06:31:05.787030+0000","last_peered":"2023-11-24T06:31:05.787030+0000","last_clean":"2023-11-24T06:31:05.787030+0000","last_became_active":"2023-11-24T06:31:04.807293+0000","last_became_peered":"2023-11-24T06:31:04.807293+0000","last_unstale":"2023-11-24T06:31:05.787030+0000","last_undegraded":"2023-11-24T06:31:05.787030+0000","last_fullsized":"2023-11-24T06:31:05.787030+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:56.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050288+0000","last_change":"2023-11-24T06:31:04.802832+0000","last_active":"2023-11-24T06:31:06.050288+0000","last_peered":"2023-11-24T06:31:06.050288+0000","last_clean":"2023-11-24T06:31:06.050288+0000","last_became_active":"2023-11-24T06:31:04.799650+0000","last_became_peered":"2023-11-24T06:31:04.799650+0000","last_unstale":"2023-11-24T06:31:06.050288+0000","last_undegraded":"2023-11-24T06:31:06.050288+0000","last_fullsized":"2023-11-24T06:31:06.050288+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:32.139638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785409+0000","last_change":"2023-11-24T06:31:04.819197+0000","last_active":"2023-11-24T06:31:05.785409+0000","last_peered":"2023-11-24T06:31:05.785409+0000","last_clean":"2023-11-24T06:31:05.785409+0000","last_became_active":"2023-11-24T06:31:04.818943+0000","last_became_peered":"2023-11-24T06:31:04.818943+0000","last_unstale":"2023-11-24T06:31:05.785409+0000","last_undegraded":"2023-11-24T06:31:05.785409+0000","last_fullsized":"2023-11-24T06:31:05.785409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:27.457469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050580+0000","last_change":"2023-11-24T06:31:04.812075+0000","last_active":"2023-11-24T06:31:06.050580+0000","last_peered":"2023-11-24T06:31:06.050580+0000","last_clean":"2023-11-24T06:31:06.050580+0000","last_became_active":"2023-11-24T06:31:04.811798+0000","last_became_peered":"2023-11-24T06:31:04.811798+0000","last_unstale":"2023-11-24T06:31:06.050580+0000","last_undegraded":"2023-11-24T06:31:06.050580+0000","last_fullsized":"2023-11-24T06:31:06.050580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.963771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786545+0000","last_change":"2023-11-24T06:31:04.813796+0000","last_active":"2023-11-24T06:31:05.786545+0000","last_peered":"2023-11-24T06:31:05.786545+0000","last_clean":"2023-11-24T06:31:05.786545+0000","last_became_active":"2023-11-24T06:31:04.813495+0000","last_became_peered":"2023-11-24T06:31:04.813495+0000","last_unstale":"2023-11-24T06:31:05.786545+0000","last_undegraded":"2023-11-24T06:31:05.786545+0000","last_fullsized":"2023-11-24T06:31:05.786545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:15.775231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786895+0000","last_change":"2023-11-24T06:31:04.815957+0000","last_active":"2023-11-24T06:31:05.786895+0000","last_peered":"2023-11-24T06:31:05.786895+0000","last_clean":"2023-11-24T06:31:05.786895+0000","last_became_active":"2023-11-24T06:31:04.815665+0000","last_became_peered":"2023-11-24T06:31:04.815665+0000","last_unstale":"2023-11-24T06:31:05.786895+0000","last_undegraded":"2023-11-24T06:31:05.786895+0000","last_fullsized":"2023-11-24T06:31:05.786895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:36.162099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786895+0000","last_change":"2023-11-24T06:31:04.813606+0000","last_active":"2023-11-24T06:31:05.786895+0000","last_peered":"2023-11-24T06:31:05.786895+0000","last_clean":"2023-11-24T06:31:05.786895+0000","last_became_active":"2023-11-24T06:31:04.813331+0000","last_became_peered":"2023-11-24T06:31:04.813331+0000","last_unstale":"2023-11-24T06:31:05.786895+0000","last_undegraded":"2023-11-24T06:31:05.786895+0000","last_fullsized":"2023-11-24T06:31:05.786895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:44:51.603596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050304+0000","last_change":"2023-11-24T06:31:04.812554+0000","last_active":"2023-11-24T06:31:06.050304+0000","last_peered":"2023-11-24T06:31:06.050304+0000","last_clean":"2023-11-24T06:31:06.050304+0000","last_became_active":"2023-11-24T06:31:04.810849+0000","last_became_peered":"2023-11-24T06:31:04.810849+0000","last_unstale":"2023-11-24T06:31:06.050304+0000","last_undegraded":"2023-11-24T06:31:06.050304+0000","last_fullsized":"2023-11-24T06:31:06.050304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:33:17.219549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051356+0000","last_change":"2023-11-24T06:31:04.808335+0000","last_active":"2023-11-24T06:31:06.051356+0000","last_peered":"2023-11-24T06:31:06.051356+0000","last_clean":"2023-11-24T06:31:06.051356+0000","last_became_active":"2023-11-24T06:31:04.807956+0000","last_became_peered":"2023-11-24T06:31:04.807956+0000","last_unstale":"2023-11-24T06:31:06.051356+0000","last_undegraded":"2023-11-24T06:31:06.051356+0000","last_fullsized":"2023-11-24T06:31:06.051356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:09.368923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052665+0000","last_change":"2023-11-24T06:31:04.804930+0000","last_active":"2023-11-24T06:31:06.052665+0000","last_peered":"2023-11-24T06:31:06.052665+0000","last_clean":"2023-11-24T06:31:06.052665+0000","last_became_active":"2023-11-24T06:31:04.804305+0000","last_became_peered":"2023-11-24T06:31:04.804305+0000","last_unstale":"2023-11-24T06:31:06.052665+0000","last_undegraded":"2023-11-24T06:31:06.052665+0000","last_fullsized":"2023-11-24T06:31:06.052665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:21.632487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786990+0000","last_change":"2023-11-24T06:31:04.811657+0000","last_active":"2023-11-24T06:31:05.786990+0000","last_peered":"2023-11-24T06:31:05.786990+0000","last_clean":"2023-11-24T06:31:05.786990+0000","last_became_active":"2023-11-24T06:31:04.807427+0000","last_became_peered":"2023-11-24T06:31:04.807427+0000","last_unstale":"2023-11-24T06:31:05.786990+0000","last_undegraded":"2023-11-24T06:31:05.786990+0000","last_fullsized":"2023-11-24T06:31:05.786990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:44.347785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051323+0000","last_change":"2023-11-24T06:31:04.813486+0000","last_active":"2023-11-24T06:31:06.051323+0000","last_peered":"2023-11-24T06:31:06.051323+0000","last_clean":"2023-11-24T06:31:06.051323+0000","last_became_active":"2023-11-24T06:31:04.813077+0000","last_became_peered":"2023-11-24T06:31:04.813077+0000","last_unstale":"2023-11-24T06:31:06.051323+0000","last_undegraded":"2023-11-24T06:31:06.051323+0000","last_fullsized":"2023-11-24T06:31:06.051323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:19.871124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785255+0000","last_change":"2023-11-24T06:31:04.802365+0000","last_active":"2023-11-24T06:31:05.785255+0000","last_peered":"2023-11-24T06:31:05.785255+0000","last_clean":"2023-11-24T06:31:05.785255+0000","last_became_active":"2023-11-24T06:31:04.801307+0000","last_became_peered":"2023-11-24T06:31:04.801307+0000","last_unstale":"2023-11-24T06:31:05.785255+0000","last_undegraded":"2023-11-24T06:31:05.785255+0000","last_fullsized":"2023-11-24T06:31:05.785255+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:22:55.144592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050558+0000","last_change":"2023-11-24T06:31:04.801172+0000","last_active":"2023-11-24T06:31:06.050558+0000","last_peered":"2023-11-24T06:31:06.050558+0000","last_clean":"2023-11-24T06:31:06.050558+0000","last_became_active":"2023-11-24T06:31:04.800003+0000","last_became_peered":"2023-11-24T06:31:04.800003+0000","last_unstale":"2023-11-24T06:31:06.050558+0000","last_undegraded":"2023-11-24T06:31:06.050558+0000","last_fullsized":"2023-11-24T06:31:06.050558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:43:09.979433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786711+0000","last_change":"2023-11-24T06:31:04.795033+0000","last_active":"2023-11-24T06:31:05.786711+0000","last_peered":"2023-11-24T06:31:05.786711+0000","last_clean":"2023-11-24T06:31:05.786711+0000","last_became_active":"2023-11-24T06:31:04.794776+0000","last_became_peered":"2023-11-24T06:31:04.794776+0000","last_unstale":"2023-11-24T06:31:05.786711+0000","last_undegraded":"2023-11-24T06:31:05.786711+0000","last_fullsized":"2023-11-24T06:31:05.786711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:56.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826973+0000","last_change":"2023-11-24T06:31:03.797084+0000","last_active":"2023-11-24T06:31:04.826973+0000","last_peered":"2023-11-24T06:31:04.826973+0000","last_clean":"2023-11-24T06:31:04.826973+0000","last_became_active":"2023-11-24T06:31:03.796775+0000","last_became_peered":"2023-11-24T06:31:03.796775+0000","last_unstale":"2023-11-24T06:31:04.826973+0000","last_undegraded":"2023-11-24T06:31:04.826973+0000","last_fullsized":"2023-11-24T06:31:04.826973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:21.050211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787036+0000","last_change":"2023-11-24T06:31:04.810481+0000","last_active":"2023-11-24T06:31:05.787036+0000","last_peered":"2023-11-24T06:31:05.787036+0000","last_clean":"2023-11-24T06:31:05.787036+0000","last_became_active":"2023-11-24T06:31:04.806701+0000","last_became_peered":"2023-11-24T06:31:04.806701+0000","last_unstale":"2023-11-24T06:31:05.787036+0000","last_undegraded":"2023-11-24T06:31:05.787036+0000","last_fullsized":"2023-11-24T06:31:05.787036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:46.519446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.829761+0000","last_change":"2023-11-24T06:31:03.805039+0000","last_active":"2023-11-24T06:31:04.829761+0000","last_peered":"2023-11-24T06:31:04.829761+0000","last_clean":"2023-11-24T06:31:04.829761+0000","last_became_active":"2023-11-24T06:31:03.804728+0000","last_became_peered":"2023-11-24T06:31:03.804728+0000","last_unstale":"2023-11-24T06:31:04.829761+0000","last_undegraded":"2023-11-24T06:31:04.829761+0000","last_fullsized":"2023-11-24T06:31:04.829761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:26.104360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052827+0000","last_change":"2023-11-24T06:31:04.811971+0000","last_active":"2023-11-24T06:31:06.052827+0000","last_peered":"2023-11-24T06:31:06.052827+0000","last_clean":"2023-11-24T06:31:06.052827+0000","last_became_active":"2023-11-24T06:31:04.811571+0000","last_became_peered":"2023-11-24T06:31:04.811571+0000","last_unstale":"2023-11-24T06:31:06.052827+0000","last_undegraded":"2023-11-24T06:31:06.052827+0000","last_fullsized":"2023-11-24T06:31:06.052827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:55.547711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.824567+0000","last_change":"2023-11-24T06:31:03.796384+0000","last_active":"2023-11-24T06:31:04.824567+0000","last_peered":"2023-11-24T06:31:04.824567+0000","last_clean":"2023-11-24T06:31:04.824567+0000","last_became_active":"2023-11-24T06:31:03.795918+0000","last_became_peered":"2023-11-24T06:31:03.795918+0000","last_unstale":"2023-11-24T06:31:04.824567+0000","last_undegraded":"2023-11-24T06:31:04.824567+0000","last_fullsized":"2023-11-24T06:31:04.824567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:35.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786772+0000","last_change":"2023-11-24T06:31:04.814458+0000","last_active":"2023-11-24T06:31:05.786772+0000","last_peered":"2023-11-24T06:31:05.786772+0000","last_clean":"2023-11-24T06:31:05.786772+0000","last_became_active":"2023-11-24T06:31:04.814228+0000","last_became_peered":"2023-11-24T06:31:04.814228+0000","last_unstale":"2023-11-24T06:31:05.786772+0000","last_undegraded":"2023-11-24T06:31:05.786772+0000","last_fullsized":"2023-11-24T06:31:05.786772+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:46.519446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.822909+0000","last_change":"2023-11-24T06:31:03.803229+0000","last_active":"2023-11-24T06:31:04.822909+0000","last_peered":"2023-11-24T06:31:04.822909+0000","last_clean":"2023-11-24T06:31:04.822909+0000","last_became_active":"2023-11-24T06:31:03.802878+0000","last_became_peered":"2023-11-24T06:31:03.802878+0000","last_unstale":"2023-11-24T06:31:04.822909+0000","last_undegraded":"2023-11-24T06:31:04.822909+0000","last_fullsized":"2023-11-24T06:31:04.822909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:08.362504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051491+0000","last_change":"2023-11-24T06:31:04.814531+0000","last_active":"2023-11-24T06:31:06.051491+0000","last_peered":"2023-11-24T06:31:06.051491+0000","last_clean":"2023-11-24T06:31:06.051491+0000","last_became_active":"2023-11-24T06:31:04.814249+0000","last_became_peered":"2023-11-24T06:31:04.814249+0000","last_unstale":"2023-11-24T06:31:06.051491+0000","last_undegraded":"2023-11-24T06:31:06.051491+0000","last_fullsized":"2023-11-24T06:31:06.051491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:43:00.149592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.827011+0000","last_change":"2023-11-24T06:31:03.802597+0000","last_active":"2023-11-24T06:31:04.827011+0000","last_peered":"2023-11-24T06:31:04.827011+0000","last_clean":"2023-11-24T06:31:04.827011+0000","last_became_active":"2023-11-24T06:31:03.802297+0000","last_became_peered":"2023-11-24T06:31:03.802297+0000","last_unstale":"2023-11-24T06:31:04.827011+0000","last_undegraded":"2023-11-24T06:31:04.827011+0000","last_fullsized":"2023-11-24T06:31:04.827011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:54.541292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050622+0000","last_change":"2023-11-24T06:31:04.811060+0000","last_active":"2023-11-24T06:31:06.050622+0000","last_peered":"2023-11-24T06:31:06.050622+0000","last_clean":"2023-11-24T06:31:06.050622+0000","last_became_active":"2023-11-24T06:31:04.810178+0000","last_became_peered":"2023-11-24T06:31:04.810178+0000","last_unstale":"2023-11-24T06:31:06.050622+0000","last_undegraded":"2023-11-24T06:31:06.050622+0000","last_fullsized":"2023-11-24T06:31:06.050622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:55.547711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.829115+0000","last_change":"2023-11-24T06:31:03.805478+0000","last_active":"2023-11-24T06:31:04.829115+0000","last_peered":"2023-11-24T06:31:04.829115+0000","last_clean":"2023-11-24T06:31:04.829115+0000","last_became_active":"2023-11-24T06:31:03.805096+0000","last_became_peered":"2023-11-24T06:31:03.805096+0000","last_unstale":"2023-11-24T06:31:04.829115+0000","last_undegraded":"2023-11-24T06:31:04.829115+0000","last_fullsized":"2023-11-24T06:31:04.829115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:35.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050141+0000","last_change":"2023-11-24T06:31:04.821458+0000","last_active":"2023-11-24T06:31:06.050141+0000","last_peered":"2023-11-24T06:31:06.050141+0000","last_clean":"2023-11-24T06:31:06.050141+0000","last_became_active":"2023-11-24T06:31:04.820906+0000","last_became_peered":"2023-11-24T06:31:04.820906+0000","last_unstale":"2023-11-24T06:31:06.050141+0000","last_undegraded":"2023-11-24T06:31:06.050141+0000","last_fullsized":"2023-11-24T06:31:06.050141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:12.750721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.789416+0000","last_change":"2023-11-24T06:31:03.797719+0000","last_active":"2023-11-24T06:31:04.789416+0000","last_peered":"2023-11-24T06:31:04.789416+0000","last_clean":"2023-11-24T06:31:04.789416+0000","last_became_active":"2023-11-24T06:31:03.797375+0000","last_became_peered":"2023-11-24T06:31:03.797375+0000","last_unstale":"2023-11-24T06:31:04.789416+0000","last_undegraded":"2023-11-24T06:31:04.789416+0000","last_fullsized":"2023-11-24T06:31:04.789416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:37.758481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786501+0000","last_change":"2023-11-24T06:31:04.807100+0000","last_active":"2023-11-24T06:31:05.786501+0000","last_peered":"2023-11-24T06:31:05.786501+0000","last_clean":"2023-11-24T06:31:05.786501+0000","last_became_active":"2023-11-24T06:31:04.806716+0000","last_became_peered":"2023-11-24T06:31:04.806716+0000","last_unstale":"2023-11-24T06:31:05.786501+0000","last_undegraded":"2023-11-24T06:31:05.786501+0000","last_fullsized":"2023-11-24T06:31:05.786501+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:32:07.773188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.791342+0000","last_change":"2023-11-24T06:31:03.797822+0000","last_active":"2023-11-24T06:31:04.791342+0000","last_peered":"2023-11-24T06:31:04.791342+0000","last_clean":"2023-11-24T06:31:04.791342+0000","last_became_active":"2023-11-24T06:31:03.797521+0000","last_became_peered":"2023-11-24T06:31:03.797521+0000","last_unstale":"2023-11-24T06:31:04.791342+0000","last_undegraded":"2023-11-24T06:31:04.791342+0000","last_fullsized":"2023-11-24T06:31:04.791342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:04:03.625854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051461+0000","last_change":"2023-11-24T06:31:04.803742+0000","last_active":"2023-11-24T06:31:06.051461+0000","last_peered":"2023-11-24T06:31:06.051461+0000","last_clean":"2023-11-24T06:31:06.051461+0000","last_became_active":"2023-11-24T06:31:04.803229+0000","last_became_peered":"2023-11-24T06:31:04.803229+0000","last_unstale":"2023-11-24T06:31:06.051461+0000","last_undegraded":"2023-11-24T06:31:06.051461+0000","last_fullsized":"2023-11-24T06:31:06.051461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:04:04.632273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.792877+0000","last_change":"2023-11-24T06:31:03.803899+0000","last_active":"2023-11-24T06:31:04.792877+0000","last_peered":"2023-11-24T06:31:04.792877+0000","last_clean":"2023-11-24T06:31:04.792877+0000","last_became_active":"2023-11-24T06:31:03.803582+0000","last_became_peered":"2023-11-24T06:31:03.803582+0000","last_unstale":"2023-11-24T06:31:04.792877+0000","last_undegraded":"2023-11-24T06:31:04.792877+0000","last_fullsized":"2023-11-24T06:31:04.792877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:45.513027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051642+0000","last_change":"2023-11-24T06:31:04.804968+0000","last_active":"2023-11-24T06:31:06.051642+0000","last_peered":"2023-11-24T06:31:06.051642+0000","last_clean":"2023-11-24T06:31:06.051642+0000","last_became_active":"2023-11-24T06:31:04.804747+0000","last_became_peered":"2023-11-24T06:31:04.804747+0000","last_unstale":"2023-11-24T06:31:06.051642+0000","last_undegraded":"2023-11-24T06:31:06.051642+0000","last_fullsized":"2023-11-24T06:31:06.051642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:22.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.792918+0000","last_change":"2023-11-24T06:31:03.802893+0000","last_active":"2023-11-24T06:31:04.792918+0000","last_peered":"2023-11-24T06:31:04.792918+0000","last_clean":"2023-11-24T06:31:04.792918+0000","last_became_active":"2023-11-24T06:31:03.802606+0000","last_became_peered":"2023-11-24T06:31:03.802606+0000","last_unstale":"2023-11-24T06:31:04.792918+0000","last_undegraded":"2023-11-24T06:31:04.792918+0000","last_fullsized":"2023-11-24T06:31:04.792918+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:46.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785485+0000","last_change":"2023-11-24T06:31:04.801275+0000","last_active":"2023-11-24T06:31:05.785485+0000","last_peered":"2023-11-24T06:31:05.785485+0000","last_clean":"2023-11-24T06:31:05.785485+0000","last_became_active":"2023-11-24T06:31:04.800956+0000","last_became_peered":"2023-11-24T06:31:04.800956+0000","last_unstale":"2023-11-24T06:31:05.785485+0000","last_undegraded":"2023-11-24T06:31:05.785485+0000","last_fullsized":"2023-11-24T06:31:05.785485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:13.883718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.827449+0000","last_change":"2023-11-24T06:31:03.804485+0000","last_active":"2023-11-24T06:31:04.827449+0000","last_peered":"2023-11-24T06:31:04.827449+0000","last_clean":"2023-11-24T06:31:04.827449+0000","last_became_active":"2023-11-24T06:31:03.804157+0000","last_became_peered":"2023-11-24T06:31:03.804157+0000","last_unstale":"2023-11-24T06:31:04.827449+0000","last_undegraded":"2023-11-24T06:31:04.827449+0000","last_fullsized":"2023-11-24T06:31:04.827449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:46.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051823+0000","last_change":"2023-11-24T06:31:04.808676+0000","last_active":"2023-11-24T06:31:06.051823+0000","last_peered":"2023-11-24T06:31:06.051823+0000","last_clean":"2023-11-24T06:31:06.051823+0000","last_became_active":"2023-11-24T06:31:04.808379+0000","last_became_peered":"2023-11-24T06:31:04.808379+0000","last_unstale":"2023-11-24T06:31:06.051823+0000","last_undegraded":"2023-11-24T06:31:06.051823+0000","last_fullsized":"2023-11-24T06:31:06.051823+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:10.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.832115+0000","last_change":"2023-11-24T06:31:03.800094+0000","last_active":"2023-11-24T06:31:04.832115+0000","last_peered":"2023-11-24T06:31:04.832115+0000","last_clean":"2023-11-24T06:31:04.832115+0000","last_became_active":"2023-11-24T06:31:03.799842+0000","last_became_peered":"2023-11-24T06:31:03.799842+0000","last_unstale":"2023-11-24T06:31:04.832115+0000","last_undegraded":"2023-11-24T06:31:04.832115+0000","last_fullsized":"2023-11-24T06:31:04.832115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:33:37.768508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787154+0000","last_change":"2023-11-24T06:31:04.810924+0000","last_active":"2023-11-24T06:31:05.787154+0000","last_peered":"2023-11-24T06:31:05.787154+0000","last_clean":"2023-11-24T06:31:05.787154+0000","last_became_active":"2023-11-24T06:31:04.810553+0000","last_became_peered":"2023-11-24T06:31:04.810553+0000","last_unstale":"2023-11-24T06:31:05.787154+0000","last_undegraded":"2023-11-24T06:31:05.787154+0000","last_fullsized":"2023-11-24T06:31:05.787154+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:56.604961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826922+0000","last_change":"2023-11-24T06:31:03.801487+0000","last_active":"2023-11-24T06:31:04.826922+0000","last_peered":"2023-11-24T06:31:04.826922+0000","last_clean":"2023-11-24T06:31:04.826922+0000","last_became_active":"2023-11-24T06:31:03.801106+0000","last_became_peered":"2023-11-24T06:31:03.801106+0000","last_unstale":"2023-11-24T06:31:04.826922+0000","last_undegraded":"2023-11-24T06:31:04.826922+0000","last_fullsized":"2023-11-24T06:31:04.826922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:37.524338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050654+0000","last_change":"2023-11-24T06:31:04.813508+0000","last_active":"2023-11-24T06:31:06.050654+0000","last_peered":"2023-11-24T06:31:06.050654+0000","last_clean":"2023-11-24T06:31:06.050654+0000","last_became_active":"2023-11-24T06:31:04.813194+0000","last_became_peered":"2023-11-24T06:31:04.813194+0000","last_unstale":"2023-11-24T06:31:06.050654+0000","last_undegraded":"2023-11-24T06:31:06.050654+0000","last_fullsized":"2023-11-24T06:31:06.050654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:22.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.794344+0000","last_change":"2023-11-24T06:31:03.800024+0000","last_active":"2023-11-24T06:31:04.794344+0000","last_peered":"2023-11-24T06:31:04.794344+0000","last_clean":"2023-11-24T06:31:04.794344+0000","last_became_active":"2023-11-24T06:31:03.799715+0000","last_became_peered":"2023-11-24T06:31:03.799715+0000","last_unstale":"2023-11-24T06:31:04.794344+0000","last_undegraded":"2023-11-24T06:31:04.794344+0000","last_fullsized":"2023-11-24T06:31:04.794344+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:37.758481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785021+0000","last_change":"2023-11-24T06:31:04.795024+0000","last_active":"2023-11-24T06:31:05.785021+0000","last_peered":"2023-11-24T06:31:05.785021+0000","last_clean":"2023-11-24T06:31:05.785021+0000","last_became_active":"2023-11-24T06:31:04.794731+0000","last_became_peered":"2023-11-24T06:31:04.794731+0000","last_unstale":"2023-11-24T06:31:05.785021+0000","last_undegraded":"2023-11-24T06:31:05.785021+0000","last_fullsized":"2023-11-24T06:31:05.785021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:33.554360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.784837+0000","last_change":"2023-11-24T06:31:03.798848+0000","last_active":"2023-11-24T06:31:04.784837+0000","last_peered":"2023-11-24T06:31:04.784837+0000","last_clean":"2023-11-24T06:31:04.784837+0000","last_became_active":"2023-11-24T06:31:03.798524+0000","last_became_peered":"2023-11-24T06:31:03.798524+0000","last_unstale":"2023-11-24T06:31:04.784837+0000","last_undegraded":"2023-11-24T06:31:04.784837+0000","last_fullsized":"2023-11-24T06:31:04.784837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:13.473933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051753+0000","last_change":"2023-11-24T06:31:04.818993+0000","last_active":"2023-11-24T06:31:06.051753+0000","last_peered":"2023-11-24T06:31:06.051753+0000","last_clean":"2023-11-24T06:31:06.051753+0000","last_became_active":"2023-11-24T06:31:04.818390+0000","last_became_peered":"2023-11-24T06:31:04.818390+0000","last_unstale":"2023-11-24T06:31:06.051753+0000","last_undegraded":"2023-11-24T06:31:06.051753+0000","last_fullsized":"2023-11-24T06:31:06.051753+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:21.097556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.834458+0000","last_change":"2023-11-24T06:31:03.797247+0000","last_active":"2023-11-24T06:31:04.834458+0000","last_peered":"2023-11-24T06:31:04.834458+0000","last_clean":"2023-11-24T06:31:04.834458+0000","last_became_active":"2023-11-24T06:31:03.796778+0000","last_became_peered":"2023-11-24T06:31:03.796778+0000","last_unstale":"2023-11-24T06:31:04.834458+0000","last_undegraded":"2023-11-24T06:31:04.834458+0000","last_fullsized":"2023-11-24T06:31:04.834458+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:42:59.143173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050432+0000","last_change":"2023-11-24T06:31:04.803276+0000","last_active":"2023-11-24T06:31:06.050432+0000","last_peered":"2023-11-24T06:31:06.050432+0000","last_clean":"2023-11-24T06:31:06.050432+0000","last_became_active":"2023-11-24T06:31:04.803012+0000","last_became_peered":"2023-11-24T06:31:04.803012+0000","last_unstale":"2023-11-24T06:31:06.050432+0000","last_undegraded":"2023-11-24T06:31:06.050432+0000","last_fullsized":"2023-11-24T06:31:06.050432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:27:11.595239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.825383+0000","last_change":"2023-11-24T06:31:03.796670+0000","last_active":"2023-11-24T06:31:04.825383+0000","last_peered":"2023-11-24T06:31:04.825383+0000","last_clean":"2023-11-24T06:31:04.825383+0000","last_became_active":"2023-11-24T06:31:03.796415+0000","last_became_peered":"2023-11-24T06:31:03.796415+0000","last_unstale":"2023-11-24T06:31:04.825383+0000","last_undegraded":"2023-11-24T06:31:04.825383+0000","last_fullsized":"2023-11-24T06:31:04.825383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:45.167537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051016+0000","last_change":"2023-11-24T06:31:04.798468+0000","last_active":"2023-11-24T06:31:06.051016+0000","last_peered":"2023-11-24T06:31:06.051016+0000","last_clean":"2023-11-24T06:31:06.051016+0000","last_became_active":"2023-11-24T06:31:04.798218+0000","last_became_peered":"2023-11-24T06:31:04.798218+0000","last_unstale":"2023-11-24T06:31:06.051016+0000","last_undegraded":"2023-11-24T06:31:06.051016+0000","last_fullsized":"2023-11-24T06:31:06.051016+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:14.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.829544+0000","last_change":"2023-11-24T06:31:03.800104+0000","last_active":"2023-11-24T06:31:04.829544+0000","last_peered":"2023-11-24T06:31:04.829544+0000","last_clean":"2023-11-24T06:31:04.829544+0000","last_became_active":"2023-11-24T06:31:03.799837+0000","last_became_peered":"2023-11-24T06:31:03.799837+0000","last_unstale":"2023-11-24T06:31:04.829544+0000","last_undegraded":"2023-11-24T06:31:04.829544+0000","last_fullsized":"2023-11-24T06:31:04.829544+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:43.341366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786809+0000","last_change":"2023-11-24T06:31:04.811393+0000","last_active":"2023-11-24T06:31:05.786809+0000","last_peered":"2023-11-24T06:31:05.786809+0000","last_clean":"2023-11-24T06:31:05.786809+0000","last_became_active":"2023-11-24T06:31:04.811136+0000","last_became_peered":"2023-11-24T06:31:04.811136+0000","last_unstale":"2023-11-24T06:31:05.786809+0000","last_undegraded":"2023-11-24T06:31:05.786809+0000","last_fullsized":"2023-11-24T06:31:05.786809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:08.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826008+0000","last_change":"2023-11-24T06:31:03.800550+0000","last_active":"2023-11-24T06:31:04.826008+0000","last_peered":"2023-11-24T06:31:04.826008+0000","last_clean":"2023-11-24T06:31:04.826008+0000","last_became_active":"2023-11-24T06:31:03.800252+0000","last_became_peered":"2023-11-24T06:31:03.800252+0000","last_unstale":"2023-11-24T06:31:04.826008+0000","last_undegraded":"2023-11-24T06:31:04.826008+0000","last_fullsized":"2023-11-24T06:31:04.826008+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:42:59.143173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786997+0000","last_change":"2023-11-24T06:31:04.811900+0000","last_active":"2023-11-24T06:31:05.786997+0000","last_peered":"2023-11-24T06:31:05.786997+0000","last_clean":"2023-11-24T06:31:05.786997+0000","last_became_active":"2023-11-24T06:31:04.806789+0000","last_became_peered":"2023-11-24T06:31:04.806789+0000","last_unstale":"2023-11-24T06:31:05.786997+0000","last_undegraded":"2023-11-24T06:31:05.786997+0000","last_fullsized":"2023-11-24T06:31:05.786997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:46.182837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.783762+0000","last_change":"2023-11-24T06:31:03.797298+0000","last_active":"2023-11-24T06:31:04.783762+0000","last_peered":"2023-11-24T06:31:04.783762+0000","last_clean":"2023-11-24T06:31:04.783762+0000","last_became_active":"2023-11-24T06:31:03.797047+0000","last_became_peered":"2023-11-24T06:31:03.797047+0000","last_unstale":"2023-11-24T06:31:04.783762+0000","last_undegraded":"2023-11-24T06:31:04.783762+0000","last_fullsized":"2023-11-24T06:31:04.783762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:17.957352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785458+0000","last_change":"2023-11-24T06:31:04.801168+0000","last_active":"2023-11-24T06:31:05.785458+0000","last_peered":"2023-11-24T06:31:05.785458+0000","last_clean":"2023-11-24T06:31:05.785458+0000","last_became_active":"2023-11-24T06:31:04.800836+0000","last_became_peered":"2023-11-24T06:31:04.800836+0000","last_unstale":"2023-11-24T06:31:05.785458+0000","last_undegraded":"2023-11-24T06:31:05.785458+0000","last_fullsized":"2023-11-24T06:31:05.785458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:42:37.561025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.827095+0000","last_change":"2023-11-24T06:31:03.802498+0000","last_active":"2023-11-24T06:31:04.827095+0000","last_peered":"2023-11-24T06:31:04.827095+0000","last_clean":"2023-11-24T06:31:04.827095+0000","last_became_active":"2023-11-24T06:31:03.802233+0000","last_became_peered":"2023-11-24T06:31:03.802233+0000","last_unstale":"2023-11-24T06:31:04.827095+0000","last_undegraded":"2023-11-24T06:31:04.827095+0000","last_fullsized":"2023-11-24T06:31:04.827095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:30.695415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.786507+0000","last_change":"2023-11-24T06:31:04.801916+0000","last_active":"2023-11-24T06:31:05.786507+0000","last_peered":"2023-11-24T06:31:05.786507+0000","last_clean":"2023-11-24T06:31:05.786507+0000","last_became_active":"2023-11-24T06:31:04.801627+0000","last_became_peered":"2023-11-24T06:31:04.801627+0000","last_unstale":"2023-11-24T06:31:05.786507+0000","last_undegraded":"2023-11-24T06:31:05.786507+0000","last_fullsized":"2023-11-24T06:31:05.786507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:46.182837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.789471+0000","last_change":"2023-11-24T06:31:03.797774+0000","last_active":"2023-11-24T06:31:04.789471+0000","last_peered":"2023-11-24T06:31:04.789471+0000","last_clean":"2023-11-24T06:31:04.789471+0000","last_became_active":"2023-11-24T06:31:03.797455+0000","last_became_peered":"2023-11-24T06:31:03.797455+0000","last_unstale":"2023-11-24T06:31:04.789471+0000","last_undegraded":"2023-11-24T06:31:04.789471+0000","last_fullsized":"2023-11-24T06:31:04.789471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:18.864705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050690+0000","last_change":"2023-11-24T06:31:04.816669+0000","last_active":"2023-11-24T06:31:06.050690+0000","last_peered":"2023-11-24T06:31:06.050690+0000","last_clean":"2023-11-24T06:31:06.050690+0000","last_became_active":"2023-11-24T06:31:04.816369+0000","last_became_peered":"2023-11-24T06:31:04.816369+0000","last_unstale":"2023-11-24T06:31:06.050690+0000","last_undegraded":"2023-11-24T06:31:06.050690+0000","last_fullsized":"2023-11-24T06:31:06.050690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:58.821104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.791068+0000","last_change":"2023-11-24T06:31:03.803086+0000","last_active":"2023-11-24T06:31:04.791068+0000","last_peered":"2023-11-24T06:31:04.791068+0000","last_clean":"2023-11-24T06:31:04.791068+0000","last_became_active":"2023-11-24T06:31:03.802569+0000","last_became_peered":"2023-11-24T06:31:03.802569+0000","last_unstale":"2023-11-24T06:31:04.791068+0000","last_undegraded":"2023-11-24T06:31:04.791068+0000","last_fullsized":"2023-11-24T06:31:04.791068+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:08.362504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050227+0000","last_change":"2023-11-24T06:31:04.793260+0000","last_active":"2023-11-24T06:31:06.050227+0000","last_peered":"2023-11-24T06:31:06.050227+0000","last_clean":"2023-11-24T06:31:06.050227+0000","last_became_active":"2023-11-24T06:31:04.792979+0000","last_became_peered":"2023-11-24T06:31:04.792979+0000","last_unstale":"2023-11-24T06:31:06.050227+0000","last_undegraded":"2023-11-24T06:31:06.050227+0000","last_fullsized":"2023-11-24T06:31:06.050227+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:00.492991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.798107+0000","last_change":"2023-11-24T06:31:03.799508+0000","last_active":"2023-11-24T06:31:04.798107+0000","last_peered":"2023-11-24T06:31:04.798107+0000","last_clean":"2023-11-24T06:31:04.798107+0000","last_became_active":"2023-11-24T06:31:03.799312+0000","last_became_peered":"2023-11-24T06:31:03.799312+0000","last_unstale":"2023-11-24T06:31:04.798107+0000","last_undegraded":"2023-11-24T06:31:04.798107+0000","last_fullsized":"2023-11-24T06:31:04.798107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:59.486572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.787100+0000","last_change":"2023-11-24T06:31:04.807404+0000","last_active":"2023-11-24T06:31:05.787100+0000","last_peered":"2023-11-24T06:31:05.787100+0000","last_clean":"2023-11-24T06:31:05.787100+0000","last_became_active":"2023-11-24T06:31:04.807122+0000","last_became_peered":"2023-11-24T06:31:04.807122+0000","last_unstale":"2023-11-24T06:31:05.787100+0000","last_undegraded":"2023-11-24T06:31:05.787100+0000","last_fullsized":"2023-11-24T06:31:05.787100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:12.880888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.784319+0000","last_change":"2023-11-24T06:31:03.805983+0000","last_active":"2023-11-24T06:31:04.784319+0000","last_peered":"2023-11-24T06:31:04.784319+0000","last_clean":"2023-11-24T06:31:04.784319+0000","last_became_active":"2023-11-24T06:31:03.805360+0000","last_became_peered":"2023-11-24T06:31:03.805360+0000","last_unstale":"2023-11-24T06:31:04.784319+0000","last_undegraded":"2023-11-24T06:31:04.784319+0000","last_fullsized":"2023-11-24T06:31:04.784319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:09.203545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050663+0000","last_change":"2023-11-24T06:31:04.800369+0000","last_active":"2023-11-24T06:31:06.050663+0000","last_peered":"2023-11-24T06:31:06.050663+0000","last_clean":"2023-11-24T06:31:06.050663+0000","last_became_active":"2023-11-24T06:31:04.799962+0000","last_became_peered":"2023-11-24T06:31:04.799962+0000","last_unstale":"2023-11-24T06:31:06.050663+0000","last_undegraded":"2023-11-24T06:31:06.050663+0000","last_fullsized":"2023-11-24T06:31:06.050663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:21.097556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.795667+0000","last_change":"2023-11-24T06:31:03.804481+0000","last_active":"2023-11-24T06:31:04.795667+0000","last_peered":"2023-11-24T06:31:04.795667+0000","last_clean":"2023-11-24T06:31:04.795667+0000","last_became_active":"2023-11-24T06:31:03.804159+0000","last_became_peered":"2023-11-24T06:31:03.804159+0000","last_unstale":"2023-11-24T06:31:04.795667+0000","last_undegraded":"2023-11-24T06:31:04.795667+0000","last_fullsized":"2023-11-24T06:31:04.795667+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:11.744302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051867+0000","last_change":"2023-11-24T06:31:04.809473+0000","last_active":"2023-11-24T06:31:06.051867+0000","last_peered":"2023-11-24T06:31:06.051867+0000","last_clean":"2023-11-24T06:31:06.051867+0000","last_became_active":"2023-11-24T06:31:04.809188+0000","last_became_peered":"2023-11-24T06:31:04.809188+0000","last_unstale":"2023-11-24T06:31:06.051867+0000","last_undegraded":"2023-11-24T06:31:06.051867+0000","last_fullsized":"2023-11-24T06:31:06.051867+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:38.530757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.786747+0000","last_change":"2023-11-24T06:31:03.796217+0000","last_active":"2023-11-24T06:31:04.786747+0000","last_peered":"2023-11-24T06:31:04.786747+0000","last_clean":"2023-11-24T06:31:04.786747+0000","last_became_active":"2023-11-24T06:31:03.795905+0000","last_became_peered":"2023-11-24T06:31:03.795905+0000","last_unstale":"2023-11-24T06:31:04.786747+0000","last_undegraded":"2023-11-24T06:31:04.786747+0000","last_fullsized":"2023-11-24T06:31:04.786747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:44:50.597177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785548+0000","last_change":"2023-11-24T06:31:04.796411+0000","last_active":"2023-11-24T06:31:05.785548+0000","last_peered":"2023-11-24T06:31:05.785548+0000","last_clean":"2023-11-24T06:31:05.785548+0000","last_became_active":"2023-11-24T06:31:04.796084+0000","last_became_peered":"2023-11-24T06:31:04.796084+0000","last_unstale":"2023-11-24T06:31:05.785548+0000","last_undegraded":"2023-11-24T06:31:05.785548+0000","last_fullsized":"2023-11-24T06:31:05.785548+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:11:10.210512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.795158+0000","last_change":"2023-11-24T06:31:03.809752+0000","last_active":"2023-11-24T06:31:04.795158+0000","last_peered":"2023-11-24T06:31:04.795158+0000","last_clean":"2023-11-24T06:31:04.795158+0000","last_became_active":"2023-11-24T06:31:03.809477+0000","last_became_peered":"2023-11-24T06:31:03.809477+0000","last_unstale":"2023-11-24T06:31:04.795158+0000","last_undegraded":"2023-11-24T06:31:04.795158+0000","last_fullsized":"2023-11-24T06:31:04.795158+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:04:03.625854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:05.785567+0000","last_change":"2023-11-24T06:31:04.811818+0000","last_active":"2023-11-24T06:31:05.785567+0000","last_peered":"2023-11-24T06:31:05.785567+0000","last_clean":"2023-11-24T06:31:05.785567+0000","last_became_active":"2023-11-24T06:31:04.811507+0000","last_became_peered":"2023-11-24T06:31:04.811507+0000","last_unstale":"2023-11-24T06:31:05.785567+0000","last_undegraded":"2023-11-24T06:31:05.785567+0000","last_fullsized":"2023-11-24T06:31:05.785567+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:46.675550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.792258+0000","last_change":"2023-11-24T06:31:03.804921+0000","last_active":"2023-11-24T06:31:04.792258+0000","last_peered":"2023-11-24T06:31:04.792258+0000","last_clean":"2023-11-24T06:31:04.792258+0000","last_became_active":"2023-11-24T06:31:03.804596+0000","last_became_peered":"2023-11-24T06:31:03.804596+0000","last_unstale":"2023-11-24T06:31:04.792258+0000","last_undegraded":"2023-11-24T06:31:04.792258+0000","last_fullsized":"2023-11-24T06:31:04.792258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:50:45.176418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.052297+0000","last_change":"2023-11-24T06:31:04.803938+0000","last_active":"2023-11-24T06:31:06.052297+0000","last_peered":"2023-11-24T06:31:06.052297+0000","last_clean":"2023-11-24T06:31:06.052297+0000","last_became_active":"2023-11-24T06:31:04.803648+0000","last_became_peered":"2023-11-24T06:31:04.803648+0000","last_unstale":"2023-11-24T06:31:06.052297+0000","last_undegraded":"2023-11-24T06:31:06.052297+0000","last_fullsized":"2023-11-24T06:31:06.052297+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:13.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.786561+0000","last_change":"2023-11-24T06:31:03.796465+0000","last_active":"2023-11-24T06:31:04.786561+0000","last_peered":"2023-11-24T06:31:04.786561+0000","last_clean":"2023-11-24T06:31:04.786561+0000","last_became_active":"2023-11-24T06:31:03.796194+0000","last_became_peered":"2023-11-24T06:31:03.796194+0000","last_unstale":"2023-11-24T06:31:04.786561+0000","last_undegraded":"2023-11-24T06:31:04.786561+0000","last_fullsized":"2023-11-24T06:31:04.786561+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:07.364951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.051971+0000","last_change":"2023-11-24T06:31:04.812246+0000","last_active":"2023-11-24T06:31:06.051971+0000","last_peered":"2023-11-24T06:31:06.051971+0000","last_clean":"2023-11-24T06:31:06.051971+0000","last_became_active":"2023-11-24T06:31:04.811872+0000","last_became_peered":"2023-11-24T06:31:04.811872+0000","last_unstale":"2023-11-24T06:31:06.051971+0000","last_undegraded":"2023-11-24T06:31:06.051971+0000","last_fullsized":"2023-11-24T06:31:06.051971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:44.377467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.791594+0000","last_change":"2023-11-24T06:31:03.799041+0000","last_active":"2023-11-24T06:31:04.791594+0000","last_peered":"2023-11-24T06:31:04.791594+0000","last_clean":"2023-11-24T06:31:04.791594+0000","last_became_active":"2023-11-24T06:31:03.798401+0000","last_became_peered":"2023-11-24T06:31:03.798401+0000","last_unstale":"2023-11-24T06:31:04.791594+0000","last_undegraded":"2023-11-24T06:31:04.791594+0000","last_fullsized":"2023-11-24T06:31:04.791594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:43.371048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-24T06:31:06.050974+0000","last_change":"2023-11-24T06:31:04.815105+0000","last_active":"2023-11-24T06:31:06.050974+0000","last_peered":"2023-11-24T06:31:06.050974+0000","last_clean":"2023-11-24T06:31:06.050974+0000","last_became_active":"2023-11-24T06:31:04.814850+0000","last_became_peered":"2023-11-24T06:31:04.814850+0000","last_unstale":"2023-11-24T06:31:06.050974+0000","last_undegraded":"2023-11-24T06:31:06.050974+0000","last_fullsized":"2023-11-24T06:31:06.050974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:03.766384+0000","last_clean_scrub_stamp":"2023-11-24T06:31:03.766384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:10.209964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.826031+0000","last_change":"2023-11-24T06:31:03.802227+0000","last_active":"2023-11-24T06:31:04.826031+0000","last_peered":"2023-11-24T06:31:04.826031+0000","last_clean":"2023-11-24T06:31:04.826031+0000","last_became_active":"2023-11-24T06:31:03.801927+0000","last_became_peered":"2023-11-24T06:31:03.801927+0000","last_unstale":"2023-11-24T06:31:04.826031+0000","last_undegraded":"2023-11-24T06:31:04.826031+0000","last_fullsized":"2023-11-24T06:31:04.826031+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:02.759964+0000","last_clean_scrub_stamp":"2023-11-24T06:31:02.759964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:51:46.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:31:04.798249+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:04.798249+0000","last_peered":"2023-11-24T06:31:04.798249+0000","last_clean":"2023-11-24T06:31:04.798249+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:04.798249+0000","last_undegraded":"2023-11-24T06:31:04.798249+0000","last_fullsized":"2023-11-24T06:31:04.798249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":799516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.622}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.755}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1,"5min":1,"15min":1},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":209730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1,"5min":1,"15min":1},"last":0.745}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":209128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.752},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":210670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.749},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":209696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.62},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.81599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":210692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.75},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":209128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.25},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.375},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.501},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":798491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.38}]},{"osd":2,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.629}]},{"osd":7,"last update":"Fri Nov 24 06:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:13.770 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:31:13.770 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:31:13.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.946+0000 7f3a917b4640 1 Processor -- start 2023-11-24T06:31:13.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.946+0000 7f3a917b4640 1 -- start start 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a917b4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a8c15f830 0x7f3a8c0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a917b4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a8c0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a917b4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c06c5c0 con 0x7f3a8c13e130 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a917b4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cfb90 con 0x7f3a8c15f830 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a917b4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c13e510 con 0x7f3a8c0cf700 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3a8c13e130 0x7f3a8c15bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57924/0 (socket says 172.21.15.143:57924) 2023-11-24T06:31:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 -- 172.21.15.143:0/2371004133 learned_addr learned my addr 172.21.15.143:0/2371004133 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:13.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a90fb3640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a8c0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776828773 0 0) 0x7f3a8c06c5c0 con 0x7f3a8c13e130 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8b7fe640 1 --2- 172.21.15.143:0/2371004133 >> v2:172.21.15.146:3300/0 conn(0x7f3a8c15f830 0x7f3a8c0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a74003530 con 0x7f3a8c13e130 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3608550860 0 0) 0x7f3a74003530 con 0x7f3a8c13e130 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 msgr2=0x7f3a8c0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a8c0cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 >> v2:172.21.15.146:3300/0 conn(0x7f3a8c15f830 msgr2=0x7f3a8c0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 --2- 172.21.15.143:0/2371004133 >> v2:172.21.15.146:3300/0 conn(0x7f3a8c15f830 0x7f3a8c0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c15c4b0 con 0x7f3a8c13e130 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f3a7c001680 con 0x7f3a8c13e130 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 >> v1:172.21.15.143:6789/0 conn(0x7f3a8c13e130 legacy=0x7f3a8c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a74004d10 0x7f3a74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cfb90 con 0x7f3a740039b0 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c13e510 con 0x7f3a74004d10 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7400b9e0 con 0x7f3a8c0cf700 2023-11-24T06:31:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8b7fe640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a90fb3640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a74004d10 0x7f3a74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 -- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 msgr2=0x7f3a740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 -- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a74004d10 msgr2=0x7f3a74005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a74004d10 0x7f3a74005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8bfff640 1 -- 172.21.15.143:0/2371004133 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74003530 con 0x7f3a740039b0 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a90fb3640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a74004d10 0x7f3a74005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.950+0000 7f3a8b7fe640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0cf700 0x7f3a740047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:13.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00c240 tx=0x7f3a7c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30915d006cd16ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:13.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0058e0 con 0x7f3a740039b0 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c005a40 con 0x7f3a740039b0 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a8affd640 1 -- 172.21.15.143:0/2371004133 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c005e30 con 0x7f3a740039b0 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 -- 172.21.15.143:0/2371004133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 msgr2=0x7f3a74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 --2- 172.21.15.143:0/2371004133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a74003dd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00c240 tx=0x7f3a7c01cbd0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a90fb3640 1 -- 172.21.15.143:0/2371004133 reap_dead start 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 -- 172.21.15.143:0/2371004133 shutdown_connections 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 -- 172.21.15.143:0/2371004133 >> 172.21.15.143:0/2371004133 conn(0x7f3a8c06a9e0 msgr2=0x7f3a8c06adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 -- 172.21.15.143:0/2371004133 shutdown_connections 2023-11-24T06:31:13.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 -- 172.21.15.143:0/2371004133 wait complete. 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.954+0000 7f3a917b4640 1 Processor -- start 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- start start 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a8c13a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a8c0aec90 0x7f3a8c0b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0b3480 0x7f3a8c13aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0b3900 con 0x7f3a740039b0 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c1560d0 con 0x7f3a8c0aec90 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0af170 con 0x7f3a8c0b3480 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a8c13a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a8c13a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43198/0 (socket says 172.21.15.143:43198) 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 -- 172.21.15.143:0/3284709114 learned_addr learned my addr 172.21.15.143:0/3284709114 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a90fb3640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0b3480 0x7f3a8c13aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8b7fe640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a8c0aec90 0x7f3a8c0b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 -- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0b3480 msgr2=0x7f3a8c13aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0b3480 0x7f3a8c13aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 -- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a8c0aec90 msgr2=0x7f3a8c0b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a8c0aec90 0x7f3a8c0b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 -- 172.21.15.143:0/3284709114 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0af450 con 0x7f3a740039b0 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a8bfff640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a8c13a320 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c001ec0 tx=0x7f3a74005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:13.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c000ee0 con 0x7f3a740039b0 2023-11-24T06:31:13.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c005e10 con 0x7f3a740039b0 2023-11-24T06:31:13.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c001440 con 0x7f3a740039b0 2023-11-24T06:31:13.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c155d60 con 0x7f3a740039b0 2023-11-24T06:31:13.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c158570 con 0x7f3a740039b0 2023-11-24T06:31:13.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.958+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c04e850 con 0x7f3a740039b0 2023-11-24T06:31:13.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.962+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f3a7c0047f0 con 0x7f3a740039b0 2023-11-24T06:31:13.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.962+0000 7f3a88ff9640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a78066530 0x7f3a780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:13.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.962+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a7c11d730 con 0x7f3a740039b0 2023-11-24T06:31:13.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.962+0000 7f3a8b7fe640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a78066530 0x7f3a780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:13.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.962+0000 7f3a8b7fe640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a78066530 0x7f3a780689f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0b3ae0 tx=0x7f3a80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:13.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:13.966+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a7c0eaa30 con 0x7f3a740039b0 2023-11-24T06:31:14.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.166+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3a8c155a30 con 0x7f3a740039b0 2023-11-24T06:31:14.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a88ff9640 1 -- 172.21.15.143:0/3284709114 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3a7c0ee050 con 0x7f3a740039b0 2023-11-24T06:31:14.175 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-11-24T06:31:14.175 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:31:14.175 INFO:teuthology.orchestra.run.smithi143.stdout: caps mds = "allow" 2023-11-24T06:31:14.175 INFO:teuthology.orchestra.run.smithi143.stdout: caps mon = "allow r" 2023-11-24T06:31:14.175 INFO:teuthology.orchestra.run.smithi143.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:31:14.175 INFO:teuthology.orchestra.run.smithi143.stderr:updated caps for client.0 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a78066530 msgr2=0x7f3a780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a78066530 0x7f3a780689f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0b3ae0 tx=0x7f3a80008040 comp rx=0 tx=0).stop 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 msgr2=0x7f3a8c13a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a8c13a320 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c001ec0 tx=0x7f3a74005800 comp rx=0 tx=0).stop 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 shutdown_connections 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a78066530 0x7f3a780689f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a8c0b3480 0x7f3a8c13aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a8c0aec90 0x7f3a8c0b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 --2- 172.21.15.143:0/3284709114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a740039b0 0x7f3a8c13a320 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 >> 172.21.15.143:0/3284709114 conn(0x7f3a8c06a9e0 msgr2=0x7f3a8c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:14.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 shutdown_connections 2023-11-24T06:31:14.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.170+0000 7f3a917b4640 1 -- 172.21.15.143:0/3284709114 wait complete. 2023-11-24T06:31:14.196 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:14.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.330+0000 7fc9e6daa640 1 Processor -- start 2023-11-24T06:31:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.330+0000 7fc9e6daa640 1 -- start start 2023-11-24T06:31:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e6daa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9e00d3020 0x7fc9e00d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e6daa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00ce8b0 0x7fc9e00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e6daa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e006c0e0 con 0x7fc9e015d570 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e6daa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00d39f0 con 0x7fc9e00d3020 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e6daa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00d1cc0 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e4b46640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc9e015d570 0x7fc9e006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57926/0 (socket says 172.21.15.143:57926) 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e4b46640 1 -- 172.21.15.143:0/541977876 learned_addr learned my addr 172.21.15.143:0/541977876 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9dffff640 1 --2- 172.21.15.143:0/541977876 >> v2:172.21.15.146:3300/0 conn(0x7fc9e00d3020 0x7fc9e00d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:14.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e5347640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00ce8b0 0x7fc9e00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9df7fe640 1 -- 172.21.15.143:0/541977876 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252055948 0 0) 0x7fc9e006c0e0 con 0x7fc9e015d570 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9df7fe640 1 -- 172.21.15.143:0/541977876 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d0003530 con 0x7fc9e015d570 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9dffff640 1 -- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00ce8b0 msgr2=0x7fc9e00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9dffff640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00ce8b0 0x7fc9e00ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9dffff640 1 -- 172.21.15.143:0/541977876 >> v1:172.21.15.143:6789/0 conn(0x7fc9e015d570 legacy=0x7fc9e006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9df7fe640 1 -- 172.21.15.143:0/541977876 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 371357560 0 0) 0x7fc9d0003530 con 0x7fc9e015d570 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9dffff640 1 -- 172.21.15.143:0/541977876 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00d1fa0 con 0x7fc9e00d3020 2023-11-24T06:31:14.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.334+0000 7fc9e5347640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00ce8b0 0x7fc9e00ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:14.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9dffff640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e00d34b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097c0 tx=0x7fc9cc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a481c02672d7f490 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:14.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9df7fe640 1 -- 172.21.15.143:0/541977876 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4001680 con 0x7fc9e00d3020 2023-11-24T06:31:14.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9df7fe640 1 -- 172.21.15.143:0/541977876 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0a7050 con 0x7fc9e00d3020 2023-11-24T06:31:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9df7fe640 1 -- 172.21.15.143:0/541977876 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0ab620 con 0x7fc9e00d3020 2023-11-24T06:31:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 -- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 msgr2=0x7fc9e00d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e00d34b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097c0 tx=0x7fc9cc01c370 comp rx=0 tx=0).stop 2023-11-24T06:31:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 -- 172.21.15.143:0/541977876 shutdown_connections 2023-11-24T06:31:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00ce8b0 0x7fc9e00ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/541977876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e00d34b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 -- 172.21.15.143:0/541977876 >> 172.21.15.143:0/541977876 conn(0x7fc9e008ceb0 msgr2=0x7fc9e009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 -- 172.21.15.143:0/541977876 shutdown_connections 2023-11-24T06:31:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 -- 172.21.15.143:0/541977876 wait complete. 2023-11-24T06:31:14.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 Processor -- start 2023-11-24T06:31:14.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.338+0000 7fc9e6daa640 1 -- start start 2023-11-24T06:31:14.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 0x7fc9e00b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:14.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:14.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e015d570 0x7fc9e00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e015e570 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e015e850 con 0x7fc9e00d3020 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e015eb30 con 0x7fc9e015d570 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 0x7fc9e00b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 0x7fc9e00b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43208/0 (socket says 172.21.15.143:43208) 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 -- 172.21.15.143:0/3854068678 learned_addr learned my addr 172.21.15.143:0/3854068678 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e5347640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e015d570 0x7fc9e00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:14.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9dffff640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 -- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e015d570 msgr2=0x7fc9e00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e015d570 0x7fc9e00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 -- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 msgr2=0x7fc9e015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e015dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 -- 172.21.15.143:0/3854068678 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8009a70 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9dffff640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e4b46640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 0x7fc9e00b6020 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c780 tx=0x7fc9d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:14.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4005ae0 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d4005c40 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007070 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc009420 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e015f0f0 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.342+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e015f2e0 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.346+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fc9d40071d0 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.346+0000 7fc9dd7fa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc9c4066530 0x7fc9c40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:14.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.346+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9d4083b10 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.346+0000 7fc9dffff640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc9c4066530 0x7fc9c40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:14.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.346+0000 7fc9dffff640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc9c4066530 0x7fc9c40689f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0ad000 tx=0x7fc9cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:14.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.350+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9d4051030 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9e0067520 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9dd7fa640 1 -- 172.21.15.143:0/3854068678 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fc9d4054650 con 0x7fc9e00ce8b0 2023-11-24T06:31:14.534 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:14.534 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:04.159303+0000","modified":"2023-11-24T06:31:07.177660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3877501822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3877501822},{"type":"v1","addr":"172.21.15.143:6837","nonce":3877501822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:31:14.535 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 25 2023-11-24T06:31:14.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc9c4066530 msgr2=0x7fc9c40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc9c4066530 0x7fc9c40689f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0ad000 tx=0x7fc9cc008040 comp rx=0 tx=0).stop 2023-11-24T06:31:14.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 msgr2=0x7fc9e00b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:14.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 0x7fc9e00b6020 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c780 tx=0x7fc9d400cc40 comp rx=0 tx=0).stop 2023-11-24T06:31:14.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 shutdown_connections 2023-11-24T06:31:14.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc9c4066530 0x7fc9c40689f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e015d570 0x7fc9e00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9e00d3020 0x7fc9e015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 --2- 172.21.15.143:0/3854068678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9e00ce8b0 0x7fc9e00b6020 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:14.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 >> 172.21.15.143:0/3854068678 conn(0x7fc9e008ceb0 msgr2=0x7fc9e0159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:14.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 shutdown_connections 2023-11-24T06:31:14.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:14.530+0000 7fc9e6daa640 1 -- 172.21.15.143:0/3854068678 wait complete. 2023-11-24T06:31:14.958 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:31:04.159303+0000', 'modified': '2023-11-24T06:31:07.177660+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5610': {'gid': 5610, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/3877501822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6835', 'nonce': 3877501822}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3877501822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:31:14.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:31:14.959 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T06:31:15.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 Processor -- start 2023-11-24T06:31:15.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 -- start start 2023-11-24T06:31:15.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0725f0 0x7f43cc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43cc0717c0 0x7f43cc0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0ca270 con 0x7f43cc0c98f0 2023-11-24T06:31:15.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0ca770 con 0x7f43cc0717c0 2023-11-24T06:31:15.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.094+0000 7f43d1157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0729d0 con 0x7f43cc0725f0 2023-11-24T06:31:15.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0725f0 0x7f43cc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cb59e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43cc0717c0 0x7f43cc0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43ca59c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43cc0c98f0 0x7f43cc0cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:49700/0 (socket says 172.21.15.143:49700) 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43ca59c640 1 -- 172.21.15.143:0/2318555841 learned_addr learned my addr 172.21.15.143:0/2318555841 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cad9d640 1 -- 172.21.15.143:0/2318555841 >> v2:172.21.15.146:3300/0 conn(0x7f43cc0717c0 msgr2=0x7f43cc0c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cad9d640 1 --2- 172.21.15.143:0/2318555841 >> v2:172.21.15.146:3300/0 conn(0x7f43cc0717c0 0x7f43cc0c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cad9d640 1 -- 172.21.15.143:0/2318555841 >> v1:172.21.15.146:6789/0 conn(0x7f43cc0c98f0 legacy=0x7f43cc0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cad9d640 1 -- 172.21.15.143:0/2318555841 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc06cb70 con 0x7f43cc0725f0 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43cb59e640 1 --2- 172.21.15.143:0/2318555841 >> v2:172.21.15.146:3300/0 conn(0x7f43cc0717c0 0x7f43cc0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:15.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.098+0000 7f43c9d9b640 1 -- 172.21.15.143:0/2318555841 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462739141 0 0) 0x7f43cc0ca270 con 0x7f43cc0c98f0 2023-11-24T06:31:15.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43cad9d640 1 --2- 172.21.15.143:0/2318555841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0725f0 0x7f43cc06c630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097c0 tx=0x7f43bc01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36dce608e591d52d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43c9d9b640 1 -- 172.21.15.143:0/2318555841 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0a8970 con 0x7f43cc0725f0 2023-11-24T06:31:15.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43c9d9b640 1 -- 172.21.15.143:0/2318555841 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc0a8ad0 con 0x7f43cc0725f0 2023-11-24T06:31:15.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43c9d9b640 1 -- 172.21.15.143:0/2318555841 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0a8e60 con 0x7f43cc0725f0 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 -- 172.21.15.143:0/2318555841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0725f0 msgr2=0x7f43cc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 --2- 172.21.15.143:0/2318555841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0725f0 0x7f43cc06c630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097c0 tx=0x7f43bc01ec70 comp rx=0 tx=0).stop 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 -- 172.21.15.143:0/2318555841 shutdown_connections 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 --2- 172.21.15.143:0/2318555841 >> v2:172.21.15.146:3300/0 conn(0x7f43cc0717c0 0x7f43cc0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 --2- 172.21.15.143:0/2318555841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0725f0 0x7f43cc06c630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 -- 172.21.15.143:0/2318555841 >> 172.21.15.143:0/2318555841 conn(0x7f43cc0b0bf0 msgr2=0x7f43cc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 -- 172.21.15.143:0/2318555841 shutdown_connections 2023-11-24T06:31:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 -- 172.21.15.143:0/2318555841 wait complete. 2023-11-24T06:31:15.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 Processor -- start 2023-11-24T06:31:15.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.102+0000 7f43d1157640 1 -- start start 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0717c0 0x7f43cc09c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 0x7f43cc0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43cc0c98f0 0x7f43cc099c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc09be40 con 0x7f43cc0725f0 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc09c0e0 con 0x7f43cc0c98f0 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc09a5b0 con 0x7f43cc0717c0 2023-11-24T06:31:15.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 0x7f43cc0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 0x7f43cc0b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43212/0 (socket says 172.21.15.143:43212) 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 -- 172.21.15.143:0/2049392372 learned_addr learned my addr 172.21.15.143:0/2049392372 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43cad9d640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0717c0 0x7f43cc09c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43cb59e640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43cc0c98f0 0x7f43cc099c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 -- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0717c0 msgr2=0x7f43cc09c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0717c0 0x7f43cc09c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 -- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43cc0c98f0 msgr2=0x7f43cc099c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43cc0c98f0 0x7f43cc099c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 -- 172.21.15.143:0/2049392372 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009a70 con 0x7f43cc0725f0 2023-11-24T06:31:15.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43ca59c640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 0x7f43cc0b48c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c480 tx=0x7f43c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43b37fe640 1 -- 172.21.15.143:0/2049392372 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00074e0 con 0x7f43cc0725f0 2023-11-24T06:31:15.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43b37fe640 1 -- 172.21.15.143:0/2049392372 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0007660 con 0x7f43cc0725f0 2023-11-24T06:31:15.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc009420 con 0x7f43cc0725f0 2023-11-24T06:31:15.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43b37fe640 1 -- 172.21.15.143:0/2049392372 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0004a30 con 0x7f43cc0725f0 2023-11-24T06:31:15.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc09ab70 con 0x7f43cc0725f0 2023-11-24T06:31:15.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.106+0000 7f43b37fe640 1 -- 172.21.15.143:0/2049392372 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f43c0004b90 con 0x7f43cc0725f0 2023-11-24T06:31:15.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43b37fe640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43b8066500 0x7f43b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43b37fe640 1 -- 172.21.15.143:0/2049392372 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c0083bf0 con 0x7f43cc0725f0 2023-11-24T06:31:15.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43b8066500 0x7f43b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 Processor -- start 2023-11-24T06:31:15.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 -- start start 2023-11-24T06:31:15.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43b8066500 0x7f43b80689c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097c0 tx=0x7f43bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eba10 0x564b988a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b98707130 con 0x564b988eb0f0 2023-11-24T06:31:15.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b986f49a0 con 0x564b988eba10 2023-11-24T06:31:15.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b986f1ed0 con 0x564b988a1730 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988eb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43222/0 (socket says 172.21.15.143:43222) 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 -- 172.21.15.143:0/3926296721 learned_addr learned my addr 172.21.15.143:0/3926296721 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43ca59c640 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eba10 0x564b988a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cb59e640 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 -- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 msgr2=0x564b988a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 -- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eba10 msgr2=0x564b988a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eba10 0x564b988a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 -- 172.21.15.143:0/3926296721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b983e5890 con 0x564b988eb0f0 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43cad9d640 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988eb4d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0b3040 tx=0x7f43bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa4c55736a0aa28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43b0ff9640 1 -- 172.21.15.143:0/3926296721 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0c1040 con 0x564b988eb0f0 2023-11-24T06:31:15.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43b0ff9640 1 -- 172.21.15.143:0/3926296721 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc0b0d20 con 0x564b988eb0f0 2023-11-24T06:31:15.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.110+0000 7f43b0ff9640 1 -- 172.21.15.143:0/3926296721 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0bb680 con 0x564b988eb0f0 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- 172.21.15.143:0/3926296721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 msgr2=0x564b988eb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988eb4d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0b3040 tx=0x7f43bc004740 comp rx=0 tx=0).stop 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- 172.21.15.143:0/3926296721 shutdown_connections 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eba10 0x564b988a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3926296721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988eb4d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- 172.21.15.143:0/3926296721 >> 172.21.15.143:0/3926296721 conn(0x564b988992d0 msgr2=0x564b9889b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- 172.21.15.143:0/3926296721 shutdown_connections 2023-11-24T06:31:15.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- 172.21.15.143:0/3926296721 wait complete. 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- start start 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 Processor -- start 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 0x564b988cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b988d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988eba10 0x564b988d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b986ed7c0 con 0x564b988a1730 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b986a5bf0 con 0x564b988eb0f0 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b986aba90 con 0x564b988eba10 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 10 client.0 _ll_register_callbacks cb 0x564b988883c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 0x564b988cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 0x564b988cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43238/0 (socket says 172.21.15.143:43238) 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 -- 172.21.15.143:0/379158839 learned_addr learned my addr 172.21.15.143:0/379158839 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:15.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43ca59c640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b988d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cb59e640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988eba10 0x564b988d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 -- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988eba10 msgr2=0x564b988d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988eba10 0x564b988d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 -- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 msgr2=0x564b988d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b988d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 -- 172.21.15.143:0/379158839 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc06cb70 con 0x564b988a1730 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43ca59c640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b988d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43cad9d640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 0x564b988cfb20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0c9040 tx=0x7f43bc01d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf31e7da6e364e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43a9ffb640 1 -- 172.21.15.143:0/379158839 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0c1040 con 0x564b988a1730 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b986af470 con 0x564b988a1730 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.114+0000 7f43a9ffb640 1 -- 172.21.15.143:0/379158839 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43bc0bb740 con 0x564b988a1730 2023-11-24T06:31:15.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 1 -- 172.21.15.143:0/379158839 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43bc0bb900 con 0x564b988a1730 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 10 client.5766 fetch_fsmap learned FSMap version 25 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x564b986ae190 con 0x564b988a1730 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 1 -- 172.21.15.143:0/379158839 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b986af470 con 0x564b988a1730 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 1 -- 172.21.15.143:0/379158839 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f43bc0bba60 con 0x564b988a1730 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 10 client.5766 fetch_fsmap finished waiting for FSMap version 25 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 10 client.5766 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 20 client.5766 populate_metadata read hostname 'smithi143' 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988fb190 0x564b988fd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 4 client.5766 mds_command: new command op to 5610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:31:15.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 --> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b986b2b50 con 0x564b988fb190 2023-11-24T06:31:15.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43ca59c640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988fb190 0x564b988fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43ca59c640 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988fb190 0x564b988fd580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ff51ed00ba1b755 server_cookie=fd3f438193d8df7c in_seq=0 out_seq=0 2023-11-24T06:31:15.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 10 client.5766 ms_handle_connect on v2:172.21.15.143:6835/3877501822 2023-11-24T06:31:15.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 1 -- 172.21.15.143:0/379158839 <== mds.0 v2:172.21.15.143:6835/3877501822 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b986b2b50 con 0x564b988fb190 2023-11-24T06:31:15.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 10 client.5766 handle_command_reply: tid=0 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 client.5766 shutdown 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 msgr2=0x564b988cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 0x564b988cfb20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0c9040 tx=0x7f43bc01d4b0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 shutdown_connections 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988fb190 0x564b988fd580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988eba10 0x564b988d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b988d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43a9ffb640 0 client.5766 ms_handle_reset on v2:172.21.15.143:6835/3877501822 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 --2- 172.21.15.143:0/379158839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988a1730 0x564b988cfb20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 >> 172.21.15.143:0/379158839 conn(0x564b988992d0 msgr2=0x564b988a25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 shutdown_connections 2023-11-24T06:31:15.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 1 -- 172.21.15.143:0/379158839 wait complete. 2023-11-24T06:31:15.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.118+0000 7f43d44bc000 20 client.5766 trim_cache size 0 max 16384 2023-11-24T06:31:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 Processor -- start 2023-11-24T06:31:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 -- start start 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988992d0 0x564b9889bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b9889c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b983a6940 con 0x564b988eb0f0 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b9872f140 con 0x564b988992d0 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b98774fa0 con 0x564b988a1730 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988e93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43254/0 (socket says 172.21.15.143:43254) 2023-11-24T06:31:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 -- 172.21.15.143:0/273192612 learned_addr learned my addr 172.21.15.143:0/273192612 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cad9d640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988992d0 0x564b9889bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43ca59c640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b9889c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 -- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 msgr2=0x564b9889c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b9889c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 -- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988992d0 msgr2=0x564b9889bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988992d0 0x564b9889bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 -- 172.21.15.143:0/273192612 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b98694490 con 0x564b988eb0f0 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43ca59c640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b9889c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cad9d640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988992d0 0x564b9889bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:15.143 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43cb59e640 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988e93a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009670 tx=0x7f43c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d19673ec943b3c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43b17fa640 1 -- 172.21.15.143:0/273192612 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c400e040 con 0x564b988eb0f0 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43b17fa640 1 -- 172.21.15.143:0/273192612 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c400f040 con 0x564b988eb0f0 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.134+0000 7f43b17fa640 1 -- 172.21.15.143:0/273192612 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007ca0 con 0x564b988eb0f0 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/273192612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 msgr2=0x564b988e93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988e93a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009670 tx=0x7f43c4009750 comp rx=0 tx=0).stop 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/273192612 shutdown_connections 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988eb0f0 0x564b988e93a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b9889c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- 172.21.15.143:0/273192612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988992d0 0x564b9889bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/273192612 >> 172.21.15.143:0/273192612 conn(0x564b988cd690 msgr2=0x564b9889b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/273192612 shutdown_connections 2023-11-24T06:31:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/273192612 wait complete. 2023-11-24T06:31:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- start start 2023-11-24T06:31:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 Processor -- start 2023-11-24T06:31:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 0x564b988fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988feb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b98909010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b988a4890 con 0x564b988992d0 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b986a4a10 con 0x564b988eb0f0 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b986c6e10 con 0x564b988a1730 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 10 client.0 _ll_register_callbacks cb 0x564b9873bc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 0x564b988fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 0x564b988fe5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43268/0 (socket says 172.21.15.143:43268) 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 -- 172.21.15.143:0/3889339430 learned_addr learned my addr 172.21.15.143:0/3889339430 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43ca59c640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cb59e640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b98909010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 -- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 msgr2=0x564b988feb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988feb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 -- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 msgr2=0x564b98909010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b98909010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 -- 172.21.15.143:0/3889339430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c4015430 con 0x564b988992d0 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43ca59c640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988feb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43cad9d640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 0x564b988fe5d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0b3040 tx=0x7f43bc0aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cc69c37b35f713 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43a9ffb640 1 -- 172.21.15.143:0/3889339430 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0c1070 con 0x564b988992d0 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43a9ffb640 1 -- 172.21.15.143:0/3889339430 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43bc0b0e30 con 0x564b988992d0 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b986ec110 con 0x564b988992d0 2023-11-24T06:31:15.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43a9ffb640 1 -- 172.21.15.143:0/3889339430 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43bc0a8770 con 0x564b988992d0 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 10 client.5772 fetch_fsmap learned FSMap version 25 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x564b983e5cc0 con 0x564b988992d0 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.138+0000 7f43a9ffb640 1 -- 172.21.15.143:0/3889339430 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b986ec110 con 0x564b988992d0 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43a9ffb640 1 -- 172.21.15.143:0/3889339430 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f43bc0d2a40 con 0x564b988992d0 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 10 client.5772 fetch_fsmap finished waiting for FSMap version 25 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 10 client.5772 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 20 client.5772 populate_metadata read hostname 'smithi143' 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988eba10 0x564b98909550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 4 client.5772 mds_command: new command op to 5610 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 --> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b9871b9a0 con 0x564b988eba10 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43ca59c640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988eba10 0x564b98909550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43ca59c640 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988eba10 0x564b98909550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd742538b2a1bd00 server_cookie=136a0ef4e2514fb in_seq=0 out_seq=0 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43a9ffb640 10 client.5772 ms_handle_connect on v2:172.21.15.143:6835/3877501822 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43a9ffb640 1 -- 172.21.15.143:0/3889339430 <== mds.0 v2:172.21.15.143:6835/3877501822 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564b9871b9a0 con 0x564b988eba10 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43a9ffb640 10 client.5772 handle_command_reply: tid=0 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 client.5772 shutdown 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 msgr2=0x564b988fe5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 0x564b988fe5d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0b3040 tx=0x7f43bc0aa070 comp rx=0 tx=0).stop 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 shutdown_connections 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b988eb0f0 0x564b98909010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:6835/3877501822,v1:172.21.15.143:6837/3877501822] conn(0x564b988eba10 0x564b98909550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x564b988a1730 0x564b988feb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 --2- 172.21.15.143:0/3889339430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x564b988992d0 0x564b988fe5d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43a9ffb640 0 client.5772 ms_handle_reset on v2:172.21.15.143:6835/3877501822 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 >> 172.21.15.143:0/3889339430 conn(0x564b988cd690 msgr2=0x564b9889bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 shutdown_connections 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 1 -- 172.21.15.143:0/3889339430 wait complete. 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d44bc000 20 client.5772 trim_cache size 0 max 16384 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "039ed6d4-b5c2-4e8e-a15f-05a601a78248", 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2023-11-24T06:31:15.153 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 5610, 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 10.343714670000001, 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 25, 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 44, 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 44, 2023-11-24T06:31:15.154 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 16.203723151999998 2023-11-24T06:31:15.155 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:31:15.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43b8066500 msgr2=0x7f43b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43b8066500 0x7f43b80689c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097c0 tx=0x7f43bc008040 comp rx=0 tx=0).stop 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 msgr2=0x7f43cc0b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 0x7f43cc0b48c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c480 tx=0x7f43c000c880 comp rx=0 tx=0).stop 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 shutdown_connections 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43b8066500 0x7f43b80689c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43cc0c98f0 0x7f43cc099c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43cc0725f0 0x7f43cc0b48c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 --2- 172.21.15.143:0/2049392372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43cc0717c0 0x7f43cc09c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 >> 172.21.15.143:0/2049392372 conn(0x7f43cc0b0bf0 msgr2=0x7f43cc0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 shutdown_connections 2023-11-24T06:31:15.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.142+0000 7f43d1157640 1 -- 172.21.15.143:0/2049392372 wait complete. 2023-11-24T06:31:15.167 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:31:15.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.302+0000 7f1f19dc1640 1 Processor -- start 2023-11-24T06:31:15.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.302+0000 7f1f19dc1640 1 -- start start 2023-11-24T06:31:15.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f19dc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f140b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f19dc1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f140d3fc0 0x7f1f1406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f19dc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1406c6e0 con 0x7f1f14160f40 2023-11-24T06:31:15.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f19dc1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1406d410 con 0x7f1f140d3fc0 2023-11-24T06:31:15.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f19dc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1406c350 con 0x7f1f14160b60 2023-11-24T06:31:15.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f0bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1f14160f40 0x7f1f1406b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57932/0 (socket says 172.21.15.143:57932) 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f0bfff640 1 -- 172.21.15.143:0/2293247948 learned_addr learned my addr 172.21.15.143:0/2293247948 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f137fe640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f140b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f13fff640 1 --2- 172.21.15.143:0/2293247948 >> v2:172.21.15.146:3300/0 conn(0x7f1f140d3fc0 0x7f1f1406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f12ffd640 1 -- 172.21.15.143:0/2293247948 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386186118 0 0) 0x7f1f1406c6e0 con 0x7f1f14160f40 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f12ffd640 1 -- 172.21.15.143:0/2293247948 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f00003530 con 0x7f1f14160f40 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f13fff640 1 -- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 msgr2=0x7f1f140b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f13fff640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f140b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f13fff640 1 -- 172.21.15.143:0/2293247948 >> v1:172.21.15.143:6789/0 conn(0x7f1f14160f40 legacy=0x7f1f1406b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f13fff640 1 -- 172.21.15.143:0/2293247948 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1406c930 con 0x7f1f140d3fc0 2023-11-24T06:31:15.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.306+0000 7f1f137fe640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f140b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:15.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f13fff640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f140d3fc0 0x7f1f1406bce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009d90 tx=0x7f1f0c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3f845b9718b9c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f12ffd640 1 -- 172.21.15.143:0/2293247948 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0a5950 con 0x7f1f140d3fc0 2023-11-24T06:31:15.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f12ffd640 1 -- 172.21.15.143:0/2293247948 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c0a5ab0 con 0x7f1f140d3fc0 2023-11-24T06:31:15.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f12ffd640 1 -- 172.21.15.143:0/2293247948 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0a5e40 con 0x7f1f140d3fc0 2023-11-24T06:31:15.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 -- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f140d3fc0 msgr2=0x7f1f1406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f140d3fc0 0x7f1f1406bce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009d90 tx=0x7f1f0c01c890 comp rx=0 tx=0).stop 2023-11-24T06:31:15.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 -- 172.21.15.143:0/2293247948 shutdown_connections 2023-11-24T06:31:15.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f140d3fc0 0x7f1f1406bce0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/2293247948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f140b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 -- 172.21.15.143:0/2293247948 >> 172.21.15.143:0/2293247948 conn(0x7f1f1409c6c0 msgr2=0x7f1f140d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 -- 172.21.15.143:0/2293247948 shutdown_connections 2023-11-24T06:31:15.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 -- 172.21.15.143:0/2293247948 wait complete. 2023-11-24T06:31:15.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 Processor -- start 2023-11-24T06:31:15.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 -- start start 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.310+0000 7f1f19dc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 0x7f1f140c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f1414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f14160f40 0x7f1f140c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140cc150 con 0x7f1f140d3fc0 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140cb5a0 con 0x7f1f14160f40 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14150470 con 0x7f1f14160b60 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 0x7f1f140c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 0x7f1f140c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43272/0 (socket says 172.21.15.143:43272) 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 -- 172.21.15.143:0/237142669 learned_addr learned my addr 172.21.15.143:0/237142669 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f0bfff640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f1414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f13fff640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f14160f40 0x7f1f140c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 -- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 msgr2=0x7f1f1414ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f1414ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 -- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f14160f40 msgr2=0x7f1f140c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f14160f40 0x7f1f140c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 -- 172.21.15.143:0/237142669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04009420 con 0x7f1f140d3fc0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f137fe640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 0x7f1f140c6f40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e980 tx=0x7f1f0400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400ca00 con 0x7f1f140d3fc0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400cb60 con 0x7f1f140d3fc0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c009a70 con 0x7f1f140d3fc0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04013470 con 0x7f1f140d3fc0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f140cba90 con 0x7f1f140d3fc0 2023-11-24T06:31:15.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f140cc3c0 con 0x7f1f140d3fc0 2023-11-24T06:31:15.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.314+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f1f040135d0 con 0x7f1f140d3fc0 2023-11-24T06:31:15.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.318+0000 7f1f10ff9640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ef4066500 0x7f1ef40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:15.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.318+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f04084090 con 0x7f1f140d3fc0 2023-11-24T06:31:15.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.318+0000 7f1f0bfff640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ef4066500 0x7f1ef40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:15.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.318+0000 7f1f0bfff640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ef4066500 0x7f1ef40689c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f1415db80 tx=0x7f1efc007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:15.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.322+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f040515d0 con 0x7f1f140d3fc0 2023-11-24T06:31:15.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.506+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f1408cb90 con 0x7f1f140d3fc0 2023-11-24T06:31:15.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f10ff9640 1 -- 172.21.15.143:0/237142669 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f04054bf0 con 0x7f1f140d3fc0 2023-11-24T06:31:15.514 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:31:15.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ef4066500 msgr2=0x7f1ef40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ef4066500 0x7f1ef40689c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f1415db80 tx=0x7f1efc007d40 comp rx=0 tx=0).stop 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 msgr2=0x7f1f140c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 0x7f1f140c6f40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e980 tx=0x7f1f0400ee40 comp rx=0 tx=0).stop 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 shutdown_connections 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ef4066500 0x7f1ef40689c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f14160f40 0x7f1f140c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f14160b60 0x7f1f1414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 --2- 172.21.15.143:0/237142669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f140d3fc0 0x7f1f140c6f40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 >> 172.21.15.143:0/237142669 conn(0x7f1f1409c6c0 msgr2=0x7f1f140affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 shutdown_connections 2023-11-24T06:31:15.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:15.510+0000 7f1f19dc1640 1 -- 172.21.15.143:0/237142669 wait complete. 2023-11-24T06:31:15.534 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:31:15.535 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:31:15.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.535 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:31:15.546 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:31:15.546 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:31:15.546 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:31:15.546 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:15.547 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:15.548 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:31:15.548 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:15.548 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:15.548 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:31:15.548 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:15.548 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:31:15.549 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42287sec preferred_lft 42287sec 2023-11-24T06:31:15.549 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:31:15.550 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.550 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:31:15.551 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:15.551 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:31:15.551 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.551 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:31:15.551 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:15.552 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:31:15.552 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.552 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:31:15.552 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.552 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:15.552 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:31:15.553 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:31:15.553 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.553 INFO:teuthology.orchestra.run.smithi143.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:15.553 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:31:15.553 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:31:15.553 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:15.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.554 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:31:15.612 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:31:15.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.614 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:15.668 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:15.669 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:15.669 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:31:15.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.670 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:31:15.670 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:31:15.670 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:31:15.670 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:31:15.670 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:31:15.671 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:31:15.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.760 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:31:15.815 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:31:15.815 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:31:15.816 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:31:15.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.816 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-11-24T06:31:15.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:15.881 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:15.933 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:31:15.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:15.934 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:15.985 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:31:15.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:15.986 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:16.078 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:16.078 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:31:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:31:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:31:16.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:31:16.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.097 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:16.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.117 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:31:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:client5488 2023-11-24T06:31:16.178 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:16.178 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:16.230 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:31:16.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 Processor -- start 2023-11-24T06:31:16.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 -- start start 2023-11-24T06:31:16.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f493815d5e0 0x7f49380d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:16.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f49380d3ee0 0x7f49380d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493815d9c0 con 0x7f49380d1d00 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380d2130 con 0x7f493815d5e0 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f493cbd0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380d1190 con 0x7f49380d3ee0 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f49377fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f493815d5e0 0x7f49380d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f4937fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f49380d1d00 0x7f49380cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57948/0 (socket says 172.21.15.143:57948) 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f4937fff640 1 -- 172.21.15.143:0/1092826932 learned_addr learned my addr 172.21.15.143:0/1092826932 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f4936ffd640 1 --2- 172.21.15.143:0/1092826932 >> v2:172.21.15.146:3300/0 conn(0x7f49380d3ee0 0x7f49380d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f49377fe640 1 -- 172.21.15.143:0/1092826932 >> v2:172.21.15.146:3300/0 conn(0x7f49380d3ee0 msgr2=0x7f49380d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f49377fe640 1 --2- 172.21.15.143:0/1092826932 >> v2:172.21.15.146:3300/0 conn(0x7f49380d3ee0 0x7f49380d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f49377fe640 1 -- 172.21.15.143:0/1092826932 >> v1:172.21.15.143:6789/0 conn(0x7f49380d1d00 legacy=0x7f49380cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f49367fc640 1 -- 172.21.15.143:0/1092826932 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258526293 0 0) 0x7f493815d9c0 con 0x7f49380d1d00 2023-11-24T06:31:16.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f49377fe640 1 -- 172.21.15.143:0/1092826932 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380d1470 con 0x7f493815d5e0 2023-11-24T06:31:16.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.410+0000 7f4936ffd640 1 --2- 172.21.15.143:0/1092826932 >> v2:172.21.15.146:3300/0 conn(0x7f49380d3ee0 0x7f49380d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:16.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f49377fe640 1 --2- 172.21.15.143:0/1092826932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f493815d5e0 0x7f49380d39a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f49380b5db0 tx=0x7f492801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227dcc8b5808e7db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:16.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f49367fc640 1 -- 172.21.15.143:0/1092826932 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280a7070 con 0x7f493815d5e0 2023-11-24T06:31:16.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f49367fc640 1 -- 172.21.15.143:0/1092826932 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49280ab430 con 0x7f493815d5e0 2023-11-24T06:31:16.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f49367fc640 1 -- 172.21.15.143:0/1092826932 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280ab7c0 con 0x7f493815d5e0 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 -- 172.21.15.143:0/1092826932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f493815d5e0 msgr2=0x7f49380d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1092826932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f493815d5e0 0x7f49380d39a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f49380b5db0 tx=0x7f492801c430 comp rx=0 tx=0).stop 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 -- 172.21.15.143:0/1092826932 shutdown_connections 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1092826932 >> v2:172.21.15.146:3300/0 conn(0x7f49380d3ee0 0x7f49380d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1092826932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f493815d5e0 0x7f49380d39a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 -- 172.21.15.143:0/1092826932 >> 172.21.15.143:0/1092826932 conn(0x7f493809c520 msgr2=0x7f49380d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 -- 172.21.15.143:0/1092826932 shutdown_connections 2023-11-24T06:31:16.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 -- 172.21.15.143:0/1092826932 wait complete. 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.414+0000 7f493cbd0640 1 Processor -- start 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- start start 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49380d1d00 0x7f49381535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 0x7f493806b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f493815d5e0 0x7f493806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49381596a0 con 0x7f49380d3ee0 2023-11-24T06:31:16.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b5ef0 con 0x7f49380d1d00 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4938158a90 con 0x7f493815d5e0 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 0x7f493806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 0x7f493806b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43290/0 (socket says 172.21.15.143:43290) 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 -- 172.21.15.143:0/1172652832 learned_addr learned my addr 172.21.15.143:0/1172652832 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f49377fe640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49380d1d00 0x7f49381535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4937fff640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f493815d5e0 0x7f493806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 -- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f493815d5e0 msgr2=0x7f493806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f493815d5e0 0x7f493806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 -- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49380d1d00 msgr2=0x7f49381535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49380d1d00 0x7f49381535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 -- 172.21.15.143:0/1172652832 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009420 con 0x7f49380d3ee0 2023-11-24T06:31:16.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4937fff640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f493815d5e0 0x7f493806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:16.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f4936ffd640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 0x7f493806b370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f492c00c7f0 tx=0x7f492c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:16.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c007820 con 0x7f49380d3ee0 2023-11-24T06:31:16.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c007980 con 0x7f49380d3ee0 2023-11-24T06:31:16.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4938158d70 con 0x7f49380d3ee0 2023-11-24T06:31:16.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c007d30 con 0x7f49380d3ee0 2023-11-24T06:31:16.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4938159330 con 0x7f49380d3ee0 2023-11-24T06:31:16.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.418+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493804e850 con 0x7f49380d3ee0 2023-11-24T06:31:16.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.422+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f492c0113f0 con 0x7f49380d3ee0 2023-11-24T06:31:16.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.422+0000 7f491ffff640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4924066500 0x7f49240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:16.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.422+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f492c084340 con 0x7f49380d3ee0 2023-11-24T06:31:16.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.422+0000 7f49377fe640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4924066500 0x7f49240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:16.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.422+0000 7f49377fe640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4924066500 0x7f49240689c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f49280af000 tx=0x7f49280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:16.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.426+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f492c051630 con 0x7f49380d3ee0 2023-11-24T06:31:16.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.606+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f493806cf60 con 0x7f49380d3ee0 2023-11-24T06:31:16.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.606+0000 7f491ffff640 1 -- 172.21.15.143:0/1172652832 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f492c054c50 con 0x7f49380d3ee0 2023-11-24T06:31:16.612 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:31:16.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4924066500 msgr2=0x7f49240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:16.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4924066500 0x7f49240689c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f49280af000 tx=0x7f49280a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:16.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 msgr2=0x7f493806b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:16.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 0x7f493806b370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f492c00c7f0 tx=0x7f492c00ccb0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 shutdown_connections 2023-11-24T06:31:16.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4924066500 0x7f49240689c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f493815d5e0 0x7f493806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49380d3ee0 0x7f493806b370 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 --2- 172.21.15.143:0/1172652832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49380d1d00 0x7f49381535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:16.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 >> 172.21.15.143:0/1172652832 conn(0x7f493809c520 msgr2=0x7f4938156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:16.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 shutdown_connections 2023-11-24T06:31:16.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:16.610+0000 7f493cbd0640 1 -- 172.21.15.143:0/1172652832 wait complete. 2023-11-24T06:31:16.632 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:31:16.633 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:31:16.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.634 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.647 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:31:16.648 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.649 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:16.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.650 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:31:16.710 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:31:16.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.714 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:31:16.765 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:31:16.765 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:31:16.765 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:31:16.766 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:31:16.766 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:31:16.766 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:31:16.766 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:16.766 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:16.767 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:16.767 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:31:16.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.767 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:31:16.768 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:31:16.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:31:16.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:31:16.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:31:16.768 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:31:16.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.862 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:31:16.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:31:16.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:31:16.873 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:31:16.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:16.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-11-24T06:31:16.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:16.935 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:16.990 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:31:16.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:16.991 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:17.042 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:31:17.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:17.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:17.136 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:17.137 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:17.151 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:17.152 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:17.152 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:31:17.152 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 1@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:31:17.152 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:31:17.156 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:31:17.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:17.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:17.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:17.177 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:31:17.233 INFO:teuthology.orchestra.run.smithi146.stdout:client5790 2023-11-24T06:31:17.234 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:17.234 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:17.282 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:31:17.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.418+0000 7f96d2691640 1 Processor -- start 2023-11-24T06:31:17.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.418+0000 7f96d2691640 1 -- start start 2023-11-24T06:31:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96d2691640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96cc144030 0x7f96cc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96d2691640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f96cc09cc20 0x7f96cc06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:17.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96d2691640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc06d8b0 con 0x7f96cc06e280 2023-11-24T06:31:17.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96d2691640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc145020 con 0x7f96cc09cc20 2023-11-24T06:31:17.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96d2691640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc09d0a0 con 0x7f96cc144030 2023-11-24T06:31:17.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f96cc09cc20 0x7f96cc06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:17.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f96cc09cc20 0x7f96cc06dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37692/0 (socket says 172.21.15.143:37692) 2023-11-24T06:31:17.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 -- 172.21.15.143:0/3456406903 learned_addr learned my addr 172.21.15.143:0/3456406903 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:17.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cbfff640 1 --2- 172.21.15.143:0/3456406903 >> v2:172.21.15.146:3300/0 conn(0x7f96cc144030 0x7f96cc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 -- 172.21.15.143:0/3456406903 >> v2:172.21.15.146:3300/0 conn(0x7f96cc144030 msgr2=0x7f96cc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 --2- 172.21.15.143:0/3456406903 >> v2:172.21.15.146:3300/0 conn(0x7f96cc144030 0x7f96cc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 -- 172.21.15.143:0/3456406903 >> v1:172.21.15.146:6789/0 conn(0x7f96cc06e280 legacy=0x7f96cc0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.422+0000 7f96cb7fe640 1 -- 172.21.15.143:0/3456406903 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc06cca0 con 0x7f96cc09cc20 2023-11-24T06:31:17.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96cb7fe640 1 --2- 172.21.15.143:0/3456406903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc06dd40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f96cc06c2f0 tx=0x7f96c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77ec9780bc201cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:17.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96caffd640 1 -- 172.21.15.143:0/3456406903 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00aa430 con 0x7f96cc09cc20 2023-11-24T06:31:17.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96caffd640 1 -- 172.21.15.143:0/3456406903 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c00aa590 con 0x7f96cc09cc20 2023-11-24T06:31:17.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96caffd640 1 -- 172.21.15.143:0/3456406903 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00aa920 con 0x7f96cc09cc20 2023-11-24T06:31:17.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 -- 172.21.15.143:0/3456406903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 msgr2=0x7f96cc06dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:17.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 --2- 172.21.15.143:0/3456406903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc06dd40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f96cc06c2f0 tx=0x7f96c001c4d0 comp rx=0 tx=0).stop 2023-11-24T06:31:17.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 -- 172.21.15.143:0/3456406903 shutdown_connections 2023-11-24T06:31:17.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 --2- 172.21.15.143:0/3456406903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc06dd40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:17.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 --2- 172.21.15.143:0/3456406903 >> v2:172.21.15.146:3300/0 conn(0x7f96cc144030 0x7f96cc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:17.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 -- 172.21.15.143:0/3456406903 >> 172.21.15.143:0/3456406903 conn(0x7f96cc0b0bf0 msgr2=0x7f96cc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:17.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 -- 172.21.15.143:0/3456406903 shutdown_connections 2023-11-24T06:31:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 -- 172.21.15.143:0/3456406903 wait complete. 2023-11-24T06:31:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 Processor -- start 2023-11-24T06:31:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.426+0000 7f96d2691640 1 -- start start 2023-11-24T06:31:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc06e280 0x7f96cc15a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc13ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96cc144030 0x7f96cc13d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0cf580 con 0x7f96cc09cc20 2023-11-24T06:31:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0ce970 con 0x7f96cc06e280 2023-11-24T06:31:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0cec50 con 0x7f96cc144030 2023-11-24T06:31:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc13ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:17.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc13ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37700/0 (socket says 172.21.15.143:37700) 2023-11-24T06:31:17.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 -- 172.21.15.143:0/197897038 learned_addr learned my addr 172.21.15.143:0/197897038 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:17.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cbfff640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc06e280 0x7f96cc15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:17.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d0c2e640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96cc144030 0x7f96cc13d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:17.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 -- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96cc144030 msgr2=0x7f96cc13d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:17.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96cc144030 0x7f96cc13d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:17.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 -- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc06e280 msgr2=0x7f96cc15a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:17.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc06e280 0x7f96cc15a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:17.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 -- 172.21.15.143:0/197897038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c00094d0 con 0x7f96cc09cc20 2023-11-24T06:31:17.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96cb7fe640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc13ce00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f96c00190e0 tx=0x7f96c001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00aa430 con 0x7f96cc09cc20 2023-11-24T06:31:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c00b3800 con 0x7f96cc09cc20 2023-11-24T06:31:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc0cef30 con 0x7f96cc09cc20 2023-11-24T06:31:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00b3b90 con 0x7f96cc09cc20 2023-11-24T06:31:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc15ac50 con 0x7f96cc09cc20 2023-11-24T06:31:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc0cf6f0 con 0x7f96cc09cc20 2023-11-24T06:31:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.430+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f96c00b3cf0 con 0x7f96cc09cc20 2023-11-24T06:31:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.434+0000 7f96c8ff9640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f96b8066530 0x7f96b80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.434+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c011e830 con 0x7f96cc09cc20 2023-11-24T06:31:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.434+0000 7f96cbfff640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f96b8066530 0x7f96b80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.434+0000 7f96cbfff640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f96b8066530 0x7f96b80689f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f96cc142d60 tx=0x7f96bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.438+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96c00ebb60 con 0x7f96cc09cc20 2023-11-24T06:31:17.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:17.618+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f96cc067520 con 0x7f96cc09cc20 2023-11-24T06:31:18.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.238+0000 7f96c8ff9640 1 -- 172.21.15.143:0/197897038 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 136+0+0 (secure 0 0 0) 0x7f96c00ef180 con 0x7f96cc09cc20 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f96b8066530 msgr2=0x7f96b80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f96b8066530 0x7f96b80689f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f96cc142d60 tx=0x7f96bc009190 comp rx=0 tx=0).stop 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 msgr2=0x7f96cc13ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc13ce00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f96c00190e0 tx=0x7f96c001ad10 comp rx=0 tx=0).stop 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 shutdown_connections 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f96b8066530 0x7f96b80689f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96cc144030 0x7f96cc13d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96cc09cc20 0x7f96cc13ce00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 --2- 172.21.15.143:0/197897038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc06e280 0x7f96cc15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 >> 172.21.15.143:0/197897038 conn(0x7f96cc0b0bf0 msgr2=0x7f96cc0abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:18.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 shutdown_connections 2023-11-24T06:31:18.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.242+0000 7f96d2691640 1 -- 172.21.15.143:0/197897038 wait complete. 2023-11-24T06:31:18.266 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:31:18.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.398+0000 7fc897caa640 1 Processor -- start 2023-11-24T06:31:18.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 -- start start 2023-11-24T06:31:18.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900725f0 0x7fc89006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8900c98f0 0x7fc8900c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8900cd0d0 0x7fc8900cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900ca770 con 0x7fc8900c98f0 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900729d0 con 0x7fc8900cd0d0 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc897caa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900ca270 con 0x7fc8900725f0 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8900c98f0 0x7fc8900c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8900c98f0 0x7fc8900c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37704/0 (socket says 172.21.15.143:37704) 2023-11-24T06:31:18.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 -- 172.21.15.143:0/2431446938 learned_addr learned my addr 172.21.15.143:0/2431446938 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895a46640 1 --2- 172.21.15.143:0/2431446938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900725f0 0x7fc89006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc896247640 1 --2- 172.21.15.143:0/2431446938 >> v2:172.21.15.146:3300/0 conn(0x7fc8900cd0d0 0x7fc8900cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 -- 172.21.15.143:0/2431446938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900725f0 msgr2=0x7fc89006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 --2- 172.21.15.143:0/2431446938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900725f0 0x7fc89006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 -- 172.21.15.143:0/2431446938 >> v2:172.21.15.146:3300/0 conn(0x7fc8900cd0d0 msgr2=0x7fc8900cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 --2- 172.21.15.143:0/2431446938 >> v2:172.21.15.146:3300/0 conn(0x7fc8900cd0d0 0x7fc8900cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.402+0000 7fc895245640 1 -- 172.21.15.143:0/2431446938 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89006cb70 con 0x7fc8900c98f0 2023-11-24T06:31:18.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc895245640 1 --2- 172.21.15.143:0/2431446938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8900c9d30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc89006e6e0 tx=0x7fc88001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b646f759012ddb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:18.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc894a44640 1 -- 172.21.15.143:0/2431446938 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800a89b0 con 0x7fc8900c98f0 2023-11-24T06:31:18.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc894a44640 1 -- 172.21.15.143:0/2431446938 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8800a8b10 con 0x7fc8900c98f0 2023-11-24T06:31:18.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc894a44640 1 -- 172.21.15.143:0/2431446938 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800a8ea0 con 0x7fc8900c98f0 2023-11-24T06:31:18.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 -- 172.21.15.143:0/2431446938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 msgr2=0x7fc8900c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 --2- 172.21.15.143:0/2431446938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8900c9d30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc89006e6e0 tx=0x7fc88001ecf0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 -- 172.21.15.143:0/2431446938 shutdown_connections 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 --2- 172.21.15.143:0/2431446938 >> v2:172.21.15.146:3300/0 conn(0x7fc8900cd0d0 0x7fc8900cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 --2- 172.21.15.143:0/2431446938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8900c9d30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 --2- 172.21.15.143:0/2431446938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900725f0 0x7fc89006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 -- 172.21.15.143:0/2431446938 >> 172.21.15.143:0/2431446938 conn(0x7fc8900b0bf0 msgr2=0x7fc8900b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 -- 172.21.15.143:0/2431446938 shutdown_connections 2023-11-24T06:31:18.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 -- 172.21.15.143:0/2431446938 wait complete. 2023-11-24T06:31:18.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 Processor -- start 2023-11-24T06:31:18.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.406+0000 7fc897caa640 1 -- start start 2023-11-24T06:31:18.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8900725f0 0x7fc890157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8901e2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900cd0d0 0x7fc8900b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900b2bc0 con 0x7fc8900c98f0 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89015b920 con 0x7fc8900725f0 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89015ad10 con 0x7fc8900cd0d0 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8901e2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8901e2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37706/0 (socket says 172.21.15.143:37706) 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 -- 172.21.15.143:0/4220225624 learned_addr learned my addr 172.21.15.143:0/4220225624 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895a46640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8900725f0 0x7fc890157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc896247640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900cd0d0 0x7fc8900b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 -- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900cd0d0 msgr2=0x7fc8900b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900cd0d0 0x7fc8900b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 -- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8900725f0 msgr2=0x7fc890157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8900725f0 0x7fc890157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 -- 172.21.15.143:0/4220225624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800094d0 con 0x7fc8900c98f0 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895a46640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8900725f0 0x7fc890157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc895245640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8901e2080 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc8800b3040 tx=0x7fc88001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800b0cc0 con 0x7fc8900c98f0 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8800b0e20 con 0x7fc8900c98f0 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89015aff0 con 0x7fc8900c98f0 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800bb6b0 con 0x7fc8900c98f0 2023-11-24T06:31:18.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89015b5b0 con 0x7fc8900c98f0 2023-11-24T06:31:18.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.410+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89015bab0 con 0x7fc8900c98f0 2023-11-24T06:31:18.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.414+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fc8800b7070 con 0x7fc8900c98f0 2023-11-24T06:31:18.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.414+0000 7fc8867fc640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc874066500 0x7fc8740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.414+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc880122140 con 0x7fc8900c98f0 2023-11-24T06:31:18.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.414+0000 7fc895a46640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc874066500 0x7fc8740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.414+0000 7fc895a46640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc874066500 0x7fc8740689c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009b30 tx=0x7fc88c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:18.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.418+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8800ef560 con 0x7fc8900c98f0 2023-11-24T06:31:18.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.586+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc89006d3d0 con 0x7fc874066500 2023-11-24T06:31:18.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc8867fc640 1 -- 172.21.15.143:0/4220225624 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc88c009860 con 0x7fc874066500 2023-11-24T06:31:18.593 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:31:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "cephfs" 2023-11-24T06:31:18.594 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:18.594 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:31:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc874066500 msgr2=0x7fc8740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc874066500 0x7fc8740689c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009b30 tx=0x7fc88c008040 comp rx=0 tx=0).stop 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 msgr2=0x7fc8901e2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8901e2080 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc8800b3040 tx=0x7fc88001ba90 comp rx=0 tx=0).stop 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 shutdown_connections 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc874066500 0x7fc8740689c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8900cd0d0 0x7fc8900b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8900c98f0 0x7fc8901e2080 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 --2- 172.21.15.143:0/4220225624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8900725f0 0x7fc890157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 >> 172.21.15.143:0/4220225624 conn(0x7fc8900b0bf0 msgr2=0x7fc890159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 shutdown_connections 2023-11-24T06:31:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.590+0000 7fc897caa640 1 -- 172.21.15.143:0/4220225624 wait complete. 2023-11-24T06:31:18.615 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:31:18.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 Processor -- start 2023-11-24T06:31:18.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 -- start start 2023-11-24T06:31:18.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1ef0160970 0x7f1ef00d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ef00d1de0 0x7f1ef00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef00cf0a0 con 0x7f1ef00cdc60 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00ce490 con 0x7f1ef0160970 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1ef4bd0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00ce770 con 0x7f1ef00d1de0 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1ef0160970 0x7f1ef00d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1ef0160970 0x7f1ef00d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37712/0 (socket says 172.21.15.143:37712) 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 -- 172.21.15.143:0/2344096168 learned_addr learned my addr 172.21.15.143:0/2344096168 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eeffff640 1 --2- 172.21.15.143:0/2344096168 >> v2:172.21.15.146:3300/0 conn(0x7f1ef00d1de0 0x7f1ef00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 -- 172.21.15.143:0/2344096168 >> v2:172.21.15.146:3300/0 conn(0x7f1ef00d1de0 msgr2=0x7f1ef00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 --2- 172.21.15.143:0/2344096168 >> v2:172.21.15.146:3300/0 conn(0x7f1ef00d1de0 0x7f1ef00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 -- 172.21.15.143:0/2344096168 >> v1:172.21.15.146:6789/0 conn(0x7f1ef00cdc60 legacy=0x7f1ef00d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.750+0000 7f1eef7fe640 1 -- 172.21.15.143:0/2344096168 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00cea50 con 0x7f1ef0160970 2023-11-24T06:31:18.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1eef7fe640 1 --2- 172.21.15.143:0/2344096168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef00d3d20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b4920 tx=0x7f1ee001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c3a156101cf40b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:18.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1eee7fc640 1 -- 172.21.15.143:0/2344096168 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00aa650 con 0x7f1ef0160970 2023-11-24T06:31:18.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1eee7fc640 1 -- 172.21.15.143:0/2344096168 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00aa7b0 con 0x7f1ef0160970 2023-11-24T06:31:18.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1eee7fc640 1 -- 172.21.15.143:0/2344096168 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00aab40 con 0x7f1ef0160970 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/2344096168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 msgr2=0x7f1ef00d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/2344096168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef00d3d20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b4920 tx=0x7f1ee001c4d0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/2344096168 shutdown_connections 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/2344096168 >> v2:172.21.15.146:3300/0 conn(0x7f1ef00d1de0 0x7f1ef00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/2344096168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef00d3d20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/2344096168 >> 172.21.15.143:0/2344096168 conn(0x7f1ef009c5c0 msgr2=0x7f1ef00d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:18.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/2344096168 shutdown_connections 2023-11-24T06:31:18.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.754+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/2344096168 wait complete. 2023-11-24T06:31:18.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 Processor -- start 2023-11-24T06:31:18.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 -- start start 2023-11-24T06:31:18.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 0x7f1ef01f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef00d1de0 0x7f1ef014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef014f400 con 0x7f1ef0160970 2023-11-24T06:31:18.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef014fe10 con 0x7f1ef00d1de0 2023-11-24T06:31:18.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0150290 con 0x7f1ef00cdc60 2023-11-24T06:31:18.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 0x7f1ef01f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 0x7f1ef01f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:45708/0 (socket says 172.21.15.143:45708) 2023-11-24T06:31:18.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 -- 172.21.15.143:0/1501752989 learned_addr learned my addr 172.21.15.143:0/1501752989 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:18.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eeffff640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eeeffd640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef00d1de0 0x7f1ef014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 -- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef00d1de0 msgr2=0x7f1ef014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef00d1de0 0x7f1ef014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 -- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 msgr2=0x7f1ef014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 -- 172.21.15.143:0/1501752989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee00094d0 con 0x7f1ef00cdc60 2023-11-24T06:31:18.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1eef7fe640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 0x7f1ef01f7fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00190e0 tx=0x7f1ee001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:18.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00b3800 con 0x7f1ef00cdc60 2023-11-24T06:31:18.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00b3960 con 0x7f1ef00cdc60 2023-11-24T06:31:18.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef015ae60 con 0x7f1ef00cdc60 2023-11-24T06:31:18.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.758+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00b3d10 con 0x7f1ef00cdc60 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef015b420 con 0x7f1ef00cdc60 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef004e850 con 0x7f1ef00cdc60 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f1ee00b2380 con 0x7f1ef00cdc60 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1ed7fff640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1edc066500 0x7f1edc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ee011e6a0 con 0x7f1ef00cdc60 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1eeeffd640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1edc066500 0x7f1edc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:18.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.762+0000 7f1eeeffd640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1edc066500 0x7f1edc0689c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1ef01539a0 tx=0x7f1ee4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:18.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.766+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ee00ebb00 con 0x7f1ef00cdc60 2023-11-24T06:31:18.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.918+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1ef00d12a0 con 0x7f1ef00cdc60 2023-11-24T06:31:18.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.918+0000 7f1ed7fff640 1 -- 172.21.15.143:0/1501752989 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1ee00aa610 con 0x7f1ef00cdc60 2023-11-24T06:31:18.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1edc066500 msgr2=0x7f1edc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1edc066500 0x7f1edc0689c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1ef01539a0 tx=0x7f1ee4009040 comp rx=0 tx=0).stop 2023-11-24T06:31:18.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 msgr2=0x7f1ef01f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:18.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 0x7f1ef01f7fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00190e0 tx=0x7f1ee001ad10 comp rx=0 tx=0).stop 2023-11-24T06:31:18.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 shutdown_connections 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1edc066500 0x7f1edc0689c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ef0160970 0x7f1ef014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef00d1de0 0x7f1ef014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 --2- 172.21.15.143:0/1501752989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ef00cdc60 0x7f1ef01f7fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 >> 172.21.15.143:0/1501752989 conn(0x7f1ef009c5c0 msgr2=0x7f1ef00b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 shutdown_connections 2023-11-24T06:31:18.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:18.922+0000 7f1ef4bd0640 1 -- 172.21.15.143:0/1501752989 wait complete. 2023-11-24T06:31:18.946 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp1033 2023-11-24T06:31:19.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 Processor -- start 2023-11-24T06:31:19.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 -- start start 2023-11-24T06:31:19.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f819c15d7f0 0x7f819c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c06cce0 0x7f819c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0d3c60 con 0x7f819c0d37e0 2023-11-24T06:31:19.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c06b980 con 0x7f819c15d7f0 2023-11-24T06:31:19.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f81a08e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b0090 con 0x7f819c06cce0 2023-11-24T06:31:19.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f819c15d7f0 0x7f819c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f819c15d7f0 0x7f819c0d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37734/0 (socket says 172.21.15.143:37734) 2023-11-24T06:31:19.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 -- 172.21.15.143:0/2181051864 learned_addr learned my addr 172.21.15.143:0/2181051864 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:19.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819ad9d640 1 --2- 172.21.15.143:0/2181051864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c06cce0 0x7f819c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 -- 172.21.15.143:0/2181051864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c06cce0 msgr2=0x7f819c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:19.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 --2- 172.21.15.143:0/2181051864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c06cce0 0x7f819c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 -- 172.21.15.143:0/2181051864 >> v1:172.21.15.146:6789/0 conn(0x7f819c0d37e0 legacy=0x7f819c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.082+0000 7f819a59c640 1 -- 172.21.15.143:0/2181051864 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c06d6b0 con 0x7f819c15d7f0 2023-11-24T06:31:19.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f819a59c640 1 --2- 172.21.15.143:0/2181051864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c0d32a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8184009870 tx=0x7f818401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e08a8be1cdcb037 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f8199d9b640 1 -- 172.21.15.143:0/2181051864 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840a7070 con 0x7f819c15d7f0 2023-11-24T06:31:19.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f8199d9b640 1 -- 172.21.15.143:0/2181051864 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840ab430 con 0x7f819c15d7f0 2023-11-24T06:31:19.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f8199d9b640 1 -- 172.21.15.143:0/2181051864 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840ab7c0 con 0x7f819c15d7f0 2023-11-24T06:31:19.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 -- 172.21.15.143:0/2181051864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 msgr2=0x7f819c0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 --2- 172.21.15.143:0/2181051864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c0d32a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8184009870 tx=0x7f818401c540 comp rx=0 tx=0).stop 2023-11-24T06:31:19.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 -- 172.21.15.143:0/2181051864 shutdown_connections 2023-11-24T06:31:19.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 --2- 172.21.15.143:0/2181051864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c06cce0 0x7f819c06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 --2- 172.21.15.143:0/2181051864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c0d32a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 -- 172.21.15.143:0/2181051864 >> 172.21.15.143:0/2181051864 conn(0x7f819c09c790 msgr2=0x7f819c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:19.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 -- 172.21.15.143:0/2181051864 shutdown_connections 2023-11-24T06:31:19.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.086+0000 7f81a08e3640 1 -- 172.21.15.143:0/2181051864 wait complete. 2023-11-24T06:31:19.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 Processor -- start 2023-11-24T06:31:19.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 -- start start 2023-11-24T06:31:19.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c06cce0 0x7f819c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c0d37e0 0x7f819c0b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b3550 con 0x7f819c15d7f0 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b88a0 con 0x7f819c06cce0 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b2f00 con 0x7f819c0d37e0 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c14ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37738/0 (socket says 172.21.15.143:37738) 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 -- 172.21.15.143:0/1955471014 learned_addr learned my addr 172.21.15.143:0/1955471014 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819a59c640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c06cce0 0x7f819c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f8191d9b640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c0d37e0 0x7f819c0b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 -- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c0d37e0 msgr2=0x7f819c0b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c0d37e0 0x7f819c0b7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 -- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c06cce0 msgr2=0x7f819c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c06cce0 0x7f819c0d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 -- 172.21.15.143:0/1955471014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840094d0 con 0x7f819c15d7f0 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819a59c640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c06cce0 0x7f819c0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f8191d9b640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c0d37e0 0x7f819c0b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f819ad9d640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c14ac90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f819400efc0 tx=0x7f819400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194009b10 con 0x7f819c15d7f0 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819400f040 con 0x7f819c15d7f0 2023-11-24T06:31:19.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940146c0 con 0x7f819c15d7f0 2023-11-24T06:31:19.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c0b31e0 con 0x7f819c15d7f0 2023-11-24T06:31:19.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.090+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c0d0cb0 con 0x7f819c15d7f0 2023-11-24T06:31:19.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.094+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c0b3700 con 0x7f819c15d7f0 2023-11-24T06:31:19.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.094+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f8194014820 con 0x7f819c15d7f0 2023-11-24T06:31:19.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.094+0000 7f81937fe640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f817c066500 0x7f817c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.094+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8194084e70 con 0x7f819c15d7f0 2023-11-24T06:31:19.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.094+0000 7f819a59c640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f817c066500 0x7f817c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.094+0000 7f819a59c640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f817c066500 0x7f817c0689c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f81840af000 tx=0x7f8184008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.098+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f819c0b3700 con 0x7f819c15d7f0 2023-11-24T06:31:19.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.274+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7f819c0ca2c0 con 0x7f817c066500 2023-11-24T06:31:19.284 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:19.278+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:19.284 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:19.278+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:19.284 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:19.278+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:19.284 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:19.278+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:19.285 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:19.278+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:19.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81937fe640 1 -- 172.21.15.143:0/1955471014 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f819c0ca2c0 con 0x7f817c066500 2023-11-24T06:31:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f817c066500 msgr2=0x7f817c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81a08e3640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f817c066500 0x7f817c0689c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f81840af000 tx=0x7f8184008040 comp rx=0 tx=0).stop 2023-11-24T06:31:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 msgr2=0x7f819c14ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81a08e3640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c14ac90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f819400efc0 tx=0x7f819400c490 comp rx=0 tx=0).stop 2023-11-24T06:31:19.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 shutdown_connections 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.294+0000 7f81a08e3640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f817c066500 0x7f817c0689c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.298+0000 7f81a08e3640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f819c15d7f0 0x7f819c14ac90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.298+0000 7f81a08e3640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819c0d37e0 0x7f819c0b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.298+0000 7f81a08e3640 1 --2- 172.21.15.143:0/1955471014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c06cce0 0x7f819c0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.298+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 >> 172.21.15.143:0/1955471014 conn(0x7f819c09c790 msgr2=0x7f819c15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.298+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 shutdown_connections 2023-11-24T06:31:19.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.298+0000 7f81a08e3640 1 -- 172.21.15.143:0/1955471014 wait complete. 2023-11-24T06:31:19.320 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol2152 subvol_grp1033 2023-11-24T06:31:19.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.474+0000 7f815b42f640 1 Processor -- start 2023-11-24T06:31:19.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.474+0000 7f815b42f640 1 -- start start 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815b42f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81540b8e50 0x7f81540d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815b42f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81540cdf00 0x7f81540ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815b42f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81540b69b0 con 0x7f8154160900 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815b42f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540b9290 con 0x7f81540cdf00 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815b42f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540b6bf0 con 0x7f81540b8e50 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81540cdf00 0x7f81540ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81540cdf00 0x7f81540ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37772/0 (socket says 172.21.15.143:37772) 2023-11-24T06:31:19.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 -- 172.21.15.143:0/2316953517 learned_addr learned my addr 172.21.15.143:0/2316953517 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:19.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815a42d640 1 --1- 172.21.15.143:0/2316953517 >> v1:172.21.15.146:6789/0 conn(0x7f8154160900 0x7f81540b62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:53832/0 (socket says 172.21.15.143:53832) 2023-11-24T06:31:19.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f8159c2c640 1 --2- 172.21.15.143:0/2316953517 >> v2:172.21.15.146:3300/0 conn(0x7f81540b8e50 0x7f81540d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 -- 172.21.15.143:0/2316953517 >> v2:172.21.15.146:3300/0 conn(0x7f81540b8e50 msgr2=0x7f81540d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:19.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 --2- 172.21.15.143:0/2316953517 >> v2:172.21.15.146:3300/0 conn(0x7f81540b8e50 0x7f81540d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 -- 172.21.15.143:0/2316953517 >> v1:172.21.15.146:6789/0 conn(0x7f8154160900 legacy=0x7f81540b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.478+0000 7f815ac2e640 1 -- 172.21.15.143:0/2316953517 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540b6ed0 con 0x7f81540cdf00 2023-11-24T06:31:19.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815ac2e640 1 --2- 172.21.15.143:0/2316953517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540cdf00 0x7f81540ce350 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f815406c590 tx=0x7f814c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca94956a97986dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815942b640 1 -- 172.21.15.143:0/2316953517 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0a5860 con 0x7f81540cdf00 2023-11-24T06:31:19.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815942b640 1 -- 172.21.15.143:0/2316953517 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c0a59c0 con 0x7f81540cdf00 2023-11-24T06:31:19.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815942b640 1 -- 172.21.15.143:0/2316953517 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0a5d50 con 0x7f81540cdf00 2023-11-24T06:31:19.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 -- 172.21.15.143:0/2316953517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540cdf00 msgr2=0x7f81540ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 --2- 172.21.15.143:0/2316953517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540cdf00 0x7f81540ce350 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f815406c590 tx=0x7f814c01c9a0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 -- 172.21.15.143:0/2316953517 shutdown_connections 2023-11-24T06:31:19.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 --2- 172.21.15.143:0/2316953517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540cdf00 0x7f81540ce350 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 --2- 172.21.15.143:0/2316953517 >> v2:172.21.15.146:3300/0 conn(0x7f81540b8e50 0x7f81540d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 -- 172.21.15.143:0/2316953517 >> 172.21.15.143:0/2316953517 conn(0x7f81540613d0 msgr2=0x7f81540617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:19.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 -- 172.21.15.143:0/2316953517 shutdown_connections 2023-11-24T06:31:19.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 -- 172.21.15.143:0/2316953517 wait complete. 2023-11-24T06:31:19.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.482+0000 7f815b42f640 1 Processor -- start 2023-11-24T06:31:19.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- start start 2023-11-24T06:31:19.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 0x7f815414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81540cdf00 0x7f815414f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8154160900 0x7f815414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540caba0 con 0x7f81540b8e50 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540d1f80 con 0x7f8154160900 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81540cae40 con 0x7f81540cdf00 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 0x7f815414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 0x7f815414a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37788/0 (socket says 172.21.15.143:37788) 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 -- 172.21.15.143:0/12365504 learned_addr learned my addr 172.21.15.143:0/12365504 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815ac2e640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8154160900 0x7f815414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f8159c2c640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81540cdf00 0x7f815414f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 -- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81540cdf00 msgr2=0x7f815414f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81540cdf00 0x7f815414f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 -- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8154160900 msgr2=0x7f815414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8154160900 0x7f815414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 -- 172.21.15.143:0/12365504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c009b30 con 0x7f81540b8e50 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f8159c2c640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81540cdf00 0x7f815414f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815a42d640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 0x7f815414a9e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f815000c490 tx=0x7f815000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150007480 con 0x7f81540b8e50 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81500075e0 con 0x7f81540b8e50 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150004a10 con 0x7f81540b8e50 2023-11-24T06:31:19.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81540cb120 con 0x7f81540b8e50 2023-11-24T06:31:19.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815414af20 con 0x7f81540b8e50 2023-11-24T06:31:19.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.486+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815404e850 con 0x7f81540b8e50 2023-11-24T06:31:19.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.490+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f8150004b70 con 0x7f81540b8e50 2023-11-24T06:31:19.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.490+0000 7f814affd640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8138066500 0x7f81380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.490+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8150082f50 con 0x7f81540b8e50 2023-11-24T06:31:19.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.490+0000 7f8159c2c640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8138066500 0x7f81380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.490+0000 7f8159c2c640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8138066500 0x7f81380689c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8144009b10 tx=0x7f8144008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.494+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8150050390 con 0x7f81540b8e50 2023-11-24T06:31:19.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.662+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol2152", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7f81540ce890 con 0x7f8138066500 2023-11-24T06:31:19.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.782+0000 7f814affd640 1 -- 172.21.15.143:0/12365504 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8144009760 con 0x7f8138066500 2023-11-24T06:31:19.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.782+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8138066500 msgr2=0x7f81380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.782+0000 7f815b42f640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8138066500 0x7f81380689c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8144009b10 tx=0x7f8144008040 comp rx=0 tx=0).stop 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.782+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 msgr2=0x7f815414a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 0x7f815414a9e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f815000c490 tx=0x7f815000c950 comp rx=0 tx=0).stop 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 shutdown_connections 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8138066500 0x7f81380689c0 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8144009b10 tx=0x7f8144008040 comp rx=0 tx=0).stop 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8154160900 0x7f815414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81540cdf00 0x7f815414f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 --2- 172.21.15.143:0/12365504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81540b8e50 0x7f815414a9e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 >> 172.21.15.143:0/12365504 conn(0x7f81540613d0 msgr2=0x7f81540b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 shutdown_connections 2023-11-24T06:31:19.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.786+0000 7f815b42f640 1 -- 172.21.15.143:0/12365504 wait complete. 2023-11-24T06:31:19.809 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol2152 subvol_snap6116 subvol_grp1033 2023-11-24T06:31:19.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.946+0000 7f6c76c68640 1 Processor -- start 2023-11-24T06:31:19.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.946+0000 7f6c76c68640 1 -- start start 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c76c68640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c700cd290 0x7f6c700ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c76c68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c7006e070 0x7f6c700cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c76c68640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c700cda00 con 0x7f6c7015d500 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c76c68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700ce6c0 con 0x7f6c7006e070 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c76c68640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700c9600 con 0x7f6c700cd290 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c7006e070 0x7f6c700cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c7006e070 0x7f6c700cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37798/0 (socket says 172.21.15.143:37798) 2023-11-24T06:31:19.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 -- 172.21.15.143:0/2334900247 learned_addr learned my addr 172.21.15.143:0/2334900247 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:19.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c67fff640 1 --2- 172.21.15.143:0/2334900247 >> v2:172.21.15.146:3300/0 conn(0x7f6c700cd290 0x7f6c700ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 -- 172.21.15.143:0/2334900247 >> v2:172.21.15.146:3300/0 conn(0x7f6c700cd290 msgr2=0x7f6c700ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:19.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 --2- 172.21.15.143:0/2334900247 >> v2:172.21.15.146:3300/0 conn(0x7f6c700cd290 0x7f6c700ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 -- 172.21.15.143:0/2334900247 >> v1:172.21.15.143:6789/0 conn(0x7f6c7015d500 legacy=0x7f6c700ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c75205640 1 -- 172.21.15.143:0/2334900247 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7006c510 con 0x7f6c7006e070 2023-11-24T06:31:19.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.950+0000 7f6c677fe640 1 -- 172.21.15.143:0/2334900247 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766063102 0 0) 0x7f6c700cda00 con 0x7f6c7015d500 2023-11-24T06:31:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c75205640 1 --2- 172.21.15.143:0/2334900247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7006e070 0x7f6c700cb270 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c700cc740 tx=0x7f6c6801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37479b119f0d838f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c677fe640 1 -- 172.21.15.143:0/2334900247 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c680a5660 con 0x7f6c7006e070 2023-11-24T06:31:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c677fe640 1 -- 172.21.15.143:0/2334900247 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c680a57c0 con 0x7f6c7006e070 2023-11-24T06:31:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c677fe640 1 -- 172.21.15.143:0/2334900247 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c680a5b50 con 0x7f6c7006e070 2023-11-24T06:31:19.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 -- 172.21.15.143:0/2334900247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7006e070 msgr2=0x7f6c700cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2334900247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7006e070 0x7f6c700cb270 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c700cc740 tx=0x7f6c6801c8b0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 -- 172.21.15.143:0/2334900247 shutdown_connections 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2334900247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7006e070 0x7f6c700cb270 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2334900247 >> v2:172.21.15.146:3300/0 conn(0x7f6c700cd290 0x7f6c700ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 -- 172.21.15.143:0/2334900247 >> 172.21.15.143:0/2334900247 conn(0x7f6c700b0d50 msgr2=0x7f6c700b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 -- 172.21.15.143:0/2334900247 shutdown_connections 2023-11-24T06:31:19.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 -- 172.21.15.143:0/2334900247 wait complete. 2023-11-24T06:31:19.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 Processor -- start 2023-11-24T06:31:19.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 -- start start 2023-11-24T06:31:19.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7006e070 0x7f6c7014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.954+0000 7f6c76c68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700cd290 0x7f6c700b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 0x7f6c700c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700c7960 con 0x7f6c7015d500 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7014eec0 con 0x7f6c7006e070 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700c6ad0 con 0x7f6c700cd290 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 0x7f6c700c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 0x7f6c700c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37804/0 (socket says 172.21.15.143:37804) 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 -- 172.21.15.143:0/2494618116 learned_addr learned my addr 172.21.15.143:0/2494618116 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c74a04640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7006e070 0x7f6c7014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c67fff640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700cd290 0x7f6c700b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 -- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700cd290 msgr2=0x7f6c700b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700cd290 0x7f6c700b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 -- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7006e070 msgr2=0x7f6c7014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7006e070 0x7f6c7014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 -- 172.21.15.143:0/2494618116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009b30 con 0x7f6c7015d500 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c74a04640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7006e070 0x7f6c7014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c67fff640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700cd290 0x7f6c700b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c75205640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 0x7f6c700c6080 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6c680194c0 tx=0x7f6c68019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68009510 con 0x7f6c7015d500 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c680b8470 con 0x7f6c7015d500 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c680b8800 con 0x7f6c7015d500 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c700c6db0 con 0x7f6c7015d500 2023-11-24T06:31:19.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7014f270 con 0x7f6c7015d500 2023-11-24T06:31:19.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c700c7aa0 con 0x7f6c7015d500 2023-11-24T06:31:19.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.958+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f6c680b8960 con 0x7f6c7015d500 2023-11-24T06:31:19.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.962+0000 7f6c657fa640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c5c066500 0x7f6c5c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.962+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c6811f150 con 0x7f6c7015d500 2023-11-24T06:31:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.962+0000 7f6c74a04640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c5c066500 0x7f6c5c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:19.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.962+0000 7f6c74a04640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c5c066500 0x7f6c5c0689c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c000f70 tx=0x7f6c6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:19.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:19.966+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c700c7aa0 con 0x7f6c7015d500 2023-11-24T06:31:20.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.142+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol2152", "snap_name": "subvol_snap6116", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c7015d8e0 con 0x7f6c5c066500 2023-11-24T06:31:20.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c657fa640 1 -- 172.21.15.143:0/2494618116 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6c6c001cb0 con 0x7f6c5c066500 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c5c066500 msgr2=0x7f6c5c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c5c066500 0x7f6c5c0689c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c000f70 tx=0x7f6c6c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 msgr2=0x7f6c700c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 0x7f6c700c6080 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6c680194c0 tx=0x7f6c68019650 comp rx=0 tx=0).stop 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 shutdown_connections 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c5c066500 0x7f6c5c0689c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c7015d500 0x7f6c700c6080 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700cd290 0x7f6c700b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 --2- 172.21.15.143:0/2494618116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7006e070 0x7f6c7014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 >> 172.21.15.143:0/2494618116 conn(0x7f6c700b0d50 msgr2=0x7f6c700afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:20.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 shutdown_connections 2023-11-24T06:31:20.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.158+0000 7f6c76c68640 1 -- 172.21.15.143:0/2494618116 wait complete. 2023-11-24T06:31:20.183 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot metadata set cephfs subvol2152 subvol_snap6116 key value subvol_grp1033 2023-11-24T06:31:20.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.326+0000 7f0d45bdf640 1 Processor -- start 2023-11-24T06:31:20.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d45bdf640 1 -- start start 2023-11-24T06:31:20.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d45bdf640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d4015b220 0x7f0d400cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:20.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d45bdf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d4015b600 0x7f0d4006d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:20.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d45bdf640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d400abed0 con 0x7f0d400c9650 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d45bdf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40072710 con 0x7f0d4015b600 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d45bdf640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40072370 con 0x7f0d4015b220 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d4015b600 0x7f0d4006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d4015b600 0x7f0d4006d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37806/0 (socket says 172.21.15.143:37806) 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 -- 172.21.15.143:0/3863029452 learned_addr learned my addr 172.21.15.143:0/3863029452 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3f7fe640 1 --2- 172.21.15.143:0/3863029452 >> v2:172.21.15.146:3300/0 conn(0x7f0d4015b220 0x7f0d400cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 -- 172.21.15.143:0/3863029452 >> v2:172.21.15.146:3300/0 conn(0x7f0d4015b220 msgr2=0x7f0d400cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 --2- 172.21.15.143:0/3863029452 >> v2:172.21.15.146:3300/0 conn(0x7f0d4015b220 0x7f0d400cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 -- 172.21.15.143:0/3863029452 >> v1:172.21.15.146:6789/0 conn(0x7f0d400c9650 legacy=0x7f0d400c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:20.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.330+0000 7f0d3effd640 1 -- 172.21.15.143:0/3863029452 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4006d580 con 0x7f0d4015b600 2023-11-24T06:31:20.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d3effd640 1 --2- 172.21.15.143:0/3863029452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d4006d040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cee30 tx=0x7f0d3401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9832a6dfea0b4469 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:20.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d3e7fc640 1 -- 172.21.15.143:0/3863029452 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340aa5f0 con 0x7f0d4015b600 2023-11-24T06:31:20.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d3e7fc640 1 -- 172.21.15.143:0/3863029452 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d340aa750 con 0x7f0d4015b600 2023-11-24T06:31:20.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d3e7fc640 1 -- 172.21.15.143:0/3863029452 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340aaae0 con 0x7f0d4015b600 2023-11-24T06:31:20.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 -- 172.21.15.143:0/3863029452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 msgr2=0x7f0d4006d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/3863029452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d4006d040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cee30 tx=0x7f0d3401c490 comp rx=0 tx=0).stop 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 -- 172.21.15.143:0/3863029452 shutdown_connections 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/3863029452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d4006d040 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/3863029452 >> v2:172.21.15.146:3300/0 conn(0x7f0d4015b220 0x7f0d400cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 -- 172.21.15.143:0/3863029452 >> 172.21.15.143:0/3863029452 conn(0x7f0d400b0bf0 msgr2=0x7f0d400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 -- 172.21.15.143:0/3863029452 shutdown_connections 2023-11-24T06:31:20.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 -- 172.21.15.143:0/3863029452 wait complete. 2023-11-24T06:31:20.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 Processor -- start 2023-11-24T06:31:20.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.334+0000 7f0d45bdf640 1 -- start start 2023-11-24T06:31:20.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d400c9650 0x7f0d400b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:20.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d4015b220 0x7f0d400b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:20.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d401f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:20.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015bae0 con 0x7f0d4015b600 2023-11-24T06:31:20.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015bdc0 con 0x7f0d4015b220 2023-11-24T06:31:20.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015c0a0 con 0x7f0d400c9650 2023-11-24T06:31:20.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d401f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:20.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d401f7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37814/0 (socket says 172.21.15.143:37814) 2023-11-24T06:31:20.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 -- 172.21.15.143:0/989016462 learned_addr learned my addr 172.21.15.143:0/989016462 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:20.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3effd640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d4015b220 0x7f0d400b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:20.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3f7fe640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d400c9650 0x7f0d400b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 -- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d400c9650 msgr2=0x7f0d400b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d400c9650 0x7f0d400b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 -- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d4015b220 msgr2=0x7f0d400b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d4015b220 0x7f0d400b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 -- 172.21.15.143:0/989016462 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340094d0 con 0x7f0d4015b600 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d3ffff640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d401f7990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c780 tx=0x7f0d3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38004b70 con 0x7f0d4015b600 2023-11-24T06:31:20.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3800ce90 con 0x7f0d4015b600 2023-11-24T06:31:20.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800a850 con 0x7f0d4015b600 2023-11-24T06:31:20.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4015c380 con 0x7f0d4015b600 2023-11-24T06:31:20.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d400b4920 con 0x7f0d4015b600 2023-11-24T06:31:20.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.338+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4009d250 con 0x7f0d4015b600 2023-11-24T06:31:20.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.342+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f0d3800a9b0 con 0x7f0d4015b600 2023-11-24T06:31:20.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.342+0000 7f0d27fff640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d2c066500 0x7f0d2c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:20.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.342+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d38083f40 con 0x7f0d4015b600 2023-11-24T06:31:20.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.342+0000 7f0d3f7fe640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d2c066500 0x7f0d2c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:20.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.342+0000 7f0d3f7fe640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d2c066500 0x7f0d2c0689c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d40165c30 tx=0x7f0d30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:20.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.346+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d380b5280 con 0x7f0d4015b600 2023-11-24T06:31:20.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.522+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot metadata set", "vol_name": "cephfs", "sub_name": "subvol2152", "snap_name": "subvol_snap6116", "key_name": "key", "value": "value", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d4004e930 con 0x7f0d2c066500 2023-11-24T06:31:20.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.534+0000 7f0d27fff640 1 -- 172.21.15.143:0/989016462 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0d4004e930 con 0x7f0d2c066500 2023-11-24T06:31:20.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d2c066500 msgr2=0x7f0d2c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d2c066500 0x7f0d2c0689c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d40165c30 tx=0x7f0d30008040 comp rx=0 tx=0).stop 2023-11-24T06:31:20.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 msgr2=0x7f0d401f7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:20.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d401f7990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c780 tx=0x7f0d3800cc40 comp rx=0 tx=0).stop 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 shutdown_connections 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d2c066500 0x7f0d2c0689c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d4015b600 0x7f0d401f7990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d4015b220 0x7f0d400b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 --2- 172.21.15.143:0/989016462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d400c9650 0x7f0d400b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 >> 172.21.15.143:0/989016462 conn(0x7f0d400b0bf0 msgr2=0x7f0d400ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 shutdown_connections 2023-11-24T06:31:20.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:20.538+0000 7f0d45bdf640 1 -- 172.21.15.143:0/989016462 wait complete. 2023-11-24T06:31:20.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:20.562 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/subvol_grp1033/subvol2152/.meta ./volumes/subvol_grp1033/subvol2152/.meta.stale_snap_section) 2023-11-24T06:31:23.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol2152 subvol_snap6116 subvol_grp1033 2023-11-24T06:31:24.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 Processor -- start 2023-11-24T06:31:24.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 -- start start 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66380c98f0 0x7f66380c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66380707b0 0x7f6638070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66380ca270 con 0x7f66380725f0 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380ca770 con 0x7f66380c98f0 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f664018d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380729d0 con 0x7f66380707b0 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66380c98f0 0x7f66380c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66380c98f0 0x7f66380c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37816/0 (socket says 172.21.15.143:37816) 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 -- 172.21.15.143:0/2232107284 learned_addr learned my addr 172.21.15.143:0/2232107284 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663df29640 1 --1- 172.21.15.143:0/2232107284 >> v1:172.21.15.143:6789/0 conn(0x7f66380725f0 0x7f663806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34982/0 (socket says 172.21.15.143:34982) 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663e72a640 1 --2- 172.21.15.143:0/2232107284 >> v2:172.21.15.146:3300/0 conn(0x7f66380707b0 0x7f6638070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 -- 172.21.15.143:0/2232107284 >> v2:172.21.15.146:3300/0 conn(0x7f66380707b0 msgr2=0x7f6638070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:24.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 --2- 172.21.15.143:0/2232107284 >> v2:172.21.15.146:3300/0 conn(0x7f66380707b0 0x7f6638070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 -- 172.21.15.143:0/2232107284 >> v1:172.21.15.143:6789/0 conn(0x7f66380725f0 legacy=0x7f663806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.114+0000 7f663d728640 1 -- 172.21.15.143:0/2232107284 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380ce0e0 con 0x7f66380c98f0 2023-11-24T06:31:24.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f663d728640 1 --2- 172.21.15.143:0/2232107284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380c98f0 0x7f66380c9d30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f663809d200 tx=0x7f662801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3154381a5b0e7d0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:24.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f663cf27640 1 -- 172.21.15.143:0/2232107284 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280a89f0 con 0x7f66380c98f0 2023-11-24T06:31:24.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f663cf27640 1 -- 172.21.15.143:0/2232107284 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280a8b50 con 0x7f66380c98f0 2023-11-24T06:31:24.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f663cf27640 1 -- 172.21.15.143:0/2232107284 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280b0440 con 0x7f66380c98f0 2023-11-24T06:31:24.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 -- 172.21.15.143:0/2232107284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380c98f0 msgr2=0x7f66380c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 --2- 172.21.15.143:0/2232107284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380c98f0 0x7f66380c9d30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f663809d200 tx=0x7f662801ecf0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 -- 172.21.15.143:0/2232107284 shutdown_connections 2023-11-24T06:31:24.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 --2- 172.21.15.143:0/2232107284 >> v2:172.21.15.146:3300/0 conn(0x7f66380707b0 0x7f6638070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 --2- 172.21.15.143:0/2232107284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380c98f0 0x7f66380c9d30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 -- 172.21.15.143:0/2232107284 >> 172.21.15.143:0/2232107284 conn(0x7f66380b0bf0 msgr2=0x7f66380b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:24.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 -- 172.21.15.143:0/2232107284 shutdown_connections 2023-11-24T06:31:24.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.118+0000 7f664018d640 1 -- 172.21.15.143:0/2232107284 wait complete. 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 Processor -- start 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 -- start start 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 0x7f663815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66380725f0 0x7f66380b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66380c98f0 0x7f66380c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6638156070 con 0x7f66380707b0 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b3690 con 0x7f66380725f0 2023-11-24T06:31:24.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663815b370 con 0x7f66380c98f0 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 0x7f663815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 0x7f663815ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37828/0 (socket says 172.21.15.143:37828) 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 -- 172.21.15.143:0/420964092 learned_addr learned my addr 172.21.15.143:0/420964092 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663d728640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66380725f0 0x7f66380b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663e72a640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66380c98f0 0x7f66380c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 -- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66380c98f0 msgr2=0x7f66380c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66380c98f0 0x7f66380c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 -- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66380725f0 msgr2=0x7f66380b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66380725f0 0x7f66380b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 -- 172.21.15.143:0/420964092 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280094d0 con 0x7f66380707b0 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f663df29640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 0x7f663815ace0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f663400c490 tx=0x7f663400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:24.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340074e0 con 0x7f66380707b0 2023-11-24T06:31:24.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6634007640 con 0x7f66380707b0 2023-11-24T06:31:24.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634004a10 con 0x7f66380707b0 2023-11-24T06:31:24.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663815b650 con 0x7f66380707b0 2023-11-24T06:31:24.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.122+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66380b3d10 con 0x7f66380707b0 2023-11-24T06:31:24.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.126+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66380b3880 con 0x7f66380707b0 2023-11-24T06:31:24.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.126+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 7) v1 ==== 85954+0+0 (secure 0 0 0) 0x7f6634004b70 con 0x7f66380707b0 2023-11-24T06:31:24.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.126+0000 7f662e7fc640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f661c066590 0x7f661c068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.126+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6634083a10 con 0x7f66380707b0 2023-11-24T06:31:24.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.126+0000 7f663d728640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f661c066590 0x7f661c068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.126+0000 7f663d728640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f661c066590 0x7f661c068a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f66280b2000 tx=0x7f6628008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:24.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.130+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6634050dd0 con 0x7f66380707b0 2023-11-24T06:31:24.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.310+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol2152", "snap_name": "subvol_snap6116", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7f663806d3d0 con 0x7f661c066590 2023-11-24T06:31:24.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.346+0000 7f662e7fc640 1 -- 172.21.15.143:0/420964092 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f66280b0440 con 0x7f661c066590 2023-11-24T06:31:24.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f661c066590 msgr2=0x7f661c068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f661c066590 0x7f661c068a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f66280b2000 tx=0x7f6628008040 comp rx=0 tx=0).stop 2023-11-24T06:31:24.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 msgr2=0x7f663815ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 0x7f663815ace0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f663400c490 tx=0x7f663400c950 comp rx=0 tx=0).stop 2023-11-24T06:31:24.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 shutdown_connections 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f661c066590 0x7f661c068a50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66380c98f0 0x7f66380c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66380725f0 0x7f66380b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 --2- 172.21.15.143:0/420964092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66380707b0 0x7f663815ace0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 >> 172.21.15.143:0/420964092 conn(0x7f66380b0bf0 msgr2=0x7f663806c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 shutdown_connections 2023-11-24T06:31:24.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.350+0000 7f664018d640 1 -- 172.21.15.143:0/420964092 wait complete. 2023-11-24T06:31:24.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:24.374 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/subvol_grp1033/subvol2152/.meta.stale_snap_section ./volumes/subvol_grp1033/subvol2152/.meta) 2023-11-24T06:31:24.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:24.408 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo grep SNAP_METADATA_subvol_snap6116 ./volumes/subvol_grp1033/subvol2152/.meta) 2023-11-24T06:31:24.468 INFO:teuthology.orchestra.run.smithi143.stdout:[SNAP_METADATA_subvol_snap6116] 2023-11-24T06:31:24.470 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol2152 subvol_grp1033 2023-11-24T06:31:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 Processor -- start 2023-11-24T06:31:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 -- start start 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff89015d200 0x7ff8900d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff8900cb750 0x7ff89006e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900d1dd0 con 0x7ff89015d5e0 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8900cbb60 con 0x7ff8900cb750 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff89569a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8900d11c0 con 0x7ff89015d200 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff8900cb750 0x7ff89006e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff8900cb750 0x7ff89006e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37834/0 (socket says 172.21.15.143:37834) 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 -- 172.21.15.143:0/214596015 learned_addr learned my addr 172.21.15.143:0/214596015 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:24.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88effd640 1 --2- 172.21.15.143:0/214596015 >> v2:172.21.15.146:3300/0 conn(0x7ff89015d200 0x7ff8900d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 -- 172.21.15.143:0/214596015 >> v2:172.21.15.146:3300/0 conn(0x7ff89015d200 msgr2=0x7ff8900d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 --2- 172.21.15.143:0/214596015 >> v2:172.21.15.146:3300/0 conn(0x7ff89015d200 0x7ff8900d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 -- 172.21.15.143:0/214596015 >> v1:172.21.15.146:6789/0 conn(0x7ff89015d5e0 legacy=0x7ff8900ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88f7fe640 1 -- 172.21.15.143:0/214596015 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900d14a0 con 0x7ff8900cb750 2023-11-24T06:31:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.654+0000 7ff88effd640 1 --2- 172.21.15.143:0/214596015 >> v2:172.21.15.146:3300/0 conn(0x7ff89015d200 0x7ff8900d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff88f7fe640 1 --2- 172.21.15.143:0/214596015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff89006e8b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff8900d21d0 tx=0x7ff88801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c11b2628b9b19a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff88e7fc640 1 -- 172.21.15.143:0/214596015 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880a56a0 con 0x7ff8900cb750 2023-11-24T06:31:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff88e7fc640 1 -- 172.21.15.143:0/214596015 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880a5800 con 0x7ff8900cb750 2023-11-24T06:31:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff88e7fc640 1 -- 172.21.15.143:0/214596015 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880a5b90 con 0x7ff8900cb750 2023-11-24T06:31:24.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 -- 172.21.15.143:0/214596015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 msgr2=0x7ff89006e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 --2- 172.21.15.143:0/214596015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff89006e8b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff8900d21d0 tx=0x7ff88801c8d0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 -- 172.21.15.143:0/214596015 shutdown_connections 2023-11-24T06:31:24.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 --2- 172.21.15.143:0/214596015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff89006e8b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 --2- 172.21.15.143:0/214596015 >> v2:172.21.15.146:3300/0 conn(0x7ff89015d200 0x7ff8900d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 -- 172.21.15.143:0/214596015 >> 172.21.15.143:0/214596015 conn(0x7ff8900701c0 msgr2=0x7ff8900705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:24.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 -- 172.21.15.143:0/214596015 shutdown_connections 2023-11-24T06:31:24.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.658+0000 7ff89569a640 1 -- 172.21.15.143:0/214596015 wait complete. 2023-11-24T06:31:24.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 Processor -- start 2023-11-24T06:31:24.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- start start 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff890151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff89015d200 0x7ff8900c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8901598c0 0x7ff8901521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8901576b0 con 0x7ff8900cb750 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff890151fb0 con 0x7ff89015d200 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff890157900 con 0x7ff8901598c0 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff890151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff890151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37844/0 (socket says 172.21.15.143:37844) 2023-11-24T06:31:24.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 -- 172.21.15.143:0/2647795792 learned_addr learned my addr 172.21.15.143:0/2647795792 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff887fff640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff89015d200 0x7ff8900c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88f7fe640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8901598c0 0x7ff8901521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 -- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8901598c0 msgr2=0x7ff8901521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8901598c0 0x7ff8901521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 -- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff89015d200 msgr2=0x7ff8900c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff89015d200 0x7ff8900c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 -- 172.21.15.143:0/2647795792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff888009b30 con 0x7ff8900cb750 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff88effd640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff890151a70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c820 tx=0x7ff88000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880007a30 con 0x7ff8900cb750 2023-11-24T06:31:24.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880007b90 con 0x7ff8900cb750 2023-11-24T06:31:24.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000ce10 con 0x7ff8900cb750 2023-11-24T06:31:24.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff890157be0 con 0x7ff8900cb750 2023-11-24T06:31:24.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8901581a0 con 0x7ff8900cb750 2023-11-24T06:31:24.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.662+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89004e850 con 0x7ff8900cb750 2023-11-24T06:31:24.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.666+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 7) v1 ==== 85954+0+0 (secure 0 0 0) 0x7ff8800113f0 con 0x7ff8900cb750 2023-11-24T06:31:24.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.666+0000 7ff8877fe640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff870066610 0x7ff870068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:24.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.666+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff880084160 con 0x7ff8900cb750 2023-11-24T06:31:24.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.666+0000 7ff887fff640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff870066610 0x7ff870068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:24.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.666+0000 7ff887fff640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff870066610 0x7ff870068ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff8900cc570 tx=0x7ff878009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:24.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.670+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff880051410 con 0x7ff8900cb750 2023-11-24T06:31:24.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.842+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol2152", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8900ce360 con 0x7ff870066610 2023-11-24T06:31:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff8877fe640 1 -- 172.21.15.143:0/2647795792 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+705 (secure 0 0 0) 0x7ff8900ce360 con 0x7ff870066610 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "atime": "2023-11-24 06:31:19", 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "bytes_pcent": "undefined", 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "bytes_quota": "infinite", 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "bytes_used": 0, 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "created_at": "2023-11-24 06:31:19", 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "ctime": "2023-11-24 06:31:19", 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "data_pool": "cephfs_data", 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "features": [ 2023-11-24T06:31:24.891 INFO:teuthology.orchestra.run.smithi143.stdout: "snapshot-clone", 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "snapshot-autoprotect", 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "snapshot-retention" 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "gid": 0, 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "mode": 16877, 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "mon_addrs": [ 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "172.21.15.143:6789", 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "172.21.15.146:6789", 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "172.21.15.146:6790" 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "mtime": "2023-11-24 06:31:19", 2023-11-24T06:31:24.892 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/volumes/subvol_grp1033/subvol2152/cea7e62c-fcb3-49a4-b5ab-96ed9dc3a72a", 2023-11-24T06:31:24.893 INFO:teuthology.orchestra.run.smithi143.stdout: "pool_namespace": "", 2023-11-24T06:31:24.893 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "complete", 2023-11-24T06:31:24.893 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "subvolume", 2023-11-24T06:31:24.893 INFO:teuthology.orchestra.run.smithi143.stdout: "uid": 0 2023-11-24T06:31:24.893 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff870066610 msgr2=0x7ff870068ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff870066610 0x7ff870068ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff8900cc570 tx=0x7ff878009060 comp rx=0 tx=0).stop 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 msgr2=0x7ff890151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff890151a70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c820 tx=0x7ff88000cce0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 shutdown_connections 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff870066610 0x7ff870068ad0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8901598c0 0x7ff8901521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff89015d200 0x7ff8900c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 --2- 172.21.15.143:0/2647795792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8900cb750 0x7ff890151a70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:24.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 >> 172.21.15.143:0/2647795792 conn(0x7ff8900701c0 msgr2=0x7ff8900b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:24.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 shutdown_connections 2023-11-24T06:31:24.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:24.886+0000 7ff89569a640 1 -- 172.21.15.143:0/2647795792 wait complete. 2023-11-24T06:31:24.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:24.911 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo grep SNAP_METADATA_subvol_snap6116 ./volumes/subvol_grp1033/subvol2152/.meta) 2023-11-24T06:31:24.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:31:24.940 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol2152 subvol_grp1033 2023-11-24T06:31:25.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f0066b01640 1 Processor -- start 2023-11-24T06:31:25.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f0066b01640 1 -- start start 2023-11-24T06:31:25.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f0066b01640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00600b36c0 0x7f00600b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f0066b01640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006015a700 con 0x7f006015a320 2023-11-24T06:31:25.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f0066b01640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00600b2620 con 0x7f0060070da0 2023-11-24T06:31:25.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f0066b01640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600b2430 con 0x7f00600b36c0 2023-11-24T06:31:25.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f006489d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f006015a320 0x7f0060070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34996/0 (socket says 172.21.15.143:34996) 2023-11-24T06:31:25.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f006489d640 1 -- 172.21.15.143:0/1402037078 learned_addr learned my addr 172.21.15.143:0/1402037078 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213454882 0 0) 0x7f006015a700 con 0x7f006015a320 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005ffff640 1 --2- 172.21.15.143:0/1402037078 >> v2:172.21.15.146:3300/0 conn(0x7f00600b36c0 0x7f00600b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0050003530 con 0x7f006015a320 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961551098 0 0) 0x7f0050003530 con 0x7f006015a320 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 >> v2:172.21.15.146:3300/0 conn(0x7f00600b36c0 msgr2=0x7f00600b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 --2- 172.21.15.143:0/1402037078 >> v2:172.21.15.146:3300/0 conn(0x7f00600b36c0 0x7f00600b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 >> v1:172.21.15.146:6789/0 conn(0x7f0060070da0 legacy=0x7f006015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600b2900 con 0x7f006015a320 2023-11-24T06:31:25.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f0054001680 con 0x7f006015a320 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 >> v1:172.21.15.143:6789/0 conn(0x7f006015a320 legacy=0x7f0060070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050003980 0x7f0050003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00500047d0 0x7f0050004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0050005190 0x7f005000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005000c000 con 0x7f0050003980 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005000c170 con 0x7f00500047d0 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005000c330 con 0x7f0050005190 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f006489d640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050003980 0x7f0050003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f005ffff640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00500047d0 0x7f0050004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.122+0000 7f006509e640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0050005190 0x7f005000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006489d640 1 -- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0050005190 msgr2=0x7f005000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:25.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006489d640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0050005190 0x7f005000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006489d640 1 -- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00500047d0 msgr2=0x7f0050004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:25.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006489d640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00500047d0 0x7f0050004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006489d640 1 -- 172.21.15.143:0/1402037078 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050003530 con 0x7f0050003980 2023-11-24T06:31:25.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006509e640 1 -- 172.21.15.143:0/1402037078 reap_dead start 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f006489d640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050003980 0x7f0050003da0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f005400c240 tx=0x7f005401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5543ffa1f17928e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540a5ba0 con 0x7f0050003980 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00540a5d00 con 0x7f0050003980 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f005f7fe640 1 -- 172.21.15.143:0/1402037078 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054005b20 con 0x7f0050003980 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 -- 172.21.15.143:0/1402037078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050003980 msgr2=0x7f0050003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050003980 0x7f0050003da0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f005400c240 tx=0x7f005401cc10 comp rx=0 tx=0).stop 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 -- 172.21.15.143:0/1402037078 shutdown_connections 2023-11-24T06:31:25.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 --2- 172.21.15.143:0/1402037078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050003980 0x7f0050003da0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 -- 172.21.15.143:0/1402037078 >> 172.21.15.143:0/1402037078 conn(0x7f00600b0bf0 msgr2=0x7f00600b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:25.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 -- 172.21.15.143:0/1402037078 shutdown_connections 2023-11-24T06:31:25.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.126+0000 7f0066b01640 1 -- 172.21.15.143:0/1402037078 wait complete. 2023-11-24T06:31:25.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 Processor -- start 2023-11-24T06:31:25.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 -- start start 2023-11-24T06:31:25.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0050003980 0x7f006014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 0x7f0060147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00601495f0 0x7f0060149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006014d1e0 con 0x7f0060147230 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060147bd0 con 0x7f0050003980 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f0066b01640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006014c610 con 0x7f00601495f0 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 0x7f0060147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 0x7f0060147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37856/0 (socket says 172.21.15.143:37856) 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 -- 172.21.15.143:0/3784587057 learned_addr learned my addr 172.21.15.143:0/3784587057 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f006509e640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00601495f0 0x7f0060149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f006489d640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0050003980 0x7f006014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 -- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00601495f0 msgr2=0x7f0060149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00601495f0 0x7f0060149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 -- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0050003980 msgr2=0x7f006014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0050003980 0x7f006014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 -- 172.21.15.143:0/3784587057 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006014c8b0 con 0x7f0060147230 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005ffff640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 0x7f0060147690 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f004c011ad0 tx=0x7f004c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00fbb0 con 0x7f0060147230 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.130+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00fd10 con 0x7f0060147230 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c014680 con 0x7f0060147230 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006014cb90 con 0x7f0060147230 2023-11-24T06:31:25.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060149fb0 con 0x7f0060147230 2023-11-24T06:31:25.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006014d390 con 0x7f0060147230 2023-11-24T06:31:25.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 7) v1 ==== 85954+0+0 (secure 0 0 0) 0x7f004c0147e0 con 0x7f0060147230 2023-11-24T06:31:25.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f005d7fa640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0044066590 0x7f0044068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f004c0848f0 con 0x7f0060147230 2023-11-24T06:31:25.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f006489d640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0044066590 0x7f0044068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.134+0000 7f006489d640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0044066590 0x7f0044068a50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f00540ab000 tx=0x7f00540a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:25.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.138+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f006014d390 con 0x7f0060147230 2023-11-24T06:31:25.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.314+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol2152", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7f0060061b70 con 0x7f0044066590 2023-11-24T06:31:25.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.330+0000 7f005d7fa640 1 -- 172.21.15.143:0/3784587057 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0060061b70 con 0x7f0044066590 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0044066590 msgr2=0x7f0044068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0044066590 0x7f0044068a50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f00540ab000 tx=0x7f00540a7070 comp rx=0 tx=0).stop 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 msgr2=0x7f0060147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 0x7f0060147690 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f004c011ad0 tx=0x7f004c011f90 comp rx=0 tx=0).stop 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 shutdown_connections 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0044066590 0x7f0044068a50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00601495f0 0x7f0060149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0060147230 0x7f0060147690 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 --2- 172.21.15.143:0/3784587057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0050003980 0x7f006014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 >> 172.21.15.143:0/3784587057 conn(0x7f00600b0bf0 msgr2=0x7f006009a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:25.339 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 shutdown_connections 2023-11-24T06:31:25.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f0066b01640 1 -- 172.21.15.143:0/3784587057 wait complete. 2023-11-24T06:31:25.341 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f509b021640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.341 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f509b021640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.341 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f509b021640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.342 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f509b021640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.342 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.334+0000 7f509b021640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.357 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.354+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.358 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.354+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.358 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.354+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.358 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.354+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.358 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:31:25.354+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:31:25.362 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp1033 2023-11-24T06:31:25.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 Processor -- start 2023-11-24T06:31:25.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 -- start start 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4815a290 0x7fcc480707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc4815ec60 0x7fcc480cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc480cc6b0 0x7fcc480b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc48071170 con 0x7fcc4815ec60 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480cb690 con 0x7fcc4815a290 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4d1aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480cb970 con 0x7fcc480cc6b0 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc4815ec60 0x7fcc480cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc4815ec60 0x7fcc480cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37902/0 (socket says 172.21.15.143:37902) 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 -- 172.21.15.143:0/3297633155 learned_addr learned my addr 172.21.15.143:0/3297633155 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc46d9d640 1 --2- 172.21.15.143:0/3297633155 >> v2:172.21.15.146:3300/0 conn(0x7fcc4815a290 0x7fcc480707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4759e640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc480cc6b0 0x7fcc480b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 -- 172.21.15.143:0/3297633155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc480cc6b0 msgr2=0x7fcc480b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc480cc6b0 0x7fcc480b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 -- 172.21.15.143:0/3297633155 >> v2:172.21.15.146:3300/0 conn(0x7fcc4815a290 msgr2=0x7fcc480707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 --2- 172.21.15.143:0/3297633155 >> v2:172.21.15.146:3300/0 conn(0x7fcc4815a290 0x7fcc480707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc3ffff640 1 -- 172.21.15.143:0/3297633155 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480cbc50 con 0x7fcc4815ec60 2023-11-24T06:31:25.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.502+0000 7fcc4759e640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc480cc6b0 0x7fcc480b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:25.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc3ffff640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc4815ec60 0x7fcc480cc170 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcc4806c0d0 tx=0x7fcc3001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583bf9a3b2167683 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:25.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4659c640 1 -- 172.21.15.143:0/3297633155 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300ab600 con 0x7fcc4815ec60 2023-11-24T06:31:25.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4659c640 1 -- 172.21.15.143:0/3297633155 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc300a7050 con 0x7fcc4815ec60 2023-11-24T06:31:25.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4659c640 1 -- 172.21.15.143:0/3297633155 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300ab980 con 0x7fcc4815ec60 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/3297633155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc4815ec60 msgr2=0x7fcc480cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc4815ec60 0x7fcc480cc170 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcc4806c0d0 tx=0x7fcc3001c470 comp rx=0 tx=0).stop 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/3297633155 shutdown_connections 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc480cc6b0 0x7fcc480b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/3297633155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc4815ec60 0x7fcc480cc170 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/3297633155 >> v2:172.21.15.146:3300/0 conn(0x7fcc4815a290 0x7fcc480707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/3297633155 >> 172.21.15.143:0/3297633155 conn(0x7fcc480b0c80 msgr2=0x7fcc480b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:25.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/3297633155 shutdown_connections 2023-11-24T06:31:25.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.506+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/3297633155 wait complete. 2023-11-24T06:31:25.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 Processor -- start 2023-11-24T06:31:25.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 -- start start 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 0x7fcc48146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4815a290 0x7fcc48146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4815ec60 0x7fcc480b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48151b20 con 0x7fcc480cc6b0 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48154200 con 0x7fcc4815a290 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4d1aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48151280 con 0x7fcc4815ec60 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 0x7fcc48146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 0x7fcc48146dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37906/0 (socket says 172.21.15.143:37906) 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 -- 172.21.15.143:0/2703155701 learned_addr learned my addr 172.21.15.143:0/2703155701 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc3ffff640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4815a290 0x7fcc48146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc4759e640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4815ec60 0x7fcc480b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 -- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4815ec60 msgr2=0x7fcc480b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4815ec60 0x7fcc480b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 -- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4815a290 msgr2=0x7fcc48146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4815a290 0x7fcc48146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 -- 172.21.15.143:0/2703155701 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300094d0 con 0x7fcc480cc6b0 2023-11-24T06:31:25.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.510+0000 7fcc46d9d640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 0x7fcc48146dd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800e930 tx=0x7fcc3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:25.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38009690 con 0x7fcc480cc6b0 2023-11-24T06:31:25.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3800ca00 con 0x7fcc480cc6b0 2023-11-24T06:31:25.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc48070f40 con 0x7fcc480cc6b0 2023-11-24T06:31:25.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800cd70 con 0x7fcc480cc6b0 2023-11-24T06:31:25.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc48151840 con 0x7fcc480cc6b0 2023-11-24T06:31:25.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc48153fd0 con 0x7fcc480cc6b0 2023-11-24T06:31:25.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 7) v1 ==== 85954+0+0 (secure 0 0 0) 0x7fcc38013470 con 0x7fcc480cc6b0 2023-11-24T06:31:25.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3f7fe640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcc28066590 0x7fcc28068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:25.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcc38084280 con 0x7fcc480cc6b0 2023-11-24T06:31:25.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3ffff640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcc28066590 0x7fcc28068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:25.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.514+0000 7fcc3ffff640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcc28066590 0x7fcc28068a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc4806be60 tx=0x7fcc30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:25.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.518+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc38051680 con 0x7fcc480cc6b0 2023-11-24T06:31:25.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.694+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp1033", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc4815a880 con 0x7fcc28066590 2023-11-24T06:31:25.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc3f7fe640 1 -- 172.21.15.143:0/2703155701 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcc300ac030 con 0x7fcc28066590 2023-11-24T06:31:25.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcc28066590 msgr2=0x7fcc28068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcc28066590 0x7fcc28068a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc4806be60 tx=0x7fcc30008040 comp rx=0 tx=0).stop 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 msgr2=0x7fcc48146dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 0x7fcc48146dd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800e930 tx=0x7fcc3800edf0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 shutdown_connections 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcc28066590 0x7fcc28068a50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4815ec60 0x7fcc480b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4815a290 0x7fcc48146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 --2- 172.21.15.143:0/2703155701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc480cc6b0 0x7fcc48146dd0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 >> 172.21.15.143:0/2703155701 conn(0x7fcc480b0c80 msgr2=0x7fcc480b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 shutdown_connections 2023-11-24T06:31:25.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:25.698+0000 7fcc4d1aa640 1 -- 172.21.15.143:0/2703155701 wait complete. 2023-11-24T06:31:25.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:25.724 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T06:31:25.740 INFO:teuthology.orchestra.run.smithi143.stdout:2 2023-11-24T06:31:25.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:25.741 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f ./volumes/subvol_grp1033/subvol2152/.meta.stale_snap_section) 2023-11-24T06:31:25.806 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:31:25.806 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:31:25.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:31:26.016 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:31:26.017 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:26.017 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:26.026 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:26.026 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:26.077 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:26.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d7e8e3640 1 Processor -- start 2023-11-24T06:31:26.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d7e8e3640 1 -- start start 2023-11-24T06:31:26.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d7e8e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d780b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d7e8e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7815a700 con 0x7f3d780b36c0 2023-11-24T06:31:26.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d7e8e3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d780b2620 con 0x7f3d78070da0 2023-11-24T06:31:26.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d7e8e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780b2430 con 0x7f3d7815a320 2023-11-24T06:31:26.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d777fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3d780b36c0 0x7f3d78070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35008/0 (socket says 172.21.15.143:35008) 2023-11-24T06:31:26.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d777fe640 1 -- 172.21.15.143:0/2466026802 learned_addr learned my addr 172.21.15.143:0/2466026802 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:26.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d77fff640 1 --2- 172.21.15.143:0/2466026802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d780b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d77fff640 1 -- 172.21.15.143:0/2466026802 >> v1:172.21.15.146:6789/0 conn(0x7f3d78070da0 legacy=0x7f3d7815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d77fff640 1 -- 172.21.15.143:0/2466026802 >> v1:172.21.15.143:6789/0 conn(0x7f3d780b36c0 legacy=0x7f3d78070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.254+0000 7f3d77fff640 1 -- 172.21.15.143:0/2466026802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780b2900 con 0x7f3d7815a320 2023-11-24T06:31:26.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.258+0000 7f3d77fff640 1 --2- 172.21.15.143:0/2466026802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d780b1ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d680097f0 tx=0x7f3d6801e6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08dbf57b1e66bcb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.258+0000 7f3d76ffd640 1 -- 172.21.15.143:0/2466026802 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680ab680 con 0x7f3d7815a320 2023-11-24T06:31:26.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.258+0000 7f3d76ffd640 1 -- 172.21.15.143:0/2466026802 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d680ab7e0 con 0x7f3d7815a320 2023-11-24T06:31:26.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.258+0000 7f3d76ffd640 1 -- 172.21.15.143:0/2466026802 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680abb70 con 0x7f3d7815a320 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/2466026802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 msgr2=0x7f3d780b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/2466026802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d780b1ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d680097f0 tx=0x7f3d6801e6a0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/2466026802 shutdown_connections 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/2466026802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d780b1ef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/2466026802 >> 172.21.15.143:0/2466026802 conn(0x7f3d780b0bf0 msgr2=0x7f3d780b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/2466026802 shutdown_connections 2023-11-24T06:31:26.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/2466026802 wait complete. 2023-11-24T06:31:26.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 Processor -- start 2023-11-24T06:31:26.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.262+0000 7f3d7e8e3640 1 -- start start 2023-11-24T06:31:26.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d78070da0 0x7f3d7815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 0x7f3d78150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d7809c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d78150d10 con 0x7f3d780b36c0 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d78150ff0 con 0x7f3d78070da0 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781512d0 con 0x7f3d7815a320 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 0x7f3d78150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 0x7f3d78150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37918/0 (socket says 172.21.15.143:37918) 2023-11-24T06:31:26.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 -- 172.21.15.143:0/3625645819 learned_addr learned my addr 172.21.15.143:0/3625645819 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:26.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d77fff640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d78070da0 0x7f3d7815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7ce80640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d7809c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 -- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 msgr2=0x7f3d7809c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d7809c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 -- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d78070da0 msgr2=0x7f3d7815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d78070da0 0x7f3d7815cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 -- 172.21.15.143:0/3625645819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68009420 con 0x7f3d780b36c0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d777fe640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 0x7f3d78150270 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c4d0 tx=0x7f3d6c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c005cf0 con 0x7f3d780b36c0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c005e50 con 0x7f3d780b36c0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d781515b0 con 0x7f3d780b36c0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c007270 con 0x7f3d780b36c0 2023-11-24T06:31:26.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d781f59f0 con 0x7f3d780b36c0 2023-11-24T06:31:26.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.266+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d78067520 con 0x7f3d780b36c0 2023-11-24T06:31:26.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.270+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f3d6c0073d0 con 0x7f3d780b36c0 2023-11-24T06:31:26.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.270+0000 7f3d74ff9640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d640666b0 0x7f3d64068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.270+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3d6c083790 con 0x7f3d780b36c0 2023-11-24T06:31:26.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.270+0000 7f3d77fff640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d640666b0 0x7f3d64068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.270+0000 7f3d77fff640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d640666b0 0x7f3d64068b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3d680b0000 tx=0x7f3d680b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.274+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d6c050880 con 0x7f3d780b36c0 2023-11-24T06:31:26.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.426+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d78151a60 con 0x7f3d780b36c0 2023-11-24T06:31:26.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.426+0000 7f3d74ff9640 1 -- 172.21.15.143:0/3625645819 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f3d6c053ea0 con 0x7f3d780b36c0 2023-11-24T06:31:26.433 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:26.433 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":46,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:23.040661+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:26.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d640666b0 msgr2=0x7f3d64068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d640666b0 0x7f3d64068b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3d680b0000 tx=0x7f3d680b5040 comp rx=0 tx=0).stop 2023-11-24T06:31:26.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 msgr2=0x7f3d78150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 0x7f3d78150270 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c4d0 tx=0x7f3d6c00c990 comp rx=0 tx=0).stop 2023-11-24T06:31:26.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 shutdown_connections 2023-11-24T06:31:26.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d640666b0 0x7f3d64068b70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d7815a320 0x7f3d7809c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d780b36c0 0x7f3d78150270 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 --2- 172.21.15.143:0/3625645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d78070da0 0x7f3d7815cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 >> 172.21.15.143:0/3625645819 conn(0x7f3d780b0bf0 msgr2=0x7f3d780b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:26.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 shutdown_connections 2023-11-24T06:31:26.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.430+0000 7f3d7e8e3640 1 -- 172.21.15.143:0/3625645819 wait complete. 2023-11-24T06:31:26.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:31:01.856093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:31:03.157713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:31:26.455 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:31:26.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 Processor -- start 2023-11-24T06:31:26.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 -- start start 2023-11-24T06:31:26.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0dc06d760 0x7fa0dc071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc071e40 0x7fa0dc0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0cd400 con 0x7fa0dc15d540 2023-11-24T06:31:26.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc072860 con 0x7fa0dc06d760 2023-11-24T06:31:26.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0e1c32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06dc30 con 0x7fa0dc071e40 2023-11-24T06:31:26.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0dbfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc071e40 0x7fa0dc0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0db7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa0dc15d540 0x7fa0dc06d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:53874/0 (socket says 172.21.15.143:53874) 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0db7fe640 1 -- 172.21.15.143:0/2364927932 learned_addr learned my addr 172.21.15.143:0/2364927932 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0daffd640 1 --2- 172.21.15.143:0/2364927932 >> v2:172.21.15.146:3300/0 conn(0x7fa0dc06d760 0x7fa0dc071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0da7fc640 1 -- 172.21.15.143:0/2364927932 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015515968 0 0) 0x7fa0dc0cd400 con 0x7fa0dc15d540 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0da7fc640 1 -- 172.21.15.143:0/2364927932 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c4003530 con 0x7fa0dc15d540 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0dbfff640 1 -- 172.21.15.143:0/2364927932 >> v2:172.21.15.146:3300/0 conn(0x7fa0dc06d760 msgr2=0x7fa0dc071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0dbfff640 1 --2- 172.21.15.143:0/2364927932 >> v2:172.21.15.146:3300/0 conn(0x7fa0dc06d760 0x7fa0dc071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0dbfff640 1 -- 172.21.15.143:0/2364927932 >> v1:172.21.15.146:6789/0 conn(0x7fa0dc15d540 legacy=0x7fa0dc06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.590+0000 7fa0dbfff640 1 -- 172.21.15.143:0/2364927932 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc06df10 con 0x7fa0dc071e40 2023-11-24T06:31:26.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0dbfff640 1 --2- 172.21.15.143:0/2364927932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc071e40 0x7fa0dc0cd890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=957e2d2cc7997ae5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0da7fc640 1 -- 172.21.15.143:0/2364927932 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a5920 con 0x7fa0dc071e40 2023-11-24T06:31:26.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0da7fc640 1 -- 172.21.15.143:0/2364927932 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40a5a80 con 0x7fa0dc071e40 2023-11-24T06:31:26.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0da7fc640 1 -- 172.21.15.143:0/2364927932 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a5df0 con 0x7fa0dc071e40 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 -- 172.21.15.143:0/2364927932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc071e40 msgr2=0x7fa0dc0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/2364927932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc071e40 0x7fa0dc0cd890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d401c950 comp rx=0 tx=0).stop 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 -- 172.21.15.143:0/2364927932 shutdown_connections 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/2364927932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc071e40 0x7fa0dc0cd890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/2364927932 >> v2:172.21.15.146:3300/0 conn(0x7fa0dc06d760 0x7fa0dc071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 -- 172.21.15.143:0/2364927932 >> 172.21.15.143:0/2364927932 conn(0x7fa0dc0b0c80 msgr2=0x7fa0dc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 -- 172.21.15.143:0/2364927932 shutdown_connections 2023-11-24T06:31:26.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.594+0000 7fa0e1c32640 1 -- 172.21.15.143:0/2364927932 wait complete. 2023-11-24T06:31:26.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 Processor -- start 2023-11-24T06:31:26.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 -- start start 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc06d760 0x7fa0dc1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 0x7fa0dc14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc15d540 0x7fa0dc0960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc095c30 con 0x7fa0dc071e40 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc14fef0 con 0x7fa0dc15d540 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc14f930 con 0x7fa0dc06d760 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 0x7fa0dc14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 0x7fa0dc14d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37920/0 (socket says 172.21.15.143:37920) 2023-11-24T06:31:26.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 -- 172.21.15.143:0/3779738016 learned_addr learned my addr 172.21.15.143:0/3779738016 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:26.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0db7fe640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc06d760 0x7fa0dc1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0dbfff640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc15d540 0x7fa0dc0960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 -- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc06d760 msgr2=0x7fa0dc1461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc06d760 0x7fa0dc1461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 -- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc15d540 msgr2=0x7fa0dc0960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc15d540 0x7fa0dc0960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 -- 172.21.15.143:0/3779738016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4009a70 con 0x7fa0dc071e40 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0daffd640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 0x7fa0dc14d690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000e900 tx=0x7fa0d000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0009690 con 0x7fa0dc071e40 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d000ca00 con 0x7fa0dc071e40 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc14fc10 con 0x7fa0dc071e40 2023-11-24T06:31:26.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000cdb0 con 0x7fa0dc071e40 2023-11-24T06:31:26.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.598+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc096600 con 0x7fa0dc071e40 2023-11-24T06:31:26.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.602+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc095de0 con 0x7fa0dc071e40 2023-11-24T06:31:26.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.602+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fa0d0013470 con 0x7fa0dc071e40 2023-11-24T06:31:26.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.602+0000 7fa0c3fff640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0c80666b0 0x7fa0c8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.602+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa0d0084560 con 0x7fa0dc071e40 2023-11-24T06:31:26.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.602+0000 7fa0db7fe640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0c80666b0 0x7fa0c8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.602+0000 7fa0db7fe640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0c80666b0 0x7fa0c8068b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc007fd0 tx=0x7fa0cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.606+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0dc095de0 con 0x7fa0dc071e40 2023-11-24T06:31:26.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.754+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0dc04e8c0 con 0x7fa0dc071e40 2023-11-24T06:31:26.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0c3fff640 1 -- 172.21.15.143:0/3779738016 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0d00515d0 con 0x7fa0dc071e40 2023-11-24T06:31:26.762 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:31:26.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0c80666b0 msgr2=0x7fa0c8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0c80666b0 0x7fa0c8068b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc007fd0 tx=0x7fa0cc009040 comp rx=0 tx=0).stop 2023-11-24T06:31:26.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 msgr2=0x7fa0dc14d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 0x7fa0dc14d690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000e900 tx=0x7fa0d000edc0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 shutdown_connections 2023-11-24T06:31:26.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0c80666b0 0x7fa0c8068b70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc15d540 0x7fa0dc0960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0dc071e40 0x7fa0dc14d690 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 --2- 172.21.15.143:0/3779738016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0dc06d760 0x7fa0dc1461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 >> 172.21.15.143:0/3779738016 conn(0x7fa0dc0b0c80 msgr2=0x7fa0dc06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:26.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 shutdown_connections 2023-11-24T06:31:26.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.758+0000 7fa0e1c32640 1 -- 172.21.15.143:0/3779738016 wait complete. 2023-11-24T06:31:26.782 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:31:26.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cc56c9640 1 Processor -- start 2023-11-24T06:31:26.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cc56c9640 1 -- start start 2023-11-24T06:31:26.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cc56c9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0cc00b1f80 0x7f0cc00b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cc56c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc0070f00 con 0x7f0cc015ec60 2023-11-24T06:31:26.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cc56c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc0071170 con 0x7f0cc015a290 2023-11-24T06:31:26.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cc56c9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00cb690 con 0x7f0cc00b1f80 2023-11-24T06:31:26.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cb7fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0cc015ec60 0x7f0cc00cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35020/0 (socket says 172.21.15.143:35020) 2023-11-24T06:31:26.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cb7fff640 1 -- 172.21.15.143:0/853363789 learned_addr learned my addr 172.21.15.143:0/853363789 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:26.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbf7fe640 1 --2- 172.21.15.143:0/853363789 >> v2:172.21.15.146:3300/0 conn(0x7f0cc00b1f80 0x7f0cc00b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635345708 0 0) 0x7f0cc0070f00 con 0x7f0cc015ec60 2023-11-24T06:31:26.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cac003530 con 0x7f0cc015ec60 2023-11-24T06:31:26.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227459275 0 0) 0x7f0cc0071170 con 0x7f0cc015a290 2023-11-24T06:31:26.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc0070f00 con 0x7f0cc015a290 2023-11-24T06:31:26.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/853363789 >> v1:172.21.15.146:6789/0 conn(0x7f0cc015a290 legacy=0x7f0cc00707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/853363789 >> v1:172.21.15.143:6789/0 conn(0x7f0cc015ec60 legacy=0x7f0cc00cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.922+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/853363789 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00cb970 con 0x7f0cc00b1f80 2023-11-24T06:31:26.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cbf7fe640 1 --2- 172.21.15.143:0/853363789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc00b23f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009d90 tx=0x7f0cb801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbd636b509edd0e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80a5890 con 0x7f0cc00b1f80 2023-11-24T06:31:26.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb80a59f0 con 0x7f0cc00b1f80 2023-11-24T06:31:26.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cbe7fc640 1 -- 172.21.15.143:0/853363789 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80a5d80 con 0x7f0cc00b1f80 2023-11-24T06:31:26.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 -- 172.21.15.143:0/853363789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 msgr2=0x7f0cc00b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/853363789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc00b23f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009d90 tx=0x7f0cb801c8c0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 -- 172.21.15.143:0/853363789 shutdown_connections 2023-11-24T06:31:26.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/853363789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc00b23f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 -- 172.21.15.143:0/853363789 >> 172.21.15.143:0/853363789 conn(0x7f0cc00b0c80 msgr2=0x7f0cc00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:26.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 -- 172.21.15.143:0/853363789 shutdown_connections 2023-11-24T06:31:26.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.926+0000 7f0cc56c9640 1 -- 172.21.15.143:0/853363789 wait complete. 2023-11-24T06:31:26.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 Processor -- start 2023-11-24T06:31:26.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- start start 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc0159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc015a290 0x7f0cc00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 0x7f0cc0157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00ac930 con 0x7f0cc015ec60 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc01598c0 con 0x7f0cc00b1f80 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00ac000 con 0x7f0cc015a290 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 0x7f0cc0157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 0x7f0cc0157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37934/0 (socket says 172.21.15.143:37934) 2023-11-24T06:31:26.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/1663890892 learned_addr learned my addr 172.21.15.143:0/1663890892 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:26.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbeffd640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc0159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cb7fff640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc015a290 0x7f0cc00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc015a290 msgr2=0x7f0cc00acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc015a290 0x7f0cc00acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 msgr2=0x7f0cc0159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:26.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc0159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:26.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 -- 172.21.15.143:0/1663890892 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8009a70 con 0x7f0cc015ec60 2023-11-24T06:31:26.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cb7fff640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc015a290 0x7f0cc00acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:26.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cbf7fe640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 0x7f0cc0157400 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80b0040 tx=0x7f0cb8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80b9650 con 0x7f0cc015ec60 2023-11-24T06:31:26.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb80b97b0 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc00ac2e0 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80b9b60 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc00b3550 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.930+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc004e8c0 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.934+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f0cb80b9cc0 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.934+0000 7f0cb77fe640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ca00666b0 0x7f0ca0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.934+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0cb811f4f0 con 0x7f0cc015ec60 2023-11-24T06:31:26.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.934+0000 7f0cbeffd640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ca00666b0 0x7f0ca0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:26.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.934+0000 7f0cbeffd640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ca00666b0 0x7f0ca0068b70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00011f0 tx=0x7f0cb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:26.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:26.938+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cb80ec5c0 con 0x7f0cc015ec60 2023-11-24T06:31:27.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0cc00b14e0 con 0x7f0cc015ec60 2023-11-24T06:31:27.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cb77fe640 1 -- 172.21.15.143:0/1663890892 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0cb80efbe0 con 0x7f0cc015ec60 2023-11-24T06:31:27.094 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ca00666b0 msgr2=0x7f0ca0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ca00666b0 0x7f0ca0068b70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00011f0 tx=0x7f0cb0009040 comp rx=0 tx=0).stop 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 msgr2=0x7f0cc0157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 0x7f0cc0157400 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80b0040 tx=0x7f0cb8019660 comp rx=0 tx=0).stop 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 shutdown_connections 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0ca00666b0 0x7f0ca0068b70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cc015ec60 0x7f0cc0157400 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc015a290 0x7f0cc00acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 --2- 172.21.15.143:0/1663890892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc00b1f80 0x7f0cc0159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 >> 172.21.15.143:0/1663890892 conn(0x7f0cc00b0c80 msgr2=0x7f0cc0152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:27.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 shutdown_connections 2023-11-24T06:31:27.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.090+0000 7f0cc56c9640 1 -- 172.21.15.143:0/1663890892 wait complete. 2023-11-24T06:31:27.115 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:31:27.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7c49aa640 1 Processor -- start 2023-11-24T06:31:27.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7c49aa640 1 -- start start 2023-11-24T06:31:27.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7c49aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00d39b0 0x7fc7c006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7c49aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00b0090 con 0x7fc7c015d7f0 2023-11-24T06:31:27.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7c49aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00b0330 con 0x7fc7c00b2100 2023-11-24T06:31:27.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7c49aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c006b980 con 0x7fc7c00d39b0 2023-11-24T06:31:27.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7be59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc7c015d7f0 0x7fc7c00d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35028/0 (socket says 172.21.15.143:35028) 2023-11-24T06:31:27.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7be59c640 1 -- 172.21.15.143:0/3625617172 learned_addr learned my addr 172.21.15.143:0/3625617172 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bdd9b640 1 --2- 172.21.15.143:0/3625617172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00d39b0 0x7fc7c006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178922689 0 0) 0x7fc7c00b0090 con 0x7fc7c015d7f0 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a8003530 con 0x7fc7c015d7f0 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496513101 0 0) 0x7fc7c00b0330 con 0x7fc7c00b2100 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c00b0090 con 0x7fc7c00b2100 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bdd9b640 1 -- 172.21.15.143:0/3625617172 >> v1:172.21.15.146:6789/0 conn(0x7fc7c00b2100 legacy=0x7fc7c006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873414557 0 0) 0x7fc7a8003530 con 0x7fc7c015d7f0 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bdd9b640 1 -- 172.21.15.143:0/3625617172 >> v1:172.21.15.143:6789/0 conn(0x7fc7c015d7f0 legacy=0x7fc7c00d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.250+0000 7fc7bdd9b640 1 -- 172.21.15.143:0/3625617172 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00b0610 con 0x7fc7c00d39b0 2023-11-24T06:31:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7bdd9b640 1 --2- 172.21.15.143:0/3625617172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00d39b0 0x7fc7c006bcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40097f0 tx=0x7fc7b401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13bac09ec48d60da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0001680 con 0x7fc7c00d39b0 2023-11-24T06:31:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b40a7050 con 0x7fc7c00d39b0 2023-11-24T06:31:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7bd59a640 1 -- 172.21.15.143:0/3625617172 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40ab620 con 0x7fc7c00d39b0 2023-11-24T06:31:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 -- 172.21.15.143:0/3625617172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00d39b0 msgr2=0x7fc7c006bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/3625617172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00d39b0 0x7fc7c006bcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40097f0 tx=0x7fc7b401c3e0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 -- 172.21.15.143:0/3625617172 shutdown_connections 2023-11-24T06:31:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/3625617172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00d39b0 0x7fc7c006bcd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 -- 172.21.15.143:0/3625617172 >> 172.21.15.143:0/3625617172 conn(0x7fc7c009c790 msgr2=0x7fc7c008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 -- 172.21.15.143:0/3625617172 shutdown_connections 2023-11-24T06:31:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.254+0000 7fc7c49aa640 1 -- 172.21.15.143:0/3625617172 wait complete. 2023-11-24T06:31:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 Processor -- start 2023-11-24T06:31:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 -- start start 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00b2100 0x7fc7c00b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c00d39b0 0x7fc7c00b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 0x7fc7c0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b41a0 con 0x7fc7c015d7f0 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b32a0 con 0x7fc7c00d39b0 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7c49aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b3520 con 0x7fc7c00b2100 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 0x7fc7c0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 0x7fc7c0150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:37938/0 (socket says 172.21.15.143:37938) 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 -- 172.21.15.143:0/2697790694 learned_addr learned my addr 172.21.15.143:0/2697790694 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bdd9b640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c00d39b0 0x7fc7c00b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7be59c640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00b2100 0x7fc7c00b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 -- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00b2100 msgr2=0x7fc7c00b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00b2100 0x7fc7c00b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 -- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c00d39b0 msgr2=0x7fc7c00b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c00d39b0 0x7fc7c00b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 -- 172.21.15.143:0/2697790694 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009420 con 0x7fc7c015d7f0 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7be59c640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00b2100 0x7fc7c00b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.258+0000 7fc7bed9d640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 0x7fc7c0150e40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c6e0 tx=0x7fc7b800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8003b80 con 0x7fc7c015d7f0 2023-11-24T06:31:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8003ce0 con 0x7fc7c015d7f0 2023-11-24T06:31:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c00b3800 con 0x7fc7c015d7f0 2023-11-24T06:31:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8005310 con 0x7fc7c015d7f0 2023-11-24T06:31:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c00b3dc0 con 0x7fc7c015d7f0 2023-11-24T06:31:27.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c00b42e0 con 0x7fc7c015d7f0 2023-11-24T06:31:27.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fc7b8005470 con 0x7fc7c015d7f0 2023-11-24T06:31:27.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7aeffd640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7a00666b0 0x7fc7a0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc7b8084060 con 0x7fc7c015d7f0 2023-11-24T06:31:27.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.262+0000 7fc7be59c640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7a00666b0 0x7fc7a0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.266+0000 7fc7be59c640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7a00666b0 0x7fc7a0068b70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00017b0 tx=0x7fc7b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:27.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.270+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7b80b5280 con 0x7fc7c015d7f0 2023-11-24T06:31:27.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.418+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7c006c5d0 con 0x7fc7c015d7f0 2023-11-24T06:31:27.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.418+0000 7fc7aeffd640 1 -- 172.21.15.143:0/2697790694 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7c00b42e0 con 0x7fc7c015d7f0 2023-11-24T06:31:27.425 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7a00666b0 msgr2=0x7fc7a0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7a00666b0 0x7fc7a0068b70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00017b0 tx=0x7fc7b0009040 comp rx=0 tx=0).stop 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 msgr2=0x7fc7c0150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 0x7fc7c0150e40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c6e0 tx=0x7fc7b800cba0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 shutdown_connections 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7a00666b0 0x7fc7a0068b70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c015d7f0 0x7fc7c0150e40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c00d39b0 0x7fc7c00b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 --2- 172.21.15.143:0/2697790694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c00b2100 0x7fc7c00b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 >> 172.21.15.143:0/2697790694 conn(0x7fc7c009c790 msgr2=0x7fc7c015a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 shutdown_connections 2023-11-24T06:31:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.422+0000 7fc7c49aa640 1 -- 172.21.15.143:0/2697790694 wait complete. 2023-11-24T06:31:27.446 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:31:27.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.578+0000 7f9888f80640 1 Processor -- start 2023-11-24T06:31:27.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9888f80640 1 -- start start 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9888f80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98840cad20 0x7f98840c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9888f80640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f988406d740 0x7f988406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9888f80640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988406e0d0 con 0x7f988415a4d0 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9888f80640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988415a8b0 con 0x7f988406d740 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9888f80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840c9c30 con 0x7f98840cad20 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f988259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f988415a4d0 0x7f988415e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56102/0 (socket says 172.21.15.143:56102) 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f988259c640 1 -- 172.21.15.143:0/2222304822 learned_addr learned my addr 172.21.15.143:0/2222304822 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9879d9b640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98840cad20 0x7f98840c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9882d9d640 1 --2- 172.21.15.143:0/2222304822 >> v2:172.21.15.146:3300/0 conn(0x7f988406d740 0x7f988406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9881d9b640 1 -- 172.21.15.143:0/2222304822 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296426749 0 0) 0x7f986c001120 con 0x7f988415a4d0 2023-11-24T06:31:27.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9881d9b640 1 -- 172.21.15.143:0/2222304822 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9870003530 con 0x7f988415a4d0 2023-11-24T06:31:27.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9882d9d640 1 -- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98840cad20 msgr2=0x7f98840c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:27.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9882d9d640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98840cad20 0x7f98840c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9882d9d640 1 -- 172.21.15.143:0/2222304822 >> v1:172.21.15.143:6789/0 conn(0x7f988415a4d0 legacy=0x7f988415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9882d9d640 1 -- 172.21.15.143:0/2222304822 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840c9f60 con 0x7f988406d740 2023-11-24T06:31:27.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.582+0000 7f9879d9b640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98840cad20 0x7f98840c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:27.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9882d9d640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988406d740 0x7f988406db90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f987c009d90 tx=0x7f987c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7cc6348b7e6de6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:27.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9881d9b640 1 -- 172.21.15.143:0/2222304822 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0a5950 con 0x7f988406d740 2023-11-24T06:31:27.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9881d9b640 1 -- 172.21.15.143:0/2222304822 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c0a5ab0 con 0x7f988406d740 2023-11-24T06:31:27.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9881d9b640 1 -- 172.21.15.143:0/2222304822 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0a5e40 con 0x7f988406d740 2023-11-24T06:31:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 -- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988406d740 msgr2=0x7f988406db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988406d740 0x7f988406db90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f987c009d90 tx=0x7f987c01c890 comp rx=0 tx=0).stop 2023-11-24T06:31:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 -- 172.21.15.143:0/2222304822 shutdown_connections 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988406d740 0x7f988406db90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 --2- 172.21.15.143:0/2222304822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98840cad20 0x7f98840c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 -- 172.21.15.143:0/2222304822 >> 172.21.15.143:0/2222304822 conn(0x7f98840b0bf0 msgr2=0x7f98840b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 -- 172.21.15.143:0/2222304822 shutdown_connections 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.586+0000 7f9888f80640 1 -- 172.21.15.143:0/2222304822 wait complete. 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 Processor -- start 2023-11-24T06:31:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- start start 2023-11-24T06:31:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f988406d740 0x7f9884151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 0x7f9884154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988415a4d0 0x7f9884155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9884151750 con 0x7f98840cad20 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840c60d0 con 0x7f988415a4d0 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840c63b0 con 0x7f988406d740 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 0x7f9884154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 0x7f9884154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57194/0 (socket says 172.21.15.143:57194) 2023-11-24T06:31:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 -- 172.21.15.143:0/1141764062 learned_addr learned my addr 172.21.15.143:0/1141764062 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9882d9d640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988415a4d0 0x7f9884155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f988259c640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f988406d740 0x7f9884151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 -- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f988406d740 msgr2=0x7f9884151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f988406d740 0x7f9884151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 -- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988415a4d0 msgr2=0x7f9884155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988415a4d0 0x7f9884155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 -- 172.21.15.143:0/1141764062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874009420 con 0x7f98840cad20 2023-11-24T06:31:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9882d9d640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988415a4d0 0x7f9884155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:27.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f988259c640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f988406d740 0x7f9884151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:27.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9879d9b640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 0x7f9884154f20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9d0 tx=0x7f987400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:27.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400ca60 con 0x7f98840cad20 2023-11-24T06:31:27.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987400cbc0 con 0x7f98840cad20 2023-11-24T06:31:27.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c009a70 con 0x7f98840cad20 2023-11-24T06:31:27.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874013470 con 0x7f98840cad20 2023-11-24T06:31:27.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98840c6970 con 0x7f98840cad20 2023-11-24T06:31:27.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.590+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988409d250 con 0x7f98840cad20 2023-11-24T06:31:27.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.594+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f98740135d0 con 0x7f98840cad20 2023-11-24T06:31:27.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.594+0000 7f987b7fe640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98640666b0 0x7f9864068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:27.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.594+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9874084390 con 0x7f98840cad20 2023-11-24T06:31:27.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.594+0000 7f988259c640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98640666b0 0x7f9864068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:27.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.594+0000 7f988259c640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98640666b0 0x7f9864068b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f986c007fd0 tx=0x7f986c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:27.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.598+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9874051340 con 0x7f98840cad20 2023-11-24T06:31:27.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f988404e930 con 0x7f98840cad20 2023-11-24T06:31:27.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f987b7fe640 1 -- 172.21.15.143:0/1141764062 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9874054960 con 0x7f98840cad20 2023-11-24T06:31:27.762 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:31:27.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98640666b0 msgr2=0x7f9864068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98640666b0 0x7f9864068b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f986c007fd0 tx=0x7f986c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 msgr2=0x7f9884154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 0x7f9884154f20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9d0 tx=0x7f987400ee90 comp rx=0 tx=0).stop 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 shutdown_connections 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98640666b0 0x7f9864068b70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988415a4d0 0x7f9884155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98840cad20 0x7f9884154f20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 --2- 172.21.15.143:0/1141764062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f988406d740 0x7f9884151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 >> 172.21.15.143:0/1141764062 conn(0x7f98840b0bf0 msgr2=0x7f9884155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 shutdown_connections 2023-11-24T06:31:27.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:27.758+0000 7f9888f80640 1 -- 172.21.15.143:0/1141764062 wait complete. 2023-11-24T06:31:27.783 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:31:27.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:27.784 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:27.815 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:31:27.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:27.815 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:31:27.870 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:27.870 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:27.880 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:27.880 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:27.930 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:28.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.062+0000 7f068d854640 1 Processor -- start 2023-11-24T06:31:28.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.062+0000 7f068d854640 1 -- start start 2023-11-24T06:31:28.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f068d854640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0688160f60 0x7f06880d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f068d854640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f06880d0700 0x7f06880d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f068d854640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06880d14d0 con 0x7f0688160aa0 2023-11-24T06:31:28.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f068d854640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06880d0b70 con 0x7f06880d0700 2023-11-24T06:31:28.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f068d854640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0688161540 con 0x7f0688160f60 2023-11-24T06:31:28.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f06877fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f06880d0700 0x7f06880d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f0686ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0688160aa0 0x7f06880b8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56118/0 (socket says 172.21.15.143:56118) 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f0686ffd640 1 -- 172.21.15.143:0/1279078628 learned_addr learned my addr 172.21.15.143:0/1279078628 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f067e7fc640 1 --2- 172.21.15.143:0/1279078628 >> v2:172.21.15.146:3300/0 conn(0x7f0688160f60 0x7f06880d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f06877fe640 1 -- 172.21.15.143:0/1279078628 >> v2:172.21.15.146:3300/0 conn(0x7f0688160f60 msgr2=0x7f06880d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f06877fe640 1 --2- 172.21.15.143:0/1279078628 >> v2:172.21.15.146:3300/0 conn(0x7f0688160f60 0x7f06880d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f06877fe640 1 -- 172.21.15.143:0/1279078628 >> v1:172.21.15.143:6789/0 conn(0x7f0688160aa0 legacy=0x7f06880b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f06877fe640 1 -- 172.21.15.143:0/1279078628 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688161820 con 0x7f06880d0700 2023-11-24T06:31:28.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.066+0000 7f067e7fc640 1 --2- 172.21.15.143:0/1279078628 >> v2:172.21.15.146:3300/0 conn(0x7f0688160f60 0x7f06880d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:28.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f06877fe640 1 --2- 172.21.15.143:0/1279078628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06880d0700 0x7f06880d1960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f068808c770 tx=0x7f068001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a3b4901eb99e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f06867fc640 1 -- 172.21.15.143:0/1279078628 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800a5820 con 0x7f06880d0700 2023-11-24T06:31:28.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f06867fc640 1 -- 172.21.15.143:0/1279078628 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800a5980 con 0x7f06880d0700 2023-11-24T06:31:28.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f06867fc640 1 -- 172.21.15.143:0/1279078628 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800a5d10 con 0x7f06880d0700 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 -- 172.21.15.143:0/1279078628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06880d0700 msgr2=0x7f06880d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 --2- 172.21.15.143:0/1279078628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06880d0700 0x7f06880d1960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f068808c770 tx=0x7f068001c850 comp rx=0 tx=0).stop 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 -- 172.21.15.143:0/1279078628 shutdown_connections 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 --2- 172.21.15.143:0/1279078628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06880d0700 0x7f06880d1960 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 --2- 172.21.15.143:0/1279078628 >> v2:172.21.15.146:3300/0 conn(0x7f0688160f60 0x7f06880d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 -- 172.21.15.143:0/1279078628 >> 172.21.15.143:0/1279078628 conn(0x7f06880613d0 msgr2=0x7f06880617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:28.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 -- 172.21.15.143:0/1279078628 shutdown_connections 2023-11-24T06:31:28.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 -- 172.21.15.143:0/1279078628 wait complete. 2023-11-24T06:31:28.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 Processor -- start 2023-11-24T06:31:28.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.070+0000 7f068d854640 1 -- start start 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06880d0700 0x7f06880c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0688160aa0 0x7f06880b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 0x7f06880b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06880c93b0 con 0x7f0688160f60 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06880cb3e0 con 0x7f0688160aa0 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06880cb6c0 con 0x7f06880d0700 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 0x7f06880b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 0x7f06880b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57214/0 (socket says 172.21.15.143:57214) 2023-11-24T06:31:28.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 -- 172.21.15.143:0/2768297799 learned_addr learned my addr 172.21.15.143:0/2768297799 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:28.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f0686ffd640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06880d0700 0x7f06880c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f067e7fc640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0688160aa0 0x7f06880b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 -- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06880d0700 msgr2=0x7f06880c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06880d0700 0x7f06880c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 -- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0688160aa0 msgr2=0x7f06880b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0688160aa0 0x7f06880b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 -- 172.21.15.143:0/2768297799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009a70 con 0x7f0688160f60 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f06877fe640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 0x7f06880b7a80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f06800b0040 tx=0x7f06800195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800b9860 con 0x7f0688160f60 2023-11-24T06:31:28.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800b99c0 con 0x7f0688160f60 2023-11-24T06:31:28.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800b9d70 con 0x7f0688160f60 2023-11-24T06:31:28.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06880cb9a0 con 0x7f0688160f60 2023-11-24T06:31:28.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06880cbf60 con 0x7f0688160f60 2023-11-24T06:31:28.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06880cd4e0 con 0x7f0688160f60 2023-11-24T06:31:28.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.074+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f06800ad440 con 0x7f0688160f60 2023-11-24T06:31:28.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.078+0000 7f0684ff9640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06680666b0 0x7f0668068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.078+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f068011f710 con 0x7f0688160f60 2023-11-24T06:31:28.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.078+0000 7f0686ffd640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06680666b0 0x7f0668068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.078+0000 7f0686ffd640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06680666b0 0x7f0668068b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0670005890 tx=0x7f0670009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.082+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06800ec920 con 0x7f0688160f60 2023-11-24T06:31:28.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.234+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f068804e850 con 0x7f0688160f60 2023-11-24T06:31:28.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.234+0000 7f0684ff9640 1 -- 172.21.15.143:0/2768297799 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f06800eff40 con 0x7f0688160f60 2023-11-24T06:31:28.240 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:28.240 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":46,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:23.040661+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:28.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06680666b0 msgr2=0x7f0668068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06680666b0 0x7f0668068b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0670005890 tx=0x7f0670009040 comp rx=0 tx=0).stop 2023-11-24T06:31:28.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 msgr2=0x7f06880b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 0x7f06880b7a80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f06800b0040 tx=0x7f06800195f0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 shutdown_connections 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06680666b0 0x7f0668068b70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0688160f60 0x7f06880b7a80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0688160aa0 0x7f06880b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 --2- 172.21.15.143:0/2768297799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06880d0700 0x7f06880c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 >> 172.21.15.143:0/2768297799 conn(0x7f06880613d0 msgr2=0x7f0688159e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 shutdown_connections 2023-11-24T06:31:28.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.238+0000 7f068d854640 1 -- 172.21.15.143:0/2768297799 wait complete. 2023-11-24T06:31:28.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:31:01.856093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:31:03.157713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:31:28.263 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:31:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1148c9a640 1 Processor -- start 2023-11-24T06:31:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1148c9a640 1 -- start start 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1148c9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f11440b1f80 0x7f1144164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1148c9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114415a050 con 0x7f11440ccef0 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1148c9a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114406e150 con 0x7f11440ce2e0 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1148c9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440722e0 con 0x7f11440b1f80 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f114259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f11440ccef0 0x7f114406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56122/0 (socket says 172.21.15.143:56122) 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f114259c640 1 -- 172.21.15.143:0/3417834174 learned_addr learned my addr 172.21.15.143:0/3417834174 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1142d9d640 1 --2- 172.21.15.143:0/3417834174 >> v2:172.21.15.143:3300/0 conn(0x7f11440b1f80 0x7f1144164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1142d9d640 1 -- 172.21.15.143:0/3417834174 >> v1:172.21.15.146:6789/0 conn(0x7f11440ce2e0 legacy=0x7f114406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1142d9d640 1 -- 172.21.15.143:0/3417834174 >> v1:172.21.15.143:6789/0 conn(0x7f11440ccef0 legacy=0x7f114406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1142d9d640 1 -- 172.21.15.143:0/3417834174 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144072860 con 0x7f11440b1f80 2023-11-24T06:31:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.402+0000 7f1141d9b640 1 -- 172.21.15.143:0/3417834174 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124263746 0 0) 0x7f114415a050 con 0x7f11440ccef0 2023-11-24T06:31:28.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1142d9d640 1 --2- 172.21.15.143:0/3417834174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f1144164740 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f113c009d90 tx=0x7f113c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b072ac8faf9a3aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1141d9b640 1 -- 172.21.15.143:0/3417834174 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0a59e0 con 0x7f11440b1f80 2023-11-24T06:31:28.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1141d9b640 1 -- 172.21.15.143:0/3417834174 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c0a5b40 con 0x7f11440b1f80 2023-11-24T06:31:28.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1141d9b640 1 -- 172.21.15.143:0/3417834174 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0ad440 con 0x7f11440b1f80 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 -- 172.21.15.143:0/3417834174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 msgr2=0x7f1144164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3417834174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f1144164740 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f113c009d90 tx=0x7f113c01c920 comp rx=0 tx=0).stop 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 -- 172.21.15.143:0/3417834174 shutdown_connections 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3417834174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f1144164740 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 -- 172.21.15.143:0/3417834174 >> 172.21.15.143:0/3417834174 conn(0x7f11440b0c80 msgr2=0x7f11440b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 -- 172.21.15.143:0/3417834174 shutdown_connections 2023-11-24T06:31:28.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.406+0000 7f1148c9a640 1 -- 172.21.15.143:0/3417834174 wait complete. 2023-11-24T06:31:28.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 Processor -- start 2023-11-24T06:31:28.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 -- start start 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f11440c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11440ccef0 0x7f11440ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11440ce2e0 0x7f114414df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440ac540 con 0x7f11440b1f80 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440ac820 con 0x7f11440ccef0 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440acb00 con 0x7f11440ce2e0 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f11440c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f11440c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57228/0 (socket says 172.21.15.143:57228) 2023-11-24T06:31:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 -- 172.21.15.143:0/3695461426 learned_addr learned my addr 172.21.15.143:0/3695461426 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f113bfff640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11440ccef0 0x7f11440ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1142d9d640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11440ce2e0 0x7f114414df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 -- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11440ce2e0 msgr2=0x7f114414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11440ce2e0 0x7f114414df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 -- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11440ccef0 msgr2=0x7f11440ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11440ccef0 0x7f11440ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 -- 172.21.15.143:0/3695461426 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c009a70 con 0x7f11440b1f80 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f113bfff640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11440ccef0 0x7f11440ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1142d9d640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11440ce2e0 0x7f114414df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f114259c640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f11440c93d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f113400c4a0 tx=0x7f113400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340074e0 con 0x7f11440b1f80 2023-11-24T06:31:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134007640 con 0x7f11440b1f80 2023-11-24T06:31:28.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134004a30 con 0x7f11440b1f80 2023-11-24T06:31:28.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11440acde0 con 0x7f11440b1f80 2023-11-24T06:31:28.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.410+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114414e440 con 0x7f11440b1f80 2023-11-24T06:31:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.414+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114404e8c0 con 0x7f11440b1f80 2023-11-24T06:31:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.414+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f1134004b90 con 0x7f11440b1f80 2023-11-24T06:31:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.414+0000 7f113affd640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11240666b0 0x7f1124068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.414+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1134083620 con 0x7f11440b1f80 2023-11-24T06:31:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.414+0000 7f113bfff640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11240666b0 0x7f1124068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.414+0000 7f113bfff640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11240666b0 0x7f1124068b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11440712d0 tx=0x7f112c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.418+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1134050660 con 0x7f11440b1f80 2023-11-24T06:31:28.574 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11440b44a0 con 0x7f11440b1f80 2023-11-24T06:31:28.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f113affd640 1 -- 172.21.15.143:0/3695461426 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11340180a0 con 0x7f11440b1f80 2023-11-24T06:31:28.575 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:31:28.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11240666b0 msgr2=0x7f1124068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11240666b0 0x7f1124068b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11440712d0 tx=0x7f112c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 msgr2=0x7f11440c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f11440c93d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f113400c4a0 tx=0x7f113400c960 comp rx=0 tx=0).stop 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 shutdown_connections 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11240666b0 0x7f1124068b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11440ce2e0 0x7f114414df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11440ccef0 0x7f11440ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 --2- 172.21.15.143:0/3695461426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11440b1f80 0x7f11440c93d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 >> 172.21.15.143:0/3695461426 conn(0x7f11440b0c80 msgr2=0x7f1144153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 shutdown_connections 2023-11-24T06:31:28.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.570+0000 7f1148c9a640 1 -- 172.21.15.143:0/3695461426 wait complete. 2023-11-24T06:31:28.596 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:31:28.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.730+0000 7f1dd17c1640 1 Processor -- start 2023-11-24T06:31:28.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.730+0000 7f1dd17c1640 1 -- start start 2023-11-24T06:31:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.730+0000 7f1dd17c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1dcc0ae4a0 0x7f1dcc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.730+0000 7f1dd17c1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1dcc0ce420 0x7f1dcc06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dd17c1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0b3510 con 0x7f1dcc0cd850 2023-11-24T06:31:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dd17c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0b37f0 con 0x7f1dcc0ae4a0 2023-11-24T06:31:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dd17c1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0b3ad0 con 0x7f1dcc0ce420 2023-11-24T06:31:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1dcc0ae4a0 0x7f1dcc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1dcc0ae4a0 0x7f1dcc15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57234/0 (socket says 172.21.15.143:57234) 2023-11-24T06:31:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 -- 172.21.15.143:0/3697980384 learned_addr learned my addr 172.21.15.143:0/3697980384 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 -- 172.21.15.143:0/3697980384 >> v2:172.21.15.146:3300/0 conn(0x7f1dcc0ce420 msgr2=0x7f1dcc06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 --2- 172.21.15.143:0/3697980384 >> v2:172.21.15.146:3300/0 conn(0x7f1dcc0ce420 0x7f1dcc06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 -- 172.21.15.143:0/3697980384 >> v1:172.21.15.146:6789/0 conn(0x7f1dcc0cd850 legacy=0x7f1dcc0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:28.739 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 -- 172.21.15.143:0/3697980384 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0b3db0 con 0x7f1dcc0ae4a0 2023-11-24T06:31:28.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dcaffd640 1 --2- 172.21.15.143:0/3697980384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc15ba00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0b45b0 tx=0x7f1dbc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be7ad8fdec99c5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.734+0000 7f1dca7fc640 1 -- 172.21.15.143:0/3697980384 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0a5840 con 0x7f1dcc0ae4a0 2023-11-24T06:31:28.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dca7fc640 1 -- 172.21.15.143:0/3697980384 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0a59a0 con 0x7f1dcc0ae4a0 2023-11-24T06:31:28.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dca7fc640 1 -- 172.21.15.143:0/3697980384 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0a5d30 con 0x7f1dcc0ae4a0 2023-11-24T06:31:28.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- 172.21.15.143:0/3697980384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0ae4a0 msgr2=0x7f1dcc15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/3697980384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc15ba00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0b45b0 tx=0x7f1dbc01c960 comp rx=0 tx=0).stop 2023-11-24T06:31:28.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- 172.21.15.143:0/3697980384 shutdown_connections 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/3697980384 >> v2:172.21.15.146:3300/0 conn(0x7f1dcc0ce420 0x7f1dcc06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/3697980384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc15ba00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- 172.21.15.143:0/3697980384 >> 172.21.15.143:0/3697980384 conn(0x7f1dcc0b0c80 msgr2=0x7f1dcc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- 172.21.15.143:0/3697980384 shutdown_connections 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- 172.21.15.143:0/3697980384 wait complete. 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 Processor -- start 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- start start 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 0x7f1dcc0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dcc0ce420 0x7f1dcc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc153d90 con 0x7f1dcc0cd850 2023-11-24T06:31:28.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1533f0 con 0x7f1dcc0ae4a0 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dd17c1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1536d0 con 0x7f1dcc0ce420 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.738+0000 7f1dc27fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 0x7f1dcc0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 0x7f1dcc0aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57242/0 (socket says 172.21.15.143:57242) 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 -- 172.21.15.143:0/931036261 learned_addr learned my addr 172.21.15.143:0/931036261 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dcaffd640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dcb7fe640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dcc0ce420 0x7f1dcc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 -- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dcc0ce420 msgr2=0x7f1dcc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dcc0ce420 0x7f1dcc154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 -- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dcc0ae4a0 msgr2=0x7f1dcc1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc1541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 -- 172.21.15.143:0/931036261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009b30 con 0x7f1dcc0cd850 2023-11-24T06:31:28.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc27fc640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 0x7f1dcc0aee50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c400 tx=0x7f1db400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4003600 con 0x7f1dcc0cd850 2023-11-24T06:31:28.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4003760 con 0x7f1dcc0cd850 2023-11-24T06:31:28.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4003b10 con 0x7f1dcc0cd850 2023-11-24T06:31:28.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc1539b0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc1546f0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc153ed0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f1db4003c70 con 0x7f1dcc0cd850 2023-11-24T06:31:28.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc3fff640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dac0666b0 0x7f1dac068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:28.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.742+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1db40833f0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.746+0000 7f1dcaffd640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dac0666b0 0x7f1dac068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:28.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.746+0000 7f1dcaffd640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dac0666b0 0x7f1dac068b70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0ae000 tx=0x7f1dbc0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.750+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1dcc153ed0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.902+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1dcc153ed0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.902+0000 7f1dc3fff640 1 -- 172.21.15.143:0/931036261 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dcc153ed0 con 0x7f1dcc0cd850 2023-11-24T06:31:28.914 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:31:28.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dac0666b0 msgr2=0x7f1dac068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dac0666b0 0x7f1dac068b70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0ae000 tx=0x7f1dbc0a7070 comp rx=0 tx=0).stop 2023-11-24T06:31:28.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 msgr2=0x7f1dcc0aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:28.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 0x7f1dcc0aee50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c400 tx=0x7f1db400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 shutdown_connections 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1dac0666b0 0x7f1dac068b70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dcc0ce420 0x7f1dcc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1dcc0cd850 0x7f1dcc0aee50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 --2- 172.21.15.143:0/931036261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dcc0ae4a0 0x7f1dcc1541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 >> 172.21.15.143:0/931036261 conn(0x7f1dcc0b0c80 msgr2=0x7f1dcc15e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 shutdown_connections 2023-11-24T06:31:28.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:28.906+0000 7f1dd17c1640 1 -- 172.21.15.143:0/931036261 wait complete. 2023-11-24T06:31:28.930 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:31:29.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 Processor -- start 2023-11-24T06:31:29.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 -- start start 2023-11-24T06:31:29.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44e80cb4f0 0x7f44e80b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44e806c870 0x7f44e806cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80ce090 con 0x7f44e8072490 2023-11-24T06:31:29.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e80cb950 con 0x7f44e806c870 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44ec8e2640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e8159f50 con 0x7f44e80cb4f0 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44e759e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44e806c870 0x7f44e806cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44e759e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44e806c870 0x7f44e806cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57246/0 (socket says 172.21.15.143:57246) 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44e759e640 1 -- 172.21.15.143:0/957223977 learned_addr learned my addr 172.21.15.143:0/957223977 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.066+0000 7f44de59c640 1 --2- 172.21.15.143:0/957223977 >> v2:172.21.15.146:3300/0 conn(0x7f44e80cb4f0 0x7f44e80b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e759e640 1 -- 172.21.15.143:0/957223977 >> v2:172.21.15.146:3300/0 conn(0x7f44e80cb4f0 msgr2=0x7f44e80b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e759e640 1 --2- 172.21.15.143:0/957223977 >> v2:172.21.15.146:3300/0 conn(0x7f44e80cb4f0 0x7f44e80b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e759e640 1 -- 172.21.15.143:0/957223977 >> v1:172.21.15.146:6789/0 conn(0x7f44e8072490 legacy=0x7f44e80ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e759e640 1 -- 172.21.15.143:0/957223977 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e80cab60 con 0x7f44e806c870 2023-11-24T06:31:29.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e759e640 1 --2- 172.21.15.143:0/957223977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e806c870 0x7f44e806cc90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f44e80cef40 tx=0x7f44e001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d7742e7abf1fdd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e659c640 1 -- 172.21.15.143:0/957223977 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00af400 con 0x7f44e806c870 2023-11-24T06:31:29.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e659c640 1 -- 172.21.15.143:0/957223977 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e00ab050 con 0x7f44e806c870 2023-11-24T06:31:29.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44e659c640 1 -- 172.21.15.143:0/957223977 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00af780 con 0x7f44e806c870 2023-11-24T06:31:29.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44ec8e2640 1 -- 172.21.15.143:0/957223977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e806c870 msgr2=0x7f44e806cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.070+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/957223977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e806c870 0x7f44e806cc90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f44e80cef40 tx=0x7f44e001f1c0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- 172.21.15.143:0/957223977 shutdown_connections 2023-11-24T06:31:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/957223977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e806c870 0x7f44e806cc90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/957223977 >> v2:172.21.15.146:3300/0 conn(0x7f44e80cb4f0 0x7f44e80b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- 172.21.15.143:0/957223977 >> 172.21.15.143:0/957223977 conn(0x7f44e80cbb50 msgr2=0x7f44e80cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- 172.21.15.143:0/957223977 shutdown_connections 2023-11-24T06:31:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- 172.21.15.143:0/957223977 wait complete. 2023-11-24T06:31:29.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 Processor -- start 2023-11-24T06:31:29.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- start start 2023-11-24T06:31:29.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44e806c870 0x7f44e80b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e8072490 0x7f44e814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 0x7f44e814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b3d30 con 0x7f44e80cb4f0 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b4690 con 0x7f44e8072490 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44ec8e2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e814ea50 con 0x7f44e806c870 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 0x7f44e814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 0x7f44e814b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57252/0 (socket says 172.21.15.143:57252) 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 -- 172.21.15.143:0/2142851225 learned_addr learned my addr 172.21.15.143:0/2142851225 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 -- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44e806c870 msgr2=0x7f44e80b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e6d9d640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44e806c870 0x7f44e80b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44de59c640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e8072490 0x7f44e814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44e806c870 0x7f44e80b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 -- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e8072490 msgr2=0x7f44e814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e8072490 0x7f44e814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.074+0000 7f44e759e640 1 -- 172.21.15.143:0/2142851225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009b30 con 0x7f44e80cb4f0 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44de59c640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e8072490 0x7f44e814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44e6d9d640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44e806c870 0x7f44e80b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44e759e640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 0x7f44e814b1f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f44e001bdd0 tx=0x7f44e001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00c0070 con 0x7f44e80cb4f0 2023-11-24T06:31:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0009510 con 0x7f44e80cb4f0 2023-11-24T06:31:29.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e80b30b0 con 0x7f44e80cb4f0 2023-11-24T06:31:29.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00afda0 con 0x7f44e80cb4f0 2023-11-24T06:31:29.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e80b3670 con 0x7f44e80cb4f0 2023-11-24T06:31:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e80b3e70 con 0x7f44e80cb4f0 2023-11-24T06:31:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f44e00b6040 con 0x7f44e80cb4f0 2023-11-24T06:31:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44dffff640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44c80666b0 0x7f44c8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f44e0121ca0 con 0x7f44e80cb4f0 2023-11-24T06:31:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.078+0000 7f44e6d9d640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44c80666b0 0x7f44c8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.082+0000 7f44e6d9d640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44c80666b0 0x7f44c8068b70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f44d0000f70 tx=0x7f44d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.082+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44e80b3e70 con 0x7f44e80cb4f0 2023-11-24T06:31:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44e80b3e70 con 0x7f44e80cb4f0 2023-11-24T06:31:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44dffff640 1 -- 172.21.15.143:0/2142851225 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44e80b3e70 con 0x7f44e80cb4f0 2023-11-24T06:31:29.239 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:31:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44c80666b0 msgr2=0x7f44c8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44c80666b0 0x7f44c8068b70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f44d0000f70 tx=0x7f44d0009040 comp rx=0 tx=0).stop 2023-11-24T06:31:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 msgr2=0x7f44e814b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 0x7f44e814b1f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f44e001bdd0 tx=0x7f44e001bf60 comp rx=0 tx=0).stop 2023-11-24T06:31:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 shutdown_connections 2023-11-24T06:31:29.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44c80666b0 0x7f44c8068b70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44e80cb4f0 0x7f44e814b1f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e8072490 0x7f44e814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 --2- 172.21.15.143:0/2142851225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44e806c870 0x7f44e80b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 >> 172.21.15.143:0/2142851225 conn(0x7f44e80cbb50 msgr2=0x7f44e81596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:29.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 shutdown_connections 2023-11-24T06:31:29.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.234+0000 7f44ec8e2640 1 -- 172.21.15.143:0/2142851225 wait complete. 2023-11-24T06:31:29.261 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:31:29.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 Processor -- start 2023-11-24T06:31:29.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 -- start start 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d720 0x7f3c880d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c880cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8806d050 con 0x7f3c880b25c0 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880d2240 con 0x7f3c8815d720 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c8dc68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8806d4e0 con 0x7f3c880d3a50 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c877fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d720 0x7f3c880d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c877fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d720 0x7f3c880d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57256/0 (socket says 172.21.15.143:57256) 2023-11-24T06:31:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.402+0000 7f3c877fe640 1 -- 172.21.15.143:0/1582279063 learned_addr learned my addr 172.21.15.143:0/1582279063 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:29.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c87fff640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c880cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c877fe640 1 -- 172.21.15.143:0/1582279063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 msgr2=0x7f3c880cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:29.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c877fe640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c880cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c877fe640 1 -- 172.21.15.143:0/1582279063 >> v1:172.21.15.146:6789/0 conn(0x7f3c880b25c0 legacy=0x7f3c880d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:29.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c877fe640 1 -- 172.21.15.143:0/1582279063 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8806c720 con 0x7f3c8815d720 2023-11-24T06:31:29.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c87fff640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c880cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c877fe640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8815d720 0x7f3c880d1a10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098d0 tx=0x7f3c7801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2970c71cb0b67de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c867fc640 1 -- 172.21.15.143:0/1582279063 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780ab670 con 0x7f3c8815d720 2023-11-24T06:31:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c867fc640 1 -- 172.21.15.143:0/1582279063 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c780ab7d0 con 0x7f3c8815d720 2023-11-24T06:31:29.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.406+0000 7f3c867fc640 1 -- 172.21.15.143:0/1582279063 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780abb60 con 0x7f3c8815d720 2023-11-24T06:31:29.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- 172.21.15.143:0/1582279063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8815d720 msgr2=0x7f3c880d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8815d720 0x7f3c880d1a10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098d0 tx=0x7f3c7801c4b0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- 172.21.15.143:0/1582279063 shutdown_connections 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c880cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/1582279063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8815d720 0x7f3c880d1a10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- 172.21.15.143:0/1582279063 >> 172.21.15.143:0/1582279063 conn(0x7f3c8808af70 msgr2=0x7f3c8809c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- 172.21.15.143:0/1582279063 shutdown_connections 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- 172.21.15.143:0/1582279063 wait complete. 2023-11-24T06:31:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 Processor -- start 2023-11-24T06:31:29.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- start start 2023-11-24T06:31:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 0x7f3c88154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c8814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8815d720 0x7f3c881576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c881586a0 con 0x7f3c880b25c0 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88159ad0 con 0x7f3c8815d720 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c8dc68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88159510 con 0x7f3c880d3a50 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 0x7f3c88154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 0x7f3c88154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57268/0 (socket says 172.21.15.143:57268) 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 -- 172.21.15.143:0/468402903 learned_addr learned my addr 172.21.15.143:0/468402903 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c87fff640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8815d720 0x7f3c881576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c86ffd640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c8814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 -- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 msgr2=0x7f3c8814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c8814b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 -- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8815d720 msgr2=0x7f3c881576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8815d720 0x7f3c881576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 -- 172.21.15.143:0/468402903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780094d0 con 0x7f3c880b25c0 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.410+0000 7f3c877fe640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 0x7f3c88154150 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3c780ad040 tx=0x7f3c7801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780b4800 con 0x7f3c880b25c0 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c780b49a0 con 0x7f3c880b25c0 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780b4d50 con 0x7f3c880b25c0 2023-11-24T06:31:29.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c881597f0 con 0x7f3c880b25c0 2023-11-24T06:31:29.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c88154690 con 0x7f3c880b25c0 2023-11-24T06:31:29.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c88158500 con 0x7f3c880b25c0 2023-11-24T06:31:29.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f3c780c83a0 con 0x7f3c880b25c0 2023-11-24T06:31:29.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c6ffff640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3c740666b0 0x7f3c74068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f3c7811ef20 con 0x7f3c880b25c0 2023-11-24T06:31:29.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.414+0000 7f3c86ffd640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3c740666b0 0x7f3c74068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.418+0000 7f3c86ffd640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3c740666b0 0x7f3c74068b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3c881f9640 tx=0x7f3c7c007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.418+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c88158500 con 0x7f3c880b25c0 2023-11-24T06:31:29.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c88158500 con 0x7f3c880b25c0 2023-11-24T06:31:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c6ffff640 1 -- 172.21.15.143:0/468402903 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c88158500 con 0x7f3c880b25c0 2023-11-24T06:31:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:31:29.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3c740666b0 msgr2=0x7f3c74068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3c740666b0 0x7f3c74068b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3c881f9640 tx=0x7f3c7c007e40 comp rx=0 tx=0).stop 2023-11-24T06:31:29.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 msgr2=0x7f3c88154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 0x7f3c88154150 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3c780ad040 tx=0x7f3c7801acf0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 shutdown_connections 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3c740666b0 0x7f3c74068b70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8815d720 0x7f3c881576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c880d3a50 0x7f3c8814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 --2- 172.21.15.143:0/468402903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b25c0 0x7f3c88154150 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.582+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 >> 172.21.15.143:0/468402903 conn(0x7f3c8808af70 msgr2=0x7f3c880b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.586+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 shutdown_connections 2023-11-24T06:31:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.586+0000 7f3c8dc68640 1 -- 172.21.15.143:0/468402903 wait complete. 2023-11-24T06:31:29.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:31:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:29.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:29.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:31:29.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:29.642 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:31:29.696 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:29.696 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:29.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:31:29.705 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:29.705 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:29.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:31:29.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:29.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 Processor -- start 2023-11-24T06:31:29.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 -- start start 2023-11-24T06:31:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a840b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a8415dae0 0x7f1a8415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a841430a0 con 0x7f1a841423e0 2023-11-24T06:31:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a84140ac0 con 0x7f1a8415dae0 2023-11-24T06:31:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8c7f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840b3810 con 0x7f1a840b2e50 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8a591640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1a841423e0 0x7f1a841427c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56126/0 (socket says 172.21.15.143:56126) 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8ad92640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a8415dae0 0x7f1a8415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8a591640 1 -- 172.21.15.143:0/1365022874 learned_addr learned my addr 172.21.15.143:0/1365022874 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a89d90640 1 --2- 172.21.15.143:0/1365022874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a840b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8ad92640 1 -- 172.21.15.143:0/1365022874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 msgr2=0x7f1a840b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8ad92640 1 --2- 172.21.15.143:0/1365022874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a840b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8ad92640 1 -- 172.21.15.143:0/1365022874 >> v1:172.21.15.143:6789/0 conn(0x7f1a841423e0 legacy=0x7f1a841427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8ad92640 1 -- 172.21.15.143:0/1365022874 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84143380 con 0x7f1a8415dae0 2023-11-24T06:31:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.886+0000 7f1a8958f640 1 -- 172.21.15.143:0/1365022874 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083390460 0 0) 0x7f1a841430a0 con 0x7f1a841423e0 2023-11-24T06:31:29.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8ad92640 1 --2- 172.21.15.143:0/1365022874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8415dae0 0x7f1a8415df30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009d90 tx=0x7f1a7c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3ac682f096315e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8958f640 1 -- 172.21.15.143:0/1365022874 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0a5900 con 0x7f1a8415dae0 2023-11-24T06:31:29.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8958f640 1 -- 172.21.15.143:0/1365022874 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0a5a60 con 0x7f1a8415dae0 2023-11-24T06:31:29.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8958f640 1 -- 172.21.15.143:0/1365022874 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0a5df0 con 0x7f1a8415dae0 2023-11-24T06:31:29.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/1365022874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8415dae0 msgr2=0x7f1a8415df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/1365022874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8415dae0 0x7f1a8415df30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009d90 tx=0x7f1a7c01c950 comp rx=0 tx=0).stop 2023-11-24T06:31:29.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/1365022874 shutdown_connections 2023-11-24T06:31:29.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/1365022874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8415dae0 0x7f1a8415df30 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/1365022874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a840b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/1365022874 >> 172.21.15.143:0/1365022874 conn(0x7f1a84060fd0 msgr2=0x7f1a840613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:29.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/1365022874 shutdown_connections 2023-11-24T06:31:29.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.890+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/1365022874 wait complete. 2023-11-24T06:31:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 Processor -- start 2023-11-24T06:31:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- start start 2023-11-24T06:31:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a8413cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 0x7f1a84156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a8415dae0 0x7f1a840b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84156560 con 0x7f1a841423e0 2023-11-24T06:31:29.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840b51f0 con 0x7f1a8415dae0 2023-11-24T06:31:29.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840b54d0 con 0x7f1a840b2e50 2023-11-24T06:31:29.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 0x7f1a84156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 0x7f1a84156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57280/0 (socket says 172.21.15.143:57280) 2023-11-24T06:31:29.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 -- 172.21.15.143:0/3724453131 learned_addr learned my addr 172.21.15.143:0/3724453131 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:29.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8a591640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a8413cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8ad92640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a8415dae0 0x7f1a840b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 -- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 msgr2=0x7f1a8413cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a8413cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 -- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a8415dae0 msgr2=0x7f1a840b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a8415dae0 0x7f1a840b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 -- 172.21.15.143:0/3724453131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c009a70 con 0x7f1a841423e0 2023-11-24T06:31:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a89d90640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 0x7f1a84156020 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d800 tx=0x7f1a7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400b6c0 con 0x7f1a841423e0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400b820 con 0x7f1a841423e0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840b57b0 con 0x7f1a841423e0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400bb90 con 0x7f1a841423e0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840b5d70 con 0x7f1a841423e0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.894+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a840b5f30 con 0x7f1a841423e0 2023-11-24T06:31:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.898+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f1a7400bcf0 con 0x7f1a841423e0 2023-11-24T06:31:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.898+0000 7f1a7affd640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a680666b0 0x7f1a68068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.898+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f1a740847f0 con 0x7f1a841423e0 2023-11-24T06:31:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.898+0000 7f1a8a591640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a680666b0 0x7f1a68068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.898+0000 7f1a8a591640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a680666b0 0x7f1a68068b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1a80007fd0 tx=0x7f1a80007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:29.908 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:29.902+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a74051880 con 0x7f1a841423e0 2023-11-24T06:31:30.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.082+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a84067520 con 0x7f1a841423e0 2023-11-24T06:31:30.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.082+0000 7f1a7affd640 1 -- 172.21.15.143:0/3724453131 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f1a74054ea0 con 0x7f1a841423e0 2023-11-24T06:31:30.090 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:30.090 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:04.159303+0000","modified":"2023-11-24T06:31:07.177660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3877501822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3877501822},{"type":"v1","addr":"172.21.15.143:6837","nonce":3877501822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:31:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 26 2023-11-24T06:31:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a680666b0 msgr2=0x7f1a68068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a680666b0 0x7f1a68068b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1a80007fd0 tx=0x7f1a80007d60 comp rx=0 tx=0).stop 2023-11-24T06:31:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 msgr2=0x7f1a84156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 0x7f1a84156020 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d800 tx=0x7f1a7400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 shutdown_connections 2023-11-24T06:31:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a680666b0 0x7f1a68068b70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a8415dae0 0x7f1a840b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a841423e0 0x7f1a84156020 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 --2- 172.21.15.143:0/3724453131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a840b2e50 0x7f1a8413cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 >> 172.21.15.143:0/3724453131 conn(0x7f1a84060fd0 msgr2=0x7f1a840ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 shutdown_connections 2023-11-24T06:31:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.086+0000 7f1a8c7f5640 1 -- 172.21.15.143:0/3724453131 wait complete. 2023-11-24T06:31:30.110 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:30.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.242+0000 7f52a62a9640 1 Processor -- start 2023-11-24T06:31:30.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.242+0000 7f52a62a9640 1 -- start start 2023-11-24T06:31:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f52a62a9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52a015a320 0x7f52a00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f52a62a9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a0070da0 0x7f52a015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f52a62a9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a015a700 con 0x7f52a00b36c0 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f52a62a9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a00b2430 con 0x7f52a015a320 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f52a62a9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00b2620 con 0x7f52a0070da0 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52a015a320 0x7f52a00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f52a00b36c0 0x7f52a0070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56134/0 (socket says 172.21.15.143:56134) 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529f7fe640 1 -- 172.21.15.143:0/2806431713 learned_addr learned my addr 172.21.15.143:0/2806431713 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f52a4846640 1 --2- 172.21.15.143:0/2806431713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a0070da0 0x7f52a015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529ffff640 1 -- 172.21.15.143:0/2806431713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a0070da0 msgr2=0x7f52a015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529ffff640 1 --2- 172.21.15.143:0/2806431713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a0070da0 0x7f52a015ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529ffff640 1 -- 172.21.15.143:0/2806431713 >> v1:172.21.15.143:6789/0 conn(0x7f52a00b36c0 legacy=0x7f52a0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529ffff640 1 -- 172.21.15.143:0/2806431713 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00b2900 con 0x7f52a015a320 2023-11-24T06:31:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.246+0000 7f529effd640 1 -- 172.21.15.143:0/2806431713 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603440025 0 0) 0x7f52a015a700 con 0x7f52a00b36c0 2023-11-24T06:31:30.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f529ffff640 1 --2- 172.21.15.143:0/2806431713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a015a320 0x7f52a00b1ef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f52900097c0 tx=0x7f529001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b258a474e9d4f23 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f529effd640 1 -- 172.21.15.143:0/2806431713 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900ad660 con 0x7f52a015a320 2023-11-24T06:31:30.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f529effd640 1 -- 172.21.15.143:0/2806431713 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52900ad7c0 con 0x7f52a015a320 2023-11-24T06:31:30.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f529effd640 1 -- 172.21.15.143:0/2806431713 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900adb50 con 0x7f52a015a320 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 -- 172.21.15.143:0/2806431713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a015a320 msgr2=0x7f52a00b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 --2- 172.21.15.143:0/2806431713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a015a320 0x7f52a00b1ef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f52900097c0 tx=0x7f529001c450 comp rx=0 tx=0).stop 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 -- 172.21.15.143:0/2806431713 shutdown_connections 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 --2- 172.21.15.143:0/2806431713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a0070da0 0x7f52a015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 --2- 172.21.15.143:0/2806431713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a015a320 0x7f52a00b1ef0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 -- 172.21.15.143:0/2806431713 >> 172.21.15.143:0/2806431713 conn(0x7f52a00b0bf0 msgr2=0x7f52a00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 -- 172.21.15.143:0/2806431713 shutdown_connections 2023-11-24T06:31:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 -- 172.21.15.143:0/2806431713 wait complete. 2023-11-24T06:31:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 Processor -- start 2023-11-24T06:31:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.250+0000 7f52a62a9640 1 -- start start 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52a0070da0 0x7f52a0163570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 0x7f52a009adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a015a320 0x7f52a009b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a014c680 con 0x7f52a00b36c0 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a009a3d0 con 0x7f52a0070da0 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a009b9d0 con 0x7f52a015a320 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 0x7f52a009adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 0x7f52a009adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57304/0 (socket says 172.21.15.143:57304) 2023-11-24T06:31:30.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 -- 172.21.15.143:0/828164594 learned_addr learned my addr 172.21.15.143:0/828164594 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529ffff640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52a0070da0 0x7f52a0163570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 -- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a015a320 msgr2=0x7f52a009b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a4846640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a015a320 0x7f52a009b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a015a320 0x7f52a009b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 -- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52a0070da0 msgr2=0x7f52a0163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52a0070da0 0x7f52a0163570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 -- 172.21.15.143:0/828164594 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290009420 con 0x7f52a00b36c0 2023-11-24T06:31:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529ffff640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52a0070da0 0x7f52a0163570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a4846640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a015a320 0x7f52a009b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529f7fe640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 0x7f52a009adc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f529400c520 tx=0x7f529400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940074e0 con 0x7f52a00b36c0 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294007640 con 0x7f52a00b36c0 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940049f0 con 0x7f52a00b36c0 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a0099aa0 con 0x7f52a00b36c0 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a009a060 con 0x7f52a00b36c0 2023-11-24T06:31:30.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a0067520 con 0x7f52a00b36c0 2023-11-24T06:31:30.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.254+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f5294004b50 con 0x7f52a00b36c0 2023-11-24T06:31:30.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.258+0000 7f529cff9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f528c0666b0 0x7f528c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.258+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f5294083570 con 0x7f52a00b36c0 2023-11-24T06:31:30.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.258+0000 7f529ffff640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f528c0666b0 0x7f528c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.258+0000 7f529ffff640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f528c0666b0 0x7f528c068b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f52900af000 tx=0x7f5290008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.262+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5294050630 con 0x7f52a00b36c0 2023-11-24T06:31:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.414+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52a006f000 con 0x7f52a00b36c0 2023-11-24T06:31:30.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f529cff9640 1 -- 172.21.15.143:0/828164594 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16761 (secure 0 0 0) 0x7f5294053c50 con 0x7f52a00b36c0 2023-11-24T06:31:30.423 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:30.423 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":47,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:29.271922+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f528c0666b0 msgr2=0x7f528c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f528c0666b0 0x7f528c068b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f52900af000 tx=0x7f5290008040 comp rx=0 tx=0).stop 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 msgr2=0x7f52a009adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 0x7f52a009adc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f529400c520 tx=0x7f529400c9e0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 shutdown_connections 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f528c0666b0 0x7f528c068b70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52a015a320 0x7f52a009b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52a00b36c0 0x7f52a009adc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 --2- 172.21.15.143:0/828164594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52a0070da0 0x7f52a0163570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 >> 172.21.15.143:0/828164594 conn(0x7f52a00b0bf0 msgr2=0x7f52a00aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 shutdown_connections 2023-11-24T06:31:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.418+0000 7f52a62a9640 1 -- 172.21.15.143:0/828164594 wait complete. 2023-11-24T06:31:30.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:31:01.856093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:31:03.157713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 47, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:31:30.444 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:31:30.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.578+0000 7f79f9faa640 1 Processor -- start 2023-11-24T06:31:30.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.578+0000 7f79f9faa640 1 -- start start 2023-11-24T06:31:30.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.578+0000 7f79f9faa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79f40ccef0 0x7f79f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.578+0000 7f79f9faa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f415a050 con 0x7f79f40ce2e0 2023-11-24T06:31:30.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.578+0000 7f79f9faa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40722e0 con 0x7f79f40b1f80 2023-11-24T06:31:30.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.578+0000 7f79f9faa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f4072860 con 0x7f79f40ccef0 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f3fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f79f40ce2e0 0x7f79f4163730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56136/0 (socket says 172.21.15.143:56136) 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f3fff640 1 -- 172.21.15.143:0/3427476949 learned_addr learned my addr 172.21.15.143:0/3427476949 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f37fe640 1 --2- 172.21.15.143:0/3427476949 >> v2:172.21.15.146:3300/0 conn(0x7f79f40ccef0 0x7f79f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f27fc640 1 -- 172.21.15.143:0/3427476949 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305494070 0 0) 0x7f79f415a050 con 0x7f79f40ce2e0 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f27fc640 1 -- 172.21.15.143:0/3427476949 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc003530 con 0x7f79f40ce2e0 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f37fe640 1 -- 172.21.15.143:0/3427476949 >> v1:172.21.15.146:6789/0 conn(0x7f79f40b1f80 legacy=0x7f79f406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f37fe640 1 -- 172.21.15.143:0/3427476949 >> v1:172.21.15.143:6789/0 conn(0x7f79f40ce2e0 legacy=0x7f79f4163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f37fe640 1 -- 172.21.15.143:0/3427476949 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40705e0 con 0x7f79f40ccef0 2023-11-24T06:31:30.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.582+0000 7f79f37fe640 1 --2- 172.21.15.143:0/3427476949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40ccef0 0x7f79f406d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f79e40097c0 tx=0x7f79e401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0a9297f8137e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f27fc640 1 -- 172.21.15.143:0/3427476949 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e40ab650 con 0x7f79f40ccef0 2023-11-24T06:31:30.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f27fc640 1 -- 172.21.15.143:0/3427476949 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e40ab7b0 con 0x7f79f40ccef0 2023-11-24T06:31:30.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f27fc640 1 -- 172.21.15.143:0/3427476949 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e40abb40 con 0x7f79f40ccef0 2023-11-24T06:31:30.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- 172.21.15.143:0/3427476949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40ccef0 msgr2=0x7f79f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 --2- 172.21.15.143:0/3427476949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40ccef0 0x7f79f406d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f79e40097c0 tx=0x7f79e401c450 comp rx=0 tx=0).stop 2023-11-24T06:31:30.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- 172.21.15.143:0/3427476949 shutdown_connections 2023-11-24T06:31:30.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 --2- 172.21.15.143:0/3427476949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40ccef0 0x7f79f406d330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- 172.21.15.143:0/3427476949 >> 172.21.15.143:0/3427476949 conn(0x7f79f40b0c80 msgr2=0x7f79f40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:30.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- 172.21.15.143:0/3427476949 shutdown_connections 2023-11-24T06:31:30.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- 172.21.15.143:0/3427476949 wait complete. 2023-11-24T06:31:30.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 Processor -- start 2023-11-24T06:31:30.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- start start 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40b1f80 0x7f79f4144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 0x7f79f41f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79f40ce2e0 0x7f79f414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41454f0 con 0x7f79f40ccef0 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4145ab0 con 0x7f79f40b1f80 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f9faa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41452a0 con 0x7f79f40ce2e0 2023-11-24T06:31:30.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 0x7f79f41f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 0x7f79f41f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57310/0 (socket says 172.21.15.143:57310) 2023-11-24T06:31:30.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.586+0000 7f79f2ffd640 1 -- 172.21.15.143:0/2892845044 learned_addr learned my addr 172.21.15.143:0/2892845044 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f37fe640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40b1f80 0x7f79f4144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f3fff640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79f40ce2e0 0x7f79f414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f2ffd640 1 -- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79f40ce2e0 msgr2=0x7f79f414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f2ffd640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79f40ce2e0 0x7f79f414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f2ffd640 1 -- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40b1f80 msgr2=0x7f79f4144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f2ffd640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40b1f80 0x7f79f4144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f2ffd640 1 -- 172.21.15.143:0/2892845044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009420 con 0x7f79f40ccef0 2023-11-24T06:31:30.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f37fe640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40b1f80 0x7f79f4144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:30.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f3fff640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79f40ce2e0 0x7f79f414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:30.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f2ffd640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 0x7f79f41f7220 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f79e800c4d0 tx=0x7f79e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80052d0 con 0x7f79f40ccef0 2023-11-24T06:31:30.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8005430 con 0x7f79f40ccef0 2023-11-24T06:31:30.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8012830 con 0x7f79f40ccef0 2023-11-24T06:31:30.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f41f7c30 con 0x7f79f40ccef0 2023-11-24T06:31:30.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f4145740 con 0x7f79f40ccef0 2023-11-24T06:31:30.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f41f8150 con 0x7f79f40ccef0 2023-11-24T06:31:30.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f79e8012990 con 0x7f79f40ccef0 2023-11-24T06:31:30.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.590+0000 7f79dbfff640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f79e00666b0 0x7f79e0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.594+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f79e8083e40 con 0x7f79f40ccef0 2023-11-24T06:31:30.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.594+0000 7f79f37fe640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f79e00666b0 0x7f79e0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.594+0000 7f79f37fe640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f79e00666b0 0x7f79e0068b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f79e40af000 tx=0x7f79e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.594+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79e8050ef0 con 0x7f79f40ccef0 2023-11-24T06:31:30.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79f404e8c0 con 0x7f79f40ccef0 2023-11-24T06:31:30.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79dbfff640 1 -- 172.21.15.143:0/2892845044 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79e8054510 con 0x7f79f40ccef0 2023-11-24T06:31:30.751 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f79e00666b0 msgr2=0x7f79e0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f79e00666b0 0x7f79e0068b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f79e40af000 tx=0x7f79e4008040 comp rx=0 tx=0).stop 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 msgr2=0x7f79f41f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 0x7f79f41f7220 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f79e800c4d0 tx=0x7f79e800c990 comp rx=0 tx=0).stop 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 shutdown_connections 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f79e00666b0 0x7f79e0068b70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79f40ce2e0 0x7f79f414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79f40ccef0 0x7f79f41f7220 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 --2- 172.21.15.143:0/2892845044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f40b1f80 0x7f79f4144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 >> 172.21.15.143:0/2892845044 conn(0x7f79f40b0c80 msgr2=0x7f79f4150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:30.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 shutdown_connections 2023-11-24T06:31:30.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.746+0000 7f79f9faa640 1 -- 172.21.15.143:0/2892845044 wait complete. 2023-11-24T06:31:30.772 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:31:30.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42f4f2a640 1 Processor -- start 2023-11-24T06:31:30.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42f4f2a640 1 -- start start 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42f4f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f42f00ae4a0 0x7f42f015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42f4f2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00b3510 con 0x7f42f00cd850 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42f4f2a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00b37f0 con 0x7f42f00ce420 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42f4f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f00b3ad0 con 0x7f42f00ae4a0 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42ee59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f42f00ae4a0 0x7f42f015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42e5d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f42f00cd850 0x7f42f00cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56140/0 (socket says 172.21.15.143:56140) 2023-11-24T06:31:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42e5d9b640 1 -- 172.21.15.143:0/262913321 learned_addr learned my addr 172.21.15.143:0/262913321 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:30.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42ee59c640 1 -- 172.21.15.143:0/262913321 >> v1:172.21.15.146:6789/0 conn(0x7f42f00ce420 legacy=0x7f42f006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42ee59c640 1 -- 172.21.15.143:0/262913321 >> v1:172.21.15.143:6789/0 conn(0x7f42f00cd850 legacy=0x7f42f00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42ee59c640 1 -- 172.21.15.143:0/262913321 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00b3db0 con 0x7f42f00ae4a0 2023-11-24T06:31:30.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.910+0000 7f42edd9b640 1 -- 172.21.15.143:0/262913321 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418617221 0 0) 0x7f42f00b3510 con 0x7f42f00cd850 2023-11-24T06:31:30.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42ee59c640 1 --2- 172.21.15.143:0/262913321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ae4a0 0x7f42f015ba00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f42e00097c0 tx=0x7f42e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e69c9ee2d01008 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42edd9b640 1 -- 172.21.15.143:0/262913321 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00ab670 con 0x7f42f00ae4a0 2023-11-24T06:31:30.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42edd9b640 1 -- 172.21.15.143:0/262913321 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00ab7d0 con 0x7f42f00ae4a0 2023-11-24T06:31:30.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42edd9b640 1 -- 172.21.15.143:0/262913321 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00abb60 con 0x7f42f00ae4a0 2023-11-24T06:31:30.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 -- 172.21.15.143:0/262913321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ae4a0 msgr2=0x7f42f015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/262913321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ae4a0 0x7f42f015ba00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f42e00097c0 tx=0x7f42e001c450 comp rx=0 tx=0).stop 2023-11-24T06:31:30.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 -- 172.21.15.143:0/262913321 shutdown_connections 2023-11-24T06:31:30.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/262913321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ae4a0 0x7f42f015ba00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 -- 172.21.15.143:0/262913321 >> 172.21.15.143:0/262913321 conn(0x7f42f00b0c80 msgr2=0x7f42f00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:30.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 -- 172.21.15.143:0/262913321 shutdown_connections 2023-11-24T06:31:30.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.914+0000 7f42f4f2a640 1 -- 172.21.15.143:0/262913321 wait complete. 2023-11-24T06:31:30.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 Processor -- start 2023-11-24T06:31:30.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- start start 2023-11-24T06:31:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f00ae4a0 0x7f42f0145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f00cd850 0x7f42f00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 0x7f42f014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01468f0 con 0x7f42f00ce420 2023-11-24T06:31:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0072630 con 0x7f42f00ae4a0 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0071e20 con 0x7f42f00cd850 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 0x7f42f014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 0x7f42f014e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57324/0 (socket says 172.21.15.143:57324) 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 -- 172.21.15.143:0/1863942524 learned_addr learned my addr 172.21.15.143:0/1863942524 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42ee59c640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f00ae4a0 0x7f42f0145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42e5d9b640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f00cd850 0x7f42f00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 -- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f00cd850 msgr2=0x7f42f00cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f00cd850 0x7f42f00cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 -- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f00ae4a0 msgr2=0x7f42f0145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:30.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f00ae4a0 0x7f42f0145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:30.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 -- 172.21.15.143:0/1863942524 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0009420 con 0x7f42f00ce420 2023-11-24T06:31:30.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42eed9d640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 0x7f42f014e7f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c760 tx=0x7f42e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8003b80 con 0x7f42f00ce420 2023-11-24T06:31:30.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8003ce0 con 0x7f42f00ce420 2023-11-24T06:31:30.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800aa30 con 0x7f42f00ce420 2023-11-24T06:31:30.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f0070780 con 0x7f42f00ce420 2023-11-24T06:31:30.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f0072350 con 0x7f42f00ce420 2023-11-24T06:31:30.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.918+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f00705e0 con 0x7f42f00ce420 2023-11-24T06:31:30.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.922+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f42e800ab90 con 0x7f42f00ce420 2023-11-24T06:31:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.922+0000 7f42e77fe640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f42d00666b0 0x7f42d0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.922+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f42e8083ff0 con 0x7f42f00ce420 2023-11-24T06:31:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.922+0000 7f42ee59c640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f42d00666b0 0x7f42d0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:30.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.922+0000 7f42ee59c640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f42d00666b0 0x7f42d0068b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f42e00af000 tx=0x7f42e00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:30.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:30.926+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42f00705e0 con 0x7f42f00ce420 2023-11-24T06:31:31.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.074+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42f00705e0 con 0x7f42f00ce420 2023-11-24T06:31:31.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.074+0000 7f42e77fe640 1 -- 172.21.15.143:0/1863942524 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42f00705e0 con 0x7f42f00ce420 2023-11-24T06:31:31.081 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:31:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f42d00666b0 msgr2=0x7f42d0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f42d00666b0 0x7f42d0068b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f42e00af000 tx=0x7f42e00a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 msgr2=0x7f42f014e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 0x7f42f014e7f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c760 tx=0x7f42e800cc20 comp rx=0 tx=0).stop 2023-11-24T06:31:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 shutdown_connections 2023-11-24T06:31:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f42d00666b0 0x7f42d0068b70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42f00ce420 0x7f42f014e7f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f00cd850 0x7f42f00cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 --2- 172.21.15.143:0/1863942524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f00ae4a0 0x7f42f0145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 >> 172.21.15.143:0/1863942524 conn(0x7f42f00b0c80 msgr2=0x7f42f00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 shutdown_connections 2023-11-24T06:31:31.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.078+0000 7f42f4f2a640 1 -- 172.21.15.143:0/1863942524 wait complete. 2023-11-24T06:31:31.102 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:31:31.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f99542fe640 1 Processor -- start 2023-11-24T06:31:31.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f99542fe640 1 -- start start 2023-11-24T06:31:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f99542fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f994c0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f99542fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c070f00 con 0x7f994c15a290 2023-11-24T06:31:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f99542fe640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c071170 con 0x7f994c15ec60 2023-11-24T06:31:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f99542fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0cb690 con 0x7f994c0b1f80 2023-11-24T06:31:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f995209a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f994c15a290 0x7f994c0707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56144/0 (socket says 172.21.15.143:56144) 2023-11-24T06:31:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.238+0000 7f995209a640 1 -- 172.21.15.143:0/3210331044 learned_addr learned my addr 172.21.15.143:0/3210331044 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995289b640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f994c0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958380964 0 0) 0x7f994c070f00 con 0x7f994c15a290 2023-11-24T06:31:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9938003530 con 0x7f994c15a290 2023-11-24T06:31:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542472560 0 0) 0x7f994c071170 con 0x7f994c15ec60 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f994c070f00 con 0x7f994c15ec60 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2960420534 0 0) 0x7f9938003530 con 0x7f994c15a290 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 msgr2=0x7f994c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f994c0b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 >> v1:172.21.15.146:6789/0 conn(0x7f994c15ec60 legacy=0x7f994c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0cb970 con 0x7f994c15a290 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f99480016a0 con 0x7f994c15a290 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995289b640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f994c0b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 >> v1:172.21.15.143:6789/0 conn(0x7f994c15a290 legacy=0x7f994c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9938003b40 0x7f9938003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99380047d0 0x7f9938004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f9938005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0cb690 con 0x7f9938003b40 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993800baa0 con 0x7f99380047d0 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993800bc60 con 0x7f994c0b1f80 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995209a640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9938003b40 0x7f9938003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995289b640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f9938005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f9951899640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99380047d0 0x7f9938004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995209a640 1 -- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 msgr2=0x7f9938005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995209a640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c0b1f80 0x7f9938005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995209a640 1 -- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99380047d0 msgr2=0x7f9938004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995209a640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99380047d0 0x7f9938004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.242+0000 7f995209a640 1 -- 172.21.15.143:0/3210331044 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944009a70 con 0x7f9938003b40 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f995209a640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9938003b40 0x7f9938003f40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9948001ec0 tx=0x7f994801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b275f7edf3fb390b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480058e0 con 0x7f9938003b40 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948005a60 con 0x7f9938003b40 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f9951098640 1 -- 172.21.15.143:0/3210331044 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948005e10 con 0x7f9938003b40 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- 172.21.15.143:0/3210331044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9938003b40 msgr2=0x7f9938003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 --2- 172.21.15.143:0/3210331044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9938003b40 0x7f9938003f40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9948001ec0 tx=0x7f994801cb50 comp rx=0 tx=0).stop 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f995289b640 1 -- 172.21.15.143:0/3210331044 reap_dead start 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- 172.21.15.143:0/3210331044 shutdown_connections 2023-11-24T06:31:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- 172.21.15.143:0/3210331044 >> 172.21.15.143:0/3210331044 conn(0x7f994c0b0c80 msgr2=0x7f994c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- 172.21.15.143:0/3210331044 shutdown_connections 2023-11-24T06:31:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- 172.21.15.143:0/3210331044 wait complete. 2023-11-24T06:31:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 Processor -- start 2023-11-24T06:31:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- start start 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9938003b40 0x7f994c14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c14f030 0x7f994c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 0x7f994c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1512b0 con 0x7f994c14f4b0 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c14fa20 con 0x7f9938003b40 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.246+0000 7f99542fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c14fd00 con 0x7f994c14f030 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 0x7f994c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 0x7f994c0b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57332/0 (socket says 172.21.15.143:57332) 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 -- 172.21.15.143:0/3789561825 learned_addr learned my addr 172.21.15.143:0/3789561825 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f9951899640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c14f030 0x7f994c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995209a640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9938003b40 0x7f994c14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 -- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c14f030 msgr2=0x7f994c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c14f030 0x7f994c0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 -- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9938003b40 msgr2=0x7f994c14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9938003b40 0x7f994c14e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 -- 172.21.15.143:0/3789561825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c14ffe0 con 0x7f994c14f4b0 2023-11-24T06:31:31.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f995289b640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 0x7f994c0b3ac0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f994c06bd70 tx=0x7f994400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994401c070 con 0x7f994c14f4b0 2023-11-24T06:31:31.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994400f040 con 0x7f994c14f4b0 2023-11-24T06:31:31.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400e040 con 0x7f994c14f4b0 2023-11-24T06:31:31.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c14edd0 con 0x7f994c14f4b0 2023-11-24T06:31:31.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c150750 con 0x7f994c14f4b0 2023-11-24T06:31:31.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c04e8c0 con 0x7f994c14f4b0 2023-11-24T06:31:31.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.250+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f9944015430 con 0x7f994c14f4b0 2023-11-24T06:31:31.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.254+0000 7f9942ffd640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f99300666e0 0x7f9930068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.254+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9944084750 con 0x7f994c14f4b0 2023-11-24T06:31:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.254+0000 7f995209a640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f99300666e0 0x7f9930068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.254+0000 7f995209a640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f99300666e0 0x7f9930068ba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f99480aa000 tx=0x7f9948001a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.258+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99440516d0 con 0x7f994c14f4b0 2023-11-24T06:31:31.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.406+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f994c071f60 con 0x7f994c14f4b0 2023-11-24T06:31:31.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.406+0000 7f9942ffd640 1 -- 172.21.15.143:0/3789561825 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9944054cf0 con 0x7f994c14f4b0 2023-11-24T06:31:31.412 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:31:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f99300666e0 msgr2=0x7f9930068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f99300666e0 0x7f9930068ba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f99480aa000 tx=0x7f9948001a20 comp rx=0 tx=0).stop 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 msgr2=0x7f994c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 0x7f994c0b3ac0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f994c06bd70 tx=0x7f994400f580 comp rx=0 tx=0).stop 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 shutdown_connections 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f99300666e0 0x7f9930068ba0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f994c14f4b0 0x7f994c0b3ac0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c14f030 0x7f994c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 --2- 172.21.15.143:0/3789561825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9938003b40 0x7f994c14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 >> 172.21.15.143:0/3789561825 conn(0x7f994c0b0c80 msgr2=0x7f994c073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 shutdown_connections 2023-11-24T06:31:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.410+0000 7f99542fe640 1 -- 172.21.15.143:0/3789561825 wait complete. 2023-11-24T06:31:31.433 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.566+0000 7efe70c54640 1 Processor -- start 2023-11-24T06:31:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.566+0000 7efe70c54640 1 -- start start 2023-11-24T06:31:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.566+0000 7efe70c54640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe6c15d4f0 0x7efe6c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe70c54640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c06af20 con 0x7efe6c0ce710 2023-11-24T06:31:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe70c54640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c06b200 con 0x7efe6c0715b0 2023-11-24T06:31:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe70c54640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c06bba0 con 0x7efe6c15d4f0 2023-11-24T06:31:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe61d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efe6c0ce710 0x7efe6c070ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56156/0 (socket says 172.21.15.143:56156) 2023-11-24T06:31:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe61d9b640 1 -- 172.21.15.143:0/2497331431 learned_addr learned my addr 172.21.15.143:0/2497331431 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 --2- 172.21.15.143:0/2497331431 >> v2:172.21.15.146:3300/0 conn(0x7efe6c15d4f0 0x7efe6c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169277184 0 0) 0x7efe6c06af20 con 0x7efe6c0ce710 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe58003530 con 0x7efe6c0ce710 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 345016147 0 0) 0x7efe58003530 con 0x7efe6c0ce710 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 >> v2:172.21.15.146:3300/0 conn(0x7efe6c15d4f0 msgr2=0x7efe6c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 --2- 172.21.15.143:0/2497331431 >> v2:172.21.15.146:3300/0 conn(0x7efe6c15d4f0 0x7efe6c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 >> v1:172.21.15.146:6789/0 conn(0x7efe6c0715b0 legacy=0x7efe6c167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c06b4e0 con 0x7efe6c0ce710 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7efe54001680 con 0x7efe6c0ce710 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 --2- 172.21.15.143:0/2497331431 >> v2:172.21.15.146:3300/0 conn(0x7efe6c15d4f0 0x7efe6c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 >> v1:172.21.15.143:6789/0 conn(0x7efe6c0ce710 legacy=0x7efe6c070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe580047d0 0x7efe58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe58005190 0x7efe5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c06bba0 con 0x7efe58003980 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5800c030 con 0x7efe580047d0 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5800c1f0 con 0x7efe58005190 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe61d9b640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe580047d0 0x7efe58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6ad9d640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe58005190 0x7efe5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 -- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe58005190 msgr2=0x7efe5800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe58005190 0x7efe5800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 -- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe580047d0 msgr2=0x7efe58004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe580047d0 0x7efe58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6a59c640 1 -- 172.21.15.143:0/2497331431 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58003530 con 0x7efe58003980 2023-11-24T06:31:31.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.570+0000 7efe6ad9d640 1 -- 172.21.15.143:0/2497331431 reap_dead start 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe6a59c640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe58003da0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009cb0 tx=0x7efe5c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb129b2a98caa883 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0a5680 con 0x7efe58003980 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c0a57e0 con 0x7efe58003980 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe69d9b640 1 -- 172.21.15.143:0/2497331431 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0a5bd0 con 0x7efe58003980 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 -- 172.21.15.143:0/2497331431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 msgr2=0x7efe58003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe58003da0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009cb0 tx=0x7efe5c01cbc0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 -- 172.21.15.143:0/2497331431 shutdown_connections 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 --2- 172.21.15.143:0/2497331431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe58003da0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 -- 172.21.15.143:0/2497331431 >> 172.21.15.143:0/2497331431 conn(0x7efe6c0cc330 msgr2=0x7efe6c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 -- 172.21.15.143:0/2497331431 shutdown_connections 2023-11-24T06:31:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 -- 172.21.15.143:0/2497331431 wait complete. 2023-11-24T06:31:31.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 Processor -- start 2023-11-24T06:31:31.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.574+0000 7efe70c54640 1 -- start start 2023-11-24T06:31:31.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe6c13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe6c13bba0 0x7efe6c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe6c15e350 0x7efe6c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c15e7d0 con 0x7efe58003980 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c13ebc0 con 0x7efe6c15e350 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c158900 con 0x7efe6c13bba0 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe6c13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe6c13e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57348/0 (socket says 172.21.15.143:57348) 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 -- 172.21.15.143:0/4278829327 learned_addr learned my addr 172.21.15.143:0/4278829327 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6ad9d640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe6c15e350 0x7efe6c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe61d9b640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe6c13bba0 0x7efe6c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 -- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe6c13bba0 msgr2=0x7efe6c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe6c13bba0 0x7efe6c15de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 -- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe6c15e350 msgr2=0x7efe6c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe6c15e350 0x7efe6c156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 -- 172.21.15.143:0/4278829327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c158be0 con 0x7efe58003980 2023-11-24T06:31:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe6a59c640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe6c13e680 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009cb0 tx=0x7efe5c019960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0b8450 con 0x7efe58003980 2023-11-24T06:31:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c0b85d0 con 0x7efe58003980 2023-11-24T06:31:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0b8980 con 0x7efe58003980 2023-11-24T06:31:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c158ec0 con 0x7efe58003980 2023-11-24T06:31:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c159480 con 0x7efe58003980 2023-11-24T06:31:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c067520 con 0x7efe58003980 2023-11-24T06:31:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.578+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7efe5c0b4070 con 0x7efe58003980 2023-11-24T06:31:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.582+0000 7efe637fe640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe4c0666b0 0x7efe4c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.582+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7efe5c11e6a0 con 0x7efe58003980 2023-11-24T06:31:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.582+0000 7efe61d9b640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe4c0666b0 0x7efe4c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.582+0000 7efe61d9b640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe4c0666b0 0x7efe4c068b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efe54001ca0 tx=0x7efe54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.586+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe5c0eb740 con 0x7efe58003980 2023-11-24T06:31:31.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.762+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe6c04e8c0 con 0x7efe58003980 2023-11-24T06:31:31.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.762+0000 7efe637fe640 1 -- 172.21.15.143:0/4278829327 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7efe5c0eed60 con 0x7efe58003980 2023-11-24T06:31:31.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:31.769 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:04.159303+0000","modified":"2023-11-24T06:31:07.177660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3877501822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3877501822},{"type":"v1","addr":"172.21.15.143:6837","nonce":3877501822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:31:31.769 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 26 2023-11-24T06:31:31.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe4c0666b0 msgr2=0x7efe4c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe4c0666b0 0x7efe4c068b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efe54001ca0 tx=0x7efe54009040 comp rx=0 tx=0).stop 2023-11-24T06:31:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 msgr2=0x7efe6c13e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe6c13e680 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009cb0 tx=0x7efe5c019960 comp rx=0 tx=0).stop 2023-11-24T06:31:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 shutdown_connections 2023-11-24T06:31:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe4c0666b0 0x7efe4c068b70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe6c15e350 0x7efe6c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe6c13bba0 0x7efe6c15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 --2- 172.21.15.143:0/4278829327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe58003980 0x7efe6c13e680 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 >> 172.21.15.143:0/4278829327 conn(0x7efe6c0cc330 msgr2=0x7efe6c06e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:31.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 shutdown_connections 2023-11-24T06:31:31.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.766+0000 7efe70c54640 1 -- 172.21.15.143:0/4278829327 wait complete. 2023-11-24T06:31:31.789 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:31.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 Processor -- start 2023-11-24T06:31:31.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 -- start start 2023-11-24T06:31:31.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5fc160be0 0x7fe5fc15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc15e680 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc06c650 con 0x7fe5fc160be0 2023-11-24T06:31:31.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe602fd1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b4180 con 0x7fe5fc15e250 2023-11-24T06:31:31.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5fc160be0 0x7fe5fc15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5fc160be0 0x7fe5fc15ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57354/0 (socket says 172.21.15.143:57354) 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 -- 172.21.15.143:0/3945951420 learned_addr learned my addr 172.21.15.143:0/3945951420 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 -- 172.21.15.143:0/3945951420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 msgr2=0x7fe5fc0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe60156e640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 -- 172.21.15.143:0/3945951420 >> v1:172.21.15.146:6789/0 conn(0x7fe5fc0b37b0 legacy=0x7fe5fc15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe600d6d640 1 -- 172.21.15.143:0/3945951420 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc15e900 con 0x7fe5fc160be0 2023-11-24T06:31:31.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.922+0000 7fe60156e640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:31.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe600d6d640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15ed00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009870 tx=0x7fe5f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c63458421465b94 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe5f37fe640 1 -- 172.21.15.143:0/3945951420 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80aa5f0 con 0x7fe5fc160be0 2023-11-24T06:31:31.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe5f37fe640 1 -- 172.21.15.143:0/3945951420 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80aa750 con 0x7fe5fc160be0 2023-11-24T06:31:31.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe5f37fe640 1 -- 172.21.15.143:0/3945951420 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80aaae0 con 0x7fe5fc160be0 2023-11-24T06:31:31.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 -- 172.21.15.143:0/3945951420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc160be0 msgr2=0x7fe5fc15ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15ed00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009870 tx=0x7fe5f801c4d0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 -- 172.21.15.143:0/3945951420 shutdown_connections 2023-11-24T06:31:31.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3945951420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15ed00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 -- 172.21.15.143:0/3945951420 >> 172.21.15.143:0/3945951420 conn(0x7fe5fc0b0bf0 msgr2=0x7fe5fc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:31.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 -- 172.21.15.143:0/3945951420 shutdown_connections 2023-11-24T06:31:31.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.926+0000 7fe602fd1640 1 -- 172.21.15.143:0/3945951420 wait complete. 2023-11-24T06:31:31.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 Processor -- start 2023-11-24T06:31:31.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 -- start start 2023-11-24T06:31:31.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 0x7fe5fc153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc154b80 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc154e60 con 0x7fe5fc160be0 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc155140 con 0x7fe5fc15e250 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 0x7fe5fc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 0x7fe5fc153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57356/0 (socket says 172.21.15.143:57356) 2023-11-24T06:31:31.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 -- 172.21.15.143:0/3262018346 learned_addr learned my addr 172.21.15.143:0/3262018346 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:31.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe5f3fff640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe60156e640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 -- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 msgr2=0x7fe5fc1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 -- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5fc160be0 msgr2=0x7fe5fc15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:31.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:31.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 -- 172.21.15.143:0/3262018346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80094d0 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe5f3fff640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe600d6d640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 0x7fe5fc153610 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe5f801ab80 tx=0x7fe5f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80b3800 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80b3980 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc155420 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80b3d30 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.930+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc09c450 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.934+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc067520 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.934+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fe5f80c6390 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.934+0000 7fe5f17fa640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe5e80666b0 0x7fe5e8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:31.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.934+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fe5f80a7070 con 0x7fe5fc0b37b0 2023-11-24T06:31:31.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.934+0000 7fe5f3fff640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe5e80666b0 0x7fe5e8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:31.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.934+0000 7fe5f3fff640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe5e80666b0 0x7fe5e8068b70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0706b0 tx=0x7fe5ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:31.944 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:31.938+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5f80ebe70 con 0x7fe5fc0b37b0 2023-11-24T06:31:32.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.090+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc154cc0 con 0x7fe5fc0b37b0 2023-11-24T06:31:32.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.090+0000 7fe5f17fa640 1 -- 172.21.15.143:0/3262018346 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16761 (secure 0 0 0) 0x7fe5fc154cc0 con 0x7fe5fc0b37b0 2023-11-24T06:31:32.096 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:32.097 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":47,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:29.271922+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:32.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe5e80666b0 msgr2=0x7fe5e8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe5e80666b0 0x7fe5e8068b70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0706b0 tx=0x7fe5ec009040 comp rx=0 tx=0).stop 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 msgr2=0x7fe5fc153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 0x7fe5fc153610 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe5f801ab80 tx=0x7fe5f801ad10 comp rx=0 tx=0).stop 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 shutdown_connections 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe5e80666b0 0x7fe5e8068b70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5fc160be0 0x7fe5fc15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5fc15e250 0x7fe5fc1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 --2- 172.21.15.143:0/3262018346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5fc0b37b0 0x7fe5fc153610 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 >> 172.21.15.143:0/3262018346 conn(0x7fe5fc0b0bf0 msgr2=0x7fe5fc15f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 shutdown_connections 2023-11-24T06:31:32.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.094+0000 7fe602fd1640 1 -- 172.21.15.143:0/3262018346 wait complete. 2023-11-24T06:31:32.118 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:31:32.118 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:32.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.250+0000 7f6814632640 1 Processor -- start 2023-11-24T06:31:32.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.250+0000 7f6814632640 1 -- start start 2023-11-24T06:31:32.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6814632640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6814632640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0ae950 con 0x7f680c06d5f0 2023-11-24T06:31:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6814632640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0b1ef0 con 0x7f680c159a80 2023-11-24T06:31:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6814632640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0adca0 con 0x7f680c0b3670 2023-11-24T06:31:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6811bcd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f680c06d5f0 0x7f680c0ac5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56160/0 (socket says 172.21.15.143:56160) 2023-11-24T06:31:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6811bcd640 1 -- 172.21.15.143:0/3006235229 learned_addr learned my addr 172.21.15.143:0/3006235229 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6812bcf640 1 --2- 172.21.15.143:0/3006235229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437946881 0 0) 0x7f680c0ae950 con 0x7f680c06d5f0 2023-11-24T06:31:32.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f8003450 con 0x7f680c06d5f0 2023-11-24T06:31:32.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675306572 0 0) 0x7f680c0b1ef0 con 0x7f680c159a80 2023-11-24T06:31:32.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c0ae950 con 0x7f680c159a80 2023-11-24T06:31:32.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6812bcf640 1 -- 172.21.15.143:0/3006235229 >> v1:172.21.15.146:6789/0 conn(0x7f680c159a80 legacy=0x7f680c06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6812bcf640 1 -- 172.21.15.143:0/3006235229 >> v1:172.21.15.143:6789/0 conn(0x7f680c06d5f0 legacy=0x7f680c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.254+0000 7f6812bcf640 1 -- 172.21.15.143:0/3006235229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0adf80 con 0x7f680c0b3670 2023-11-24T06:31:32.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6812bcf640 1 --2- 172.21.15.143:0/3006235229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c06de50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6804009dc0 tx=0x7f680401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ffb7029091521f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68040a5980 con 0x7f680c0b3670 2023-11-24T06:31:32.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68040a5ae0 con 0x7f680c0b3670 2023-11-24T06:31:32.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f68113cc640 1 -- 172.21.15.143:0/3006235229 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68040a5e70 con 0x7f680c0b3670 2023-11-24T06:31:32.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- 172.21.15.143:0/3006235229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 msgr2=0x7f680c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 --2- 172.21.15.143:0/3006235229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c06de50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6804009dc0 tx=0x7f680401c940 comp rx=0 tx=0).stop 2023-11-24T06:31:32.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- 172.21.15.143:0/3006235229 shutdown_connections 2023-11-24T06:31:32.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 --2- 172.21.15.143:0/3006235229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c06de50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- 172.21.15.143:0/3006235229 >> 172.21.15.143:0/3006235229 conn(0x7f680c0b0bf0 msgr2=0x7f680c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:32.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- 172.21.15.143:0/3006235229 shutdown_connections 2023-11-24T06:31:32.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- 172.21.15.143:0/3006235229 wait complete. 2023-11-24T06:31:32.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 Processor -- start 2023-11-24T06:31:32.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- start start 2023-11-24T06:31:32.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 0x7f680c14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680c159a80 0x7f680c14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c138e50 con 0x7f680c06d5f0 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c14df20 con 0x7f680c159a80 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f6814632640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c14bba0 con 0x7f680c0b3670 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.258+0000 7f68123ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 0x7f680c14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 0x7f680c14b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57360/0 (socket says 172.21.15.143:57360) 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 -- 172.21.15.143:0/3298080768 learned_addr learned my addr 172.21.15.143:0/3298080768 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6812bcf640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680c159a80 0x7f680c14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6811bcd640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 -- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 msgr2=0x7f680c138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 -- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680c159a80 msgr2=0x7f680c14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680c159a80 0x7f680c14a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 -- 172.21.15.143:0/3298080768 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804009a70 con 0x7f680c06d5f0 2023-11-24T06:31:32.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6812bcf640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680c159a80 0x7f680c14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:32.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f68123ce640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 0x7f680c14b510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f680800c430 tx=0x7f680800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080052d0 con 0x7f680c06d5f0 2023-11-24T06:31:32.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808005450 con 0x7f680c06d5f0 2023-11-24T06:31:32.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808003840 con 0x7f680c06d5f0 2023-11-24T06:31:32.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c14be80 con 0x7f680c06d5f0 2023-11-24T06:31:32.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c14c440 con 0x7f680c06d5f0 2023-11-24T06:31:32.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c067520 con 0x7f680c06d5f0 2023-11-24T06:31:32.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f68080039a0 con 0x7f680c06d5f0 2023-11-24T06:31:32.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.262+0000 7f6802ffd640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67f00666b0 0x7f67f0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.266+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f6808083880 con 0x7f680c06d5f0 2023-11-24T06:31:32.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.266+0000 7f6811bcd640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67f00666b0 0x7f67f0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.266+0000 7f6811bcd640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67f00666b0 0x7f67f0068b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f680c0b12e0 tx=0x7f67fc007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.266+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6808050a10 con 0x7f680c06d5f0 2023-11-24T06:31:32.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f680c1504c0 con 0x7f680c06d5f0 2023-11-24T06:31:32.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6802ffd640 1 -- 172.21.15.143:0/3298080768 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f6808054030 con 0x7f680c06d5f0 2023-11-24T06:31:32.455 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:32.455 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:04.159303+0000","modified":"2023-11-24T06:31:07.177660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3877501822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3877501822},{"type":"v1","addr":"172.21.15.143:6837","nonce":3877501822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:31:32.457 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 26 2023-11-24T06:31:32.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67f00666b0 msgr2=0x7f67f0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67f00666b0 0x7f67f0068b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f680c0b12e0 tx=0x7f67fc007d40 comp rx=0 tx=0).stop 2023-11-24T06:31:32.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 msgr2=0x7f680c14b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 0x7f680c14b510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f680800c430 tx=0x7f680800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 shutdown_connections 2023-11-24T06:31:32.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f67f00666b0 0x7f67f0068b70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680c159a80 0x7f680c14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f680c0b3670 0x7f680c138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 --2- 172.21.15.143:0/3298080768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c06d5f0 0x7f680c14b510 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 >> 172.21.15.143:0/3298080768 conn(0x7f680c0b0bf0 msgr2=0x7f680c150900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:32.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 shutdown_connections 2023-11-24T06:31:32.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.450+0000 7f6814632640 1 -- 172.21.15.143:0/3298080768 wait complete. 2023-11-24T06:31:32.475 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:32.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.606+0000 7fb465b94640 1 Processor -- start 2023-11-24T06:31:32.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.606+0000 7fb465b94640 1 -- start start 2023-11-24T06:31:32.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb465b94640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb46015a320 0x7fb4600b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb465b94640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4600b36c0 0x7fb460070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb465b94640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46015a700 con 0x7fb460070bd0 2023-11-24T06:31:32.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb465b94640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4600b2430 con 0x7fb46015a320 2023-11-24T06:31:32.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb465b94640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4600b2620 con 0x7fb4600b36c0 2023-11-24T06:31:32.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb46015a320 0x7fb4600b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb460070bd0 0x7fb460071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56170/0 (socket says 172.21.15.143:56170) 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45ffff640 1 -- 172.21.15.143:0/218965892 learned_addr learned my addr 172.21.15.143:0/218965892 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45effd640 1 --2- 172.21.15.143:0/218965892 >> v2:172.21.15.146:3300/0 conn(0x7fb4600b36c0 0x7fb460070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45f7fe640 1 -- 172.21.15.143:0/218965892 >> v2:172.21.15.146:3300/0 conn(0x7fb4600b36c0 msgr2=0x7fb460070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45f7fe640 1 --2- 172.21.15.143:0/218965892 >> v2:172.21.15.146:3300/0 conn(0x7fb4600b36c0 0x7fb460070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45f7fe640 1 -- 172.21.15.143:0/218965892 >> v1:172.21.15.143:6789/0 conn(0x7fb460070bd0 legacy=0x7fb460071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45e7fc640 1 -- 172.21.15.143:0/218965892 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479873357 0 0) 0x7fb46015a700 con 0x7fb460070bd0 2023-11-24T06:31:32.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.610+0000 7fb45f7fe640 1 -- 172.21.15.143:0/218965892 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600b2900 con 0x7fb46015a320 2023-11-24T06:31:32.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb45f7fe640 1 --2- 172.21.15.143:0/218965892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46015a320 0x7fb4600b1ef0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb46006c180 tx=0x7fb45001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134860329c25fb87 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb45e7fc640 1 -- 172.21.15.143:0/218965892 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500a7070 con 0x7fb46015a320 2023-11-24T06:31:32.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb45e7fc640 1 -- 172.21.15.143:0/218965892 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500ab430 con 0x7fb46015a320 2023-11-24T06:31:32.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb45e7fc640 1 -- 172.21.15.143:0/218965892 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500ab7c0 con 0x7fb46015a320 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 -- 172.21.15.143:0/218965892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46015a320 msgr2=0x7fb4600b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 --2- 172.21.15.143:0/218965892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46015a320 0x7fb4600b1ef0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb46006c180 tx=0x7fb45001c430 comp rx=0 tx=0).stop 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 -- 172.21.15.143:0/218965892 shutdown_connections 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 --2- 172.21.15.143:0/218965892 >> v2:172.21.15.146:3300/0 conn(0x7fb4600b36c0 0x7fb460070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 --2- 172.21.15.143:0/218965892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46015a320 0x7fb4600b1ef0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 -- 172.21.15.143:0/218965892 >> 172.21.15.143:0/218965892 conn(0x7fb4600b0bf0 msgr2=0x7fb4600b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:32.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 -- 172.21.15.143:0/218965892 shutdown_connections 2023-11-24T06:31:32.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 -- 172.21.15.143:0/218965892 wait complete. 2023-11-24T06:31:32.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 Processor -- start 2023-11-24T06:31:32.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 -- start start 2023-11-24T06:31:32.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 0x7fb46009c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4600b36c0 0x7fb46015fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.614+0000 7fb465b94640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46015a320 0x7fb4601603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb465b94640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460151610 con 0x7fb460070bd0 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb465b94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46009a890 con 0x7fb4600b36c0 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb465b94640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600999e0 con 0x7fb46015a320 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 0x7fb46009c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 0x7fb46009c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57386/0 (socket says 172.21.15.143:57386) 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 -- 172.21.15.143:0/3331850221 learned_addr learned my addr 172.21.15.143:0/3331850221 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 -- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46015a320 msgr2=0x7fb4601603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46015a320 0x7fb4601603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 -- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4600b36c0 msgr2=0x7fb46015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45effd640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4600b36c0 0x7fb46015fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4600b36c0 0x7fb46015fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 -- 172.21.15.143:0/3331850221 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450009420 con 0x7fb460070bd0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb45f7fe640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 0x7fb46009c5f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb4500ad040 tx=0x7fb45001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500bf610 con 0x7fb460070bd0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500bf790 con 0x7fb460070bd0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500bfb40 con 0x7fb460070bd0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb460099c80 con 0x7fb460070bd0 2023-11-24T06:31:32.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46009a240 con 0x7fb460070bd0 2023-11-24T06:31:32.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb460067520 con 0x7fb460070bd0 2023-11-24T06:31:32.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fb4500b5400 con 0x7fb460070bd0 2023-11-24T06:31:32.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.618+0000 7fb447fff640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb44c0666b0 0x7fb44c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.622+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fb45011ed10 con 0x7fb460070bd0 2023-11-24T06:31:32.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.622+0000 7fb45effd640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb44c0666b0 0x7fb44c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.622+0000 7fb45effd640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb44c0666b0 0x7fb44c068b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb46006e820 tx=0x7fb454008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.626+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4500ebd50 con 0x7fb460070bd0 2023-11-24T06:31:32.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.802+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb460070830 con 0x7fb460070bd0 2023-11-24T06:31:32.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb447fff640 1 -- 172.21.15.143:0/3331850221 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb4500c4090 con 0x7fb460070bd0 2023-11-24T06:31:32.809 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:32.810 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:04.159303+0000","modified":"2023-11-24T06:31:07.177660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3877501822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3877501822},{"type":"v1","addr":"172.21.15.143:6837","nonce":3877501822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:31:32.810 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 26 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb44c0666b0 msgr2=0x7fb44c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb44c0666b0 0x7fb44c068b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb46006e820 tx=0x7fb454008040 comp rx=0 tx=0).stop 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 msgr2=0x7fb46009c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 0x7fb46009c5f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb4500ad040 tx=0x7fb45001ac70 comp rx=0 tx=0).stop 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 shutdown_connections 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb44c0666b0 0x7fb44c068b70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46015a320 0x7fb4601603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4600b36c0 0x7fb46015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 --2- 172.21.15.143:0/3331850221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb460070bd0 0x7fb46009c5f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 >> 172.21.15.143:0/3331850221 conn(0x7fb4600b0bf0 msgr2=0x7fb460071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:32.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 shutdown_connections 2023-11-24T06:31:32.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.806+0000 7fb465b94640 1 -- 172.21.15.143:0/3331850221 wait complete. 2023-11-24T06:31:32.831 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:32.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1cadead640 1 Processor -- start 2023-11-24T06:31:32.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1cadead640 1 -- start start 2023-11-24T06:31:32.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1cadead640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca80ce8b0 0x7f1ca80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1cadead640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca806c0e0 con 0x7f1ca80d3020 2023-11-24T06:31:32.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1cadead640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca80d1cc0 con 0x7f1ca815d570 2023-11-24T06:31:32.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1cadead640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80d1fa0 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1ca80d3020 0x7f1ca80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56174/0 (socket says 172.21.15.143:56174) 2023-11-24T06:31:32.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca6ffd640 1 -- 172.21.15.143:0/3187250058 learned_addr learned my addr 172.21.15.143:0/3187250058 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:32.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca7fff640 1 --2- 172.21.15.143:0/3187250058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca80ce8b0 0x7f1ca80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295610522 0 0) 0x7f1ca806c0e0 con 0x7f1ca80d3020 2023-11-24T06:31:32.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c90003530 con 0x7f1ca80d3020 2023-11-24T06:31:32.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418202582 0 0) 0x7f1ca80d1cc0 con 0x7f1ca815d570 2023-11-24T06:31:32.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca806c0e0 con 0x7f1ca815d570 2023-11-24T06:31:32.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca7fff640 1 -- 172.21.15.143:0/3187250058 >> v1:172.21.15.146:6789/0 conn(0x7f1ca815d570 legacy=0x7f1ca806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca7fff640 1 -- 172.21.15.143:0/3187250058 >> v1:172.21.15.143:6789/0 conn(0x7f1ca80d3020 legacy=0x7f1ca80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.966+0000 7f1ca7fff640 1 -- 172.21.15.143:0/3187250058 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80ce0b0 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1ca7fff640 1 --2- 172.21.15.143:0/3187250058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca80ce8b0 0x7f1ca80ced60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009dc0 tx=0x7f1ca001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df412c50e2aeb28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca00a5a00 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca00a5b60 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1ca67fc640 1 -- 172.21.15.143:0/3187250058 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca00ad440 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 -- 172.21.15.143:0/3187250058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca80ce8b0 msgr2=0x7f1ca80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 --2- 172.21.15.143:0/3187250058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca80ce8b0 0x7f1ca80ced60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009dc0 tx=0x7f1ca001c940 comp rx=0 tx=0).stop 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 -- 172.21.15.143:0/3187250058 shutdown_connections 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 --2- 172.21.15.143:0/3187250058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca80ce8b0 0x7f1ca80ced60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 -- 172.21.15.143:0/3187250058 >> 172.21.15.143:0/3187250058 conn(0x7f1ca808ceb0 msgr2=0x7f1ca809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 -- 172.21.15.143:0/3187250058 shutdown_connections 2023-11-24T06:31:32.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.970+0000 7f1cadead640 1 -- 172.21.15.143:0/3187250058 wait complete. 2023-11-24T06:31:32.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 Processor -- start 2023-11-24T06:31:32.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 -- start start 2023-11-24T06:31:32.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 0x7f1ca81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ca80d3020 0x7f1ca80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca815d570 0x7f1ca80b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80cb390 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80cb670 con 0x7f1ca80d3020 2023-11-24T06:31:32.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80cb950 con 0x7f1ca815d570 2023-11-24T06:31:32.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 0x7f1ca81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 0x7f1ca81583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57392/0 (socket says 172.21.15.143:57392) 2023-11-24T06:31:32.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 -- 172.21.15.143:0/2260311169 learned_addr learned my addr 172.21.15.143:0/2260311169 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:32.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca7fff640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca815d570 0x7f1ca80b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca6ffd640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ca80d3020 0x7f1ca80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 -- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca815d570 msgr2=0x7f1ca80b8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca815d570 0x7f1ca80b8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 -- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ca80d3020 msgr2=0x7f1ca80b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ca80d3020 0x7f1ca80b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 -- 172.21.15.143:0/2260311169 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0009a70 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca6ffd640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ca80d3020 0x7f1ca80b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1ca77fe640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 0x7f1ca81583c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800c430 tx=0x7f1c9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c980052d0 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c98005450 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98003840 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca80cbc30 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.974+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca81f62a0 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.978+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca8067520 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.978+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f1c980039a0 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.978+0000 7f1c8ffff640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1c940666b0 0x7f1c94068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:32.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.978+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f1c980839b0 con 0x7f1ca80ce8b0 2023-11-24T06:31:32.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.978+0000 7f1ca6ffd640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1c940666b0 0x7f1c94068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:32.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.978+0000 7f1ca6ffd640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1c940666b0 0x7f1c94068b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80b3720 tx=0x7f1c9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:32.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:32.982+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c98050a00 con 0x7f1ca80ce8b0 2023-11-24T06:31:33.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.130+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ca806b7b0 con 0x7f1ca80ce8b0 2023-11-24T06:31:33.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1c8ffff640 1 -- 172.21.15.143:0/2260311169 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16761 (secure 0 0 0) 0x7f1c98017020 con 0x7f1ca80ce8b0 2023-11-24T06:31:33.138 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:33.139 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":47,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:29.271922+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:01.856093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:03.157713+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:33.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1c940666b0 msgr2=0x7f1c94068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1c940666b0 0x7f1c94068b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80b3720 tx=0x7f1c9c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 msgr2=0x7f1ca81583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 0x7f1ca81583c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800c430 tx=0x7f1c9800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 shutdown_connections 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1c940666b0 0x7f1c94068b70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ca815d570 0x7f1ca80b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ca80d3020 0x7f1ca80b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 --2- 172.21.15.143:0/2260311169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca80ce8b0 0x7f1ca81583c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 >> 172.21.15.143:0/2260311169 conn(0x7f1ca808ceb0 msgr2=0x7f1ca80d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 shutdown_connections 2023-11-24T06:31:33.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.134+0000 7f1cadead640 1 -- 172.21.15.143:0/2260311169 wait complete. 2023-11-24T06:31:33.160 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:31:33.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.294+0000 7f9a5b59e640 1 Processor -- start 2023-11-24T06:31:33.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.294+0000 7f9a5b59e640 1 -- start start 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5b59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c160aa0 0x7f9a5c0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5b59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9a5c0ceba0 0x7f9a5c0d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5b59e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0cf1a0 con 0x7f9a5c0d0240 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5b59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cf480 con 0x7f9a5c0ceba0 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5b59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cf760 con 0x7f9a5c160aa0 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9a5c0ceba0 0x7f9a5c0d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9a5c0ceba0 0x7f9a5c0d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57404/0 (socket says 172.21.15.143:57404) 2023-11-24T06:31:33.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 -- 172.21.15.143:0/3133434441 learned_addr learned my addr 172.21.15.143:0/3133434441 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:33.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5a59c640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c160aa0 0x7f9a5c0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 -- 172.21.15.143:0/3133434441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c160aa0 msgr2=0x7f9a5c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:33.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c160aa0 0x7f9a5c0d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 -- 172.21.15.143:0/3133434441 >> v1:172.21.15.146:6789/0 conn(0x7f9a5c0d0240 legacy=0x7f9a5c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 -- 172.21.15.143:0/3133434441 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0cfa40 con 0x7f9a5c0ceba0 2023-11-24T06:31:33.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5a59c640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c160aa0 0x7f9a5c0d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:33.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5ad9d640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0ceba0 0x7f9a5c0d06a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009e50 tx=0x7f9a5401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507afd0a330a9c0a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:33.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5959a640 1 -- 172.21.15.143:0/3133434441 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540a5750 con 0x7f9a5c0ceba0 2023-11-24T06:31:33.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5959a640 1 -- 172.21.15.143:0/3133434441 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a540a58b0 con 0x7f9a5c0ceba0 2023-11-24T06:31:33.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.298+0000 7f9a5959a640 1 -- 172.21.15.143:0/3133434441 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540a5c40 con 0x7f9a5c0ceba0 2023-11-24T06:31:33.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3133434441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0ceba0 msgr2=0x7f9a5c0d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0ceba0 0x7f9a5c0d06a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009e50 tx=0x7f9a5401c980 comp rx=0 tx=0).stop 2023-11-24T06:31:33.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3133434441 shutdown_connections 2023-11-24T06:31:33.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0ceba0 0x7f9a5c0d06a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3133434441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c160aa0 0x7f9a5c0d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3133434441 >> 172.21.15.143:0/3133434441 conn(0x7f9a5c08cca0 msgr2=0x7f9a5c09c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:33.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3133434441 shutdown_connections 2023-11-24T06:31:33.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3133434441 wait complete. 2023-11-24T06:31:33.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 Processor -- start 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- start start 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c0ceba0 0x7f9a5c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 0x7f9a5c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5c160aa0 0x7f9a5c0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c8320 con 0x7f9a5c0d0240 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c85c0 con 0x7f9a5c160aa0 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5b59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c88a0 con 0x7f9a5c0ceba0 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a59d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 0x7f9a5c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a59d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 0x7f9a5c0cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57420/0 (socket says 172.21.15.143:57420) 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a59d9b640 1 -- 172.21.15.143:0/3844735159 learned_addr learned my addr 172.21.15.143:0/3844735159 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5ad9d640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5c160aa0 0x7f9a5c0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.302+0000 7f9a5a59c640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c0ceba0 0x7f9a5c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a59d9b640 1 -- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c0ceba0 msgr2=0x7f9a5c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a59d9b640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c0ceba0 0x7f9a5c0b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a59d9b640 1 -- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5c160aa0 msgr2=0x7f9a5c0afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a59d9b640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5c160aa0 0x7f9a5c0afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a59d9b640 1 -- 172.21.15.143:0/3844735159 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009b30 con 0x7f9a5c0d0240 2023-11-24T06:31:33.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a59d9b640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 0x7f9a5c0cb6d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c3c0 tx=0x7f9a5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500052d0 con 0x7f9a5c0d0240 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50005430 con 0x7f9a5c0d0240 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c0c8b80 con 0x7f9a5c0d0240 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50003840 con 0x7f9a5c0d0240 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c0b7550 con 0x7f9a5c0d0240 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c04e850 con 0x7f9a5c0d0240 2023-11-24T06:31:33.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f9a500039a0 con 0x7f9a5c0d0240 2023-11-24T06:31:33.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a4affd640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a3c0666b0 0x7f9a3c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9a50083790 con 0x7f9a5c0d0240 2023-11-24T06:31:33.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.306+0000 7f9a5a59c640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a3c0666b0 0x7f9a3c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.310+0000 7f9a5a59c640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a3c0666b0 0x7f9a3c068b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009950 tx=0x7f9a4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:33.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.310+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a50050920 con 0x7f9a5c0d0240 2023-11-24T06:31:33.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.494+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9a5c0d1b90 con 0x7f9a5c0d0240 2023-11-24T06:31:33.499 INFO:tasks.ceph.mon.a.smithi143.stderr:2023-11-24T06:31:33.494+0000 7f12a8d9d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:31:33.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a4affd640 1 -- 172.21.15.143:0/3844735159 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9a50053f40 con 0x7f9a5c0d0240 2023-11-24T06:31:33.502 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a3c0666b0 msgr2=0x7f9a3c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a3c0666b0 0x7f9a3c068b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009950 tx=0x7f9a4c008040 comp rx=0 tx=0).stop 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 msgr2=0x7f9a5c0cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 0x7f9a5c0cb6d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c3c0 tx=0x7f9a5000c880 comp rx=0 tx=0).stop 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 shutdown_connections 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a3c0666b0 0x7f9a3c068b70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5c160aa0 0x7f9a5c0afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a5c0d0240 0x7f9a5c0cb6d0 secure :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c3c0 tx=0x7f9a5000c880 comp rx=0 tx=0).stop 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 --2- 172.21.15.143:0/3844735159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5c0ceba0 0x7f9a5c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.498+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 >> 172.21.15.143:0/3844735159 conn(0x7f9a5c08cca0 msgr2=0x7f9a5c0ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:33.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.502+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 shutdown_connections 2023-11-24T06:31:33.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.502+0000 7f9a5b59e640 1 -- 172.21.15.143:0/3844735159 wait complete. 2023-11-24T06:31:33.536 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:31:33.582 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:31:33.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 Processor -- start 2023-11-24T06:31:33.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 -- start start 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f323406d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f323406d590 0x7f3234071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323406d9f0 con 0x7f3234071e40 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32340cd400 con 0x7f323406d590 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323b101640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234072860 con 0x7f323415d540 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323969e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3234071e40 0x7f32341611d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56196/0 (socket says 172.21.15.143:56196) 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f323969e640 1 -- 172.21.15.143:0/1557431058 learned_addr learned my addr 172.21.15.143:0/1557431058 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322bfff640 1 --2- 172.21.15.143:0/1557431058 >> v2:172.21.15.146:3300/0 conn(0x7f323406d590 0x7f3234071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f3238e9d640 1 --2- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f323406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322b7fe640 1 -- 172.21.15.143:0/1557431058 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707867056 0 0) 0x7f322c0014a0 con 0x7f3234071e40 2023-11-24T06:31:33.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322b7fe640 1 -- 172.21.15.143:0/1557431058 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f321c003530 con 0x7f3234071e40 2023-11-24T06:31:33.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322b7fe640 1 -- 172.21.15.143:0/1557431058 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1545496533 0 0) 0x7f321c003530 con 0x7f3234071e40 2023-11-24T06:31:33.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322bfff640 1 -- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 msgr2=0x7f323406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:33.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322bfff640 1 --2- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f323406d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322bfff640 1 -- 172.21.15.143:0/1557431058 >> v1:172.21.15.143:6789/0 conn(0x7f3234071e40 legacy=0x7f32341611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.674+0000 7f322bfff640 1 -- 172.21.15.143:0/1557431058 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323406dc30 con 0x7f323406d590 2023-11-24T06:31:33.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f322bfff640 1 --2- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323406d590 0x7f3234071900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32240097c0 tx=0x7f322401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e5f54262fcb16b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:33.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f322b7fe640 1 -- 172.21.15.143:0/1557431058 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c001b90 con 0x7f323406d590 2023-11-24T06:31:33.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f322b7fe640 1 -- 172.21.15.143:0/1557431058 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32240a7050 con 0x7f323406d590 2023-11-24T06:31:33.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f322b7fe640 1 -- 172.21.15.143:0/1557431058 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240ab620 con 0x7f323406d590 2023-11-24T06:31:33.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 -- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323406d590 msgr2=0x7f3234071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 --2- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323406d590 0x7f3234071900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32240097c0 tx=0x7f322401c3a0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 -- 172.21.15.143:0/1557431058 shutdown_connections 2023-11-24T06:31:33.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 --2- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323406d590 0x7f3234071900 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 --2- 172.21.15.143:0/1557431058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f323406d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 -- 172.21.15.143:0/1557431058 >> 172.21.15.143:0/1557431058 conn(0x7f32340b0c80 msgr2=0x7f32340b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:33.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 -- 172.21.15.143:0/1557431058 shutdown_connections 2023-11-24T06:31:33.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.678+0000 7f323b101640 1 -- 172.21.15.143:0/1557431058 wait complete. 2023-11-24T06:31:33.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 Processor -- start 2023-11-24T06:31:33.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 -- start start 2023-11-24T06:31:33.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 0x7f323414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234071e40 0x7f32340b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f32340b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323414ad20 con 0x7f323406d590 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323414a7b0 con 0x7f3234071e40 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340b3030 con 0x7f323415d540 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 0x7f323414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 0x7f323414a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57456/0 (socket says 172.21.15.143:57456) 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 -- 172.21.15.143:0/3909683531 learned_addr learned my addr 172.21.15.143:0/3909683531 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 -- 172.21.15.143:0/3909683531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 msgr2=0x7f32340b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f32340b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 -- 172.21.15.143:0/3909683531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234071e40 msgr2=0x7f32340b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234071e40 0x7f32340b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 -- 172.21.15.143:0/3909683531 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224009420 con 0x7f323406d590 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f3238e9d640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 0x7f323414a270 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f323000e870 tx=0x7f323000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230009510 con 0x7f323406d590 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323000eec0 con 0x7f323406d590 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000cb40 con 0x7f323406d590 2023-11-24T06:31:33.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32340b3310 con 0x7f323406d590 2023-11-24T06:31:33.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.682+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32340b38d0 con 0x7f323406d590 2023-11-24T06:31:33.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.686+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323404e8c0 con 0x7f323406d590 2023-11-24T06:31:33.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.686+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f323000cca0 con 0x7f323406d590 2023-11-24T06:31:33.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.686+0000 7f32297fa640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32200666b0 0x7f3220068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:33.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.686+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f32300844f0 con 0x7f323406d590 2023-11-24T06:31:33.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.686+0000 7f322bfff640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32200666b0 0x7f3220068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:33.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.686+0000 7f322bfff640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32200666b0 0x7f3220068b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f32240ad000 tx=0x7f3224004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.690+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3230051550 con 0x7f323406d590 2023-11-24T06:31:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:33.874+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f32340cc890 con 0x7f323406d590 2023-11-24T06:31:34.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.506+0000 7f32297fa640 1 -- 172.21.15.143:0/3909683531 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3230054b70 con 0x7f323406d590 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32200666b0 msgr2=0x7f3220068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32200666b0 0x7f3220068b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f32240ad000 tx=0x7f3224004740 comp rx=0 tx=0).stop 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 msgr2=0x7f323414a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 0x7f323414a270 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f323000e870 tx=0x7f323000ec70 comp rx=0 tx=0).stop 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 shutdown_connections 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f32200666b0 0x7f3220068b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323415d540 0x7f32340b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234071e40 0x7f32340b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 --2- 172.21.15.143:0/3909683531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323406d590 0x7f323414a270 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 >> 172.21.15.143:0/3909683531 conn(0x7f32340b0c80 msgr2=0x7f32340ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:34.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 shutdown_connections 2023-11-24T06:31:34.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.510+0000 7f323b101640 1 -- 172.21.15.143:0/3909683531 wait complete. 2023-11-24T06:31:34.536 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:31:34.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 Processor -- start 2023-11-24T06:31:34.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 -- start start 2023-11-24T06:31:34.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5314159a80 0x7f531406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f531406cee0 0x7f531406d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f53140b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531406d8b0 con 0x7f531406cee0 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140ae950 con 0x7f5314159a80 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f531a2d6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140b1ef0 con 0x7f53140b2660 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f531406cee0 0x7f531406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f531406cee0 0x7f531406d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57458/0 (socket says 172.21.15.143:57458) 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 -- 172.21.15.143:0/792674858 learned_addr learned my addr 172.21.15.143:0/792674858 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f5313fff640 1 --2- 172.21.15.143:0/792674858 >> v2:172.21.15.146:3300/0 conn(0x7f5314159a80 0x7f531406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f5318873640 1 --2- 172.21.15.143:0/792674858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f53140b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 -- 172.21.15.143:0/792674858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 msgr2=0x7f53140b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 --2- 172.21.15.143:0/792674858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f53140b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 -- 172.21.15.143:0/792674858 >> v2:172.21.15.146:3300/0 conn(0x7f5314159a80 msgr2=0x7f531406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 --2- 172.21.15.143:0/792674858 >> v2:172.21.15.146:3300/0 conn(0x7f5314159a80 0x7f531406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f53137fe640 1 -- 172.21.15.143:0/792674858 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140adca0 con 0x7f531406cee0 2023-11-24T06:31:34.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.714+0000 7f5313fff640 1 --2- 172.21.15.143:0/792674858 >> v2:172.21.15.146:3300/0 conn(0x7f5314159a80 0x7f531406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:34.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f53137fe640 1 --2- 172.21.15.143:0/792674858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f531406cee0 0x7f531406d370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f531406c180 tx=0x7f530801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb3cab44cb561f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f5312ffd640 1 -- 172.21.15.143:0/792674858 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080ab600 con 0x7f531406cee0 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f5312ffd640 1 -- 172.21.15.143:0/792674858 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080a7050 con 0x7f531406cee0 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f5312ffd640 1 -- 172.21.15.143:0/792674858 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080ab980 con 0x7f531406cee0 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 -- 172.21.15.143:0/792674858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f531406cee0 msgr2=0x7f531406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 --2- 172.21.15.143:0/792674858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f531406cee0 0x7f531406d370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f531406c180 tx=0x7f530801c4d0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 -- 172.21.15.143:0/792674858 shutdown_connections 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 --2- 172.21.15.143:0/792674858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f53140b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 --2- 172.21.15.143:0/792674858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f531406cee0 0x7f531406d370 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 --2- 172.21.15.143:0/792674858 >> v2:172.21.15.146:3300/0 conn(0x7f5314159a80 0x7f531406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 -- 172.21.15.143:0/792674858 >> 172.21.15.143:0/792674858 conn(0x7f53140b0bf0 msgr2=0x7f53140b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:34.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 -- 172.21.15.143:0/792674858 shutdown_connections 2023-11-24T06:31:34.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.718+0000 7f531a2d6640 1 -- 172.21.15.143:0/792674858 wait complete. 2023-11-24T06:31:34.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 Processor -- start 2023-11-24T06:31:34.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 -- start start 2023-11-24T06:31:34.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f531406cee0 0x7f5314162dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f531409b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 0x7f53141562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53141584e0 con 0x7f5314159a80 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314157c40 con 0x7f531406cee0 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5314157f20 con 0x7f53140b2660 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 0x7f53141562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 0x7f53141562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57460/0 (socket says 172.21.15.143:57460) 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 -- 172.21.15.143:0/3596056542 learned_addr learned my addr 172.21.15.143:0/3596056542 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5313fff640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f531406cee0 0x7f5314162dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f53137fe640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f531409b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 -- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 msgr2=0x7f531409b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:34.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f531409b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 -- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f531406cee0 msgr2=0x7f5314162dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:34.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f531406cee0 0x7f5314162dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:34.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 -- 172.21.15.143:0/3596056542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080094d0 con 0x7f5314159a80 2023-11-24T06:31:34.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f53137fe640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f531409b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:34.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5318873640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 0x7f53141562b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f530c007e60 tx=0x7f530c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c014620 con 0x7f5314159a80 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c00ee90 con 0x7f5314159a80 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0149e0 con 0x7f5314159a80 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5314158200 con 0x7f5314159a80 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.722+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5314163300 con 0x7f5314159a80 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.726+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314163550 con 0x7f5314159a80 2023-11-24T06:31:34.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.726+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f530c014b40 con 0x7f5314159a80 2023-11-24T06:31:34.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.726+0000 7f5310ff9640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53000666b0 0x7f5300068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:34.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.726+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f530c084be0 con 0x7f5314159a80 2023-11-24T06:31:34.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.726+0000 7f5313fff640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53000666b0 0x7f5300068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:34.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.726+0000 7f5313fff640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53000666b0 0x7f5300068b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f530400b930 tx=0x7f5304008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:34.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.730+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5314163550 con 0x7f5314159a80 2023-11-24T06:31:34.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:34.882+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5314163550 con 0x7f5314159a80 2023-11-24T06:31:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.026+0000 7f5310ff9640 1 -- 172.21.15.143:0/3596056542 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5314163550 con 0x7f5314159a80 2023-11-24T06:31:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:31:35.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.026+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53000666b0 msgr2=0x7f5300068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:35.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.026+0000 7f531a2d6640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53000666b0 0x7f5300068b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f530400b930 tx=0x7f5304008040 comp rx=0 tx=0).stop 2023-11-24T06:31:35.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.026+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 msgr2=0x7f53141562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:35.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.026+0000 7f531a2d6640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 0x7f53141562b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f530c007e60 tx=0x7f530c00e4b0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 shutdown_connections 2023-11-24T06:31:35.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f53000666b0 0x7f5300068b70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5314159a80 0x7f53141562b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53140b2660 0x7f531409b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 --2- 172.21.15.143:0/3596056542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f531406cee0 0x7f5314162dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 >> 172.21.15.143:0/3596056542 conn(0x7f53140b0bf0 msgr2=0x7f5314158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:35.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 shutdown_connections 2023-11-24T06:31:35.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.030+0000 7f531a2d6640 1 -- 172.21.15.143:0/3596056542 wait complete. 2023-11-24T06:31:35.062 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:31:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.198+0000 7fe6f9a32640 1 Processor -- start 2023-11-24T06:31:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.198+0000 7fe6f9a32640 1 -- start start 2023-11-24T06:31:35.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f9a32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe6f4144030 0x7fe6f406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f9a32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6f409cc20 0x7fe6f406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f9a32640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f406d8b0 con 0x7fe6f406e280 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f9a32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f4145020 con 0x7fe6f4144030 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f9a32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f409d0a0 con 0x7fe6f409cc20 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe6f4144030 0x7fe6f406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe6f4144030 0x7fe6f406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57466/0 (socket says 172.21.15.143:57466) 2023-11-24T06:31:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 -- 172.21.15.143:0/940410460 learned_addr learned my addr 172.21.15.143:0/940410460 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6ebfff640 1 --2- 172.21.15.143:0/940410460 >> v2:172.21.15.146:3300/0 conn(0x7fe6f409cc20 0x7fe6f406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 -- 172.21.15.143:0/940410460 >> v2:172.21.15.146:3300/0 conn(0x7fe6f409cc20 msgr2=0x7fe6f406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 --2- 172.21.15.143:0/940410460 >> v2:172.21.15.146:3300/0 conn(0x7fe6f409cc20 0x7fe6f406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 -- 172.21.15.143:0/940410460 >> v1:172.21.15.146:6789/0 conn(0x7fe6f406e280 legacy=0x7fe6f40709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.202+0000 7fe6f2ffd640 1 -- 172.21.15.143:0/940410460 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f406cca0 con 0x7fe6f4144030 2023-11-24T06:31:35.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f2ffd640 1 --2- 172.21.15.143:0/940410460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f406c650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40700a0 tx=0x7fe6e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe643c88d3f771ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f27fc640 1 -- 172.21.15.143:0/940410460 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40aa430 con 0x7fe6f4144030 2023-11-24T06:31:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f27fc640 1 -- 172.21.15.143:0/940410460 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e40aa590 con 0x7fe6f4144030 2023-11-24T06:31:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f27fc640 1 -- 172.21.15.143:0/940410460 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40aa920 con 0x7fe6f4144030 2023-11-24T06:31:35.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 -- 172.21.15.143:0/940410460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 msgr2=0x7fe6f406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:35.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/940410460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f406c650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40700a0 tx=0x7fe6e401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 -- 172.21.15.143:0/940410460 shutdown_connections 2023-11-24T06:31:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/940410460 >> v2:172.21.15.146:3300/0 conn(0x7fe6f409cc20 0x7fe6f406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/940410460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f406c650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 -- 172.21.15.143:0/940410460 >> 172.21.15.143:0/940410460 conn(0x7fe6f40b0bf0 msgr2=0x7fe6f40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 -- 172.21.15.143:0/940410460 shutdown_connections 2023-11-24T06:31:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 -- 172.21.15.143:0/940410460 wait complete. 2023-11-24T06:31:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 Processor -- start 2023-11-24T06:31:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.206+0000 7fe6f9a32640 1 -- start start 2023-11-24T06:31:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6f406e280 0x7fe6f41383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6f409cc20 0x7fe6f4138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f413a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4141e30 con 0x7fe6f4144030 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40b2ba0 con 0x7fe6f409cc20 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40b2e80 con 0x7fe6f406e280 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f413a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f413a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57468/0 (socket says 172.21.15.143:57468) 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 -- 172.21.15.143:0/145655625 learned_addr learned my addr 172.21.15.143:0/145655625 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f2ffd640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6f406e280 0x7fe6f41383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6ebfff640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6f409cc20 0x7fe6f4138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 -- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6f406e280 msgr2=0x7fe6f41383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6f406e280 0x7fe6f41383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 -- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6f409cc20 msgr2=0x7fe6f4138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6f409cc20 0x7fe6f4138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 -- 172.21.15.143:0/145655625 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40094d0 con 0x7fe6f4144030 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f37fe640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f413a4a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c7a0 tx=0x7fe6ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec003b80 con 0x7fe6f4144030 2023-11-24T06:31:35.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec003ce0 con 0x7fe6f4144030 2023-11-24T06:31:35.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f40b3160 con 0x7fe6f4144030 2023-11-24T06:31:35.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00aa30 con 0x7fe6f4144030 2023-11-24T06:31:35.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f409c7a0 con 0x7fe6f4144030 2023-11-24T06:31:35.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f4141fa0 con 0x7fe6f4144030 2023-11-24T06:31:35.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.210+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fe6ec00ab90 con 0x7fe6f4144030 2023-11-24T06:31:35.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.214+0000 7fe6f0ff9640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6d40666b0 0x7fe6d4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:35.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.214+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5443+0+0 (secure 0 0 0) 0x7fe6ec083ff0 con 0x7fe6f4144030 2023-11-24T06:31:35.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.214+0000 7fe6f2ffd640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6d40666b0 0x7fe6d4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:35.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.214+0000 7fe6f2ffd640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6d40666b0 0x7fe6d4068b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40ae000 tx=0x7fe6e40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:35.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.218+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6f4141fa0 con 0x7fe6f4144030 2023-11-24T06:31:35.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:35.378+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe6f4141fa0 con 0x7fe6f4144030 2023-11-24T06:31:36.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.298+0000 7fe6f0ff9640 1 -- 172.21.15.143:0/145655625 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe6f4141fa0 con 0x7fe6f4144030 2023-11-24T06:31:36.305 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2023-11-24T06:31:36.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6d40666b0 msgr2=0x7fe6d4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6d40666b0 0x7fe6d4068b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40ae000 tx=0x7fe6e40a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:36.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 msgr2=0x7fe6f413a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f413a4a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c7a0 tx=0x7fe6ec00cc60 comp rx=0 tx=0).stop 2023-11-24T06:31:36.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 shutdown_connections 2023-11-24T06:31:36.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6d40666b0 0x7fe6d4068b70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f4144030 0x7fe6f413a4a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6f409cc20 0x7fe6f4138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 --2- 172.21.15.143:0/145655625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6f406e280 0x7fe6f41383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.302+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 >> 172.21.15.143:0/145655625 conn(0x7fe6f40b0bf0 msgr2=0x7fe6f40abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:36.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.306+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 shutdown_connections 2023-11-24T06:31:36.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.306+0000 7fe6f9a32640 1 -- 172.21.15.143:0/145655625 wait complete. 2023-11-24T06:31:36.340 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:31:36.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.474+0000 7f3d87135640 1 Processor -- start 2023-11-24T06:31:36.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.474+0000 7f3d87135640 1 -- start start 2023-11-24T06:31:36.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.474+0000 7f3d87135640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 0x7f3d800b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d87135640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d80070f00 con 0x7f3d8015a290 2023-11-24T06:31:36.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d87135640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d80071170 con 0x7f3d8015ec60 2023-11-24T06:31:36.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d87135640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800cb690 con 0x7f3d800b1f80 2023-11-24T06:31:36.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d84ed1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3d8015a290 0x7f3d800707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56198/0 (socket says 172.21.15.143:56198) 2023-11-24T06:31:36.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d84ed1640 1 -- 172.21.15.143:0/1769467136 learned_addr learned my addr 172.21.15.143:0/1769467136 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:36.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d856d2640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 0x7f3d800b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181194011 0 0) 0x7f3d80070f00 con 0x7f3d8015a290 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d68005740 con 0x7f3d8015a290 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659630007 0 0) 0x7f3d80071170 con 0x7f3d8015ec60 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80070f00 con 0x7f3d8015ec60 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518361842 0 0) 0x7f3d68005740 con 0x7f3d8015a290 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 msgr2=0x7f3d800b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 0x7f3d800b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 >> v1:172.21.15.146:6789/0 conn(0x7f3d8015ec60 legacy=0x7f3d800cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800cb970 con 0x7f3d8015a290 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f3d7c0016a0 con 0x7f3d8015a290 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 >> v1:172.21.15.143:6789/0 conn(0x7f3d8015a290 legacy=0x7f3d800707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d68005d50 0x7f3d68006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d680069e0 0x7f3d68006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 0x7f3d680073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800cb690 con 0x7f3d680069e0 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6800dce0 con 0x7f3d68005d50 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6800dea0 con 0x7f3d800b1f80 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d77fff640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d680069e0 0x7f3d68006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d84ed1640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d68005d50 0x7f3d68006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d856d2640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 0x7f3d680073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d77fff640 1 -- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 msgr2=0x7f3d680073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:36.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d77fff640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d800b1f80 0x7f3d680073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d77fff640 1 -- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d68005d50 msgr2=0x7f3d68006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:36.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d77fff640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d68005d50 0x7f3d68006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.478+0000 7f3d77fff640 1 -- 172.21.15.143:0/1769467136 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68005740 con 0x7f3d680069e0 2023-11-24T06:31:36.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d77fff640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d680069e0 0x7f3d68006e60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3d80070590 tx=0x7f3d7001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f6561a1544d6a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:36.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d700052d0 con 0x7f3d680069e0 2023-11-24T06:31:36.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70005450 con 0x7f3d680069e0 2023-11-24T06:31:36.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d777fe640 1 -- 172.21.15.143:0/1769467136 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003840 con 0x7f3d680069e0 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 -- 172.21.15.143:0/1769467136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d680069e0 msgr2=0x7f3d68006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 --2- 172.21.15.143:0/1769467136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d680069e0 0x7f3d68006e60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3d80070590 tx=0x7f3d7001c510 comp rx=0 tx=0).stop 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d856d2640 1 -- 172.21.15.143:0/1769467136 reap_dead start 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 -- 172.21.15.143:0/1769467136 shutdown_connections 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 -- 172.21.15.143:0/1769467136 >> 172.21.15.143:0/1769467136 conn(0x7f3d800b0c80 msgr2=0x7f3d800b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 -- 172.21.15.143:0/1769467136 shutdown_connections 2023-11-24T06:31:36.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 -- 172.21.15.143:0/1769467136 wait complete. 2023-11-24T06:31:36.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 Processor -- start 2023-11-24T06:31:36.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.482+0000 7f3d87135640 1 -- start start 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d680069e0 0x7f3d80098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d80157530 0x7f3d800ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 0x7f3d800b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8015add0 con 0x7f3d800b3940 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800b4300 con 0x7f3d680069e0 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80098ed0 con 0x7f3d80157530 2023-11-24T06:31:36.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 0x7f3d800b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 0x7f3d800b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57490/0 (socket says 172.21.15.143:57490) 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 -- 172.21.15.143:0/1787411135 learned_addr learned my addr 172.21.15.143:0/1787411135 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d84ed1640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d680069e0 0x7f3d80098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 -- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d80157530 msgr2=0x7f3d800ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d77fff640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d80157530 0x7f3d800ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d80157530 0x7f3d800ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 -- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d680069e0 msgr2=0x7f3d80098990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d680069e0 0x7f3d80098990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 -- 172.21.15.143:0/1787411135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800ace60 con 0x7f3d800b3940 2023-11-24T06:31:36.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d84ed1640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d680069e0 0x7f3d80098990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:36.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d77fff640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d80157530 0x7f3d800ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:36.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d856d2640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 0x7f3d800b3dc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3d68006960 tx=0x7f3d7800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:36.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800e040 con 0x7f3d800b3940 2023-11-24T06:31:36.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800f040 con 0x7f3d800b3940 2023-11-24T06:31:36.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78003be0 con 0x7f3d800b3940 2023-11-24T06:31:36.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d80159710 con 0x7f3d800b3940 2023-11-24T06:31:36.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8015c620 con 0x7f3d800b3940 2023-11-24T06:31:36.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.486+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8015c1a0 con 0x7f3d800b3940 2023-11-24T06:31:36.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.490+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f3d78003d40 con 0x7f3d800b3940 2023-11-24T06:31:36.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.490+0000 7f3d757fa640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d6c0666b0 0x7f3d6c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.490+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3d78084840 con 0x7f3d800b3940 2023-11-24T06:31:36.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.490+0000 7f3d84ed1640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d6c0666b0 0x7f3d6c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.490+0000 7f3d84ed1640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d6c0666b0 0x7f3d6c068b70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c001ec0 tx=0x7f3d7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:36.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.494+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d8015c1a0 con 0x7f3d800b3940 2023-11-24T06:31:36.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.646+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3d8015c1a0 con 0x7f3d800b3940 2023-11-24T06:31:36.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d757fa640 1 -- 172.21.15.143:0/1787411135 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3d8015c1a0 con 0x7f3d800b3940 2023-11-24T06:31:36.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d6c0666b0 msgr2=0x7f3d6c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d6c0666b0 0x7f3d6c068b70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c001ec0 tx=0x7f3d7c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:36.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 msgr2=0x7f3d800b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 0x7f3d800b3dc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3d68006960 tx=0x7f3d7800f580 comp rx=0 tx=0).stop 2023-11-24T06:31:36.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 shutdown_connections 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3d6c0666b0 0x7f3d6c068b70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d800b3940 0x7f3d800b3dc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d80157530 0x7f3d800ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 --2- 172.21.15.143:0/1787411135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d680069e0 0x7f3d80098990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 >> 172.21.15.143:0/1787411135 conn(0x7f3d800b0c80 msgr2=0x7f3d8015e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 shutdown_connections 2023-11-24T06:31:36.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.650+0000 7f3d87135640 1 -- 172.21.15.143:0/1787411135 wait complete. 2023-11-24T06:31:36.675 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2023-11-24T06:31:36.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 Processor -- start 2023-11-24T06:31:36.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 -- start start 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f310015d4e0 0x7f31000d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31000d3b10 0x7f310006bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000d25a0 con 0x7f31000d1580 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310006b880 con 0x7f31000d3b10 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3107216640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000d1a20 con 0x7f310015d4e0 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f30fffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f31000d1580 0x7f31000d3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56214/0 (socket says 172.21.15.143:56214) 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f30fffff640 1 -- 172.21.15.143:0/2332882046 learned_addr learned my addr 172.21.15.143:0/2332882046 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f3104fb2640 1 --2- 172.21.15.143:0/2332882046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f310015d4e0 0x7f31000d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f31057b3640 1 --2- 172.21.15.143:0/2332882046 >> v2:172.21.15.146:3300/0 conn(0x7f31000d3b10 0x7f310006bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f30ff7fe640 1 -- 172.21.15.143:0/2332882046 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519906155 0 0) 0x7f31000d25a0 con 0x7f31000d1580 2023-11-24T06:31:36.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.810+0000 7f30ff7fe640 1 -- 172.21.15.143:0/2332882046 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f0003530 con 0x7f31000d1580 2023-11-24T06:31:36.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3104fb2640 1 -- 172.21.15.143:0/2332882046 >> v2:172.21.15.146:3300/0 conn(0x7f31000d3b10 msgr2=0x7f310006bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:36.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3104fb2640 1 --2- 172.21.15.143:0/2332882046 >> v2:172.21.15.146:3300/0 conn(0x7f31000d3b10 0x7f310006bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3104fb2640 1 -- 172.21.15.143:0/2332882046 >> v1:172.21.15.143:6789/0 conn(0x7f31000d1580 legacy=0x7f31000d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3104fb2640 1 -- 172.21.15.143:0/2332882046 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000d1d00 con 0x7f310015d4e0 2023-11-24T06:31:36.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3104fb2640 1 --2- 172.21.15.143:0/2332882046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f310015d4e0 0x7f31000d1040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30f40097c0 tx=0x7f30f401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=576ef7ef0ef4585e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:36.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f30ff7fe640 1 -- 172.21.15.143:0/2332882046 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40ad660 con 0x7f310015d4e0 2023-11-24T06:31:36.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f30ff7fe640 1 -- 172.21.15.143:0/2332882046 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f40ad7c0 con 0x7f310015d4e0 2023-11-24T06:31:36.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f30ff7fe640 1 -- 172.21.15.143:0/2332882046 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40adb50 con 0x7f310015d4e0 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3107216640 1 -- 172.21.15.143:0/2332882046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f310015d4e0 msgr2=0x7f31000d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.814+0000 7f3107216640 1 --2- 172.21.15.143:0/2332882046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f310015d4e0 0x7f31000d1040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30f40097c0 tx=0x7f30f401c450 comp rx=0 tx=0).stop 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- 172.21.15.143:0/2332882046 shutdown_connections 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 --2- 172.21.15.143:0/2332882046 >> v2:172.21.15.146:3300/0 conn(0x7f31000d3b10 0x7f310006bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 --2- 172.21.15.143:0/2332882046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f310015d4e0 0x7f31000d1040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- 172.21.15.143:0/2332882046 >> 172.21.15.143:0/2332882046 conn(0x7f310008af70 msgr2=0x7f310009c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:36.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- 172.21.15.143:0/2332882046 shutdown_connections 2023-11-24T06:31:36.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- 172.21.15.143:0/2332882046 wait complete. 2023-11-24T06:31:36.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 Processor -- start 2023-11-24T06:31:36.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- start start 2023-11-24T06:31:36.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31000d1580 0x7f31001fa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31000d3b10 0x7f310015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 0x7f31000b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000c9e90 con 0x7f310015d4e0 2023-11-24T06:31:36.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310015f7f0 con 0x7f31000d3b10 2023-11-24T06:31:36.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3107216640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000c99e0 con 0x7f31000d1580 2023-11-24T06:31:36.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 0x7f31000b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 0x7f31000b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57498/0 (socket says 172.21.15.143:57498) 2023-11-24T06:31:36.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 -- 172.21.15.143:0/3745259507 learned_addr learned my addr 172.21.15.143:0/3745259507 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f3104fb2640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31000d1580 0x7f31001fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f30fffff640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31000d3b10 0x7f310015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 -- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31000d1580 msgr2=0x7f31001fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31000d1580 0x7f31001fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 -- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31000d3b10 msgr2=0x7f310015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31000d3b10 0x7f310015f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 -- 172.21.15.143:0/3745259507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009420 con 0x7f310015d4e0 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f30fffff640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31000d3b10 0x7f310015f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:36.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.818+0000 7f31057b3640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 0x7f31000b2020 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f30f800ec10 tx=0x7f30f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:36.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f800cd20 con 0x7f310015d4e0 2023-11-24T06:31:36.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f800f040 con 0x7f310015d4e0 2023-11-24T06:31:36.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31001f99a0 con 0x7f310015d4e0 2023-11-24T06:31:36.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80146c0 con 0x7f310015d4e0 2023-11-24T06:31:36.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310015fce0 con 0x7f310015d4e0 2023-11-24T06:31:36.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3100067c30 con 0x7f310015d4e0 2023-11-24T06:31:36.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f30f8014a30 con 0x7f310015d4e0 2023-11-24T06:31:36.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f30fd7fa640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f30e40666b0 0x7f30e4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:36.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f30f8084f90 con 0x7f310015d4e0 2023-11-24T06:31:36.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.822+0000 7f3104fb2640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f30e40666b0 0x7f30e4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:36.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.826+0000 7f3104fb2640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f30e40666b0 0x7f30e4068b70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30f40af000 tx=0x7f30f40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:36.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:36.826+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30f8052290 con 0x7f310015d4e0 2023-11-24T06:31:37.032 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.026+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) v1 -- 0x7f31000b0780 con 0x7f310015d4e0 2023-11-24T06:31:37.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.302+0000 7f30fd7fa640 1 -- 172.21.15.143:0/3745259507 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v139) v1 ==== 172+0+0 (secure 0 0 0) 0x7f30f80558b0 con 0x7f310015d4e0 2023-11-24T06:31:37.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f30e40666b0 msgr2=0x7f30e4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f30e40666b0 0x7f30e4068b70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30f40af000 tx=0x7f30f40a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:37.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 msgr2=0x7f31000b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 0x7f31000b2020 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f30f800ec10 tx=0x7f30f800c490 comp rx=0 tx=0).stop 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 shutdown_connections 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f30e40666b0 0x7f30e4068b70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f310015d4e0 0x7f31000b2020 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31000d3b10 0x7f310015f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 --2- 172.21.15.143:0/3745259507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31000d1580 0x7f31001fa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 >> 172.21.15.143:0/3745259507 conn(0x7f310008af70 msgr2=0x7f31000d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:37.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 shutdown_connections 2023-11-24T06:31:37.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.306+0000 7f3107216640 1 -- 172.21.15.143:0/3745259507 wait complete. 2023-11-24T06:31:37.331 INFO:tasks.cephfs_test_runner:Validate cleaning of stale subvolume snapshot metadata. ... ok 2023-11-24T06:31:37.332 INFO:tasks.cephfs_test_runner:Starting test: test_nonexistent_subvolume_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:31:37.332 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:37.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 Processor -- start 2023-11-24T06:31:37.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 -- start start 2023-11-24T06:31:37.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f449015d570 0x7f449006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44900d3020 0x7f44900d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900d39c0 con 0x7f44900ce8b0 2023-11-24T06:31:37.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44900d1cc0 con 0x7f44900d3020 2023-11-24T06:31:37.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f449489c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900d1fa0 con 0x7f449015d570 2023-11-24T06:31:37.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f4485d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44900d3020 0x7f44900d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f448ed9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f44900ce8b0 0x7f44900ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46730/0 (socket says 172.21.15.143:46730) 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f448ed9d640 1 -- 172.21.15.143:0/2895631033 learned_addr learned my addr 172.21.15.143:0/2895631033 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f448e59c640 1 --2- 172.21.15.143:0/2895631033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f449015d570 0x7f449006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f4485d9b640 1 -- 172.21.15.143:0/2895631033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f449015d570 msgr2=0x7f449006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f4485d9b640 1 --2- 172.21.15.143:0/2895631033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f449015d570 0x7f449006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f4485d9b640 1 -- 172.21.15.143:0/2895631033 >> v1:172.21.15.143:6789/0 conn(0x7f44900ce8b0 legacy=0x7f44900ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f4485d9b640 1 -- 172.21.15.143:0/2895631033 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900ce0b0 con 0x7f44900d3020 2023-11-24T06:31:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.466+0000 7f448dd9b640 1 -- 172.21.15.143:0/2895631033 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465315089 0 0) 0x7f44900d39c0 con 0x7f44900ce8b0 2023-11-24T06:31:37.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f4485d9b640 1 --2- 172.21.15.143:0/2895631033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900d3020 0x7f44900d3480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f44800097c0 tx=0x7f448001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1362bd62217439dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:37.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f448dd9b640 1 -- 172.21.15.143:0/2895631033 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800ac640 con 0x7f44900d3020 2023-11-24T06:31:37.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f448dd9b640 1 -- 172.21.15.143:0/2895631033 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800ac7a0 con 0x7f44900d3020 2023-11-24T06:31:37.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f448dd9b640 1 -- 172.21.15.143:0/2895631033 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800acb30 con 0x7f44900d3020 2023-11-24T06:31:37.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 -- 172.21.15.143:0/2895631033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900d3020 msgr2=0x7f44900d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 --2- 172.21.15.143:0/2895631033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900d3020 0x7f44900d3480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f44800097c0 tx=0x7f448001c3c0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 -- 172.21.15.143:0/2895631033 shutdown_connections 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 --2- 172.21.15.143:0/2895631033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900d3020 0x7f44900d3480 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 --2- 172.21.15.143:0/2895631033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f449015d570 0x7f449006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 -- 172.21.15.143:0/2895631033 >> 172.21.15.143:0/2895631033 conn(0x7f449008ceb0 msgr2=0x7f449009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 -- 172.21.15.143:0/2895631033 shutdown_connections 2023-11-24T06:31:37.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.470+0000 7f449489c640 1 -- 172.21.15.143:0/2895631033 wait complete. 2023-11-24T06:31:37.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 Processor -- start 2023-11-24T06:31:37.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- start start 2023-11-24T06:31:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 0x7f44900caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44900d3020 0x7f44900c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449015d570 0x7f4490159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900cc3f0 con 0x7f44900ce8b0 2023-11-24T06:31:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900cb7e0 con 0x7f449015d570 2023-11-24T06:31:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900cbac0 con 0x7f44900d3020 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 0x7f44900caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 0x7f44900caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57210/0 (socket says 172.21.15.143:57210) 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 -- 172.21.15.143:0/3333220565 learned_addr learned my addr 172.21.15.143:0/3333220565 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f4485d9b640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44900d3020 0x7f44900c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448ed9d640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449015d570 0x7f4490159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 -- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44900d3020 msgr2=0x7f44900c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44900d3020 0x7f44900c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 -- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449015d570 msgr2=0x7f4490159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449015d570 0x7f4490159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 -- 172.21.15.143:0/3333220565 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009420 con 0x7f44900ce8b0 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448ed9d640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449015d570 0x7f4490159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f448e59c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 0x7f44900caee0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f447800d5f0 tx=0x7f447800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780125f0 con 0x7f44900ce8b0 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4478012750 con 0x7f44900ce8b0 2023-11-24T06:31:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478012ae0 con 0x7f44900ce8b0 2023-11-24T06:31:37.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900cbda0 con 0x7f44900ce8b0 2023-11-24T06:31:37.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44900cb420 con 0x7f44900ce8b0 2023-11-24T06:31:37.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.474+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4490067520 con 0x7f44900ce8b0 2023-11-24T06:31:37.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.478+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f4478012c40 con 0x7f44900ce8b0 2023-11-24T06:31:37.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.478+0000 7f44877fe640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44700666b0 0x7f4470068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.478+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44780844b0 con 0x7f44900ce8b0 2023-11-24T06:31:37.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.478+0000 7f4485d9b640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44700666b0 0x7f4470068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.478+0000 7f4485d9b640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44700666b0 0x7f4470068b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44800ae000 tx=0x7f44800a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:37.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.482+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44780518d0 con 0x7f44900ce8b0 2023-11-24T06:31:37.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.630+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44900cf230 con 0x7f44900ce8b0 2023-11-24T06:31:37.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f44877fe640 1 -- 172.21.15.143:0/3333220565 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13036 (secure 0 0 0) 0x7f4478007380 con 0x7f44900ce8b0 2023-11-24T06:31:37.637 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:37.638 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":50,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:36.297714+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3877501822":"2023-11-25T06:31:33.498096+0000","172.21.15.143:6835/3877501822":"2023-11-25T06:31:33.498096+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:37.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44700666b0 msgr2=0x7f4470068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44700666b0 0x7f4470068b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44800ae000 tx=0x7f44800a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:37.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 msgr2=0x7f44900caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 0x7f44900caee0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f447800d5f0 tx=0x7f447800dab0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 shutdown_connections 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f44700666b0 0x7f4470068b70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449015d570 0x7f4490159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44900d3020 0x7f44900c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 --2- 172.21.15.143:0/3333220565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44900ce8b0 0x7f44900caee0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 >> 172.21.15.143:0/3333220565 conn(0x7f449008ceb0 msgr2=0x7f44900b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 shutdown_connections 2023-11-24T06:31:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.634+0000 7f449489c640 1 -- 172.21.15.143:0/3333220565 wait complete. 2023-11-24T06:31:37.659 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:31:37.659 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:31:37.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.794+0000 7f8bcabd0640 1 Processor -- start 2023-11-24T06:31:37.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.794+0000 7f8bcabd0640 1 -- start start 2023-11-24T06:31:37.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bcabd0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 0x7f8bc415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bcabd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc4161570 0x7f8bc41619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bcabd0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc4161f00 con 0x7f8bc40cdf10 2023-11-24T06:31:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bcabd0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40cf620 con 0x7f8bc40cdb30 2023-11-24T06:31:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bcabd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc4161090 con 0x7f8bc4161570 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bc9bce640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 0x7f8bc415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bca3cf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc4161570 0x7f8bc41619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bc9bce640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 0x7f8bc415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:60432/0 (socket says 172.21.15.143:60432) 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bc93cd640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8bc40cdf10 0x7f8bc40cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:49212/0 (socket says 172.21.15.143:49212) 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bc9bce640 1 -- 172.21.15.143:0/114943780 learned_addr learned my addr 172.21.15.143:0/114943780 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bca3cf640 1 -- 172.21.15.143:0/114943780 >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 msgr2=0x7f8bc415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bca3cf640 1 --2- 172.21.15.143:0/114943780 >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 0x7f8bc415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bca3cf640 1 -- 172.21.15.143:0/114943780 >> v1:172.21.15.146:6789/0 conn(0x7f8bc40cdf10 legacy=0x7f8bc40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bca3cf640 1 -- 172.21.15.143:0/114943780 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc415e010 con 0x7f8bc4161570 2023-11-24T06:31:37.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.798+0000 7f8bc9bce640 1 --2- 172.21.15.143:0/114943780 >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 0x7f8bc415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:37.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bca3cf640 1 --2- 172.21.15.143:0/114943780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc4161570 0x7f8bc41619c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40cf760 tx=0x7f8bbc01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90ead0698c889b30 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:37.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bc8bcc640 1 -- 172.21.15.143:0/114943780 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0a58d0 con 0x7f8bc4161570 2023-11-24T06:31:37.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bc8bcc640 1 -- 172.21.15.143:0/114943780 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0a5a30 con 0x7f8bc4161570 2023-11-24T06:31:37.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bc8bcc640 1 -- 172.21.15.143:0/114943780 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0a5dc0 con 0x7f8bc4161570 2023-11-24T06:31:37.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 -- 172.21.15.143:0/114943780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc4161570 msgr2=0x7f8bc41619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/114943780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc4161570 0x7f8bc41619c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40cf760 tx=0x7f8bbc01c900 comp rx=0 tx=0).stop 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 -- 172.21.15.143:0/114943780 shutdown_connections 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/114943780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc4161570 0x7f8bc41619c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/114943780 >> v2:172.21.15.146:3300/0 conn(0x7f8bc40cdb30 0x7f8bc415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 -- 172.21.15.143:0/114943780 >> 172.21.15.143:0/114943780 conn(0x7f8bc4060fd0 msgr2=0x7f8bc40613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 -- 172.21.15.143:0/114943780 shutdown_connections 2023-11-24T06:31:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 -- 172.21.15.143:0/114943780 wait complete. 2023-11-24T06:31:37.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 Processor -- start 2023-11-24T06:31:37.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.802+0000 7f8bcabd0640 1 -- start start 2023-11-24T06:31:37.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc40cdb30 0x7f8bc4158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bc40cdf10 0x7f8bc4149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 0x7f8bc40ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40c6b90 con 0x7f8bc4161570 2023-11-24T06:31:37.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc4158570 con 0x7f8bc40cdf10 2023-11-24T06:31:37.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40c5f80 con 0x7f8bc40cdb30 2023-11-24T06:31:37.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 0x7f8bc40ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bc9bce640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc40cdb30 0x7f8bc4158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 0x7f8bc40ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57230/0 (socket says 172.21.15.143:57230) 2023-11-24T06:31:37.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 -- 172.21.15.143:0/211196063 learned_addr learned my addr 172.21.15.143:0/211196063 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:37.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bc93cd640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bc40cdf10 0x7f8bc4149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 -- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc40cdb30 msgr2=0x7f8bc4158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc40cdb30 0x7f8bc4158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 -- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bc40cdf10 msgr2=0x7f8bc4149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bc40cdf10 0x7f8bc4149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 -- 172.21.15.143:0/211196063 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00094d0 con 0x7f8bc4161570 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bca3cf640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 0x7f8bc40ce710 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0b0040 tx=0x7f8bbc0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0b9860 con 0x7f8bc4161570 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0b99c0 con 0x7f8bc4161570 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0b9d70 con 0x7f8bc4161570 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc009a70 con 0x7f8bc4161570 2023-11-24T06:31:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc40c6540 con 0x7f8bc4161570 2023-11-24T06:31:37.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc40c6d00 con 0x7f8bc4161570 2023-11-24T06:31:37.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.806+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f8bbc0c4460 con 0x7f8bc4161570 2023-11-24T06:31:37.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.810+0000 7f8bba7fc640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ba80666b0 0x7f8ba8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:37.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.810+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8bbc11f2d0 con 0x7f8bc4161570 2023-11-24T06:31:37.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.810+0000 7f8bc9bce640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ba80666b0 0x7f8ba8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:37.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.810+0000 7f8bc9bce640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ba80666b0 0x7f8ba8068b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0006cb0 tx=0x7f8bc0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:37.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.814+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bbc0ec820 con 0x7f8bc4161570 2023-11-24T06:31:37.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bc404e850 con 0x7f8bc4161570 2023-11-24T06:31:37.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bba7fc640 1 -- 172.21.15.143:0/211196063 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bbc0efe40 con 0x7f8bc4161570 2023-11-24T06:31:37.979 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:31:37.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ba80666b0 msgr2=0x7f8ba8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ba80666b0 0x7f8ba8068b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0006cb0 tx=0x7f8bc0009240 comp rx=0 tx=0).stop 2023-11-24T06:31:37.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 msgr2=0x7f8bc40ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 0x7f8bc40ce710 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0b0040 tx=0x7f8bbc0196a0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 shutdown_connections 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ba80666b0 0x7f8ba8068b70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc4161570 0x7f8bc40ce710 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bc40cdf10 0x7f8bc4149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 --2- 172.21.15.143:0/211196063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bc40cdb30 0x7f8bc4158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.974+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 >> 172.21.15.143:0/211196063 conn(0x7f8bc4060fd0 msgr2=0x7f8bc415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:37.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.978+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 shutdown_connections 2023-11-24T06:31:37.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:37.978+0000 7f8bcabd0640 1 -- 172.21.15.143:0/211196063 wait complete. 2023-11-24T06:31:38.000 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_nonexistent_subvolume_snapshot_rm' 2023-11-24T06:31:38.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 Processor -- start 2023-11-24T06:31:38.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 -- start start 2023-11-24T06:31:38.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f749815a6b0 0x7f749806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f749815ab60 0x7f749806dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749815b100 con 0x7f7498143a90 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749815b3e0 con 0x7f749815ab60 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749e2f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749815ddb0 con 0x7f749815a6b0 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749d2f3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7498143a90 0x7f749815e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46738/0 (socket says 172.21.15.143:46738) 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749d2f3640 1 -- 172.21.15.143:0/3542314589 learned_addr learned my addr 172.21.15.143:0/3542314589 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 --2- 172.21.15.143:0/3542314589 >> v2:172.21.15.146:3300/0 conn(0x7f749815ab60 0x7f749806dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749caf2640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f749815a6b0 0x7f749806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430400138 0 0) 0x7f749815b100 con 0x7f7498143a90 2023-11-24T06:31:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7484003530 con 0x7f7498143a90 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153442102 0 0) 0x7f7484003530 con 0x7f7498143a90 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f749815a6b0 msgr2=0x7f749806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f749815a6b0 0x7f749806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 >> v2:172.21.15.146:3300/0 conn(0x7f749815ab60 msgr2=0x7f749806dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 --2- 172.21.15.143:0/3542314589 >> v2:172.21.15.146:3300/0 conn(0x7f749815ab60 0x7f749806dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749815e090 con 0x7f7498143a90 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f7494001680 con 0x7f7498143a90 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 >> v1:172.21.15.143:6789/0 conn(0x7f7498143a90 legacy=0x7f749815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484003980 0x7f7484003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74840047d0 0x7f7484004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7484005190 0x7f748400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749815b3e0 con 0x7f74840047d0 2023-11-24T06:31:38.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749815ddb0 con 0x7f7484003980 2023-11-24T06:31:38.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7484010410 con 0x7f7484005190 2023-11-24T06:31:38.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749caf2640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f749815a6b0 0x7f749806d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:38.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749caf2640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74840047d0 0x7f7484004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7484005190 0x7f748400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749d2f3640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484003980 0x7f7484003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 -- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484003980 msgr2=0x7f7484003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484003980 0x7f7484003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 -- 172.21.15.143:0/3542314589 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74840047d0 msgr2=0x7f7484004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74840047d0 0x7f7484004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749daf4640 1 -- 172.21.15.143:0/3542314589 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484003530 con 0x7f7484005190 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.134+0000 7f749caf2640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74840047d0 0x7f7484004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749daf4640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7484005190 0x7f748400fda0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7490009fc0 tx=0x7f749001cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6323c639f957dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900a5cb0 con 0x7f7484005190 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000f040 con 0x7f7484005190 2023-11-24T06:31:38.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f748ffff640 1 -- 172.21.15.143:0/3542314589 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900ad680 con 0x7f7484005190 2023-11-24T06:31:38.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749e2f5640 1 -- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7484005190 msgr2=0x7f748400fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:38.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749e2f5640 1 --2- 172.21.15.143:0/3542314589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7484005190 0x7f748400fda0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7490009fc0 tx=0x7f749001cca0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749daf4640 1 -- 172.21.15.143:0/3542314589 reap_dead start 2023-11-24T06:31:38.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749e2f5640 1 -- 172.21.15.143:0/3542314589 shutdown_connections 2023-11-24T06:31:38.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749e2f5640 1 -- 172.21.15.143:0/3542314589 >> 172.21.15.143:0/3542314589 conn(0x7f74980cb840 msgr2=0x7f74980cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749e2f5640 1 -- 172.21.15.143:0/3542314589 shutdown_connections 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.138+0000 7f749e2f5640 1 -- 172.21.15.143:0/3542314589 wait complete. 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 Processor -- start 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 -- start start 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484005190 0x7f7498157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 0x7f74980b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498141090 0x7f749815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74981423d0 con 0x7f749813d020 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980b0ea0 con 0x7f7484005190 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74980b1180 con 0x7f7498141090 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 0x7f74980b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 0x7f74980b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57248/0 (socket says 172.21.15.143:57248) 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 -- 172.21.15.143:0/151817950 learned_addr learned my addr 172.21.15.143:0/151817950 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749d2f3640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484005190 0x7f7498157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749daf4640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498141090 0x7f749815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 -- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498141090 msgr2=0x7f749815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:38.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498141090 0x7f749815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 -- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484005190 msgr2=0x7f7498157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:38.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484005190 0x7f7498157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:38.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 -- 172.21.15.143:0/151817950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498070e60 con 0x7f749813d020 2023-11-24T06:31:38.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749caf2640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 0x7f74980b0670 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7488011cf0 tx=0x7f748800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488009690 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7488011e40 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488014660 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74980b1460 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.142+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74980b0bb0 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.146+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74980b1980 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.146+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f74880147c0 con 0x7f749813d020 2023-11-24T06:31:38.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.146+0000 7f748dffb640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f747c0666b0 0x7f747c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:38.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.146+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7488084a90 con 0x7f749813d020 2023-11-24T06:31:38.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.146+0000 7f749d2f3640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f747c0666b0 0x7f747c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:38.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.146+0000 7f749d2f3640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f747c0666b0 0x7f747c068b70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7494001130 tx=0x7f7494001de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:38.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.150+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74980b1980 con 0x7f749813d020 2023-11-24T06:31:38.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:31:38.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:31:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:38.362+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_nonexistent_subvolume_snapshot_rm"]} v 0) v1 -- 0x7f74980b1980 con 0x7f749813d020 2023-11-24T06:31:39.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f748dffb640 1 -- 172.21.15.143:0/151817950 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_nonexistent_subvolume_snapshot_rm"]}]=0 v141) v1 ==== 169+0+0 (secure 0 0 0) 0x7f74980b1980 con 0x7f749813d020 2023-11-24T06:31:43.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f747c0666b0 msgr2=0x7f747c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f747c0666b0 0x7f747c068b70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7494001130 tx=0x7f7494001de0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 msgr2=0x7f74980b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 0x7f74980b0670 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7488011cf0 tx=0x7f748800f610 comp rx=0 tx=0).stop 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 shutdown_connections 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f747c0666b0 0x7f747c068b70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498141090 0x7f749815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f749813d020 0x7f74980b0670 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 --2- 172.21.15.143:0/151817950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7484005190 0x7f7498157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 >> 172.21.15.143:0/151817950 conn(0x7f74980cb840 msgr2=0x7f749813af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:43.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.314+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 shutdown_connections 2023-11-24T06:31:43.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:39.318+0000 7f749e2f5640 1 -- 172.21.15.143:0/151817950 wait complete. 2023-11-24T06:31:43.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:31:43.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 Processor -- start 2023-11-24T06:31:43.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 -- start start 2023-11-24T06:31:43.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13840ce2e0 0x7f138406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:43.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13840b1f80 0x7f1384163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138415a050 con 0x7f13840ccef0 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840722e0 con 0x7f13840ce2e0 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138c7e7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1384072860 con 0x7f13840b1f80 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138a583640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f13840ccef0 0x7f138406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46754/0 (socket says 172.21.15.143:46754) 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138a583640 1 -- 172.21.15.143:0/3625294695 learned_addr learned my addr 172.21.15.143:0/3625294695 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389d82640 1 --2- 172.21.15.143:0/3625294695 >> v2:172.21.15.143:3300/0 conn(0x7f13840ce2e0 0x7f138406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:43.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f138ad84640 1 --2- 172.21.15.143:0/3625294695 >> v2:172.21.15.146:3300/0 conn(0x7f13840b1f80 0x7f1384163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:43.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389581640 1 -- 172.21.15.143:0/3625294695 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128730930 0 0) 0x7f138415a050 con 0x7f13840ccef0 2023-11-24T06:31:43.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389581640 1 -- 172.21.15.143:0/3625294695 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1370003450 con 0x7f13840ccef0 2023-11-24T06:31:43.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389d82640 1 -- 172.21.15.143:0/3625294695 >> v2:172.21.15.146:3300/0 conn(0x7f13840b1f80 msgr2=0x7f1384163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:43.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389d82640 1 --2- 172.21.15.143:0/3625294695 >> v2:172.21.15.146:3300/0 conn(0x7f13840b1f80 0x7f1384163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389d82640 1 -- 172.21.15.143:0/3625294695 >> v1:172.21.15.143:6789/0 conn(0x7f13840ccef0 legacy=0x7f138406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.746+0000 7f1389d82640 1 -- 172.21.15.143:0/3625294695 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840705e0 con 0x7f13840ce2e0 2023-11-24T06:31:43.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f1389d82640 1 --2- 172.21.15.143:0/3625294695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce2e0 0x7f138406da40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f13840719a0 tx=0x7f137401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc34fbf504420210 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:43.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f1389581640 1 -- 172.21.15.143:0/3625294695 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740ac410 con 0x7f13840ce2e0 2023-11-24T06:31:43.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f1389581640 1 -- 172.21.15.143:0/3625294695 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740ac570 con 0x7f13840ce2e0 2023-11-24T06:31:43.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f1389581640 1 -- 172.21.15.143:0/3625294695 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740ac900 con 0x7f13840ce2e0 2023-11-24T06:31:43.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 -- 172.21.15.143:0/3625294695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce2e0 msgr2=0x7f138406da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 --2- 172.21.15.143:0/3625294695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce2e0 0x7f138406da40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f13840719a0 tx=0x7f137401c430 comp rx=0 tx=0).stop 2023-11-24T06:31:43.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 -- 172.21.15.143:0/3625294695 shutdown_connections 2023-11-24T06:31:43.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 --2- 172.21.15.143:0/3625294695 >> v2:172.21.15.146:3300/0 conn(0x7f13840b1f80 0x7f1384163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 --2- 172.21.15.143:0/3625294695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840ce2e0 0x7f138406da40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 -- 172.21.15.143:0/3625294695 >> 172.21.15.143:0/3625294695 conn(0x7f13840b0c80 msgr2=0x7f13840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:43.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 -- 172.21.15.143:0/3625294695 shutdown_connections 2023-11-24T06:31:43.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.750+0000 7f138c7e7640 1 -- 172.21.15.143:0/3625294695 wait complete. 2023-11-24T06:31:43.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 Processor -- start 2023-11-24T06:31:43.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- start start 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 0x7f1384140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840ccef0 0x7f13840c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ce2e0 0x7f13840afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384150100 con 0x7f13840b1f80 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138414f4f0 con 0x7f13840ccef0 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138414f7d0 con 0x7f13840ce2e0 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 0x7f1384140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 0x7f1384140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57272/0 (socket says 172.21.15.143:57272) 2023-11-24T06:31:43.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 -- 172.21.15.143:0/2244117031 learned_addr learned my addr 172.21.15.143:0/2244117031 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f1389d82640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840ccef0 0x7f13840c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138ad84640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ce2e0 0x7f13840afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 -- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ce2e0 msgr2=0x7f13840afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ce2e0 0x7f13840afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 -- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840ccef0 msgr2=0x7f13840c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840ccef0 0x7f13840c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 -- 172.21.15.143:0/2244117031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009420 con 0x7f13840b1f80 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f1389d82640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840ccef0 0x7f13840c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138ad84640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ce2e0 0x7f13840afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138a583640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 0x7f1384140e80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f138000c4d0 tx=0x7f138000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380005cf0 con 0x7f13840b1f80 2023-11-24T06:31:43.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380005e50 con 0x7f13840b1f80 2023-11-24T06:31:43.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380007270 con 0x7f13840b1f80 2023-11-24T06:31:43.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138414fab0 con 0x7f13840b1f80 2023-11-24T06:31:43.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13841413c0 con 0x7f13840b1f80 2023-11-24T06:31:43.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.754+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138404e8c0 con 0x7f13840b1f80 2023-11-24T06:31:43.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.758+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f13800073d0 con 0x7f13840b1f80 2023-11-24T06:31:43.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.758+0000 7f137affd640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f13680666b0 0x7f1368068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:43.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.758+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1380083510 con 0x7f13840b1f80 2023-11-24T06:31:43.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.758+0000 7f1389d82640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f13680666b0 0x7f1368068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:43.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.758+0000 7f1389d82640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f13680666b0 0x7f1368068b70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f13740ae000 tx=0x7f13740a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:43.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.762+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13800509d0 con 0x7f13840b1f80 2023-11-24T06:31:43.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.910+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f138406e900 con 0x7f13840b1f80 2023-11-24T06:31:43.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.914+0000 7f137affd640 1 -- 172.21.15.143:0/2244117031 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13800170c0 con 0x7f13840b1f80 2023-11-24T06:31:43.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f13680666b0 msgr2=0x7f1368068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f13680666b0 0x7f1368068b70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f13740ae000 tx=0x7f13740a6040 comp rx=0 tx=0).stop 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 msgr2=0x7f1384140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 0x7f1384140e80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f138000c4d0 tx=0x7f138000c990 comp rx=0 tx=0).stop 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 shutdown_connections 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f13680666b0 0x7f1368068b70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13840ce2e0 0x7f13840afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13840ccef0 0x7f13840c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 --2- 172.21.15.143:0/2244117031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840b1f80 0x7f1384140e80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 >> 172.21.15.143:0/2244117031 conn(0x7f13840b0c80 msgr2=0x7f13840cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 shutdown_connections 2023-11-24T06:31:43.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:43.918+0000 7f138c7e7640 1 -- 172.21.15.143:0/2244117031 wait complete. 2023-11-24T06:31:43.941 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:31:43.942 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:31:44.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:31:44.140 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:31:44.140 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:44.141 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:44.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:31:44.151 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:44.151 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:44.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:31:44.163 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:44.163 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:44.202 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:31:44.202 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:44.202 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:44.219 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:31:44.219 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:31:44.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:44.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b775b8640 1 Processor -- start 2023-11-24T06:31:44.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b775b8640 1 -- start start 2023-11-24T06:31:44.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b775b8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b70070ec0 0x7f0b7016c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b775b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7006dc20 con 0x7f0b70158a50 2023-11-24T06:31:44.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b775b8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7006cd60 con 0x7f0b7006e340 2023-11-24T06:31:44.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b775b8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7006e0b0 con 0x7f0b70070ec0 2023-11-24T06:31:44.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b75354640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0b70158a50 0x7f0b7006c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46766/0 (socket says 172.21.15.143:46766) 2023-11-24T06:31:44.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b75354640 1 -- 172.21.15.143:0/2502588185 learned_addr learned my addr 172.21.15.143:0/2502588185 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:44.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b75b55640 1 --2- 172.21.15.143:0/2502588185 >> v2:172.21.15.146:3300/0 conn(0x7f0b70070ec0 0x7f0b7016c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b67fff640 1 -- 172.21.15.143:0/2502588185 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469384347 0 0) 0x7f0b7006dc20 con 0x7f0b70158a50 2023-11-24T06:31:44.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.378+0000 7f0b67fff640 1 -- 172.21.15.143:0/2502588185 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b5c003530 con 0x7f0b70158a50 2023-11-24T06:31:44.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b75b55640 1 -- 172.21.15.143:0/2502588185 >> v1:172.21.15.146:6789/0 conn(0x7f0b7006e340 legacy=0x7f0b700707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b75b55640 1 -- 172.21.15.143:0/2502588185 >> v1:172.21.15.143:6789/0 conn(0x7f0b70158a50 legacy=0x7f0b7006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b75b55640 1 -- 172.21.15.143:0/2502588185 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700b3620 con 0x7f0b70070ec0 2023-11-24T06:31:44.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b75b55640 1 --2- 172.21.15.143:0/2502588185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70070ec0 0x7f0b7016c6a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009d90 tx=0x7f0b6801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d25229d9572dcd99 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:44.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b67fff640 1 -- 172.21.15.143:0/2502588185 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680a59e0 con 0x7f0b70070ec0 2023-11-24T06:31:44.388 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b67fff640 1 -- 172.21.15.143:0/2502588185 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b680a5b40 con 0x7f0b70070ec0 2023-11-24T06:31:44.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b67fff640 1 -- 172.21.15.143:0/2502588185 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680ad440 con 0x7f0b70070ec0 2023-11-24T06:31:44.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b775b8640 1 -- 172.21.15.143:0/2502588185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70070ec0 msgr2=0x7f0b7016c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.382+0000 7f0b775b8640 1 --2- 172.21.15.143:0/2502588185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70070ec0 0x7f0b7016c6a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009d90 tx=0x7f0b6801c920 comp rx=0 tx=0).stop 2023-11-24T06:31:44.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- 172.21.15.143:0/2502588185 shutdown_connections 2023-11-24T06:31:44.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 --2- 172.21.15.143:0/2502588185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70070ec0 0x7f0b7016c6a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- 172.21.15.143:0/2502588185 >> 172.21.15.143:0/2502588185 conn(0x7f0b700b0bf0 msgr2=0x7f0b700b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:44.390 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- 172.21.15.143:0/2502588185 shutdown_connections 2023-11-24T06:31:44.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- 172.21.15.143:0/2502588185 wait complete. 2023-11-24T06:31:44.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 Processor -- start 2023-11-24T06:31:44.391 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- start start 2023-11-24T06:31:44.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b7006e340 0x7f0b700adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 0x7f0b70153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70158a50 0x7f0b701509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70163f90 con 0x7f0b70070ec0 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70164270 con 0x7f0b70158a50 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b775b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70164550 con 0x7f0b7006e340 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 0x7f0b70153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 0x7f0b70153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57282/0 (socket says 172.21.15.143:57282) 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 -- 172.21.15.143:0/1200810938 learned_addr learned my addr 172.21.15.143:0/1200810938 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b75354640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b7006e340 0x7f0b700adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b75b55640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70158a50 0x7f0b701509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 -- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b7006e340 msgr2=0x7f0b700adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b7006e340 0x7f0b700adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 -- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70158a50 msgr2=0x7f0b701509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70158a50 0x7f0b701509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 -- 172.21.15.143:0/1200810938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68009a70 con 0x7f0b70070ec0 2023-11-24T06:31:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b75354640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b7006e340 0x7f0b700adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:44.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.386+0000 7f0b74b53640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 0x7f0b70153cd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c3c0 tx=0x7f0b6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:44.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600052d0 con 0x7f0b70070ec0 2023-11-24T06:31:44.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60005430 con 0x7f0b70070ec0 2023-11-24T06:31:44.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60003840 con 0x7f0b70070ec0 2023-11-24T06:31:44.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70164830 con 0x7f0b70070ec0 2023-11-24T06:31:44.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b700ae390 con 0x7f0b70070ec0 2023-11-24T06:31:44.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b70067520 con 0x7f0b70070ec0 2023-11-24T06:31:44.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f0b600039a0 con 0x7f0b70070ec0 2023-11-24T06:31:44.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b65ffb640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0b540666b0 0x7f0b54068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0b60083410 con 0x7f0b70070ec0 2023-11-24T06:31:44.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b75354640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0b540666b0 0x7f0b54068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.390+0000 7f0b75354640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0b540666b0 0x7f0b54068b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0011f0 tx=0x7f0b6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:44.400 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.394+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b60050910 con 0x7f0b70070ec0 2023-11-24T06:31:44.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.574+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b700b1170 con 0x7f0b70070ec0 2023-11-24T06:31:44.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.574+0000 7f0b65ffb640 1 -- 172.21.15.143:0/1200810938 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f0b60053f30 con 0x7f0b70070ec0 2023-11-24T06:31:44.580 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:44.580 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2883761374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2883761374},{"type":"v1","addr":"172.21.15.146:6834","nonce":2883761374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5335,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/447234612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":447234612},{"type":"v1","addr":"172.21.15.146:6835","nonce":447234612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/1473422972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1473422972},{"type":"v1","addr":"172.21.15.143:6836","nonce":1473422972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6027,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/1176136963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":1176136963},{"type":"v1","addr":"172.21.15.143:6837","nonce":1176136963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-11-24T06:31:44.580 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 28 2023-11-24T06:31:44.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0b540666b0 msgr2=0x7f0b54068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0b540666b0 0x7f0b54068b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0011f0 tx=0x7f0b6c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:44.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 msgr2=0x7f0b70153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 0x7f0b70153cd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c3c0 tx=0x7f0b6000c880 comp rx=0 tx=0).stop 2023-11-24T06:31:44.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 shutdown_connections 2023-11-24T06:31:44.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0b540666b0 0x7f0b54068b70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b70158a50 0x7f0b701509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b70070ec0 0x7f0b70153cd0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 --2- 172.21.15.143:0/1200810938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b7006e340 0x7f0b700adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 >> 172.21.15.143:0/1200810938 conn(0x7f0b700b0bf0 msgr2=0x7f0b700aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:44.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 shutdown_connections 2023-11-24T06:31:44.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.578+0000 7f0b775b8640 1 -- 172.21.15.143:0/1200810938 wait complete. 2023-11-24T06:31:44.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:31:44.602 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:31:44.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:31:44.602 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:31:44.602 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:31:44.602 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:31:44.602 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:31:44.603 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:31:44.603 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:31:44.603 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:31:44.603 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:31:44.603 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:31:44.603 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:31:44.603 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:31:44.604 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:31:44.604 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:31:44.616 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:31:44.616 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:31:44.617 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:31:44.617 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:31:44.619 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:31:44.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:31:44.620 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:31:44.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:31:44.664 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:31:44.664 DEBUG:teuthology.parallel:result is None 2023-11-24T06:31:44.665 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:31:44.665 DEBUG:teuthology.parallel:result is None 2023-11-24T06:31:44.666 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:31:44.666 DEBUG:teuthology.parallel:result is None 2023-11-24T06:31:44.667 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:31:44.667 DEBUG:teuthology.parallel:result is None 2023-11-24T06:31:44.667 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:31:44.752 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:31:44.753 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:31:44.759 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-11-24T06:31:44.760 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:31:44.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.806+0000 7f50cbbd1640 1 Processor -- start 2023-11-24T06:31:44.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50cbbd1640 1 -- start start 2023-11-24T06:31:44.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50cbbd1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50c415d570 0x7f50c406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50cbbd1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40d1cc0 con 0x7f50c40ce8b0 2023-11-24T06:31:44.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50cbbd1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40d1fa0 con 0x7f50c40d3020 2023-11-24T06:31:44.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50cbbd1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40ce0b0 con 0x7f50c415d570 2023-11-24T06:31:44.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50ca16e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f50c40ce8b0 0x7f50c40ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46802/0 (socket says 172.21.15.143:46802) 2023-11-24T06:31:44.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50ca16e640 1 -- 172.21.15.143:0/4192300950 learned_addr learned my addr 172.21.15.143:0/4192300950 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:44.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c996d640 1 --2- 172.21.15.143:0/4192300950 >> v2:172.21.15.146:3300/0 conn(0x7f50c415d570 0x7f50c406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452815862 0 0) 0x7f50c40d1cc0 con 0x7f50c40ce8b0 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b0003530 con 0x7f50c40ce8b0 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221950159 0 0) 0x7f50c40d1fa0 con 0x7f50c40d3020 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c40d1cc0 con 0x7f50c40d3020 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c996d640 1 -- 172.21.15.143:0/4192300950 >> v1:172.21.15.146:6789/0 conn(0x7f50c40d3020 legacy=0x7f50c40d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c996d640 1 -- 172.21.15.143:0/4192300950 >> v1:172.21.15.143:6789/0 conn(0x7f50c40ce8b0 legacy=0x7f50c40ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.810+0000 7f50c996d640 1 -- 172.21.15.143:0/4192300950 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40ce390 con 0x7f50c415d570 2023-11-24T06:31:44.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50c996d640 1 --2- 172.21.15.143:0/4192300950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c415d570 0x7f50c406b9d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50c00097c0 tx=0x7f50c001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb418865a9c17359 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:44.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00a8050 con 0x7f50c415d570 2023-11-24T06:31:44.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c00ac5f0 con 0x7f50c415d570 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50c896b640 1 -- 172.21.15.143:0/4192300950 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00ac980 con 0x7f50c415d570 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 -- 172.21.15.143:0/4192300950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c415d570 msgr2=0x7f50c406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/4192300950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c415d570 0x7f50c406b9d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50c00097c0 tx=0x7f50c001c480 comp rx=0 tx=0).stop 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 -- 172.21.15.143:0/4192300950 shutdown_connections 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/4192300950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c415d570 0x7f50c406b9d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 -- 172.21.15.143:0/4192300950 >> 172.21.15.143:0/4192300950 conn(0x7f50c408ceb0 msgr2=0x7f50c409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 -- 172.21.15.143:0/4192300950 shutdown_connections 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 -- 172.21.15.143:0/4192300950 wait complete. 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 Processor -- start 2023-11-24T06:31:44.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.814+0000 7f50cbbd1640 1 -- start start 2023-11-24T06:31:44.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50c40ce8b0 0x7f50c41491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c40d3020 0x7f50c40c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 0x7f50c413ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41577f0 con 0x7f50c415d570 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41496f0 con 0x7f50c40d3020 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40b65c0 con 0x7f50c40ce8b0 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 0x7f50c413ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 0x7f50c413ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57314/0 (socket says 172.21.15.143:57314) 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 -- 172.21.15.143:0/3809757602 learned_addr learned my addr 172.21.15.143:0/3809757602 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:44.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50c996d640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50c40ce8b0 0x7f50c41491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50c916c640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c40d3020 0x7f50c40c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 -- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50c40ce8b0 msgr2=0x7f50c41491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50c40ce8b0 0x7f50c41491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 -- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c40d3020 msgr2=0x7f50c40c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c40d3020 0x7f50c40c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 -- 172.21.15.143:0/3809757602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0009420 con 0x7f50c415d570 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ca16e640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 0x7f50c413ae30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00caf0 tx=0x7f50bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc00ac40 con 0x7f50c415d570 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc00ada0 con 0x7f50c415d570 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c4157130 con 0x7f50c415d570 2023-11-24T06:31:44.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc012620 con 0x7f50c415d570 2023-11-24T06:31:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c4156e40 con 0x7f50c415d570 2023-11-24T06:31:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.818+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c4157930 con 0x7f50c415d570 2023-11-24T06:31:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.822+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f50bc007070 con 0x7f50c415d570 2023-11-24T06:31:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.822+0000 7f50ba7fc640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f50a80666e0 0x7f50a8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:44.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.822+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50bc083e80 con 0x7f50c415d570 2023-11-24T06:31:44.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.822+0000 7f50c996d640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f50a80666e0 0x7f50a8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:44.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.822+0000 7f50c996d640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f50a80666e0 0x7f50a8068ba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50c00ae000 tx=0x7f50c00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:44.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.826+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50c4157930 con 0x7f50c415d570 2023-11-24T06:31:44.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:44.994+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f50c4157930 con 0x7f50c415d570 2023-11-24T06:31:45.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.950+0000 7f50ba7fc640 1 -- 172.21.15.143:0/3809757602 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f50c4157930 con 0x7f50c415d570 2023-11-24T06:31:45.954 INFO:teuthology.orchestra.run.smithi143.stderr: removed all blocklist entries 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f50a80666e0 msgr2=0x7f50a8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f50a80666e0 0x7f50a8068ba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50c00ae000 tx=0x7f50c00a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 msgr2=0x7f50c413ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 0x7f50c413ae30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00caf0 tx=0x7f50bc00a060 comp rx=0 tx=0).stop 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 shutdown_connections 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f50a80666e0 0x7f50a8068ba0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50c415d570 0x7f50c413ae30 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c40d3020 0x7f50c40c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 --2- 172.21.15.143:0/3809757602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50c40ce8b0 0x7f50c41491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 >> 172.21.15.143:0/3809757602 conn(0x7f50c408ceb0 msgr2=0x7f50c4159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 shutdown_connections 2023-11-24T06:31:45.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:45.954+0000 7f50cbbd1640 1 -- 172.21.15.143:0/3809757602 wait complete. 2023-11-24T06:31:45.981 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:31:46.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff843c68640 1 Processor -- start 2023-11-24T06:31:46.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff843c68640 1 -- start start 2023-11-24T06:31:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff843c68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff843c68640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c15a700 con 0x7ff83c15a320 2023-11-24T06:31:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff843c68640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c0b2620 con 0x7ff83c070da0 2023-11-24T06:31:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff843c68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0b2430 con 0x7ff83c0b36c0 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff841a04640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff83c15a320 0x7ff83c070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46814/0 (socket says 172.21.15.143:46814) 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff841a04640 1 -- 172.21.15.143:0/206868962 learned_addr learned my addr 172.21.15.143:0/206868962 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff841203640 1 --2- 172.21.15.143:0/206868962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff840a02640 1 -- 172.21.15.143:0/206868962 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866418123 0 0) 0x7ff83c15a700 con 0x7ff83c15a320 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff840a02640 1 -- 172.21.15.143:0/206868962 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff828003530 con 0x7ff83c15a320 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff840a02640 1 -- 172.21.15.143:0/206868962 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694762776 0 0) 0x7ff83c0b2620 con 0x7ff83c070da0 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff841203640 1 -- 172.21.15.143:0/206868962 >> v1:172.21.15.146:6789/0 conn(0x7ff83c070da0 legacy=0x7ff83c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff841203640 1 -- 172.21.15.143:0/206868962 >> v1:172.21.15.143:6789/0 conn(0x7ff83c15a320 legacy=0x7ff83c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.118+0000 7ff841203640 1 -- 172.21.15.143:0/206868962 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0b2900 con 0x7ff83c0b36c0 2023-11-24T06:31:46.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff841203640 1 --2- 172.21.15.143:0/206868962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c0b1ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0097f0 tx=0x7ff82c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5341feacd6678102 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff840a02640 1 -- 172.21.15.143:0/206868962 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0ac600 con 0x7ff83c0b36c0 2023-11-24T06:31:46.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff840a02640 1 -- 172.21.15.143:0/206868962 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c0a8050 con 0x7ff83c0b36c0 2023-11-24T06:31:46.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff840a02640 1 -- 172.21.15.143:0/206868962 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0ac960 con 0x7ff83c0b36c0 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 -- 172.21.15.143:0/206868962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 msgr2=0x7ff83c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 --2- 172.21.15.143:0/206868962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c0b1ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0097f0 tx=0x7ff82c01c490 comp rx=0 tx=0).stop 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 -- 172.21.15.143:0/206868962 shutdown_connections 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 --2- 172.21.15.143:0/206868962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c0b1ef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 -- 172.21.15.143:0/206868962 >> 172.21.15.143:0/206868962 conn(0x7ff83c0b0bf0 msgr2=0x7ff83c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 -- 172.21.15.143:0/206868962 shutdown_connections 2023-11-24T06:31:46.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.122+0000 7ff843c68640 1 -- 172.21.15.143:0/206868962 wait complete. 2023-11-24T06:31:46.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 Processor -- start 2023-11-24T06:31:46.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 -- start start 2023-11-24T06:31:46.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c070da0 0x7ff83c164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 0x7ff83c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c163310 con 0x7ff83c15a320 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c163560 con 0x7ff83c070da0 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c163840 con 0x7ff83c0b36c0 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 0x7ff83c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 0x7ff83c14f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57316/0 (socket says 172.21.15.143:57316) 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 -- 172.21.15.143:0/2947428913 learned_addr learned my addr 172.21.15.143:0/2947428913 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff841a04640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c070da0 0x7ff83c164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff841203640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 -- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 msgr2=0x7ff83c152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 -- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c070da0 msgr2=0x7ff83c164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c070da0 0x7ff83c164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 -- 172.21.15.143:0/2947428913 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009420 con 0x7ff83c15a320 2023-11-24T06:31:46.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff842205640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 0x7ff83c14f240 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c780 tx=0x7ff83400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834003db0 con 0x7ff83c15a320 2023-11-24T06:31:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400ce90 con 0x7ff83c15a320 2023-11-24T06:31:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340052b0 con 0x7ff83c15a320 2023-11-24T06:31:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.126+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c163b20 con 0x7ff83c15a320 2023-11-24T06:31:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c1640e0 con 0x7ff83c15a320 2023-11-24T06:31:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c067520 con 0x7ff83c15a320 2023-11-24T06:31:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7ff834005410 con 0x7ff83c15a320 2023-11-24T06:31:46.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff8327fc640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff8200666e0 0x7ff820068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff834083c40 con 0x7ff83c15a320 2023-11-24T06:31:46.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff841a04640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff8200666e0 0x7ff820068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.130+0000 7ff841a04640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff8200666e0 0x7ff820068ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff838007fd0 tx=0x7ff838009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.134+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff834051150 con 0x7ff83c15a320 2023-11-24T06:31:46.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.338+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff83c0b1070 con 0x7ff83c15a320 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.338+0000 7ff8327fc640 1 -- 172.21.15.143:0/2947428913 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff834054770 con 0x7ff83c15a320 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: "auth_dump": [ 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.a", 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA==", 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.344 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.b", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA==", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:46.345 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.c", 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg==", 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.d", 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ==", 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.347 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.0", 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg==", 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.1", 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg==", 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.348 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.2", 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA==", 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.3", 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw==", 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.4", 2023-11-24T06:31:46.350 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew==", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.5", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ==", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.351 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.6", 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ==", 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.352 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.7", 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA==", 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.0", 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA==", 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.353 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow r", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.1", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w==", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:31:46.354 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.2", 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw==", 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.3", 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw==", 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.356 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.admin", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlFbv3BRAAPWkl+V8uDy+7+/Qdzjn9Fw==", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.x", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ==", 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.357 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.y", 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw==", 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:31:46.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:46.359 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2023-11-24T06:31:46.359 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff8200666e0 msgr2=0x7ff820068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff8200666e0 0x7ff820068ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff838007fd0 tx=0x7ff838009040 comp rx=0 tx=0).stop 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 msgr2=0x7ff83c14f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 0x7ff83c14f240 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c780 tx=0x7ff83400cc40 comp rx=0 tx=0).stop 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 shutdown_connections 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff8200666e0 0x7ff820068ba0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff83c15a320 0x7ff83c14f240 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff83c0b36c0 0x7ff83c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 --2- 172.21.15.143:0/2947428913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c070da0 0x7ff83c164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 >> 172.21.15.143:0/2947428913 conn(0x7ff83c0b0bf0 msgr2=0x7ff83c165740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:46.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 shutdown_connections 2023-11-24T06:31:46.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.342+0000 7ff843c68640 1 -- 172.21.15.143:0/2947428913 wait complete. 2023-11-24T06:31:46.366 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:46.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 Processor -- start 2023-11-24T06:31:46.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 -- start start 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f76d4160be0 0x7f76d415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76d415e250 0x7f76d40b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d415e660 con 0x7f76d40b37b0 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d406c650 con 0x7f76d4160be0 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76dc49a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40b4180 con 0x7f76d415e250 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76da236640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f76d4160be0 0x7f76d415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76da236640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f76d4160be0 0x7f76d415ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57334/0 (socket says 172.21.15.143:57334) 2023-11-24T06:31:46.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.498+0000 7f76da236640 1 -- 172.21.15.143:0/2278034067 learned_addr learned my addr 172.21.15.143:0/2278034067 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76da236640 1 -- 172.21.15.143:0/2278034067 >> v2:172.21.15.146:3300/0 conn(0x7f76d415e250 msgr2=0x7f76d40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76da236640 1 --2- 172.21.15.143:0/2278034067 >> v2:172.21.15.146:3300/0 conn(0x7f76d415e250 0x7f76d40b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76da236640 1 -- 172.21.15.143:0/2278034067 >> v1:172.21.15.146:6789/0 conn(0x7f76d40b37b0 legacy=0x7f76d415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:46.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76da236640 1 -- 172.21.15.143:0/2278034067 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d415e900 con 0x7f76d4160be0 2023-11-24T06:31:46.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76da236640 1 --2- 172.21.15.143:0/2278034067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415ed00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f76d40b21c0 tx=0x7f76d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad8582b77a81c43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76d9234640 1 -- 172.21.15.143:0/2278034067 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00aa5f0 con 0x7f76d4160be0 2023-11-24T06:31:46.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76d9234640 1 -- 172.21.15.143:0/2278034067 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00aa750 con 0x7f76d4160be0 2023-11-24T06:31:46.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76d9234640 1 -- 172.21.15.143:0/2278034067 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00aaae0 con 0x7f76d4160be0 2023-11-24T06:31:46.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76dc49a640 1 -- 172.21.15.143:0/2278034067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 msgr2=0x7f76d415ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.502+0000 7f76dc49a640 1 --2- 172.21.15.143:0/2278034067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415ed00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f76d40b21c0 tx=0x7f76d001c490 comp rx=0 tx=0).stop 2023-11-24T06:31:46.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- 172.21.15.143:0/2278034067 shutdown_connections 2023-11-24T06:31:46.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 --2- 172.21.15.143:0/2278034067 >> v2:172.21.15.146:3300/0 conn(0x7f76d415e250 0x7f76d40b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 --2- 172.21.15.143:0/2278034067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415ed00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- 172.21.15.143:0/2278034067 >> 172.21.15.143:0/2278034067 conn(0x7f76d40b0bf0 msgr2=0x7f76d40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:46.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- 172.21.15.143:0/2278034067 shutdown_connections 2023-11-24T06:31:46.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- 172.21.15.143:0/2278034067 wait complete. 2023-11-24T06:31:46.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 Processor -- start 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- start start 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76d40b37b0 0x7f76d41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76d415e250 0x7f76d415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d41564e0 con 0x7f76d4160be0 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d415d1e0 con 0x7f76d40b37b0 2023-11-24T06:31:46.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76dc49a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d415d4c0 con 0x7f76d415e250 2023-11-24T06:31:46.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57344/0 (socket says 172.21.15.143:57344) 2023-11-24T06:31:46.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 -- 172.21.15.143:0/1311562084 learned_addr learned my addr 172.21.15.143:0/1311562084 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:46.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76d9a35640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76d415e250 0x7f76d415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76da236640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76d40b37b0 0x7f76d41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 -- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76d415e250 msgr2=0x7f76d415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76d415e250 0x7f76d415bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 -- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76d40b37b0 msgr2=0x7f76d41542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76d40b37b0 0x7f76d41542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 -- 172.21.15.143:0/1311562084 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00094d0 con 0x7f76d4160be0 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76d9a35640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76d415e250 0x7f76d415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76daa37640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415c300 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00b970 tx=0x7f76cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00cb40 con 0x7f76d4160be0 2023-11-24T06:31:46.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00ccc0 con 0x7f76d4160be0 2023-11-24T06:31:46.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.506+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc014680 con 0x7f76d4160be0 2023-11-24T06:31:46.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d4156100 con 0x7f76d4160be0 2023-11-24T06:31:46.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4155d20 con 0x7f76d4160be0 2023-11-24T06:31:46.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d4156620 con 0x7f76d4160be0 2023-11-24T06:31:46.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f76cc01d3b0 con 0x7f76d4160be0 2023-11-24T06:31:46.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76caffd640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76b80666b0 0x7f76b8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76cc083e60 con 0x7f76d4160be0 2023-11-24T06:31:46.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76da236640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76b80666b0 0x7f76b8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.510+0000 7f76da236640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76b80666b0 0x7f76b8068b70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f76d00ae000 tx=0x7f76d00b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.514+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76d4156620 con 0x7f76d4160be0 2023-11-24T06:31:46.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.666+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76d4156620 con 0x7f76d4160be0 2023-11-24T06:31:46.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.666+0000 7f76caffd640 1 -- 172.21.15.143:0/1311562084 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+12905 (secure 0 0 0) 0x7f76d4156620 con 0x7f76d4160be0 2023-11-24T06:31:46.673 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:46.673 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":55,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:45.950654+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76b80666b0 msgr2=0x7f76b8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76b80666b0 0x7f76b8068b70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f76d00ae000 tx=0x7f76d00b5040 comp rx=0 tx=0).stop 2023-11-24T06:31:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 msgr2=0x7f76d415c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415c300 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00b970 tx=0x7f76cc00be30 comp rx=0 tx=0).stop 2023-11-24T06:31:46.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 shutdown_connections 2023-11-24T06:31:46.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f76b80666b0 0x7f76b8068b70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76d4160be0 0x7f76d415c300 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76d415e250 0x7f76d415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 --2- 172.21.15.143:0/1311562084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76d40b37b0 0x7f76d41542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 >> 172.21.15.143:0/1311562084 conn(0x7f76d40b0bf0 msgr2=0x7f76d40afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:46.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 shutdown_connections 2023-11-24T06:31:46.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.670+0000 7f76dc49a640 1 -- 172.21.15.143:0/1311562084 wait complete. 2023-11-24T06:31:46.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:31:46.695 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:31:46.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.830+0000 7f2307f72640 1 Processor -- start 2023-11-24T06:31:46.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.830+0000 7f2307f72640 1 -- start start 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.830+0000 7f2307f72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23000ccef0 0x7f2300071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.830+0000 7f2307f72640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23000cd380 0x7f23000cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2307f72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000723c0 con 0x7f23001624f0 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2307f72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2300072980 con 0x7f23000ccef0 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2307f72640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000726a0 con 0x7f23000cd380 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230550d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23000ccef0 0x7f2300071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2305d0e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f23001624f0 0x7f23001628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46826/0 (socket says 172.21.15.143:46826) 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2305d0e640 1 -- 172.21.15.143:0/918502013 learned_addr learned my addr 172.21.15.143:0/918502013 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230650f640 1 --2- 172.21.15.143:0/918502013 >> v2:172.21.15.146:3300/0 conn(0x7f23000cd380 0x7f23000cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230550d640 1 -- 172.21.15.143:0/918502013 >> v2:172.21.15.146:3300/0 conn(0x7f23000cd380 msgr2=0x7f23000cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:46.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230550d640 1 --2- 172.21.15.143:0/918502013 >> v2:172.21.15.146:3300/0 conn(0x7f23000cd380 0x7f23000cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2304d0c640 1 -- 172.21.15.143:0/918502013 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009614912 0 0) 0x7f23000723c0 con 0x7f23001624f0 2023-11-24T06:31:46.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230550d640 1 -- 172.21.15.143:0/918502013 >> v1:172.21.15.143:6789/0 conn(0x7f23001624f0 legacy=0x7f23001628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230550d640 1 -- 172.21.15.143:0/918502013 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230006c7e0 con 0x7f23000ccef0 2023-11-24T06:31:46.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f230550d640 1 --2- 172.21.15.143:0/918502013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000ccef0 0x7f2300071900 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2300070610 tx=0x7f22f001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa13ffe7e5be6cb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2304d0c640 1 -- 172.21.15.143:0/918502013 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00ac620 con 0x7f23000ccef0 2023-11-24T06:31:46.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2304d0c640 1 -- 172.21.15.143:0/918502013 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f00ac780 con 0x7f23000ccef0 2023-11-24T06:31:46.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.834+0000 7f2304d0c640 1 -- 172.21.15.143:0/918502013 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00acb10 con 0x7f23000ccef0 2023-11-24T06:31:46.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- 172.21.15.143:0/918502013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000ccef0 msgr2=0x7f2300071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 --2- 172.21.15.143:0/918502013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000ccef0 0x7f2300071900 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2300070610 tx=0x7f22f001c3a0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- 172.21.15.143:0/918502013 shutdown_connections 2023-11-24T06:31:46.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 --2- 172.21.15.143:0/918502013 >> v2:172.21.15.146:3300/0 conn(0x7f23000cd380 0x7f23000cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 --2- 172.21.15.143:0/918502013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000ccef0 0x7f2300071900 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- 172.21.15.143:0/918502013 >> 172.21.15.143:0/918502013 conn(0x7f23000b0c80 msgr2=0x7f23000b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:46.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- 172.21.15.143:0/918502013 shutdown_connections 2023-11-24T06:31:46.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- 172.21.15.143:0/918502013 wait complete. 2023-11-24T06:31:46.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 Processor -- start 2023-11-24T06:31:46.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- start start 2023-11-24T06:31:46.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23000ccef0 0x7f230015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 0x7f23001604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23001624f0 0x7f23000abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300159a00 con 0x7f23000cd380 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230015e290 con 0x7f23000ccef0 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2307f72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2300160af0 con 0x7f23001624f0 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f230550d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 0x7f23001604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f230550d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 0x7f23001604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57362/0 (socket says 172.21.15.143:57362) 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f230550d640 1 -- 172.21.15.143:0/1961937583 learned_addr learned my addr 172.21.15.143:0/1961937583 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f230650f640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23001624f0 0x7f23000abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f2305d0e640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23000ccef0 0x7f230015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.838+0000 7f230550d640 1 -- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23001624f0 msgr2=0x7f23000abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f230550d640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23001624f0 0x7f23000abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f230550d640 1 -- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23000ccef0 msgr2=0x7f230015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f230550d640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23000ccef0 0x7f230015ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f230550d640 1 -- 172.21.15.143:0/1961937583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0009420 con 0x7f23000cd380 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f230650f640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23001624f0 0x7f23000abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f2305d0e640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23000ccef0 0x7f230015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f230550d640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 0x7f23001604c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f22f0018fb0 tx=0x7f22f0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00ac620 con 0x7f23000cd380 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0004030 con 0x7f23000cd380 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00043a0 con 0x7f23000cd380 2023-11-24T06:31:46.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2300160dd0 con 0x7f23000cd380 2023-11-24T06:31:46.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2300161390 con 0x7f23000cd380 2023-11-24T06:31:46.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2300159b70 con 0x7f23000cd380 2023-11-24T06:31:46.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f22f00b3040 con 0x7f23000cd380 2023-11-24T06:31:46.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f22f67fc640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f22e40666b0 0x7f22e4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:46.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22f011e080 con 0x7f23000cd380 2023-11-24T06:31:46.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.842+0000 7f2305d0e640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f22e40666b0 0x7f22e4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:46.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.846+0000 7f2305d0e640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f22e40666b0 0x7f22e4068b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f22fc007fd0 tx=0x7f22fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:46.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:46.846+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22f014f280 con 0x7f23000cd380 2023-11-24T06:31:47.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f230004e8c0 con 0x7f23000cd380 2023-11-24T06:31:47.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f22f67fc640 1 -- 172.21.15.143:0/1961937583 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22f00c30a0 con 0x7f23000cd380 2023-11-24T06:31:47.011 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:31:47.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f22e40666b0 msgr2=0x7f22e4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f22e40666b0 0x7f22e4068b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f22fc007fd0 tx=0x7f22fc009040 comp rx=0 tx=0).stop 2023-11-24T06:31:47.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 msgr2=0x7f23001604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 0x7f23001604c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f22f0018fb0 tx=0x7f22f0019140 comp rx=0 tx=0).stop 2023-11-24T06:31:47.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 shutdown_connections 2023-11-24T06:31:47.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f22e40666b0 0x7f22e4068b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23001624f0 0x7f23000abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23000cd380 0x7f23001604c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 --2- 172.21.15.143:0/1961937583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23000ccef0 0x7f230015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 >> 172.21.15.143:0/1961937583 conn(0x7f23000b0c80 msgr2=0x7f23000ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 shutdown_connections 2023-11-24T06:31:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.006+0000 7f2307f72640 1 -- 172.21.15.143:0/1961937583 wait complete. 2023-11-24T06:31:47.033 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:31:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 Processor -- start 2023-11-24T06:31:47.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 -- start start 2023-11-24T06:31:47.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f145c158a50 0x7f145c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f145c06e340 0x7f145c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c06dc20 con 0x7f145c06cb90 2023-11-24T06:31:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c06e0b0 con 0x7f145c158a50 2023-11-24T06:31:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f146371d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c0b3620 con 0x7f145c06e340 2023-11-24T06:31:47.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f14614b9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f145c158a50 0x7f145c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f1461cba640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f145c06cb90 0x7f145c165540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:46840/0 (socket says 172.21.15.143:46840) 2023-11-24T06:31:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f1461cba640 1 -- 172.21.15.143:0/983355864 learned_addr learned my addr 172.21.15.143:0/983355864 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:47.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f1460cb8640 1 --2- 172.21.15.143:0/983355864 >> v2:172.21.15.146:3300/0 conn(0x7f145c06e340 0x7f145c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f14614b9640 1 -- 172.21.15.143:0/983355864 >> v2:172.21.15.146:3300/0 conn(0x7f145c06e340 msgr2=0x7f145c0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f14614b9640 1 --2- 172.21.15.143:0/983355864 >> v2:172.21.15.146:3300/0 conn(0x7f145c06e340 0x7f145c0707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.166+0000 7f14614b9640 1 -- 172.21.15.143:0/983355864 >> v1:172.21.15.143:6789/0 conn(0x7f145c06cb90 legacy=0x7f145c165540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f1453fff640 1 -- 172.21.15.143:0/983355864 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304178998 0 0) 0x7f145c06dc20 con 0x7f145c06cb90 2023-11-24T06:31:47.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f14614b9640 1 -- 172.21.15.143:0/983355864 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c158e30 con 0x7f145c158a50 2023-11-24T06:31:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f14614b9640 1 --2- 172.21.15.143:0/983355864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c158a50 0x7f145c06c650 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f145c0cb690 tx=0x7f145801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eae14013290571f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f1453fff640 1 -- 172.21.15.143:0/983355864 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580ab650 con 0x7f145c158a50 2023-11-24T06:31:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f1453fff640 1 -- 172.21.15.143:0/983355864 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14580ab7b0 con 0x7f145c158a50 2023-11-24T06:31:47.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f1453fff640 1 -- 172.21.15.143:0/983355864 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580abb40 con 0x7f145c158a50 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 -- 172.21.15.143:0/983355864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c158a50 msgr2=0x7f145c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 --2- 172.21.15.143:0/983355864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c158a50 0x7f145c06c650 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f145c0cb690 tx=0x7f145801c430 comp rx=0 tx=0).stop 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 -- 172.21.15.143:0/983355864 shutdown_connections 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 --2- 172.21.15.143:0/983355864 >> v2:172.21.15.146:3300/0 conn(0x7f145c06e340 0x7f145c0707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 --2- 172.21.15.143:0/983355864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c158a50 0x7f145c06c650 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 -- 172.21.15.143:0/983355864 >> 172.21.15.143:0/983355864 conn(0x7f145c0b0bf0 msgr2=0x7f145c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 -- 172.21.15.143:0/983355864 shutdown_connections 2023-11-24T06:31:47.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.170+0000 7f146371d640 1 -- 172.21.15.143:0/983355864 wait complete. 2023-11-24T06:31:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 Processor -- start 2023-11-24T06:31:47.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 -- start start 2023-11-24T06:31:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c06cb90 0x7f145c1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 0x7f145c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c158a50 0x7f145c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c151470 con 0x7f145c06e340 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c150900 con 0x7f145c06cb90 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c09a7a0 con 0x7f145c158a50 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 0x7f145c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 0x7f145c151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57388/0 (socket says 172.21.15.143:57388) 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 -- 172.21.15.143:0/2492923622 learned_addr learned my addr 172.21.15.143:0/2492923622 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1461cba640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c158a50 0x7f145c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f14614b9640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c06cb90 0x7f145c1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 -- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c158a50 msgr2=0x7f145c099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c158a50 0x7f145c099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 -- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c06cb90 msgr2=0x7f145c1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c06cb90 0x7f145c1503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 -- 172.21.15.143:0/2492923622 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458009420 con 0x7f145c06e340 2023-11-24T06:31:47.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1460cb8640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 0x7f145c151900 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f144c00d800 tx=0x7f144c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00b6c0 con 0x7f145c06e340 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00b820 con 0x7f145c06e340 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c150b40 con 0x7f145c06e340 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.174+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00bb90 con 0x7f145c06e340 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c151100 con 0x7f145c06e340 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c067520 con 0x7f145c06e340 2023-11-24T06:31:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f144c00bcf0 con 0x7f145c06e340 2023-11-24T06:31:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f1451ffb640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14400666b0 0x7f1440068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f144c084500 con 0x7f145c06e340 2023-11-24T06:31:47.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f14614b9640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14400666b0 0x7f1440068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.178+0000 7f14614b9640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14400666b0 0x7f1440068b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f14580af000 tx=0x7f14580a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:47.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.182+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f144c051960 con 0x7f145c06e340 2023-11-24T06:31:47.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.334+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f145c162aa0 con 0x7f145c06e340 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.334+0000 7f1451ffb640 1 -- 172.21.15.143:0/2492923622 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+65 (secure 0 0 0) 0x7f144c011340 con 0x7f145c06e340 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:47.341 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14400666b0 msgr2=0x7f1440068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14400666b0 0x7f1440068b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f14580af000 tx=0x7f14580a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 msgr2=0x7f145c151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 0x7f145c151900 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f144c00d800 tx=0x7f144c00dcc0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 shutdown_connections 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14400666b0 0x7f1440068b70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c158a50 0x7f145c099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f145c06e340 0x7f145c151900 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 --2- 172.21.15.143:0/2492923622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c06cb90 0x7f145c1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 >> 172.21.15.143:0/2492923622 conn(0x7f145c0b0bf0 msgr2=0x7f145c161f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:47.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 shutdown_connections 2023-11-24T06:31:47.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.338+0000 7f146371d640 1 -- 172.21.15.143:0/2492923622 wait complete. 2023-11-24T06:31:47.362 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:31:47.362 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:31:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 Processor -- start 2023-11-24T06:31:47.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 -- start start 2023-11-24T06:31:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fddb415a320 0x7fddb40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fddb4070da0 0x7fddb40711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb415a700 con 0x7fddb40b36c0 2023-11-24T06:31:47.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb40b2430 con 0x7fddb4070da0 2023-11-24T06:31:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddbabe7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb40b2620 con 0x7fddb415a320 2023-11-24T06:31:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fddb4070da0 0x7fddb40711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fddb4070da0 0x7fddb40711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52940/0 (socket says 172.21.15.143:52940) 2023-11-24T06:31:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 -- 172.21.15.143:0/406358248 learned_addr learned my addr 172.21.15.143:0/406358248 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:47.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb8983640 1 --2- 172.21.15.143:0/406358248 >> v2:172.21.15.146:3300/0 conn(0x7fddb415a320 0x7fddb40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 -- 172.21.15.143:0/406358248 >> v2:172.21.15.146:3300/0 conn(0x7fddb415a320 msgr2=0x7fddb40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 --2- 172.21.15.143:0/406358248 >> v2:172.21.15.146:3300/0 conn(0x7fddb415a320 0x7fddb40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 -- 172.21.15.143:0/406358248 >> v1:172.21.15.146:6789/0 conn(0x7fddb40b36c0 legacy=0x7fddb4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.498+0000 7fddb9184640 1 -- 172.21.15.143:0/406358248 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40b2900 con 0x7fddb4070da0 2023-11-24T06:31:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddb9184640 1 --2- 172.21.15.143:0/406358248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb40711f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fddb406c0c0 tx=0x7fddac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a40f3cb3389b309 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddb37fe640 1 -- 172.21.15.143:0/406358248 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0a5760 con 0x7fddb4070da0 2023-11-24T06:31:47.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddb37fe640 1 -- 172.21.15.143:0/406358248 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac0a58c0 con 0x7fddb4070da0 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddb37fe640 1 -- 172.21.15.143:0/406358248 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0a5c50 con 0x7fddb4070da0 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 -- 172.21.15.143:0/406358248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 msgr2=0x7fddb40711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 --2- 172.21.15.143:0/406358248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb40711f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fddb406c0c0 tx=0x7fddac01c9a0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 -- 172.21.15.143:0/406358248 shutdown_connections 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 --2- 172.21.15.143:0/406358248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb40711f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 --2- 172.21.15.143:0/406358248 >> v2:172.21.15.146:3300/0 conn(0x7fddb415a320 0x7fddb40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 -- 172.21.15.143:0/406358248 >> 172.21.15.143:0/406358248 conn(0x7fddb40b0bf0 msgr2=0x7fddb40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 -- 172.21.15.143:0/406358248 shutdown_connections 2023-11-24T06:31:47.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.502+0000 7fddbabe7640 1 -- 172.21.15.143:0/406358248 wait complete. 2023-11-24T06:31:47.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 Processor -- start 2023-11-24T06:31:47.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 -- start start 2023-11-24T06:31:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb4155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb40b36c0 0x7fddb409c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddb415a320 0x7fddb412f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb414d1f0 con 0x7fddb4070da0 2023-11-24T06:31:47.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4154db0 con 0x7fddb40b36c0 2023-11-24T06:31:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb414d400 con 0x7fddb415a320 2023-11-24T06:31:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb4155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52942/0 (socket says 172.21.15.143:52942) 2023-11-24T06:31:47.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 -- 172.21.15.143:0/849197868 learned_addr learned my addr 172.21.15.143:0/849197868 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 -- 172.21.15.143:0/849197868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddb415a320 msgr2=0x7fddb412f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddb415a320 0x7fddb412f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 -- 172.21.15.143:0/849197868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb40b36c0 msgr2=0x7fddb409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb40b36c0 0x7fddb409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 -- 172.21.15.143:0/849197868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac009b30 con 0x7fddb4070da0 2023-11-24T06:31:47.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb8983640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb4155800 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdda800e870 tx=0x7fdda800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8009510 con 0x7fddb4070da0 2023-11-24T06:31:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800eec0 con 0x7fddb4070da0 2023-11-24T06:31:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb414d6e0 con 0x7fddb4070da0 2023-11-24T06:31:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800cb40 con 0x7fddb4070da0 2023-11-24T06:31:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.506+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb41552e0 con 0x7fddb4070da0 2023-11-24T06:31:47.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.510+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4067520 con 0x7fddb4070da0 2023-11-24T06:31:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.510+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fdda800cca0 con 0x7fddb4070da0 2023-11-24T06:31:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.510+0000 7fddb17fa640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdd980666b0 0x7fdd98068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.510+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdda8084090 con 0x7fddb4070da0 2023-11-24T06:31:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.510+0000 7fddb3fff640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdd980666b0 0x7fdd98068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:47.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.510+0000 7fddb3fff640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdd980666b0 0x7fdd98068b70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdda0000f70 tx=0x7fdda00079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:47.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.514+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdda8051500 con 0x7fddb4070da0 2023-11-24T06:31:47.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.666+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fddb4071d30 con 0x7fddb4070da0 2023-11-24T06:31:47.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddb17fa640 1 -- 172.21.15.143:0/849197868 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdda8054b20 con 0x7fddb4070da0 2023-11-24T06:31:47.959 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2023-11-24T06:31:47.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdd980666b0 msgr2=0x7fdd98068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdd980666b0 0x7fdd98068b70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdda0000f70 tx=0x7fdda00079c0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 msgr2=0x7fddb4155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:47.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb4155800 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdda800e870 tx=0x7fdda800ec70 comp rx=0 tx=0).stop 2023-11-24T06:31:47.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 shutdown_connections 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdd980666b0 0x7fdd98068b70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddb415a320 0x7fddb412f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb40b36c0 0x7fddb409c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 --2- 172.21.15.143:0/849197868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddb4070da0 0x7fddb4155800 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.954+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 >> 172.21.15.143:0/849197868 conn(0x7fddb40b0bf0 msgr2=0x7fddb4071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.958+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 shutdown_connections 2023-11-24T06:31:47.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:47.958+0000 7fddbabe7640 1 -- 172.21.15.143:0/849197868 wait complete. 2023-11-24T06:31:47.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:31:48.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.126+0000 7f3e49279640 1 Processor -- start 2023-11-24T06:31:48.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.126+0000 7f3e49279640 1 -- start start 2023-11-24T06:31:48.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e49279640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e440cad20 0x7f3e440c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:48.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e49279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3e4406d740 0x7f3e4406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e49279640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4415a8b0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e49279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e440c9c30 con 0x7f3e4406d740 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e49279640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4406e090 con 0x7f3e440cad20 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e437fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3e4406d740 0x7f3e4406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e42ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3e4415a4d0 0x7f3e4415e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34522/0 (socket says 172.21.15.143:34522) 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e42ffd640 1 -- 172.21.15.143:0/704779121 learned_addr learned my addr 172.21.15.143:0/704779121 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e427fc640 1 --2- 172.21.15.143:0/704779121 >> v2:172.21.15.146:3300/0 conn(0x7f3e440cad20 0x7f3e440c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e437fe640 1 -- 172.21.15.143:0/704779121 >> v2:172.21.15.146:3300/0 conn(0x7f3e440cad20 msgr2=0x7f3e440c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e437fe640 1 --2- 172.21.15.143:0/704779121 >> v2:172.21.15.146:3300/0 conn(0x7f3e440cad20 0x7f3e440c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e437fe640 1 -- 172.21.15.143:0/704779121 >> v1:172.21.15.143:6789/0 conn(0x7f3e4415a4d0 legacy=0x7f3e4415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e437fe640 1 -- 172.21.15.143:0/704779121 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e440c9f60 con 0x7f3e4406d740 2023-11-24T06:31:48.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.130+0000 7f3e41ffb640 1 -- 172.21.15.143:0/704779121 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882663937 0 0) 0x7f3e4415a8b0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e437fe640 1 --2- 172.21.15.143:0/704779121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4406d740 0x7f3e4406db50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3e440cb9a0 tx=0x7f3e3c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cc15a19c1239f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:48.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e41ffb640 1 -- 172.21.15.143:0/704779121 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0a5910 con 0x7f3e4406d740 2023-11-24T06:31:48.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e41ffb640 1 -- 172.21.15.143:0/704779121 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0a5a70 con 0x7f3e4406d740 2023-11-24T06:31:48.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e41ffb640 1 -- 172.21.15.143:0/704779121 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0a5e00 con 0x7f3e4406d740 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 -- 172.21.15.143:0/704779121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4406d740 msgr2=0x7f3e4406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 --2- 172.21.15.143:0/704779121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4406d740 0x7f3e4406db50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3e440cb9a0 tx=0x7f3e3c01c850 comp rx=0 tx=0).stop 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 -- 172.21.15.143:0/704779121 shutdown_connections 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 --2- 172.21.15.143:0/704779121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4406d740 0x7f3e4406db50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 --2- 172.21.15.143:0/704779121 >> v2:172.21.15.146:3300/0 conn(0x7f3e440cad20 0x7f3e440c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 -- 172.21.15.143:0/704779121 >> 172.21.15.143:0/704779121 conn(0x7f3e440b0bf0 msgr2=0x7f3e440b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 -- 172.21.15.143:0/704779121 shutdown_connections 2023-11-24T06:31:48.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 -- 172.21.15.143:0/704779121 wait complete. 2023-11-24T06:31:48.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 Processor -- start 2023-11-24T06:31:48.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 -- start start 2023-11-24T06:31:48.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.134+0000 7f3e49279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e4406d740 0x7f3e440b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:48.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e440cad20 0x7f3e44153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:48.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 0x7f3e440b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:48.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440b31c0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440b25b0 con 0x7f3e440cad20 2023-11-24T06:31:48.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440b2890 con 0x7f3e4406d740 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 0x7f3e440b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 0x7f3e440b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52952/0 (socket says 172.21.15.143:52952) 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 -- 172.21.15.143:0/522878096 learned_addr learned my addr 172.21.15.143:0/522878096 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e42ffd640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e4406d740 0x7f3e440b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e427fc640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e440cad20 0x7f3e44153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 -- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e4406d740 msgr2=0x7f3e440b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e4406d740 0x7f3e440b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 -- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e440cad20 msgr2=0x7f3e44153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e440cad20 0x7f3e44153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 -- 172.21.15.143:0/522878096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c009a70 con 0x7f3e4415a4d0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e437fe640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 0x7f3e440b1cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0b0040 tx=0x7f3e3c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0ad850 con 0x7f3e4415a4d0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0ad9b0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e440b2b70 con 0x7f3e4415a4d0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0add60 con 0x7f3e4415a4d0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44153da0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e440b3370 con 0x7f3e4415a4d0 2023-11-24T06:31:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.138+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f3e3c0b4050 con 0x7f3e4415a4d0 2023-11-24T06:31:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.142+0000 7f3e2b7fe640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3e300666e0 0x7f3e30068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.142+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3e3c11f6e0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.142+0000 7f3e42ffd640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3e300666e0 0x7f3e30068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.142+0000 7f3e42ffd640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3e300666e0 0x7f3e30068ba0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3e34000f70 tx=0x7f3e34007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.146+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e3c0ecce0 con 0x7f3e4415a4d0 2023-11-24T06:31:48.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.298+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e4409d250 con 0x7f3e4415a4d0 2023-11-24T06:31:48.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.958+0000 7f3e2b7fe640 1 -- 172.21.15.143:0/522878096 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e3c0f0300 con 0x7f3e4415a4d0 2023-11-24T06:31:48.962 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2023-11-24T06:31:48.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3e300666e0 msgr2=0x7f3e30068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:48.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3e300666e0 0x7f3e30068ba0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3e34000f70 tx=0x7f3e34007df0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 msgr2=0x7f3e440b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:48.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 0x7f3e440b1cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0b0040 tx=0x7f3e3c0195f0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 shutdown_connections 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3e300666e0 0x7f3e30068ba0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e4415a4d0 0x7f3e440b1cb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e440cad20 0x7f3e44153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 --2- 172.21.15.143:0/522878096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e4406d740 0x7f3e440b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 >> 172.21.15.143:0/522878096 conn(0x7f3e440b0bf0 msgr2=0x7f3e44157920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 shutdown_connections 2023-11-24T06:31:48.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:48.962+0000 7f3e49279640 1 -- 172.21.15.143:0/522878096 wait complete. 2023-11-24T06:31:49.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:31:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 Processor -- start 2023-11-24T06:31:49.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 -- start start 2023-11-24T06:31:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe840ce420 0x7efe8415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840cd850 0x7efe8406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840b3510 con 0x7efe840ae4a0 2023-11-24T06:31:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840b37f0 con 0x7efe840ce420 2023-11-24T06:31:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8c413640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840b3ad0 con 0x7efe840cd850 2023-11-24T06:31:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8a9b0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840cd850 0x7efe8406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8a1af640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efe840ae4a0 0x7efe840cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:58798/0 (socket says 172.21.15.143:58798) 2023-11-24T06:31:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe899ae640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe840ce420 0x7efe8415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe8a1af640 1 -- 172.21.15.143:0/1049393931 learned_addr learned my addr 172.21.15.143:0/1049393931 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe899ae640 1 -- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840cd850 msgr2=0x7efe8406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe899ae640 1 --2- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840cd850 0x7efe8406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe899ae640 1 -- 172.21.15.143:0/1049393931 >> v1:172.21.15.146:6789/0 conn(0x7efe840ae4a0 legacy=0x7efe840cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.146+0000 7efe899ae640 1 -- 172.21.15.143:0/1049393931 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840b3db0 con 0x7efe840ce420 2023-11-24T06:31:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe899ae640 1 --2- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840ce420 0x7efe8415ba00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe740097c0 tx=0x7efe7401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb225922ab931e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe891ad640 1 -- 172.21.15.143:0/1049393931 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe740ab670 con 0x7efe840ce420 2023-11-24T06:31:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe891ad640 1 -- 172.21.15.143:0/1049393931 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe740ab7d0 con 0x7efe840ce420 2023-11-24T06:31:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe891ad640 1 -- 172.21.15.143:0/1049393931 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe740abb60 con 0x7efe840ce420 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 -- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840ce420 msgr2=0x7efe8415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 --2- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840ce420 0x7efe8415ba00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe740097c0 tx=0x7efe7401c450 comp rx=0 tx=0).stop 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 -- 172.21.15.143:0/1049393931 shutdown_connections 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 --2- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840cd850 0x7efe8406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 --2- 172.21.15.143:0/1049393931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840ce420 0x7efe8415ba00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 -- 172.21.15.143:0/1049393931 >> 172.21.15.143:0/1049393931 conn(0x7efe840b0c80 msgr2=0x7efe840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 -- 172.21.15.143:0/1049393931 shutdown_connections 2023-11-24T06:31:49.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.150+0000 7efe8c413640 1 -- 172.21.15.143:0/1049393931 wait complete. 2023-11-24T06:31:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 Processor -- start 2023-11-24T06:31:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 -- start start 2023-11-24T06:31:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 0x7efe841531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840cd850 0x7efe84147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840ce420 0x7efe8414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8414f670 con 0x7efe840ae4a0 2023-11-24T06:31:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84149f40 con 0x7efe840cd850 2023-11-24T06:31:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe84154a20 con 0x7efe840ce420 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 0x7efe841531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 0x7efe841531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52968/0 (socket says 172.21.15.143:52968) 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 -- 172.21.15.143:0/3538229932 learned_addr learned my addr 172.21.15.143:0/3538229932 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe899ae640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840cd850 0x7efe84147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a9b0640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840ce420 0x7efe8414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 -- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840ce420 msgr2=0x7efe8414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840ce420 0x7efe8414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 -- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840cd850 msgr2=0x7efe84147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840cd850 0x7efe84147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 -- 172.21.15.143:0/3538229932 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74009420 con 0x7efe840ae4a0 2023-11-24T06:31:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a9b0640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840ce420 0x7efe8414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8a1af640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 0x7efe841531c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c530 tx=0x7efe8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80005cf0 con 0x7efe840ae4a0 2023-11-24T06:31:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80005e50 con 0x7efe840ae4a0 2023-11-24T06:31:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80007270 con 0x7efe840ae4a0 2023-11-24T06:31:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84154ca0 con 0x7efe840ae4a0 2023-11-24T06:31:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.154+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84147d40 con 0x7efe840ae4a0 2023-11-24T06:31:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.158+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8414a110 con 0x7efe840ae4a0 2023-11-24T06:31:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.158+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7efe800073d0 con 0x7efe840ae4a0 2023-11-24T06:31:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.158+0000 7efe7affd640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe680666b0 0x7efe68068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.158+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efe80083960 con 0x7efe840ae4a0 2023-11-24T06:31:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.158+0000 7efe899ae640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe680666b0 0x7efe68068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:49.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.158+0000 7efe899ae640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe680666b0 0x7efe68068b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efe740af000 tx=0x7efe740b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:49.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.162+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe80050c00 con 0x7efe840ae4a0 2023-11-24T06:31:49.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:49.346+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efe8404e8c0 con 0x7efe840ae4a0 2023-11-24T06:31:50.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.013+0000 7efe7affd640 1 -- 172.21.15.143:0/3538229932 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7efe80054220 con 0x7efe840ae4a0 2023-11-24T06:31:50.020 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 8 and data pool 9 2023-11-24T06:31:50.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.017+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe680666b0 msgr2=0x7efe68068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.017+0000 7efe8c413640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe680666b0 0x7efe68068b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efe740af000 tx=0x7efe740b6040 comp rx=0 tx=0).stop 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.017+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 msgr2=0x7efe841531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.017+0000 7efe8c413640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 0x7efe841531c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c530 tx=0x7efe8000c9f0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.017+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 shutdown_connections 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efe680666b0 0x7efe68068b70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe840ce420 0x7efe8414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe840cd850 0x7efe84147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 --2- 172.21.15.143:0/3538229932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe840ae4a0 0x7efe841531c0 secure :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c530 tx=0x7efe8000c9f0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 >> 172.21.15.143:0/3538229932 conn(0x7efe840b0c80 msgr2=0x7efe8414f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 shutdown_connections 2023-11-24T06:31:50.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.021+0000 7efe8c413640 1 -- 172.21.15.143:0/3538229932 wait complete. 2023-11-24T06:31:50.059 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:50.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.189+0000 7f070a632640 1 Processor -- start 2023-11-24T06:31:50.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f070a632640 1 -- start start 2023-11-24T06:31:50.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f070a632640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f070406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f070a632640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07040709c0 0x7f0704070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f070a632640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070406d8b0 con 0x7f070409cc20 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f070a632640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0704145020 con 0x7f07040709c0 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f070a632640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070409d0a0 con 0x7f0704144030 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f07037fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f070409cc20 0x7f070406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34528/0 (socket says 172.21.15.143:34528) 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f07037fe640 1 -- 172.21.15.143:0/4270650510 learned_addr learned my addr 172.21.15.143:0/4270650510 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0703fff640 1 --2- 172.21.15.143:0/4270650510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f070406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0708bcf640 1 --2- 172.21.15.143:0/4270650510 >> v2:172.21.15.146:3300/0 conn(0x7f07040709c0 0x7f0704070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0702ffd640 1 -- 172.21.15.143:0/4270650510 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725014608 0 0) 0x7f070406d8b0 con 0x7f070409cc20 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0702ffd640 1 -- 172.21.15.143:0/4270650510 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec003530 con 0x7f070409cc20 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0703fff640 1 -- 172.21.15.143:0/4270650510 >> v2:172.21.15.146:3300/0 conn(0x7f07040709c0 msgr2=0x7f0704070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0703fff640 1 --2- 172.21.15.143:0/4270650510 >> v2:172.21.15.146:3300/0 conn(0x7f07040709c0 0x7f0704070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0703fff640 1 -- 172.21.15.143:0/4270650510 >> v1:172.21.15.143:6789/0 conn(0x7f070409cc20 legacy=0x7f070406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.193+0000 7f0703fff640 1 -- 172.21.15.143:0/4270650510 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704071390 con 0x7f0704144030 2023-11-24T06:31:50.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f0703fff640 1 --2- 172.21.15.143:0/4270650510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f070406c650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06f40097c0 tx=0x7f06f401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c8de7d37ebe44b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f0702ffd640 1 -- 172.21.15.143:0/4270650510 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40ab650 con 0x7f0704144030 2023-11-24T06:31:50.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f0702ffd640 1 -- 172.21.15.143:0/4270650510 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40ab7b0 con 0x7f0704144030 2023-11-24T06:31:50.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f0702ffd640 1 -- 172.21.15.143:0/4270650510 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40abb40 con 0x7f0704144030 2023-11-24T06:31:50.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 -- 172.21.15.143:0/4270650510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 msgr2=0x7f070406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 --2- 172.21.15.143:0/4270650510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f070406c650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06f40097c0 tx=0x7f06f401c450 comp rx=0 tx=0).stop 2023-11-24T06:31:50.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 -- 172.21.15.143:0/4270650510 shutdown_connections 2023-11-24T06:31:50.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 --2- 172.21.15.143:0/4270650510 >> v2:172.21.15.146:3300/0 conn(0x7f07040709c0 0x7f0704070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 --2- 172.21.15.143:0/4270650510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f070406c650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 -- 172.21.15.143:0/4270650510 >> 172.21.15.143:0/4270650510 conn(0x7f07040b0bf0 msgr2=0x7f07040b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:50.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 -- 172.21.15.143:0/4270650510 shutdown_connections 2023-11-24T06:31:50.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.197+0000 7f070a632640 1 -- 172.21.15.143:0/4270650510 wait complete. 2023-11-24T06:31:50.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 Processor -- start 2023-11-24T06:31:50.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- start start 2023-11-24T06:31:50.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 0x7f070415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f070409cc20 0x7f070413a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f07040c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070415b2c0 con 0x7f07040709c0 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070413faa0 con 0x7f070409cc20 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070413fd80 con 0x7f0704144030 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 0x7f070415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 0x7f070415ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52976/0 (socket says 172.21.15.143:52976) 2023-11-24T06:31:50.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 -- 172.21.15.143:0/599737275 learned_addr learned my addr 172.21.15.143:0/599737275 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0708bcf640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f07040c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f07037fe640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f070409cc20 0x7f070413a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 -- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 msgr2=0x7f07040c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f07040c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 -- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f070409cc20 msgr2=0x7f070413a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f070409cc20 0x7f070413a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 -- 172.21.15.143:0/599737275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4009420 con 0x7f07040709c0 2023-11-24T06:31:50.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0703fff640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 0x7f070415ad80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f06f40ad040 tx=0x7f06f401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40bf610 con 0x7f07040709c0 2023-11-24T06:31:50.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40bf790 con 0x7f07040709c0 2023-11-24T06:31:50.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40bfb40 con 0x7f07040709c0 2023-11-24T06:31:50.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0704140060 con 0x7f07040709c0 2023-11-24T06:31:50.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0704140620 con 0x7f07040709c0 2023-11-24T06:31:50.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.201+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0704067520 con 0x7f07040709c0 2023-11-24T06:31:50.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.205+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f06f40b5400 con 0x7f07040709c0 2023-11-24T06:31:50.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.205+0000 7f0700ff9640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06f00666b0 0x7f06f0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.205+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06f411ebf0 con 0x7f07040709c0 2023-11-24T06:31:50.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.205+0000 7f07037fe640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06f00666b0 0x7f06f0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.205+0000 7f07037fe640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06f00666b0 0x7f06f0068b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f07040b2a80 tx=0x7f06f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.209+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06f40ebdd0 con 0x7f07040709c0 2023-11-24T06:31:50.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.361+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f070413fec0 con 0x7f07040709c0 2023-11-24T06:31:50.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f0700ff9640 1 -- 172.21.15.143:0/599737275 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f070413fec0 con 0x7f07040709c0 2023-11-24T06:31:50.370 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:50.370 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":58,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:49.350784+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:50.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06f00666b0 msgr2=0x7f06f0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06f00666b0 0x7f06f0068b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f07040b2a80 tx=0x7f06f8009040 comp rx=0 tx=0).stop 2023-11-24T06:31:50.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 msgr2=0x7f070415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 0x7f070415ad80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f06f40ad040 tx=0x7f06f401ac90 comp rx=0 tx=0).stop 2023-11-24T06:31:50.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 shutdown_connections 2023-11-24T06:31:50.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f06f00666b0 0x7f06f0068b70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704144030 0x7f07040c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f070409cc20 0x7f070413a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 --2- 172.21.15.143:0/599737275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07040709c0 0x7f070415ad80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 >> 172.21.15.143:0/599737275 conn(0x7f07040b0bf0 msgr2=0x7f07040b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:50.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 shutdown_connections 2023-11-24T06:31:50.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.365+0000 7f070a632640 1 -- 172.21.15.143:0/599737275 wait complete. 2023-11-24T06:31:50.391 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:50.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.521+0000 7f23ef10e640 1 Processor -- start 2023-11-24T06:31:50.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.521+0000 7f23ef10e640 1 -- start start 2023-11-24T06:31:50.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ef10e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23e80b36c0 0x7f23e80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ef10e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e815a700 con 0x7f23e8070da0 2023-11-24T06:31:50.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ef10e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80b2620 con 0x7f23e815a320 2023-11-24T06:31:50.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ef10e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80b2430 con 0x7f23e80b36c0 2023-11-24T06:31:50.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ed6ab640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f23e8070da0 0x7f23e815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34534/0 (socket says 172.21.15.143:34534) 2023-11-24T06:31:50.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ed6ab640 1 -- 172.21.15.143:0/1912863196 learned_addr learned my addr 172.21.15.143:0/1912863196 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979080284 0 0) 0x7f23e815a700 con 0x7f23e8070da0 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d8005740 con 0x7f23e8070da0 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e7fff640 1 --2- 172.21.15.143:0/1912863196 >> v2:172.21.15.146:3300/0 conn(0x7f23e80b36c0 0x7f23e80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2508035378 0 0) 0x7f23d8005740 con 0x7f23e8070da0 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 >> v2:172.21.15.146:3300/0 conn(0x7f23e80b36c0 msgr2=0x7f23e80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 --2- 172.21.15.143:0/1912863196 >> v2:172.21.15.146:3300/0 conn(0x7f23e80b36c0 0x7f23e80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 >> v1:172.21.15.146:6789/0 conn(0x7f23e815a320 legacy=0x7f23e8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80b2900 con 0x7f23e8070da0 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f23e0001a00 con 0x7f23e8070da0 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 >> v1:172.21.15.143:6789/0 conn(0x7f23e8070da0 legacy=0x7f23e815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23d8005b90 0x7f23d8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d80064f0 0x7f23d80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d80071a0 0x7f23d800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80104e0 con 0x7f23d8005b90 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d8010620 con 0x7f23d80064f0 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80107e0 con 0x7f23d80071a0 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23eceaa640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23d8005b90 0x7f23d8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23e7fff640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d80064f0 0x7f23d80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ed6ab640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d80071a0 0x7f23d800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23eceaa640 1 -- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d80071a0 msgr2=0x7f23d800ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:50.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23eceaa640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d80071a0 0x7f23d800ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23eceaa640 1 -- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d80064f0 msgr2=0x7f23d80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:50.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23eceaa640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d80064f0 0x7f23d80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23eceaa640 1 -- 172.21.15.143:0/1912863196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8005740 con 0x7f23d8005b90 2023-11-24T06:31:50.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.525+0000 7f23ed6ab640 1 -- 172.21.15.143:0/1912863196 reap_dead start 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23eceaa640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23d8005b90 0x7f23d8005fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f23dc001780 tx=0x7f23dc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3305710c88a4708 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0052d0 con 0x7f23d8005b90 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc0a7050 con 0x7f23d8005b90 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23e77fe640 1 -- 172.21.15.143:0/1912863196 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc003600 con 0x7f23d8005b90 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 -- 172.21.15.143:0/1912863196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23d8005b90 msgr2=0x7f23d8005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23d8005b90 0x7f23d8005fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f23dc001780 tx=0x7f23dc01c3b0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 -- 172.21.15.143:0/1912863196 shutdown_connections 2023-11-24T06:31:50.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 --2- 172.21.15.143:0/1912863196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23d8005b90 0x7f23d8005fb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 -- 172.21.15.143:0/1912863196 >> 172.21.15.143:0/1912863196 conn(0x7f23e80b0bf0 msgr2=0x7f23e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:50.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 -- 172.21.15.143:0/1912863196 shutdown_connections 2023-11-24T06:31:50.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 -- 172.21.15.143:0/1912863196 wait complete. 2023-11-24T06:31:50.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 Processor -- start 2023-11-24T06:31:50.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.529+0000 7f23ef10e640 1 -- start start 2023-11-24T06:31:50.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d8005b90 0x7f23e809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 0x7f23e81f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e8156550 0x7f23e81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8135590 con 0x7f23e8099c10 2023-11-24T06:31:50.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e809c790 con 0x7f23e8156550 2023-11-24T06:31:50.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8146460 con 0x7f23d8005b90 2023-11-24T06:31:50.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 0x7f23e81f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 0x7f23e81f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53004/0 (socket says 172.21.15.143:53004) 2023-11-24T06:31:50.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 -- 172.21.15.143:0/514029721 learned_addr learned my addr 172.21.15.143:0/514029721 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:50.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23eceaa640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d8005b90 0x7f23e809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ed6ab640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e8156550 0x7f23e81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 -- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d8005b90 msgr2=0x7f23e809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d8005b90 0x7f23e809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 -- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e8156550 msgr2=0x7f23e81569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e8156550 0x7f23e81569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 -- 172.21.15.143:0/514029721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8146740 con 0x7f23e8099c10 2023-11-24T06:31:50.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e7fff640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 0x7f23e81f54a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b7f0 tx=0x7f23d400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40041f0 con 0x7f23e8099c10 2023-11-24T06:31:50.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4010a40 con 0x7f23e8099c10 2023-11-24T06:31:50.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e8146a20 con 0x7f23e8099c10 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4010dd0 con 0x7f23e8099c10 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e809a070 con 0x7f23e8099c10 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e8067520 con 0x7f23e8099c10 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.533+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f23d4014430 con 0x7f23e8099c10 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.537+0000 7f23e57fa640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23cc0666e0 0x7f23cc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.537+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23d40847b0 con 0x7f23e8099c10 2023-11-24T06:31:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.537+0000 7f23eceaa640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23cc0666e0 0x7f23cc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.537+0000 7f23eceaa640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23cc0666e0 0x7f23cc068ba0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23dc001750 tx=0x7f23dc0011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.541+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23d40518e0 con 0x7f23e8099c10 2023-11-24T06:31:50.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.689+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23e8071b10 con 0x7f23e8099c10 2023-11-24T06:31:50.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.689+0000 7f23e57fa640 1 -- 172.21.15.143:0/514029721 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f23d4054f00 con 0x7f23e8099c10 2023-11-24T06:31:50.699 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:50.699 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":58,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:49.350784+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23cc0666e0 msgr2=0x7f23cc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23cc0666e0 0x7f23cc068ba0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23dc001750 tx=0x7f23dc0011a0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 msgr2=0x7f23e81f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 0x7f23e81f54a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b7f0 tx=0x7f23d400bcb0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 shutdown_connections 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23cc0666e0 0x7f23cc068ba0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e8156550 0x7f23e81569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e8099c10 0x7f23e81f54a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 --2- 172.21.15.143:0/514029721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d8005b90 0x7f23e809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 >> 172.21.15.143:0/514029721 conn(0x7f23e80b0bf0 msgr2=0x7f23e80af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:50.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 shutdown_connections 2023-11-24T06:31:50.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.693+0000 7f23ef10e640 1 -- 172.21.15.143:0/514029721 wait complete. 2023-11-24T06:31:50.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:31:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 Processor -- start 2023-11-24T06:31:50.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 -- start start 2023-11-24T06:31:50.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc47015ec60 0x7fc4700cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4700cc6b0 0x7fc4700b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc470070f00 con 0x7fc47015a290 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc470071170 con 0x7fc4700cc6b0 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc4763df640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700cb690 con 0x7fc47015ec60 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4700cc6b0 0x7fc4700b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4700cc6b0 0x7fc4700b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53010/0 (socket says 172.21.15.143:53010) 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 -- 172.21.15.143:0/2195309525 learned_addr learned my addr 172.21.15.143:0/2195309525 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc46f7fe640 1 --2- 172.21.15.143:0/2195309525 >> v2:172.21.15.146:3300/0 conn(0x7fc47015ec60 0x7fc4700cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 -- 172.21.15.143:0/2195309525 >> v2:172.21.15.146:3300/0 conn(0x7fc47015ec60 msgr2=0x7fc4700cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 --2- 172.21.15.143:0/2195309525 >> v2:172.21.15.146:3300/0 conn(0x7fc47015ec60 0x7fc4700cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 -- 172.21.15.143:0/2195309525 >> v1:172.21.15.146:6789/0 conn(0x7fc47015a290 legacy=0x7fc4700707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.853+0000 7fc47497c640 1 -- 172.21.15.143:0/2195309525 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700cb970 con 0x7fc4700cc6b0 2023-11-24T06:31:50.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc47497c640 1 --2- 172.21.15.143:0/2195309525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4700cc6b0 0x7fc4700b1f80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc47006be60 tx=0x7fc46801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdf2bd2e9f21386 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc46effd640 1 -- 172.21.15.143:0/2195309525 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680a56e0 con 0x7fc4700cc6b0 2023-11-24T06:31:50.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc46effd640 1 -- 172.21.15.143:0/2195309525 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4680a5840 con 0x7fc4700cc6b0 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc46effd640 1 -- 172.21.15.143:0/2195309525 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680a5bd0 con 0x7fc4700cc6b0 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 -- 172.21.15.143:0/2195309525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4700cc6b0 msgr2=0x7fc4700b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 --2- 172.21.15.143:0/2195309525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4700cc6b0 0x7fc4700b1f80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc47006be60 tx=0x7fc46801c910 comp rx=0 tx=0).stop 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 -- 172.21.15.143:0/2195309525 shutdown_connections 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 --2- 172.21.15.143:0/2195309525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4700cc6b0 0x7fc4700b1f80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 --2- 172.21.15.143:0/2195309525 >> v2:172.21.15.146:3300/0 conn(0x7fc47015ec60 0x7fc4700cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 -- 172.21.15.143:0/2195309525 >> 172.21.15.143:0/2195309525 conn(0x7fc4700b0c80 msgr2=0x7fc4700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 -- 172.21.15.143:0/2195309525 shutdown_connections 2023-11-24T06:31:50.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.857+0000 7fc4763df640 1 -- 172.21.15.143:0/2195309525 wait complete. 2023-11-24T06:31:50.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 Processor -- start 2023-11-24T06:31:50.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- start start 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4700cc6b0 0x7fc470152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 0x7fc47015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc47015ec60 0x7fc47015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470154b90 con 0x7fc47015a290 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470154e70 con 0x7fc4700cc6b0 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc470152a70 con 0x7fc47015ec60 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 0x7fc47015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 0x7fc47015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53026/0 (socket says 172.21.15.143:53026) 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 -- 172.21.15.143:0/3374124306 learned_addr learned my addr 172.21.15.143:0/3374124306 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46ffff640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4700cc6b0 0x7fc470152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc47497c640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc47015ec60 0x7fc47015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 -- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc47015ec60 msgr2=0x7fc47015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc47015ec60 0x7fc47015bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 -- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4700cc6b0 msgr2=0x7fc470152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4700cc6b0 0x7fc470152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 -- 172.21.15.143:0/3374124306 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009b30 con 0x7fc47015a290 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46f7fe640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 0x7fc47015ba80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d5d0 tx=0x7fc46400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464004240 con 0x7fc47015a290 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4640043a0 con 0x7fc47015a290 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464003840 con 0x7fc47015a290 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc470152d50 con 0x7fc47015a290 2023-11-24T06:31:50.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4701518d0 con 0x7fc47015a290 2023-11-24T06:31:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.861+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc470154fe0 con 0x7fc47015a290 2023-11-24T06:31:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.865+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fc4640039a0 con 0x7fc47015a290 2023-11-24T06:31:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.865+0000 7fc46cff9640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc45c0666b0 0x7fc45c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:50.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.865+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4640844a0 con 0x7fc47015a290 2023-11-24T06:31:50.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.865+0000 7fc46ffff640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc45c0666b0 0x7fc45c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:50.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.865+0000 7fc46ffff640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc45c0666b0 0x7fc45c068b70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc460000f70 tx=0x7fc460009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:50.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:50.869+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4640515c0 con 0x7fc47015a290 2023-11-24T06:31:51.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:51.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc470152ee0 con 0x7fc47015a290 2023-11-24T06:31:52.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.053+0000 7fc46cff9640 1 -- 172.21.15.143:0/3374124306 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc464054be0 con 0x7fc47015a290 2023-11-24T06:31:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc45c0666b0 msgr2=0x7fc45c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc45c0666b0 0x7fc45c068b70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc460000f70 tx=0x7fc460009040 comp rx=0 tx=0).stop 2023-11-24T06:31:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 msgr2=0x7fc47015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 0x7fc47015ba80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d5d0 tx=0x7fc46400da90 comp rx=0 tx=0).stop 2023-11-24T06:31:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 shutdown_connections 2023-11-24T06:31:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc45c0666b0 0x7fc45c068b70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc47015ec60 0x7fc47015bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc47015a290 0x7fc47015ba80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 --2- 172.21.15.143:0/3374124306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4700cc6b0 0x7fc470152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 >> 172.21.15.143:0/3374124306 conn(0x7fc4700b0c80 msgr2=0x7fc47006c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 shutdown_connections 2023-11-24T06:31:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.057+0000 7fc4763df640 1 -- 172.21.15.143:0/3374124306 wait complete. 2023-11-24T06:31:52.086 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:31:52.086 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:31:52.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 Processor -- start 2023-11-24T06:31:52.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 -- start start 2023-11-24T06:31:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faad415ec60 0x7faad40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad4071170 con 0x7faad40cc6b0 2023-11-24T06:31:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad40cb690 con 0x7faad415ec60 2023-11-24T06:31:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faadc49c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40cb970 con 0x7faad415a290 2023-11-24T06:31:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faad9a37640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faad415ec60 0x7faad40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faad9a37640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faad415ec60 0x7faad40cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53042/0 (socket says 172.21.15.143:53042) 2023-11-24T06:31:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.225+0000 7faad9a37640 1 -- 172.21.15.143:0/851458473 learned_addr learned my addr 172.21.15.143:0/851458473 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faada238640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9a37640 1 -- 172.21.15.143:0/851458473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 msgr2=0x7faad40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9a37640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad40707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9a37640 1 -- 172.21.15.143:0/851458473 >> v1:172.21.15.146:6789/0 conn(0x7faad40cc6b0 legacy=0x7faad40b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:52.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9a37640 1 -- 172.21.15.143:0/851458473 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40cbc50 con 0x7faad415ec60 2023-11-24T06:31:52.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faada238640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad40707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9a37640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad415ec60 0x7faad40cc170 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faac4009870 tx=0x7faac401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e615b43fa0145 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9236640 1 -- 172.21.15.143:0/851458473 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40aa430 con 0x7faad415ec60 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9236640 1 -- 172.21.15.143:0/851458473 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40aa590 con 0x7faad415ec60 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faad9236640 1 -- 172.21.15.143:0/851458473 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40aa920 con 0x7faad415ec60 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faadc49c640 1 -- 172.21.15.143:0/851458473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad415ec60 msgr2=0x7faad40cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.229+0000 7faadc49c640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad415ec60 0x7faad40cc170 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faac4009870 tx=0x7faac401c4b0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- 172.21.15.143:0/851458473 shutdown_connections 2023-11-24T06:31:52.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad415ec60 0x7faad40cc170 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 --2- 172.21.15.143:0/851458473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad40707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- 172.21.15.143:0/851458473 >> 172.21.15.143:0/851458473 conn(0x7faad40b0c80 msgr2=0x7faad40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:52.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- 172.21.15.143:0/851458473 shutdown_connections 2023-11-24T06:31:52.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- 172.21.15.143:0/851458473 wait complete. 2023-11-24T06:31:52.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 Processor -- start 2023-11-24T06:31:52.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- start start 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 0x7faad4155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faad415ec60 0x7faad41673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4156890 con 0x7faad40cc6b0 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40b0930 con 0x7faad415ec60 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadc49c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad415bdc0 con 0x7faad415a290 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 0x7faad4155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:52.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 0x7faad4155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53056/0 (socket says 172.21.15.143:53056) 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 -- 172.21.15.143:0/2300493327 learned_addr learned my addr 172.21.15.143:0/2300493327 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadaa39640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faad415ec60 0x7faad41673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faad9a37640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 -- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 msgr2=0x7faad415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 -- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faad415ec60 msgr2=0x7faad41673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faad415ec60 0x7faad41673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 -- 172.21.15.143:0/2300493327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40094d0 con 0x7faad40cc6b0 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faad9a37640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faadaa39640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faad415ec60 0x7faad41673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:52.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.233+0000 7faada238640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 0x7faad4155d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faad000e810 tx=0x7faad000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:52.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000c8d0 con 0x7faad40cc6b0 2023-11-24T06:31:52.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad000ca30 con 0x7faad40cc6b0 2023-11-24T06:31:52.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000cdc0 con 0x7faad40cc6b0 2023-11-24T06:31:52.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad415c0a0 con 0x7faad40cc6b0 2023-11-24T06:31:52.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad4156290 con 0x7faad40cc6b0 2023-11-24T06:31:52.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad404e8c0 con 0x7faad40cc6b0 2023-11-24T06:31:52.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7faad0013410 con 0x7faad40cc6b0 2023-11-24T06:31:52.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faacaffd640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faab80666b0 0x7faab8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:52.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faad0084260 con 0x7faad40cc6b0 2023-11-24T06:31:52.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faad9a37640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faab80666b0 0x7faab8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:52.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.237+0000 7faad9a37640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faab80666b0 0x7faab8068b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faac40ae000 tx=0x7faac40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:52.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.241+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faad00511d0 con 0x7faad40cc6b0 2023-11-24T06:31:52.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:52.425+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faad40b3210 con 0x7faad40cc6b0 2023-11-24T06:31:53.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.057+0000 7faacaffd640 1 -- 172.21.15.143:0/2300493327 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7faad0009480 con 0x7faad40cc6b0 2023-11-24T06:31:53.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faab80666b0 msgr2=0x7faab8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faab80666b0 0x7faab8068b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faac40ae000 tx=0x7faac40a7000 comp rx=0 tx=0).stop 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 msgr2=0x7faad4155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 0x7faad4155d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faad000e810 tx=0x7faad000ecd0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 shutdown_connections 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faab80666b0 0x7faab8068b70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faad415ec60 0x7faad41673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faad415a290 0x7faad415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 --2- 172.21.15.143:0/2300493327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad40cc6b0 0x7faad4155d50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 >> 172.21.15.143:0/2300493327 conn(0x7faad40b0c80 msgr2=0x7faad40b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 shutdown_connections 2023-11-24T06:31:53.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.061+0000 7faadc49c640 1 -- 172.21.15.143:0/2300493327 wait complete. 2023-11-24T06:31:53.089 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:31:53.089 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:53.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 Processor -- start 2023-11-24T06:31:53.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 -- start start 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c015d5e0 0x7f24c00d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24c00d3ee0 0x7f24c00d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c015d9c0 con 0x7f24c00d1d00 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c00d2190 con 0x7f24c00d3ee0 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c59d0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00d1190 con 0x7f24c015d5e0 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c51cf640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f24c00d1d00 0x7f24c00cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34550/0 (socket says 172.21.15.143:34550) 2023-11-24T06:31:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c51cf640 1 -- 172.21.15.143:0/1064359381 learned_addr learned my addr 172.21.15.143:0/1064359381 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:53.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24bffff640 1 --2- 172.21.15.143:0/1064359381 >> v2:172.21.15.146:3300/0 conn(0x7f24c00d3ee0 0x7f24c00d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c49ce640 1 --2- 172.21.15.143:0/1064359381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c015d5e0 0x7f24c00d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24bf7fe640 1 -- 172.21.15.143:0/1064359381 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238318803 0 0) 0x7f24c015d9c0 con 0x7f24c00d1d00 2023-11-24T06:31:53.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24bf7fe640 1 -- 172.21.15.143:0/1064359381 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003530 con 0x7f24c00d1d00 2023-11-24T06:31:53.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c49ce640 1 -- 172.21.15.143:0/1064359381 >> v2:172.21.15.146:3300/0 conn(0x7f24c00d3ee0 msgr2=0x7f24c00d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:53.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c49ce640 1 --2- 172.21.15.143:0/1064359381 >> v2:172.21.15.146:3300/0 conn(0x7f24c00d3ee0 0x7f24c00d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c49ce640 1 -- 172.21.15.143:0/1064359381 >> v1:172.21.15.143:6789/0 conn(0x7f24c00d1d00 legacy=0x7f24c00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24c49ce640 1 -- 172.21.15.143:0/1064359381 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00d1470 con 0x7f24c015d5e0 2023-11-24T06:31:53.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.225+0000 7f24bffff640 1 --2- 172.21.15.143:0/1064359381 >> v2:172.21.15.146:3300/0 conn(0x7f24c00d3ee0 0x7f24c00d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:53.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c49ce640 1 --2- 172.21.15.143:0/1064359381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c015d5e0 0x7f24c00d39a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f24b40097c0 tx=0x7f24b401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a5066b35fcc3917 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24bf7fe640 1 -- 172.21.15.143:0/1064359381 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40ab650 con 0x7f24c015d5e0 2023-11-24T06:31:53.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24bf7fe640 1 -- 172.21.15.143:0/1064359381 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b40ab7b0 con 0x7f24c015d5e0 2023-11-24T06:31:53.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24bf7fe640 1 -- 172.21.15.143:0/1064359381 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40abb20 con 0x7f24c015d5e0 2023-11-24T06:31:53.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 -- 172.21.15.143:0/1064359381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c015d5e0 msgr2=0x7f24c00d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 --2- 172.21.15.143:0/1064359381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c015d5e0 0x7f24c00d39a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f24b40097c0 tx=0x7f24b401c450 comp rx=0 tx=0).stop 2023-11-24T06:31:53.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 -- 172.21.15.143:0/1064359381 shutdown_connections 2023-11-24T06:31:53.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 --2- 172.21.15.143:0/1064359381 >> v2:172.21.15.146:3300/0 conn(0x7f24c00d3ee0 0x7f24c00d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 --2- 172.21.15.143:0/1064359381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c015d5e0 0x7f24c00d39a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 -- 172.21.15.143:0/1064359381 >> 172.21.15.143:0/1064359381 conn(0x7f24c009c520 msgr2=0x7f24c00d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:53.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 -- 172.21.15.143:0/1064359381 shutdown_connections 2023-11-24T06:31:53.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.229+0000 7f24c59d0640 1 -- 172.21.15.143:0/1064359381 wait complete. 2023-11-24T06:31:53.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 Processor -- start 2023-11-24T06:31:53.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 -- start start 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c00d1d00 0x7f24c0152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c00d3ee0 0x7f24c015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 0x7f24c015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00cacc0 con 0x7f24c015d5e0 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00caf60 con 0x7f24c00d3ee0 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00cb240 con 0x7f24c00d1d00 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 0x7f24c015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 0x7f24c015be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53070/0 (socket says 172.21.15.143:53070) 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 -- 172.21.15.143:0/405749724 learned_addr learned my addr 172.21.15.143:0/405749724 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:53.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24bffff640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c00d3ee0 0x7f24c015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c49ce640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c00d1d00 0x7f24c0152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 -- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c00d1d00 msgr2=0x7f24c0152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c00d1d00 0x7f24c0152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 -- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c00d3ee0 msgr2=0x7f24c015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c00d3ee0 0x7f24c015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 -- 172.21.15.143:0/405749724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac009420 con 0x7f24c015d5e0 2023-11-24T06:31:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c51cf640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 0x7f24c015be30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f24b800c9f0 tx=0x7f24b800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800ab70 con 0x7f24c015d5e0 2023-11-24T06:31:53.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800acd0 con 0x7f24c015d5e0 2023-11-24T06:31:53.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b4009420 con 0x7f24c015d5e0 2023-11-24T06:31:53.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8012600 con 0x7f24c015d5e0 2023-11-24T06:31:53.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.233+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c00cb800 con 0x7f24c015d5e0 2023-11-24T06:31:53.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.237+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00b5db0 con 0x7f24c015d5e0 2023-11-24T06:31:53.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.237+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f24b8007070 con 0x7f24c015d5e0 2023-11-24T06:31:53.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.237+0000 7f24bd7fa640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24a40666b0 0x7f24a4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.237+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24b8084040 con 0x7f24c015d5e0 2023-11-24T06:31:53.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.237+0000 7f24c49ce640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24a40666b0 0x7f24a4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.237+0000 7f24c49ce640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24a40666b0 0x7f24a4068b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f24b40af000 tx=0x7f24b40b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.241+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24b8051210 con 0x7f24c015d5e0 2023-11-24T06:31:53.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.421+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24c004e850 con 0x7f24c015d5e0 2023-11-24T06:31:53.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24bd7fa640 1 -- 172.21.15.143:0/405749724 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f24b8054830 con 0x7f24c015d5e0 2023-11-24T06:31:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:53.430 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:49.351133+0000","modified":"2023-11-24T06:31:52.429632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/290735663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":290735663},{"type":"v1","addr":"172.21.15.146:6835","nonce":290735663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:31:53.430 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 35 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24a40666b0 msgr2=0x7f24a4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24a40666b0 0x7f24a4068b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f24b40af000 tx=0x7f24b40b6040 comp rx=0 tx=0).stop 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 msgr2=0x7f24c015be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 0x7f24c015be30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f24b800c9f0 tx=0x7f24b800ceb0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 shutdown_connections 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f24a40666b0 0x7f24a4068b70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c015d5e0 0x7f24c015be30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c00d3ee0 0x7f24c015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 --2- 172.21.15.143:0/405749724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c00d1d00 0x7f24c0152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 >> 172.21.15.143:0/405749724 conn(0x7f24c009c520 msgr2=0x7f24c00b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:53.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 shutdown_connections 2023-11-24T06:31:53.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.425+0000 7f24c59d0640 1 -- 172.21.15.143:0/405749724 wait complete. 2023-11-24T06:31:53.451 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:31:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.581+0000 7f15a9279640 1 Processor -- start 2023-11-24T06:31:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.581+0000 7f15a9279640 1 -- start start 2023-11-24T06:31:53.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a9279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a9279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15a406cee0 0x7f15a406d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a9279640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a40ae950 con 0x7f15a40b2660 2023-11-24T06:31:53.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a9279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a40b1ef0 con 0x7f15a406cee0 2023-11-24T06:31:53.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a9279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40adca0 con 0x7f15a4159a80 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f159a7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15a406cee0 0x7f15a406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f15a40b2660 0x7f15a40b2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34566/0 (socket says 172.21.15.143:34566) 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a37fe640 1 -- 172.21.15.143:0/3329628646 learned_addr learned my addr 172.21.15.143:0/3329628646 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a2ffd640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a27fc640 1 -- 172.21.15.143:0/3329628646 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292045497 0 0) 0x7f15a40ae950 con 0x7f15a40b2660 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a27fc640 1 -- 172.21.15.143:0/3329628646 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1590005740 con 0x7f15a40b2660 2023-11-24T06:31:53.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f159a7fc640 1 -- 172.21.15.143:0/3329628646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 msgr2=0x7f15a406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f159a7fc640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f159a7fc640 1 -- 172.21.15.143:0/3329628646 >> v1:172.21.15.143:6789/0 conn(0x7f15a40b2660 legacy=0x7f15a40b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f159a7fc640 1 -- 172.21.15.143:0/3329628646 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a406d880 con 0x7f15a406cee0 2023-11-24T06:31:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.585+0000 7f15a2ffd640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f159a7fc640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a406d340 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f159400a960 tx=0x7f159401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e3efd481a0e04f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a27fc640 1 -- 172.21.15.143:0/3329628646 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940a5780 con 0x7f15a406cee0 2023-11-24T06:31:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a27fc640 1 -- 172.21.15.143:0/3329628646 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15940a58e0 con 0x7f15a406cee0 2023-11-24T06:31:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a27fc640 1 -- 172.21.15.143:0/3329628646 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940a5c70 con 0x7f15a406cee0 2023-11-24T06:31:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 -- 172.21.15.143:0/3329628646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 msgr2=0x7f15a406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a406d340 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f159400a960 tx=0x7f159401c720 comp rx=0 tx=0).stop 2023-11-24T06:31:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 -- 172.21.15.143:0/3329628646 shutdown_connections 2023-11-24T06:31:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a406d340 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 --2- 172.21.15.143:0/3329628646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 -- 172.21.15.143:0/3329628646 >> 172.21.15.143:0/3329628646 conn(0x7f15a40b0bf0 msgr2=0x7f15a40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 -- 172.21.15.143:0/3329628646 shutdown_connections 2023-11-24T06:31:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 -- 172.21.15.143:0/3329628646 wait complete. 2023-11-24T06:31:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 Processor -- start 2023-11-24T06:31:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.589+0000 7f15a9279640 1 -- start start 2023-11-24T06:31:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a4157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40b2660 0x7f15a4163500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a41f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4163a40 con 0x7f15a406cee0 2023-11-24T06:31:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a41f5da0 con 0x7f15a40b2660 2023-11-24T06:31:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4158f60 con 0x7f15a4159a80 2023-11-24T06:31:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a4157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a4157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53082/0 (socket says 172.21.15.143:53082) 2023-11-24T06:31:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 -- 172.21.15.143:0/21838144 learned_addr learned my addr 172.21.15.143:0/21838144 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a37fe640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a41f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f159a7fc640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40b2660 0x7f15a4163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 -- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 msgr2=0x7f15a41f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a41f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 -- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40b2660 msgr2=0x7f15a4163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40b2660 0x7f15a4163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 -- 172.21.15.143:0/21838144 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009420 con 0x7f15a406cee0 2023-11-24T06:31:53.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a2ffd640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a4157070 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f158c00e980 tx=0x7f158c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00ca00 con 0x7f15a406cee0 2023-11-24T06:31:53.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00cb60 con 0x7f15a406cee0 2023-11-24T06:31:53.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c013470 con 0x7f15a406cee0 2023-11-24T06:31:53.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159400a5c0 con 0x7f15a406cee0 2023-11-24T06:31:53.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a41f6320 con 0x7f15a406cee0 2023-11-24T06:31:53.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a4067520 con 0x7f15a406cee0 2023-11-24T06:31:53.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.593+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f158c0135d0 con 0x7f15a406cee0 2023-11-24T06:31:53.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.597+0000 7f159bfff640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15840666e0 0x7f1584068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.597+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f158c084930 con 0x7f15a406cee0 2023-11-24T06:31:53.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.597+0000 7f159a7fc640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15840666e0 0x7f1584068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.597+0000 7f159a7fc640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15840666e0 0x7f1584068ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15940af000 tx=0x7f15940a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.601+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f158c0519d0 con 0x7f15a406cee0 2023-11-24T06:31:53.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.749+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15a415ceb0 con 0x7f15a406cee0 2023-11-24T06:31:53.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.749+0000 7f159bfff640 1 -- 172.21.15.143:0/21838144 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f158c017090 con 0x7f15a406cee0 2023-11-24T06:31:53.757 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:53.757 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":59,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:51.000119+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:31:53.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15840666e0 msgr2=0x7f1584068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15840666e0 0x7f1584068ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15940af000 tx=0x7f15940a7070 comp rx=0 tx=0).stop 2023-11-24T06:31:53.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 msgr2=0x7f15a4157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a4157070 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f158c00e980 tx=0x7f158c00ee40 comp rx=0 tx=0).stop 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 shutdown_connections 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f15840666e0 0x7f1584068ba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a4159a80 0x7f15a41f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40b2660 0x7f15a4163500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 --2- 172.21.15.143:0/21838144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a406cee0 0x7f15a4157070 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 >> 172.21.15.143:0/21838144 conn(0x7f15a40b0bf0 msgr2=0x7f15a406dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 shutdown_connections 2023-11-24T06:31:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.753+0000 7f15a9279640 1 -- 172.21.15.143:0/21838144 wait complete. 2023-11-24T06:31:53.779 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:31:53.779 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:53.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.909+0000 7f8289b57640 1 Processor -- start 2023-11-24T06:31:53.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.909+0000 7f8289b57640 1 -- start start 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8289b57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8284159a80 0x7f828406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8289b57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f828406d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8289b57640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82840ae950 con 0x7f828406cee0 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8289b57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828406d8b0 con 0x7f8284159a80 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8289b57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840b1ef0 con 0x7f82840ad5e0 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8284159a80 0x7f828406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8284159a80 0x7f828406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53094/0 (socket says 172.21.15.143:53094) 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 -- 172.21.15.143:0/3636571309 learned_addr learned my addr 172.21.15.143:0/3636571309 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8283fff640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f828406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 -- 172.21.15.143:0/3636571309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 msgr2=0x7f828406d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:53.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f828406d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 -- 172.21.15.143:0/3636571309 >> v1:172.21.15.146:6789/0 conn(0x7f828406cee0 legacy=0x7f82840b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f82837fe640 1 -- 172.21.15.143:0/3636571309 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82840ada70 con 0x7f8284159a80 2023-11-24T06:31:53.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.913+0000 7f8283fff640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f828406d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:53.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f82837fe640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8284159a80 0x7f828406de50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f827400aa10 tx=0x7f827401d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed02ff590bc4490 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8282ffd640 1 -- 172.21.15.143:0/3636571309 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82740a6910 con 0x7f8284159a80 2023-11-24T06:31:53.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8282ffd640 1 -- 172.21.15.143:0/3636571309 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740a6a70 con 0x7f8284159a80 2023-11-24T06:31:53.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8282ffd640 1 -- 172.21.15.143:0/3636571309 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82740a6e00 con 0x7f8284159a80 2023-11-24T06:31:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 -- 172.21.15.143:0/3636571309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8284159a80 msgr2=0x7f828406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8284159a80 0x7f828406de50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f827400aa10 tx=0x7f827401d8e0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 -- 172.21.15.143:0/3636571309 shutdown_connections 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f828406d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 --2- 172.21.15.143:0/3636571309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8284159a80 0x7f828406de50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 -- 172.21.15.143:0/3636571309 >> 172.21.15.143:0/3636571309 conn(0x7f82840b0bf0 msgr2=0x7f82840b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 -- 172.21.15.143:0/3636571309 shutdown_connections 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 -- 172.21.15.143:0/3636571309 wait complete. 2023-11-24T06:31:53.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 Processor -- start 2023-11-24T06:31:53.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.917+0000 7f8289b57640 1 -- start start 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 0x7f82841429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f8284142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8284159a80 0x7f82840aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82841508e0 con 0x7f828406cee0 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284143930 con 0x7f8284159a80 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840b06a0 con 0x7f82840ad5e0 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 0x7f82841429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 0x7f82841429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53104/0 (socket says 172.21.15.143:53104) 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 -- 172.21.15.143:0/2762198135 learned_addr learned my addr 172.21.15.143:0/2762198135 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:53.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f827bfff640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f8284142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8283fff640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8284159a80 0x7f82840aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 -- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 msgr2=0x7f8284142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f8284142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 -- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8284159a80 msgr2=0x7f82840aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8284159a80 0x7f82840aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 -- 172.21.15.143:0/2762198135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827400a670 con 0x7f828406cee0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f82837fe640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 0x7f82841429a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f827400a1c0 tx=0x7f827401a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82740aeb10 con 0x7f828406cee0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740aec90 con 0x7f828406cee0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82840afb20 con 0x7f828406cee0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82740b9460 con 0x7f828406cee0 2023-11-24T06:31:53.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82840b00e0 con 0x7f828406cee0 2023-11-24T06:31:53.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284067520 con 0x7f828406cee0 2023-11-24T06:31:53.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.921+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f82740b63f0 con 0x7f828406cee0 2023-11-24T06:31:53.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.925+0000 7f8280ff9640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f82640666e0 0x7f8264068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:53.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.925+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f827411e990 con 0x7f828406cee0 2023-11-24T06:31:53.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.925+0000 7f827bfff640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f82640666e0 0x7f8264068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:53.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.925+0000 7f827bfff640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f82640666e0 0x7f8264068ba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f82841457d0 tx=0x7f826c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:53.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:53.929+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82740ebaa0 con 0x7f828406cee0 2023-11-24T06:31:54.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.077+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8284159e60 con 0x7f82640666e0 2023-11-24T06:31:54.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.085+0000 7f8280ff9640 1 -- 172.21.15.143:0/2762198135 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276779 (secure 0 0 0) 0x7f826c001c80 con 0x7f82640666e0 2023-11-24T06:31:54.095 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:54.096 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:54.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f82640666e0 msgr2=0x7f8264068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f82640666e0 0x7f8264068ba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f82841457d0 tx=0x7f826c009040 comp rx=0 tx=0).stop 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 msgr2=0x7f82841429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 0x7f82841429a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f827400a1c0 tx=0x7f827401a680 comp rx=0 tx=0).stop 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 shutdown_connections 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f82640666e0 0x7f8264068ba0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8284159a80 0x7f82840aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82840ad5e0 0x7f8284142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 --2- 172.21.15.143:0/2762198135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f828406cee0 0x7f82841429a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 >> 172.21.15.143:0/2762198135 conn(0x7f82840b0bf0 msgr2=0x7f828415a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 shutdown_connections 2023-11-24T06:31:54.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.089+0000 7f8289b57640 1 -- 172.21.15.143:0/2762198135 wait complete. 2023-11-24T06:31:54.114 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2023-11-24T06:31:52.230758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":230872,"kb_used_data":6356,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743848,"statfs":{"total":773094113280,"available":772857700352,"internally_reserved":0,"allocated":6508544,"data_stored":3371755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.272468"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.965407+0000","last_change":"2023-11-24T06:31:47.965407+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.965407+0000","last_undegraded":"2023-11-24T06:31:47.965407+0000","last_fullsized":"2023-11-24T06:31:47.965407+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.967940+0000","last_change":"2023-11-24T06:31:47.967940+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.967940+0000","last_undegraded":"2023-11-24T06:31:47.967940+0000","last_fullsized":"2023-11-24T06:31:47.967940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.965757+0000","last_change":"2023-11-24T06:31:47.965757+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.965757+0000","last_undegraded":"2023-11-24T06:31:47.965757+0000","last_fullsized":"2023-11-24T06:31:47.965757+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.965733+0000","last_change":"2023-11-24T06:31:47.965733+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.965733+0000","last_undegraded":"2023-11-24T06:31:47.965733+0000","last_fullsized":"2023-11-24T06:31:47.965733+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.970379+0000","last_change":"2023-11-24T06:31:47.970379+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.970379+0000","last_undegraded":"2023-11-24T06:31:47.970379+0000","last_fullsized":"2023-11-24T06:31:47.970379+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.965022+0000","last_change":"2023-11-24T06:31:47.965022+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.965022+0000","last_undegraded":"2023-11-24T06:31:47.965022+0000","last_fullsized":"2023-11-24T06:31:47.965022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.965545+0000","last_change":"2023-11-24T06:31:47.965545+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.965545+0000","last_undegraded":"2023-11-24T06:31:47.965545+0000","last_fullsized":"2023-11-24T06:31:47.965545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.969324+0000","last_change":"2023-11-24T06:31:47.969324+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.969324+0000","last_undegraded":"2023-11-24T06:31:47.969324+0000","last_fullsized":"2023-11-24T06:31:47.969324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.967693+0000","last_change":"2023-11-24T06:31:47.967693+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.967693+0000","last_undegraded":"2023-11-24T06:31:47.967693+0000","last_fullsized":"2023-11-24T06:31:47.967693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.967364+0000","last_change":"2023-11-24T06:31:47.967364+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.967364+0000","last_undegraded":"2023-11-24T06:31:47.967364+0000","last_fullsized":"2023-11-24T06:31:47.967364+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.967466+0000","last_change":"2023-11-24T06:31:47.967466+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.967466+0000","last_undegraded":"2023-11-24T06:31:47.967466+0000","last_fullsized":"2023-11-24T06:31:47.967466+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.970056+0000","last_change":"2023-11-24T06:31:47.970056+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.970056+0000","last_undegraded":"2023-11-24T06:31:47.970056+0000","last_fullsized":"2023-11-24T06:31:47.970056+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964931+0000","last_change":"2023-11-24T06:31:47.964931+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964931+0000","last_undegraded":"2023-11-24T06:31:47.964931+0000","last_fullsized":"2023-11-24T06:31:47.964931+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.968370+0000","last_change":"2023-11-24T06:31:47.968370+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.968370+0000","last_undegraded":"2023-11-24T06:31:47.968370+0000","last_fullsized":"2023-11-24T06:31:47.968370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964692+0000","last_change":"2023-11-24T06:31:47.964692+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964692+0000","last_undegraded":"2023-11-24T06:31:47.964692+0000","last_fullsized":"2023-11-24T06:31:47.964692+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.967483+0000","last_change":"2023-11-24T06:31:47.967483+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.967483+0000","last_undegraded":"2023-11-24T06:31:47.967483+0000","last_fullsized":"2023-11-24T06:31:47.967483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.967427+0000","last_change":"2023-11-24T06:31:47.967427+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.967427+0000","last_undegraded":"2023-11-24T06:31:47.967427+0000","last_fullsized":"2023-11-24T06:31:47.967427+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.965178+0000","last_change":"2023-11-24T06:31:47.965178+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.965178+0000","last_undegraded":"2023-11-24T06:31:47.965178+0000","last_fullsized":"2023-11-24T06:31:47.965178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964620+0000","last_change":"2023-11-24T06:31:47.964620+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964620+0000","last_undegraded":"2023-11-24T06:31:47.964620+0000","last_fullsized":"2023-11-24T06:31:47.964620+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.963573+0000","last_change":"2023-11-24T06:31:47.963573+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.963573+0000","last_undegraded":"2023-11-24T06:31:47.963573+0000","last_fullsized":"2023-11-24T06:31:47.963573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964353+0000","last_change":"2023-11-24T06:31:47.964353+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964353+0000","last_undegraded":"2023-11-24T06:31:47.964353+0000","last_fullsized":"2023-11-24T06:31:47.964353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.961127+0000","last_change":"2023-11-24T06:31:47.961127+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.961127+0000","last_undegraded":"2023-11-24T06:31:47.961127+0000","last_fullsized":"2023-11-24T06:31:47.961127+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964659+0000","last_change":"2023-11-24T06:31:47.964659+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964659+0000","last_undegraded":"2023-11-24T06:31:47.964659+0000","last_fullsized":"2023-11-24T06:31:47.964659+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.961195+0000","last_change":"2023-11-24T06:31:47.961195+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.961195+0000","last_undegraded":"2023-11-24T06:31:47.961195+0000","last_fullsized":"2023-11-24T06:31:47.961195+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.963564+0000","last_change":"2023-11-24T06:31:47.963564+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.963564+0000","last_undegraded":"2023-11-24T06:31:47.963564+0000","last_fullsized":"2023-11-24T06:31:47.963564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.968427+0000","last_change":"2023-11-24T06:31:47.968427+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.968427+0000","last_undegraded":"2023-11-24T06:31:47.968427+0000","last_fullsized":"2023-11-24T06:31:47.968427+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964665+0000","last_change":"2023-11-24T06:31:47.964665+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964665+0000","last_undegraded":"2023-11-24T06:31:47.964665+0000","last_fullsized":"2023-11-24T06:31:47.964665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.961050+0000","last_change":"2023-11-24T06:31:47.961050+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.961050+0000","last_undegraded":"2023-11-24T06:31:47.961050+0000","last_fullsized":"2023-11-24T06:31:47.961050+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.971494+0000","last_change":"2023-11-24T06:31:47.971494+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.971494+0000","last_undegraded":"2023-11-24T06:31:47.971494+0000","last_fullsized":"2023-11-24T06:31:47.971494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.961141+0000","last_change":"2023-11-24T06:31:47.961141+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.961141+0000","last_undegraded":"2023-11-24T06:31:47.961141+0000","last_fullsized":"2023-11-24T06:31:47.961141+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.964364+0000","last_change":"2023-11-24T06:31:47.964364+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.964364+0000","last_undegraded":"2023-11-24T06:31:47.964364+0000","last_fullsized":"2023-11-24T06:31:47.964364+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:31:48.957326+0000","last_change":"2023-11-24T06:31:48.957326+0000","last_active":"2023-11-24T06:31:48.957326+0000","last_peered":"2023-11-24T06:31:48.957326+0000","last_clean":"2023-11-24T06:31:48.957326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:48.957326+0000","last_undegraded":"2023-11-24T06:31:48.957326+0000","last_fullsized":"2023-11-24T06:31:48.957326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-24T06:31:47.968224+0000","last_change":"2023-11-24T06:31:47.968224+0000","last_active":"2023-11-24T06:31:47.954647+0000","last_peered":"2023-11-24T06:31:47.954647+0000","last_clean":"2023-11-24T06:31:47.954647+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:31:47.968224+0000","last_undegraded":"2023-11-24T06:31:47.968224+0000","last_fullsized":"2023-11-24T06:31:47.968224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T06:31:45.956554+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:45.956554+0000","last_peered":"2023-11-24T06:31:45.956554+0000","last_clean":"2023-11-24T06:31:45.956554+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:45.956554+0000","last_undegraded":"2023-11-24T06:31:45.956554+0000","last_fullsized":"2023-11-24T06:31:45.956554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1265664,"data_stored":867275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.417,"15min":1.417},"last":0.62}]},{"osd":1,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90900000000000003,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98899999999999999,"5min":1.7,"15min":1.7},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0049999999999999,"5min":1.96,"15min":1.96},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96599999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.502}]},{"osd":3,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95699999999999996,"5min":1.55,"15min":1.55},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":0.996,"15min":0.996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.47299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92600000000000005,"5min":1,"15min":1},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94299999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":271090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89100000000000001,"5min":2.637,"15min":2.637},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0720000000000001,"5min":1.619,"15min":1.619},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93000000000000005,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97499999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0980000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.119,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.036,"15min":1.036},"last":0.439}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":271090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":1.278,"15min":1.278},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":1.919,"15min":1.919},"last":1.294}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91000000000000003,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95899999999999996,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.427},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":1.1819999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.04,"5min":1.998,"15min":1.998},"last":1.4059999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84899999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":1.125},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.3740000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.274},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.327}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.4750000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97399999999999998,"5min":1.462,"15min":1.462},"last":1.4490000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.37,"15min":0.37},"max":{"1min":0.86099999999999999,"5min":1.165,"15min":1.165},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88500000000000001,"5min":1.022,"15min":1.022},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95199999999999996,"5min":1.202,"15min":1.202},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86099999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.877}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.248,"15min":1.248},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.079,"15min":1.079},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.149,"15min":1.149},"last":0.89400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":659456,"data_stored":271090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.62,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63100000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.378},{"interface":"front","average":{"1min":0.505,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64900000000000002,"5min":1.095,"15min":1.095},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.753},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97099999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0109999999999999,"5min":1.264,"15min":1.264},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91600000000000004,"5min":1.286,"15min":1.286},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.409,"15min":1.409},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27680,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":671744,"data_stored":276907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51500000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98699999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.442},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0609999999999999,"5min":1.075,"15min":1.075},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.65700000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3400000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97799999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.27,"15min":1.27},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.3759999999999999,"5min":1.389,"15min":1.389},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1220000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.101,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.64300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3049999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":659456,"data_stored":271090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44}]},{"osd":4,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.02,"15min":1.02},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.032,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98099999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":866306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.75900000000000001,"5min":1.393,"15min":1.393},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81899999999999995,"5min":1.319,"15min":1.319},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.437}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.879,"5min":1.589,"15min":1.589},"last":0.5}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.014,"5min":1.206,"15min":1.206},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95899999999999996,"5min":1.778,"15min":1.778},"last":0.625}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79600000000000004,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92700000000000005,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92900000000000005,"5min":1.496,"15min":1.496},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82199999999999995,"15min":0.83699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95299999999999996,"5min":1.454,"15min":1.454},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.278,"15min":1.278},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93400000000000005,"5min":1.829,"15min":1.829},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:54.120 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:31:54.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.293+0000 7ff234432640 1 Processor -- start 2023-11-24T06:31:54.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.293+0000 7ff234432640 1 -- start start 2023-11-24T06:31:54.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.293+0000 7ff234432640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.293+0000 7ff234432640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c06af20 con 0x7ff22c0ce710 2023-11-24T06:31:54.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.293+0000 7ff234432640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c06b200 con 0x7ff22c0715b0 2023-11-24T06:31:54.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.293+0000 7ff234432640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c06bba0 con 0x7ff22c15d4f0 2023-11-24T06:31:54.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2319cd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff22c0ce710 0x7ff22c070ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34580/0 (socket says 172.21.15.143:34580) 2023-11-24T06:31:54.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2319cd640 1 -- 172.21.15.143:0/979276833 learned_addr learned my addr 172.21.15.143:0/979276833 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:54.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2321ce640 1 --2- 172.21.15.143:0/979276833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164949027 0 0) 0x7ff22c06af20 con 0x7ff22c0ce710 2023-11-24T06:31:54.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff218003530 con 0x7ff22c0ce710 2023-11-24T06:31:54.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614012435 0 0) 0x7ff22c06b200 con 0x7ff22c0715b0 2023-11-24T06:31:54.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22c06af20 con 0x7ff22c0715b0 2023-11-24T06:31:54.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2321ce640 1 -- 172.21.15.143:0/979276833 >> v1:172.21.15.146:6789/0 conn(0x7ff22c0715b0 legacy=0x7ff22c167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2321ce640 1 -- 172.21.15.143:0/979276833 >> v1:172.21.15.143:6789/0 conn(0x7ff22c0ce710 legacy=0x7ff22c070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2321ce640 1 -- 172.21.15.143:0/979276833 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c06b4e0 con 0x7ff22c15d4f0 2023-11-24T06:31:54.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.297+0000 7ff2321ce640 1 --2- 172.21.15.143:0/979276833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c06a5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097f0 tx=0x7ff22801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99222676bd906c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:54.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ab620 con 0x7ff22c15d4f0 2023-11-24T06:31:54.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280ab780 con 0x7ff22c15d4f0 2023-11-24T06:31:54.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff2311cc640 1 -- 172.21.15.143:0/979276833 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280abb10 con 0x7ff22c15d4f0 2023-11-24T06:31:54.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- 172.21.15.143:0/979276833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 msgr2=0x7ff22c06a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 --2- 172.21.15.143:0/979276833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c06a5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097f0 tx=0x7ff22801c490 comp rx=0 tx=0).stop 2023-11-24T06:31:54.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- 172.21.15.143:0/979276833 shutdown_connections 2023-11-24T06:31:54.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 --2- 172.21.15.143:0/979276833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c06a5b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- 172.21.15.143:0/979276833 >> 172.21.15.143:0/979276833 conn(0x7ff22c0cc330 msgr2=0x7ff22c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:54.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- 172.21.15.143:0/979276833 shutdown_connections 2023-11-24T06:31:54.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- 172.21.15.143:0/979276833 wait complete. 2023-11-24T06:31:54.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 Processor -- start 2023-11-24T06:31:54.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- start start 2023-11-24T06:31:54.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22c0715b0 0x7ff22c1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 0x7ff22c13a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c13ab20 con 0x7ff22c0ce710 2023-11-24T06:31:54.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c13ae00 con 0x7ff22c0715b0 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.301+0000 7ff234432640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c15ffb0 con 0x7ff22c15d4f0 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 0x7ff22c13a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 0x7ff22c13a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53116/0 (socket says 172.21.15.143:53116) 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 -- 172.21.15.143:0/250501506 learned_addr learned my addr 172.21.15.143:0/250501506 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2321ce640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22c0715b0 0x7ff22c1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2329cf640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 -- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 msgr2=0x7ff22c0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 -- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22c0715b0 msgr2=0x7ff22c1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22c0715b0 0x7ff22c1607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 -- 172.21.15.143:0/250501506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009420 con 0x7ff22c0ce710 2023-11-24T06:31:54.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff2319cd640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 0x7ff22c13a020 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c4d0 tx=0x7ff21c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:54.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c005cf0 con 0x7ff22c0ce710 2023-11-24T06:31:54.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c005e50 con 0x7ff22c0ce710 2023-11-24T06:31:54.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c160290 con 0x7ff22c0ce710 2023-11-24T06:31:54.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0072b0 con 0x7ff22c0ce710 2023-11-24T06:31:54.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c160cf0 con 0x7ff22c0ce710 2023-11-24T06:31:54.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c1604d0 con 0x7ff22c0ce710 2023-11-24T06:31:54.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7ff21c007410 con 0x7ff22c0ce710 2023-11-24T06:31:54.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.305+0000 7ff222ffd640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff2100666b0 0x7ff210068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.309+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff21c083830 con 0x7ff22c0ce710 2023-11-24T06:31:54.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.309+0000 7ff2321ce640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff2100666b0 0x7ff210068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.309+0000 7ff2321ce640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff2100666b0 0x7ff210068b70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff2280af000 tx=0x7ff2280b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:54.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.309+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff22c1604d0 con 0x7ff22c0ce710 2023-11-24T06:31:54.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.457+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff22c1604d0 con 0x7ff2100666b0 2023-11-24T06:31:54.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.465+0000 7ff222ffd640 1 -- 172.21.15.143:0/250501506 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288954 (secure 0 0 0) 0x7ff22c1604d0 con 0x7ff2100666b0 2023-11-24T06:31:54.473 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:54.475 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:31:54.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff2100666b0 msgr2=0x7ff210068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff2100666b0 0x7ff210068b70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff2280af000 tx=0x7ff2280b6040 comp rx=0 tx=0).stop 2023-11-24T06:31:54.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 msgr2=0x7ff22c13a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 0x7ff22c13a020 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c4d0 tx=0x7ff21c00c990 comp rx=0 tx=0).stop 2023-11-24T06:31:54.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 shutdown_connections 2023-11-24T06:31:54.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff2100666b0 0x7ff210068b70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff22c15d4f0 0x7ff22c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff22c0ce710 0x7ff22c13a020 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 --2- 172.21.15.143:0/250501506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22c0715b0 0x7ff22c1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 >> 172.21.15.143:0/250501506 conn(0x7ff22c0cc330 msgr2=0x7ff22c158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:54.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 shutdown_connections 2023-11-24T06:31:54.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.469+0000 7ff234432640 1 -- 172.21.15.143:0/250501506 wait complete. 2023-11-24T06:31:54.494 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-24T06:31:54.231072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239576,"kb_used_data":6756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735144,"statfs":{"total":773094113280,"available":772848787456,"internally_reserved":0,"allocated":6918144,"data_stored":3554579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000902"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069273+0000","last_change":"2023-11-24T06:31:50.030076+0000","last_active":"2023-11-24T06:31:51.069273+0000","last_peered":"2023-11-24T06:31:51.069273+0000","last_clean":"2023-11-24T06:31:51.069273+0000","last_became_active":"2023-11-24T06:31:50.029751+0000","last_became_peered":"2023-11-24T06:31:50.029751+0000","last_unstale":"2023-11-24T06:31:51.069273+0000","last_undegraded":"2023-11-24T06:31:51.069273+0000","last_fullsized":"2023-11-24T06:31:51.069273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:04.154713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069928+0000","last_change":"2023-11-24T06:31:50.015842+0000","last_active":"2023-11-24T06:31:51.069928+0000","last_peered":"2023-11-24T06:31:51.069928+0000","last_clean":"2023-11-24T06:31:51.069928+0000","last_became_active":"2023-11-24T06:31:50.015579+0000","last_became_peered":"2023-11-24T06:31:50.015579+0000","last_unstale":"2023-11-24T06:31:51.069928+0000","last_undegraded":"2023-11-24T06:31:51.069928+0000","last_fullsized":"2023-11-24T06:31:51.069928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:02:04.883420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070542+0000","last_change":"2023-11-24T06:31:50.038332+0000","last_active":"2023-11-24T06:31:51.070542+0000","last_peered":"2023-11-24T06:31:51.070542+0000","last_clean":"2023-11-24T06:31:51.070542+0000","last_became_active":"2023-11-24T06:31:50.038034+0000","last_became_peered":"2023-11-24T06:31:50.038034+0000","last_unstale":"2023-11-24T06:31:51.070542+0000","last_undegraded":"2023-11-24T06:31:51.070542+0000","last_fullsized":"2023-11-24T06:31:51.070542+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:24.352509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071372+0000","last_change":"2023-11-24T06:31:50.020820+0000","last_active":"2023-11-24T06:31:51.071372+0000","last_peered":"2023-11-24T06:31:51.071372+0000","last_clean":"2023-11-24T06:31:51.071372+0000","last_became_active":"2023-11-24T06:31:50.020531+0000","last_became_peered":"2023-11-24T06:31:50.020531+0000","last_unstale":"2023-11-24T06:31:51.071372+0000","last_undegraded":"2023-11-24T06:31:51.071372+0000","last_fullsized":"2023-11-24T06:31:51.071372+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:06:48.909686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.068999+0000","last_change":"2023-11-24T06:31:50.035257+0000","last_active":"2023-11-24T06:31:51.068999+0000","last_peered":"2023-11-24T06:31:51.068999+0000","last_clean":"2023-11-24T06:31:51.068999+0000","last_became_active":"2023-11-24T06:31:50.034628+0000","last_became_peered":"2023-11-24T06:31:50.034628+0000","last_unstale":"2023-11-24T06:31:51.068999+0000","last_undegraded":"2023-11-24T06:31:51.068999+0000","last_fullsized":"2023-11-24T06:31:51.068999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:57.941663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.004909+0000","last_change":"2023-11-24T06:31:50.019791+0000","last_active":"2023-11-24T06:31:51.004909+0000","last_peered":"2023-11-24T06:31:51.004909+0000","last_clean":"2023-11-24T06:31:51.004909+0000","last_became_active":"2023-11-24T06:31:50.019463+0000","last_became_peered":"2023-11-24T06:31:50.019463+0000","last_unstale":"2023-11-24T06:31:51.004909+0000","last_undegraded":"2023-11-24T06:31:51.004909+0000","last_fullsized":"2023-11-24T06:31:51.004909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:23.190155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.008134+0000","last_change":"2023-11-24T06:31:50.031956+0000","last_active":"2023-11-24T06:31:51.008134+0000","last_peered":"2023-11-24T06:31:51.008134+0000","last_clean":"2023-11-24T06:31:51.008134+0000","last_became_active":"2023-11-24T06:31:50.031567+0000","last_became_peered":"2023-11-24T06:31:50.031567+0000","last_unstale":"2023-11-24T06:31:51.008134+0000","last_undegraded":"2023-11-24T06:31:51.008134+0000","last_fullsized":"2023-11-24T06:31:51.008134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:40.193242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069365+0000","last_change":"2023-11-24T06:31:50.021200+0000","last_active":"2023-11-24T06:31:51.069365+0000","last_peered":"2023-11-24T06:31:51.069365+0000","last_clean":"2023-11-24T06:31:51.069365+0000","last_became_active":"2023-11-24T06:31:50.020873+0000","last_became_peered":"2023-11-24T06:31:50.020873+0000","last_unstale":"2023-11-24T06:31:51.069365+0000","last_undegraded":"2023-11-24T06:31:51.069365+0000","last_fullsized":"2023-11-24T06:31:51.069365+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:54.062484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.008189+0000","last_change":"2023-11-24T06:31:50.035678+0000","last_active":"2023-11-24T06:31:51.008189+0000","last_peered":"2023-11-24T06:31:51.008189+0000","last_clean":"2023-11-24T06:31:51.008189+0000","last_became_active":"2023-11-24T06:31:50.030704+0000","last_became_peered":"2023-11-24T06:31:50.030704+0000","last_unstale":"2023-11-24T06:31:51.008189+0000","last_undegraded":"2023-11-24T06:31:51.008189+0000","last_fullsized":"2023-11-24T06:31:51.008189+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:46.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.010077+0000","last_change":"2023-11-24T06:31:50.018099+0000","last_active":"2023-11-24T06:31:51.010077+0000","last_peered":"2023-11-24T06:31:51.010077+0000","last_clean":"2023-11-24T06:31:51.010077+0000","last_became_active":"2023-11-24T06:31:50.017528+0000","last_became_peered":"2023-11-24T06:31:50.017528+0000","last_unstale":"2023-11-24T06:31:51.010077+0000","last_undegraded":"2023-11-24T06:31:51.010077+0000","last_fullsized":"2023-11-24T06:31:51.010077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:11:55.401454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.010212+0000","last_change":"2023-11-24T06:31:50.015274+0000","last_active":"2023-11-24T06:31:51.010212+0000","last_peered":"2023-11-24T06:31:51.010212+0000","last_clean":"2023-11-24T06:31:51.010212+0000","last_became_active":"2023-11-24T06:31:50.013547+0000","last_became_peered":"2023-11-24T06:31:50.013547+0000","last_unstale":"2023-11-24T06:31:51.010212+0000","last_undegraded":"2023-11-24T06:31:51.010212+0000","last_fullsized":"2023-11-24T06:31:51.010212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:51.913217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071507+0000","last_change":"2023-11-24T06:31:50.028127+0000","last_active":"2023-11-24T06:31:51.071507+0000","last_peered":"2023-11-24T06:31:51.071507+0000","last_clean":"2023-11-24T06:31:51.071507+0000","last_became_active":"2023-11-24T06:31:50.027834+0000","last_became_peered":"2023-11-24T06:31:50.027834+0000","last_unstale":"2023-11-24T06:31:51.071507+0000","last_undegraded":"2023-11-24T06:31:51.071507+0000","last_fullsized":"2023-11-24T06:31:51.071507+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:33.514553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070739+0000","last_change":"2023-11-24T06:31:50.024908+0000","last_active":"2023-11-24T06:31:51.070739+0000","last_peered":"2023-11-24T06:31:51.070739+0000","last_clean":"2023-11-24T06:31:51.070739+0000","last_became_active":"2023-11-24T06:31:50.024586+0000","last_became_peered":"2023-11-24T06:31:50.024586+0000","last_unstale":"2023-11-24T06:31:51.070739+0000","last_undegraded":"2023-11-24T06:31:51.070739+0000","last_fullsized":"2023-11-24T06:31:51.070739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:29:44.354441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.008123+0000","last_change":"2023-11-24T06:31:50.022605+0000","last_active":"2023-11-24T06:31:51.008123+0000","last_peered":"2023-11-24T06:31:51.008123+0000","last_clean":"2023-11-24T06:31:51.008123+0000","last_became_active":"2023-11-24T06:31:50.018869+0000","last_became_peered":"2023-11-24T06:31:50.018869+0000","last_unstale":"2023-11-24T06:31:51.008123+0000","last_undegraded":"2023-11-24T06:31:51.008123+0000","last_fullsized":"2023-11-24T06:31:51.008123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:20.378450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.008335+0000","last_change":"2023-11-24T06:31:50.026986+0000","last_active":"2023-11-24T06:31:51.008335+0000","last_peered":"2023-11-24T06:31:51.008335+0000","last_clean":"2023-11-24T06:31:51.008335+0000","last_became_active":"2023-11-24T06:31:50.026641+0000","last_became_peered":"2023-11-24T06:31:50.026641+0000","last_unstale":"2023-11-24T06:31:51.008335+0000","last_undegraded":"2023-11-24T06:31:51.008335+0000","last_fullsized":"2023-11-24T06:31:51.008335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:55.363144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.004906+0000","last_change":"2023-11-24T06:31:50.027089+0000","last_active":"2023-11-24T06:31:51.004906+0000","last_peered":"2023-11-24T06:31:51.004906+0000","last_clean":"2023-11-24T06:31:51.004906+0000","last_became_active":"2023-11-24T06:31:50.026803+0000","last_became_peered":"2023-11-24T06:31:50.026803+0000","last_unstale":"2023-11-24T06:31:51.004906+0000","last_undegraded":"2023-11-24T06:31:51.004906+0000","last_fullsized":"2023-11-24T06:31:51.004906+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:37:30.686702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070047+0000","last_change":"2023-11-24T06:31:50.013561+0000","last_active":"2023-11-24T06:31:51.070047+0000","last_peered":"2023-11-24T06:31:51.070047+0000","last_clean":"2023-11-24T06:31:51.070047+0000","last_became_active":"2023-11-24T06:31:50.013216+0000","last_became_peered":"2023-11-24T06:31:50.013216+0000","last_unstale":"2023-11-24T06:31:51.070047+0000","last_undegraded":"2023-11-24T06:31:51.070047+0000","last_fullsized":"2023-11-24T06:31:51.070047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:40.739254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070908+0000","last_change":"2023-11-24T06:31:50.035695+0000","last_active":"2023-11-24T06:31:51.070908+0000","last_peered":"2023-11-24T06:31:51.070908+0000","last_clean":"2023-11-24T06:31:51.070908+0000","last_became_active":"2023-11-24T06:31:50.035416+0000","last_became_peered":"2023-11-24T06:31:50.035416+0000","last_unstale":"2023-11-24T06:31:51.070908+0000","last_undegraded":"2023-11-24T06:31:51.070908+0000","last_fullsized":"2023-11-24T06:31:51.070908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:49.232248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069199+0000","last_change":"2023-11-24T06:31:50.026905+0000","last_active":"2023-11-24T06:31:51.069199+0000","last_peered":"2023-11-24T06:31:51.069199+0000","last_clean":"2023-11-24T06:31:51.069199+0000","last_became_active":"2023-11-24T06:31:50.026612+0000","last_became_peered":"2023-11-24T06:31:50.026612+0000","last_unstale":"2023-11-24T06:31:51.069199+0000","last_undegraded":"2023-11-24T06:31:51.069199+0000","last_fullsized":"2023-11-24T06:31:51.069199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:06.823429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069870+0000","last_change":"2023-11-24T06:31:50.020764+0000","last_active":"2023-11-24T06:31:51.069870+0000","last_peered":"2023-11-24T06:31:51.069870+0000","last_clean":"2023-11-24T06:31:51.069870+0000","last_became_active":"2023-11-24T06:31:50.020501+0000","last_became_peered":"2023-11-24T06:31:50.020501+0000","last_unstale":"2023-11-24T06:31:51.069870+0000","last_undegraded":"2023-11-24T06:31:51.069870+0000","last_fullsized":"2023-11-24T06:31:51.069870+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:10.676752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070423+0000","last_change":"2023-11-24T06:31:50.034765+0000","last_active":"2023-11-24T06:31:51.070423+0000","last_peered":"2023-11-24T06:31:51.070423+0000","last_clean":"2023-11-24T06:31:51.070423+0000","last_became_active":"2023-11-24T06:31:50.034456+0000","last_became_peered":"2023-11-24T06:31:50.034456+0000","last_unstale":"2023-11-24T06:31:51.070423+0000","last_undegraded":"2023-11-24T06:31:51.070423+0000","last_fullsized":"2023-11-24T06:31:51.070423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:12.600772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069616+0000","last_change":"2023-11-24T06:31:50.018666+0000","last_active":"2023-11-24T06:31:51.069616+0000","last_peered":"2023-11-24T06:31:51.069616+0000","last_clean":"2023-11-24T06:31:51.069616+0000","last_became_active":"2023-11-24T06:31:50.018135+0000","last_became_peered":"2023-11-24T06:31:50.018135+0000","last_unstale":"2023-11-24T06:31:51.069616+0000","last_undegraded":"2023-11-24T06:31:51.069616+0000","last_fullsized":"2023-11-24T06:31:51.069616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:07.767655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070204+0000","last_change":"2023-11-24T06:31:50.030716+0000","last_active":"2023-11-24T06:31:51.070204+0000","last_peered":"2023-11-24T06:31:51.070204+0000","last_clean":"2023-11-24T06:31:51.070204+0000","last_became_active":"2023-11-24T06:31:50.030415+0000","last_became_peered":"2023-11-24T06:31:50.030415+0000","last_unstale":"2023-11-24T06:31:51.070204+0000","last_undegraded":"2023-11-24T06:31:51.070204+0000","last_fullsized":"2023-11-24T06:31:51.070204+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:33.514553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069735+0000","last_change":"2023-11-24T06:31:50.029569+0000","last_active":"2023-11-24T06:31:51.069735+0000","last_peered":"2023-11-24T06:31:51.069735+0000","last_clean":"2023-11-24T06:31:51.069735+0000","last_became_active":"2023-11-24T06:31:50.029268+0000","last_became_peered":"2023-11-24T06:31:50.029268+0000","last_unstale":"2023-11-24T06:31:51.069735+0000","last_undegraded":"2023-11-24T06:31:51.069735+0000","last_fullsized":"2023-11-24T06:31:51.069735+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:57.515756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069389+0000","last_change":"2023-11-24T06:31:50.023031+0000","last_active":"2023-11-24T06:31:51.069389+0000","last_peered":"2023-11-24T06:31:51.069389+0000","last_clean":"2023-11-24T06:31:51.069389+0000","last_became_active":"2023-11-24T06:31:50.022735+0000","last_became_peered":"2023-11-24T06:31:50.022735+0000","last_unstale":"2023-11-24T06:31:51.069389+0000","last_undegraded":"2023-11-24T06:31:51.069389+0000","last_fullsized":"2023-11-24T06:31:51.069389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:56:40.738653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071516+0000","last_change":"2023-11-24T06:31:50.035299+0000","last_active":"2023-11-24T06:31:51.071516+0000","last_peered":"2023-11-24T06:31:51.071516+0000","last_clean":"2023-11-24T06:31:51.071516+0000","last_became_active":"2023-11-24T06:31:50.035010+0000","last_became_peered":"2023-11-24T06:31:50.035010+0000","last_unstale":"2023-11-24T06:31:51.071516+0000","last_undegraded":"2023-11-24T06:31:51.071516+0000","last_fullsized":"2023-11-24T06:31:51.071516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:14.235196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.004955+0000","last_change":"2023-11-24T06:31:50.025255+0000","last_active":"2023-11-24T06:31:51.004955+0000","last_peered":"2023-11-24T06:31:51.004955+0000","last_clean":"2023-11-24T06:31:51.004955+0000","last_became_active":"2023-11-24T06:31:50.024926+0000","last_became_peered":"2023-11-24T06:31:50.024926+0000","last_unstale":"2023-11-24T06:31:51.004955+0000","last_undegraded":"2023-11-24T06:31:51.004955+0000","last_fullsized":"2023-11-24T06:31:51.004955+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:13.364111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069192+0000","last_change":"2023-11-24T06:31:50.020574+0000","last_active":"2023-11-24T06:31:51.069192+0000","last_peered":"2023-11-24T06:31:51.069192+0000","last_clean":"2023-11-24T06:31:51.069192+0000","last_became_active":"2023-11-24T06:31:50.020276+0000","last_became_peered":"2023-11-24T06:31:50.020276+0000","last_unstale":"2023-11-24T06:31:51.069192+0000","last_undegraded":"2023-11-24T06:31:51.069192+0000","last_fullsized":"2023-11-24T06:31:51.069192+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:45.683933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070016+0000","last_change":"2023-11-24T06:31:50.034855+0000","last_active":"2023-11-24T06:31:51.070016+0000","last_peered":"2023-11-24T06:31:51.070016+0000","last_clean":"2023-11-24T06:31:51.070016+0000","last_became_active":"2023-11-24T06:31:50.034559+0000","last_became_peered":"2023-11-24T06:31:50.034559+0000","last_unstale":"2023-11-24T06:31:51.070016+0000","last_undegraded":"2023-11-24T06:31:51.070016+0000","last_fullsized":"2023-11-24T06:31:51.070016+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:23:11.937787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070236+0000","last_change":"2023-11-24T06:31:50.037306+0000","last_active":"2023-11-24T06:31:51.070236+0000","last_peered":"2023-11-24T06:31:51.070236+0000","last_clean":"2023-11-24T06:31:51.070236+0000","last_became_active":"2023-11-24T06:31:50.036957+0000","last_became_peered":"2023-11-24T06:31:50.036957+0000","last_unstale":"2023-11-24T06:31:51.070236+0000","last_undegraded":"2023-11-24T06:31:51.070236+0000","last_fullsized":"2023-11-24T06:31:51.070236+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:14.235196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.068930+0000","last_change":"2023-11-24T06:31:50.023340+0000","last_active":"2023-11-24T06:31:51.068930+0000","last_peered":"2023-11-24T06:31:51.068930+0000","last_clean":"2023-11-24T06:31:51.068930+0000","last_became_active":"2023-11-24T06:31:50.022705+0000","last_became_peered":"2023-11-24T06:31:50.022705+0000","last_unstale":"2023-11-24T06:31:51.068930+0000","last_undegraded":"2023-11-24T06:31:51.068930+0000","last_fullsized":"2023-11-24T06:31:51.068930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:58.994573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.005033+0000","last_change":"2023-11-24T06:31:50.032554+0000","last_active":"2023-11-24T06:31:51.005033+0000","last_peered":"2023-11-24T06:31:51.005033+0000","last_clean":"2023-11-24T06:31:51.005033+0000","last_became_active":"2023-11-24T06:31:50.032187+0000","last_became_peered":"2023-11-24T06:31:50.032187+0000","last_unstale":"2023-11-24T06:31:51.005033+0000","last_undegraded":"2023-11-24T06:31:51.005033+0000","last_fullsized":"2023-11-24T06:31:51.005033+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:36.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.005203+0000","last_change":"2023-11-24T06:31:50.023420+0000","last_active":"2023-11-24T06:31:51.005203+0000","last_peered":"2023-11-24T06:31:51.005203+0000","last_clean":"2023-11-24T06:31:51.005203+0000","last_became_active":"2023-11-24T06:31:50.023162+0000","last_became_peered":"2023-11-24T06:31:50.023162+0000","last_unstale":"2023-11-24T06:31:51.005203+0000","last_undegraded":"2023-11-24T06:31:51.005203+0000","last_fullsized":"2023-11-24T06:31:51.005203+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:08.182818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.045369+0000","last_change":"2023-11-24T06:31:48.996812+0000","last_active":"2023-11-24T06:31:50.045369+0000","last_peered":"2023-11-24T06:31:50.045369+0000","last_clean":"2023-11-24T06:31:50.045369+0000","last_became_active":"2023-11-24T06:31:48.996517+0000","last_became_peered":"2023-11-24T06:31:48.996517+0000","last_unstale":"2023-11-24T06:31:50.045369+0000","last_undegraded":"2023-11-24T06:31:50.045369+0000","last_fullsized":"2023-11-24T06:31:50.045369+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:43.626664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.010216+0000","last_change":"2023-11-24T06:31:50.026092+0000","last_active":"2023-11-24T06:31:51.010216+0000","last_peered":"2023-11-24T06:31:51.010216+0000","last_clean":"2023-11-24T06:31:51.010216+0000","last_became_active":"2023-11-24T06:31:50.024380+0000","last_became_peered":"2023-11-24T06:31:50.024380+0000","last_unstale":"2023-11-24T06:31:51.010216+0000","last_undegraded":"2023-11-24T06:31:51.010216+0000","last_fullsized":"2023-11-24T06:31:51.010216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:59:30.399971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.043553+0000","last_change":"2023-11-24T06:31:48.980121+0000","last_active":"2023-11-24T06:31:50.043553+0000","last_peered":"2023-11-24T06:31:50.043553+0000","last_clean":"2023-11-24T06:31:50.043553+0000","last_became_active":"2023-11-24T06:31:48.979822+0000","last_became_peered":"2023-11-24T06:31:48.979822+0000","last_unstale":"2023-11-24T06:31:50.043553+0000","last_undegraded":"2023-11-24T06:31:50.043553+0000","last_fullsized":"2023-11-24T06:31:50.043553+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:07.180140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.005469+0000","last_change":"2023-11-24T06:31:50.026928+0000","last_active":"2023-11-24T06:31:51.005469+0000","last_peered":"2023-11-24T06:31:51.005469+0000","last_clean":"2023-11-24T06:31:51.005469+0000","last_became_active":"2023-11-24T06:31:50.026665+0000","last_became_peered":"2023-11-24T06:31:50.026665+0000","last_unstale":"2023-11-24T06:31:51.005469+0000","last_undegraded":"2023-11-24T06:31:51.005469+0000","last_fullsized":"2023-11-24T06:31:51.005469+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:02.543049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.045133+0000","last_change":"2023-11-24T06:31:48.995201+0000","last_active":"2023-11-24T06:31:50.045133+0000","last_peered":"2023-11-24T06:31:50.045133+0000","last_clean":"2023-11-24T06:31:50.045133+0000","last_became_active":"2023-11-24T06:31:48.994493+0000","last_became_peered":"2023-11-24T06:31:48.994493+0000","last_unstale":"2023-11-24T06:31:50.045133+0000","last_undegraded":"2023-11-24T06:31:50.045133+0000","last_fullsized":"2023-11-24T06:31:50.045133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:09:34.864132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.005059+0000","last_change":"2023-11-24T06:31:50.034963+0000","last_active":"2023-11-24T06:31:51.005059+0000","last_peered":"2023-11-24T06:31:51.005059+0000","last_clean":"2023-11-24T06:31:51.005059+0000","last_became_active":"2023-11-24T06:31:50.034466+0000","last_became_peered":"2023-11-24T06:31:50.034466+0000","last_unstale":"2023-11-24T06:31:51.005059+0000","last_undegraded":"2023-11-24T06:31:51.005059+0000","last_fullsized":"2023-11-24T06:31:51.005059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.776654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.050569+0000","last_change":"2023-11-24T06:31:48.984088+0000","last_active":"2023-11-24T06:31:50.050569+0000","last_peered":"2023-11-24T06:31:50.050569+0000","last_clean":"2023-11-24T06:31:50.050569+0000","last_became_active":"2023-11-24T06:31:48.983560+0000","last_became_peered":"2023-11-24T06:31:48.983560+0000","last_unstale":"2023-11-24T06:31:50.050569+0000","last_undegraded":"2023-11-24T06:31:50.050569+0000","last_fullsized":"2023-11-24T06:31:50.050569+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:19.596112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069685+0000","last_change":"2023-11-24T06:31:50.018486+0000","last_active":"2023-11-24T06:31:51.069685+0000","last_peered":"2023-11-24T06:31:51.069685+0000","last_clean":"2023-11-24T06:31:51.069685+0000","last_became_active":"2023-11-24T06:31:50.017792+0000","last_became_peered":"2023-11-24T06:31:50.017792+0000","last_unstale":"2023-11-24T06:31:51.069685+0000","last_undegraded":"2023-11-24T06:31:51.069685+0000","last_fullsized":"2023-11-24T06:31:51.069685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:52.324883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.047006+0000","last_change":"2023-11-24T06:31:48.990284+0000","last_active":"2023-11-24T06:31:50.047006+0000","last_peered":"2023-11-24T06:31:50.047006+0000","last_clean":"2023-11-24T06:31:50.047006+0000","last_became_active":"2023-11-24T06:31:48.990030+0000","last_became_peered":"2023-11-24T06:31:48.990030+0000","last_unstale":"2023-11-24T06:31:50.047006+0000","last_undegraded":"2023-11-24T06:31:50.047006+0000","last_fullsized":"2023-11-24T06:31:50.047006+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:10:11.255094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069732+0000","last_change":"2023-11-24T06:31:50.027420+0000","last_active":"2023-11-24T06:31:51.069732+0000","last_peered":"2023-11-24T06:31:51.069732+0000","last_clean":"2023-11-24T06:31:51.069732+0000","last_became_active":"2023-11-24T06:31:50.027125+0000","last_became_peered":"2023-11-24T06:31:50.027125+0000","last_unstale":"2023-11-24T06:31:51.069732+0000","last_undegraded":"2023-11-24T06:31:51.069732+0000","last_fullsized":"2023-11-24T06:31:51.069732+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:26.993015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.044832+0000","last_change":"2023-11-24T06:31:48.996052+0000","last_active":"2023-11-24T06:31:50.044832+0000","last_peered":"2023-11-24T06:31:50.044832+0000","last_clean":"2023-11-24T06:31:50.044832+0000","last_became_active":"2023-11-24T06:31:48.995713+0000","last_became_peered":"2023-11-24T06:31:48.995713+0000","last_unstale":"2023-11-24T06:31:50.044832+0000","last_undegraded":"2023-11-24T06:31:50.044832+0000","last_fullsized":"2023-11-24T06:31:50.044832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:26.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069754+0000","last_change":"2023-11-24T06:31:50.024542+0000","last_active":"2023-11-24T06:31:51.069754+0000","last_peered":"2023-11-24T06:31:51.069754+0000","last_clean":"2023-11-24T06:31:51.069754+0000","last_became_active":"2023-11-24T06:31:50.024240+0000","last_became_peered":"2023-11-24T06:31:50.024240+0000","last_unstale":"2023-11-24T06:31:51.069754+0000","last_undegraded":"2023-11-24T06:31:51.069754+0000","last_fullsized":"2023-11-24T06:31:51.069754+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:31.265880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.012683+0000","last_change":"2023-11-24T06:31:48.990700+0000","last_active":"2023-11-24T06:31:50.012683+0000","last_peered":"2023-11-24T06:31:50.012683+0000","last_clean":"2023-11-24T06:31:50.012683+0000","last_became_active":"2023-11-24T06:31:48.989699+0000","last_became_peered":"2023-11-24T06:31:48.989699+0000","last_unstale":"2023-11-24T06:31:50.012683+0000","last_undegraded":"2023-11-24T06:31:50.012683+0000","last_fullsized":"2023-11-24T06:31:50.012683+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:10:11.255094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069623+0000","last_change":"2023-11-24T06:31:50.010656+0000","last_active":"2023-11-24T06:31:51.069623+0000","last_peered":"2023-11-24T06:31:51.069623+0000","last_clean":"2023-11-24T06:31:51.069623+0000","last_became_active":"2023-11-24T06:31:50.010200+0000","last_became_peered":"2023-11-24T06:31:50.010200+0000","last_unstale":"2023-11-24T06:31:51.069623+0000","last_undegraded":"2023-11-24T06:31:51.069623+0000","last_fullsized":"2023-11-24T06:31:51.069623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:01.715145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.013106+0000","last_change":"2023-11-24T06:31:48.986544+0000","last_active":"2023-11-24T06:31:50.013106+0000","last_peered":"2023-11-24T06:31:50.013106+0000","last_clean":"2023-11-24T06:31:50.013106+0000","last_became_active":"2023-11-24T06:31:48.986229+0000","last_became_peered":"2023-11-24T06:31:48.986229+0000","last_unstale":"2023-11-24T06:31:50.013106+0000","last_undegraded":"2023-11-24T06:31:50.013106+0000","last_fullsized":"2023-11-24T06:31:50.013106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:46.108478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.008464+0000","last_change":"2023-11-24T06:31:50.038205+0000","last_active":"2023-11-24T06:31:51.008464+0000","last_peered":"2023-11-24T06:31:51.008464+0000","last_clean":"2023-11-24T06:31:51.008464+0000","last_became_active":"2023-11-24T06:31:50.037932+0000","last_became_peered":"2023-11-24T06:31:50.037932+0000","last_unstale":"2023-11-24T06:31:51.008464+0000","last_undegraded":"2023-11-24T06:31:51.008464+0000","last_fullsized":"2023-11-24T06:31:51.008464+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:26.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.017505+0000","last_change":"2023-11-24T06:31:48.993622+0000","last_active":"2023-11-24T06:31:50.017505+0000","last_peered":"2023-11-24T06:31:50.017505+0000","last_clean":"2023-11-24T06:31:50.017505+0000","last_became_active":"2023-11-24T06:31:48.993294+0000","last_became_peered":"2023-11-24T06:31:48.993294+0000","last_unstale":"2023-11-24T06:31:50.017505+0000","last_undegraded":"2023-11-24T06:31:50.017505+0000","last_fullsized":"2023-11-24T06:31:50.017505+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:41.133687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070901+0000","last_change":"2023-11-24T06:31:50.032666+0000","last_active":"2023-11-24T06:31:51.070901+0000","last_peered":"2023-11-24T06:31:51.070901+0000","last_clean":"2023-11-24T06:31:51.070901+0000","last_became_active":"2023-11-24T06:31:50.032346+0000","last_became_peered":"2023-11-24T06:31:50.032346+0000","last_unstale":"2023-11-24T06:31:51.070901+0000","last_undegraded":"2023-11-24T06:31:51.070901+0000","last_fullsized":"2023-11-24T06:31:51.070901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:00.487566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.005273+0000","last_change":"2023-11-24T06:31:48.985851+0000","last_active":"2023-11-24T06:31:50.005273+0000","last_peered":"2023-11-24T06:31:50.005273+0000","last_clean":"2023-11-24T06:31:50.005273+0000","last_became_active":"2023-11-24T06:31:48.985569+0000","last_became_peered":"2023-11-24T06:31:48.985569+0000","last_unstale":"2023-11-24T06:31:50.005273+0000","last_undegraded":"2023-11-24T06:31:50.005273+0000","last_fullsized":"2023-11-24T06:31:50.005273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:01.540371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.010030+0000","last_change":"2023-11-24T06:31:50.033281+0000","last_active":"2023-11-24T06:31:51.010030+0000","last_peered":"2023-11-24T06:31:51.010030+0000","last_clean":"2023-11-24T06:31:51.010030+0000","last_became_active":"2023-11-24T06:31:50.032553+0000","last_became_peered":"2023-11-24T06:31:50.032553+0000","last_unstale":"2023-11-24T06:31:51.010030+0000","last_undegraded":"2023-11-24T06:31:51.010030+0000","last_fullsized":"2023-11-24T06:31:51.010030+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:59.074660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.048561+0000","last_change":"2023-11-24T06:31:48.990447+0000","last_active":"2023-11-24T06:31:50.048561+0000","last_peered":"2023-11-24T06:31:50.048561+0000","last_clean":"2023-11-24T06:31:50.048561+0000","last_became_active":"2023-11-24T06:31:48.990176+0000","last_became_peered":"2023-11-24T06:31:48.990176+0000","last_unstale":"2023-11-24T06:31:50.048561+0000","last_undegraded":"2023-11-24T06:31:50.048561+0000","last_fullsized":"2023-11-24T06:31:50.048561+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:19.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070576+0000","last_change":"2023-11-24T06:31:50.033195+0000","last_active":"2023-11-24T06:31:51.070576+0000","last_peered":"2023-11-24T06:31:51.070576+0000","last_clean":"2023-11-24T06:31:51.070576+0000","last_became_active":"2023-11-24T06:31:50.032444+0000","last_became_peered":"2023-11-24T06:31:50.032444+0000","last_unstale":"2023-11-24T06:31:51.070576+0000","last_undegraded":"2023-11-24T06:31:51.070576+0000","last_fullsized":"2023-11-24T06:31:51.070576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:50.218361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.051571+0000","last_change":"2023-11-24T06:31:48.998064+0000","last_active":"2023-11-24T06:31:50.051571+0000","last_peered":"2023-11-24T06:31:50.051571+0000","last_clean":"2023-11-24T06:31:50.051571+0000","last_became_active":"2023-11-24T06:31:48.997809+0000","last_became_peered":"2023-11-24T06:31:48.997809+0000","last_unstale":"2023-11-24T06:31:50.051571+0000","last_undegraded":"2023-11-24T06:31:50.051571+0000","last_fullsized":"2023-11-24T06:31:50.051571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:01.305866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070876+0000","last_change":"2023-11-24T06:31:50.029617+0000","last_active":"2023-11-24T06:31:51.070876+0000","last_peered":"2023-11-24T06:31:51.070876+0000","last_clean":"2023-11-24T06:31:51.070876+0000","last_became_active":"2023-11-24T06:31:50.026897+0000","last_became_peered":"2023-11-24T06:31:50.026897+0000","last_unstale":"2023-11-24T06:31:51.070876+0000","last_undegraded":"2023-11-24T06:31:51.070876+0000","last_fullsized":"2023-11-24T06:31:51.070876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:28:56.610007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.042324+0000","last_change":"2023-11-24T06:31:48.984927+0000","last_active":"2023-11-24T06:31:50.042324+0000","last_peered":"2023-11-24T06:31:50.042324+0000","last_clean":"2023-11-24T06:31:50.042324+0000","last_became_active":"2023-11-24T06:31:48.984601+0000","last_became_peered":"2023-11-24T06:31:48.984601+0000","last_unstale":"2023-11-24T06:31:50.042324+0000","last_undegraded":"2023-11-24T06:31:50.042324+0000","last_fullsized":"2023-11-24T06:31:50.042324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:48.229569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070456+0000","last_change":"2023-11-24T06:31:50.023646+0000","last_active":"2023-11-24T06:31:51.070456+0000","last_peered":"2023-11-24T06:31:51.070456+0000","last_clean":"2023-11-24T06:31:51.070456+0000","last_became_active":"2023-11-24T06:31:50.023342+0000","last_became_peered":"2023-11-24T06:31:50.023342+0000","last_unstale":"2023-11-24T06:31:51.070456+0000","last_undegraded":"2023-11-24T06:31:51.070456+0000","last_fullsized":"2023-11-24T06:31:51.070456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:07.309215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.007633+0000","last_change":"2023-11-24T06:31:48.984679+0000","last_active":"2023-11-24T06:31:50.007633+0000","last_peered":"2023-11-24T06:31:50.007633+0000","last_clean":"2023-11-24T06:31:50.007633+0000","last_became_active":"2023-11-24T06:31:48.984375+0000","last_became_peered":"2023-11-24T06:31:48.984375+0000","last_unstale":"2023-11-24T06:31:50.007633+0000","last_undegraded":"2023-11-24T06:31:50.007633+0000","last_fullsized":"2023-11-24T06:31:50.007633+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:59:29.397293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.008018+0000","last_change":"2023-11-24T06:31:50.030730+0000","last_active":"2023-11-24T06:31:51.008018+0000","last_peered":"2023-11-24T06:31:51.008018+0000","last_clean":"2023-11-24T06:31:51.008018+0000","last_became_active":"2023-11-24T06:31:50.030460+0000","last_became_peered":"2023-11-24T06:31:50.030460+0000","last_unstale":"2023-11-24T06:31:51.008018+0000","last_undegraded":"2023-11-24T06:31:51.008018+0000","last_fullsized":"2023-11-24T06:31:51.008018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:20.598790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.012811+0000","last_change":"2023-11-24T06:31:48.982341+0000","last_active":"2023-11-24T06:31:50.012811+0000","last_peered":"2023-11-24T06:31:50.012811+0000","last_clean":"2023-11-24T06:31:50.012811+0000","last_became_active":"2023-11-24T06:31:48.982049+0000","last_became_peered":"2023-11-24T06:31:48.982049+0000","last_unstale":"2023-11-24T06:31:50.012811+0000","last_undegraded":"2023-11-24T06:31:50.012811+0000","last_fullsized":"2023-11-24T06:31:50.012811+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:01.305866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071076+0000","last_change":"2023-11-24T06:31:50.030649+0000","last_active":"2023-11-24T06:31:51.071076+0000","last_peered":"2023-11-24T06:31:51.071076+0000","last_clean":"2023-11-24T06:31:51.071076+0000","last_became_active":"2023-11-24T06:31:50.030363+0000","last_became_peered":"2023-11-24T06:31:50.030363+0000","last_unstale":"2023-11-24T06:31:51.071076+0000","last_undegraded":"2023-11-24T06:31:51.071076+0000","last_fullsized":"2023-11-24T06:31:51.071076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:42.796100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.049206+0000","last_change":"2023-11-24T06:31:48.988551+0000","last_active":"2023-11-24T06:31:50.049206+0000","last_peered":"2023-11-24T06:31:50.049206+0000","last_clean":"2023-11-24T06:31:50.049206+0000","last_became_active":"2023-11-24T06:31:48.987513+0000","last_became_peered":"2023-11-24T06:31:48.987513+0000","last_unstale":"2023-11-24T06:31:50.049206+0000","last_undegraded":"2023-11-24T06:31:50.049206+0000","last_fullsized":"2023-11-24T06:31:50.049206+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:16:10.263272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071029+0000","last_change":"2023-11-24T06:31:50.037161+0000","last_active":"2023-11-24T06:31:51.071029+0000","last_peered":"2023-11-24T06:31:51.071029+0000","last_clean":"2023-11-24T06:31:51.071029+0000","last_became_active":"2023-11-24T06:31:50.036891+0000","last_became_peered":"2023-11-24T06:31:50.036891+0000","last_unstale":"2023-11-24T06:31:51.071029+0000","last_undegraded":"2023-11-24T06:31:51.071029+0000","last_fullsized":"2023-11-24T06:31:51.071029+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:09:35.866810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.042124+0000","last_change":"2023-11-24T06:31:48.985578+0000","last_active":"2023-11-24T06:31:50.042124+0000","last_peered":"2023-11-24T06:31:50.042124+0000","last_clean":"2023-11-24T06:31:50.042124+0000","last_became_active":"2023-11-24T06:31:48.985314+0000","last_became_peered":"2023-11-24T06:31:48.985314+0000","last_unstale":"2023-11-24T06:31:50.042124+0000","last_undegraded":"2023-11-24T06:31:50.042124+0000","last_fullsized":"2023-11-24T06:31:50.042124+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:37:29.684023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071701+0000","last_change":"2023-11-24T06:31:50.025087+0000","last_active":"2023-11-24T06:31:51.071701+0000","last_peered":"2023-11-24T06:31:51.071701+0000","last_clean":"2023-11-24T06:31:51.071701+0000","last_became_active":"2023-11-24T06:31:50.024804+0000","last_became_peered":"2023-11-24T06:31:50.024804+0000","last_unstale":"2023-11-24T06:31:51.071701+0000","last_undegraded":"2023-11-24T06:31:51.071701+0000","last_fullsized":"2023-11-24T06:31:51.071701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:07.309215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.045123+0000","last_change":"2023-11-24T06:31:48.995160+0000","last_active":"2023-11-24T06:31:50.045123+0000","last_peered":"2023-11-24T06:31:50.045123+0000","last_clean":"2023-11-24T06:31:50.045123+0000","last_became_active":"2023-11-24T06:31:48.994787+0000","last_became_peered":"2023-11-24T06:31:48.994787+0000","last_unstale":"2023-11-24T06:31:50.045123+0000","last_undegraded":"2023-11-24T06:31:50.045123+0000","last_fullsized":"2023-11-24T06:31:50.045123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:24.033646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069905+0000","last_change":"2023-11-24T06:31:50.031425+0000","last_active":"2023-11-24T06:31:51.069905+0000","last_peered":"2023-11-24T06:31:51.069905+0000","last_clean":"2023-11-24T06:31:51.069905+0000","last_became_active":"2023-11-24T06:31:50.031059+0000","last_became_peered":"2023-11-24T06:31:50.031059+0000","last_unstale":"2023-11-24T06:31:51.069905+0000","last_undegraded":"2023-11-24T06:31:51.069905+0000","last_fullsized":"2023-11-24T06:31:51.069905+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:15:02.388199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.048897+0000","last_change":"2023-11-24T06:31:48.986215+0000","last_active":"2023-11-24T06:31:50.048897+0000","last_peered":"2023-11-24T06:31:50.048897+0000","last_clean":"2023-11-24T06:31:50.048897+0000","last_became_active":"2023-11-24T06:31:48.985888+0000","last_became_peered":"2023-11-24T06:31:48.985888+0000","last_unstale":"2023-11-24T06:31:50.048897+0000","last_undegraded":"2023-11-24T06:31:50.048897+0000","last_fullsized":"2023-11-24T06:31:50.048897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:53.388990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070668+0000","last_change":"2023-11-24T06:31:50.033708+0000","last_active":"2023-11-24T06:31:51.070668+0000","last_peered":"2023-11-24T06:31:51.070668+0000","last_clean":"2023-11-24T06:31:51.070668+0000","last_became_active":"2023-11-24T06:31:50.032871+0000","last_became_peered":"2023-11-24T06:31:50.032871+0000","last_unstale":"2023-11-24T06:31:51.070668+0000","last_undegraded":"2023-11-24T06:31:51.070668+0000","last_fullsized":"2023-11-24T06:31:51.070668+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:27.308400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.012771+0000","last_change":"2023-11-24T06:31:48.993843+0000","last_active":"2023-11-24T06:31:50.012771+0000","last_peered":"2023-11-24T06:31:50.012771+0000","last_clean":"2023-11-24T06:31:50.012771+0000","last_became_active":"2023-11-24T06:31:48.993593+0000","last_became_peered":"2023-11-24T06:31:48.993593+0000","last_unstale":"2023-11-24T06:31:50.012771+0000","last_undegraded":"2023-11-24T06:31:50.012771+0000","last_fullsized":"2023-11-24T06:31:50.012771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:48.229569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070876+0000","last_change":"2023-11-24T06:31:50.033045+0000","last_active":"2023-11-24T06:31:51.070876+0000","last_peered":"2023-11-24T06:31:51.070876+0000","last_clean":"2023-11-24T06:31:51.070876+0000","last_became_active":"2023-11-24T06:31:50.026247+0000","last_became_peered":"2023-11-24T06:31:50.026247+0000","last_unstale":"2023-11-24T06:31:51.070876+0000","last_undegraded":"2023-11-24T06:31:51.070876+0000","last_fullsized":"2023-11-24T06:31:51.070876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:42.136365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.046798+0000","last_change":"2023-11-24T06:31:48.986023+0000","last_active":"2023-11-24T06:31:50.046798+0000","last_peered":"2023-11-24T06:31:50.046798+0000","last_clean":"2023-11-24T06:31:50.046798+0000","last_became_active":"2023-11-24T06:31:48.985605+0000","last_became_peered":"2023-11-24T06:31:48.985605+0000","last_unstale":"2023-11-24T06:31:50.046798+0000","last_undegraded":"2023-11-24T06:31:50.046798+0000","last_fullsized":"2023-11-24T06:31:50.046798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:15.195100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.005342+0000","last_change":"2023-11-24T06:31:50.026126+0000","last_active":"2023-11-24T06:31:51.005342+0000","last_peered":"2023-11-24T06:31:51.005342+0000","last_clean":"2023-11-24T06:31:51.005342+0000","last_became_active":"2023-11-24T06:31:50.025652+0000","last_became_peered":"2023-11-24T06:31:50.025652+0000","last_unstale":"2023-11-24T06:31:51.005342+0000","last_undegraded":"2023-11-24T06:31:51.005342+0000","last_fullsized":"2023-11-24T06:31:51.005342+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:16.197779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.006026+0000","last_change":"2023-11-24T06:31:48.988559+0000","last_active":"2023-11-24T06:31:50.006026+0000","last_peered":"2023-11-24T06:31:50.006026+0000","last_clean":"2023-11-24T06:31:50.006026+0000","last_became_active":"2023-11-24T06:31:48.988185+0000","last_became_peered":"2023-11-24T06:31:48.988185+0000","last_unstale":"2023-11-24T06:31:50.006026+0000","last_undegraded":"2023-11-24T06:31:50.006026+0000","last_fullsized":"2023-11-24T06:31:50.006026+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:38:34.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.004883+0000","last_change":"2023-11-24T06:31:50.021620+0000","last_active":"2023-11-24T06:31:51.004883+0000","last_peered":"2023-11-24T06:31:51.004883+0000","last_clean":"2023-11-24T06:31:51.004883+0000","last_became_active":"2023-11-24T06:31:50.021016+0000","last_became_peered":"2023-11-24T06:31:50.021016+0000","last_unstale":"2023-11-24T06:31:51.004883+0000","last_undegraded":"2023-11-24T06:31:51.004883+0000","last_fullsized":"2023-11-24T06:31:51.004883+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:50.063665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.013676+0000","last_change":"2023-11-24T06:31:48.977837+0000","last_active":"2023-11-24T06:31:50.013676+0000","last_peered":"2023-11-24T06:31:50.013676+0000","last_clean":"2023-11-24T06:31:50.013676+0000","last_became_active":"2023-11-24T06:31:48.977513+0000","last_became_peered":"2023-11-24T06:31:48.977513+0000","last_unstale":"2023-11-24T06:31:50.013676+0000","last_undegraded":"2023-11-24T06:31:50.013676+0000","last_fullsized":"2023-11-24T06:31:50.013676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:54.360466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071559+0000","last_change":"2023-11-24T06:31:50.020239+0000","last_active":"2023-11-24T06:31:51.071559+0000","last_peered":"2023-11-24T06:31:51.071559+0000","last_clean":"2023-11-24T06:31:51.071559+0000","last_became_active":"2023-11-24T06:31:50.019928+0000","last_became_peered":"2023-11-24T06:31:50.019928+0000","last_unstale":"2023-11-24T06:31:51.071559+0000","last_undegraded":"2023-11-24T06:31:51.071559+0000","last_fullsized":"2023-11-24T06:31:51.071559+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:12.600772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.043849+0000","last_change":"2023-11-24T06:31:48.984533+0000","last_active":"2023-11-24T06:31:50.043849+0000","last_peered":"2023-11-24T06:31:50.043849+0000","last_clean":"2023-11-24T06:31:50.043849+0000","last_became_active":"2023-11-24T06:31:48.984205+0000","last_became_peered":"2023-11-24T06:31:48.984205+0000","last_unstale":"2023-11-24T06:31:50.043849+0000","last_undegraded":"2023-11-24T06:31:50.043849+0000","last_fullsized":"2023-11-24T06:31:50.043849+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:11.645733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.071706+0000","last_change":"2023-11-24T06:31:50.031921+0000","last_active":"2023-11-24T06:31:51.071706+0000","last_peered":"2023-11-24T06:31:51.071706+0000","last_clean":"2023-11-24T06:31:51.071706+0000","last_became_active":"2023-11-24T06:31:50.031646+0000","last_became_peered":"2023-11-24T06:31:50.031646+0000","last_unstale":"2023-11-24T06:31:51.071706+0000","last_undegraded":"2023-11-24T06:31:51.071706+0000","last_fullsized":"2023-11-24T06:31:51.071706+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:24.352509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.014177+0000","last_change":"2023-11-24T06:31:48.993568+0000","last_active":"2023-11-24T06:31:50.014177+0000","last_peered":"2023-11-24T06:31:50.014177+0000","last_clean":"2023-11-24T06:31:50.014177+0000","last_became_active":"2023-11-24T06:31:48.993293+0000","last_became_peered":"2023-11-24T06:31:48.993293+0000","last_unstale":"2023-11-24T06:31:50.014177+0000","last_undegraded":"2023-11-24T06:31:50.014177+0000","last_fullsized":"2023-11-24T06:31:50.014177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:07.375419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.010169+0000","last_change":"2023-11-24T06:31:50.033762+0000","last_active":"2023-11-24T06:31:51.010169+0000","last_peered":"2023-11-24T06:31:51.010169+0000","last_clean":"2023-11-24T06:31:51.010169+0000","last_became_active":"2023-11-24T06:31:50.032066+0000","last_became_peered":"2023-11-24T06:31:50.032066+0000","last_unstale":"2023-11-24T06:31:51.010169+0000","last_undegraded":"2023-11-24T06:31:51.010169+0000","last_fullsized":"2023-11-24T06:31:51.010169+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:31.866492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.007367+0000","last_change":"2023-11-24T06:31:48.990122+0000","last_active":"2023-11-24T06:31:50.007367+0000","last_peered":"2023-11-24T06:31:50.007367+0000","last_clean":"2023-11-24T06:31:50.007367+0000","last_became_active":"2023-11-24T06:31:48.989704+0000","last_became_peered":"2023-11-24T06:31:48.989704+0000","last_unstale":"2023-11-24T06:31:50.007367+0000","last_undegraded":"2023-11-24T06:31:50.007367+0000","last_fullsized":"2023-11-24T06:31:50.007367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:50.910538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.005129+0000","last_change":"2023-11-24T06:31:50.034524+0000","last_active":"2023-11-24T06:31:51.005129+0000","last_peered":"2023-11-24T06:31:51.005129+0000","last_clean":"2023-11-24T06:31:51.005129+0000","last_became_active":"2023-11-24T06:31:50.034204+0000","last_became_peered":"2023-11-24T06:31:50.034204+0000","last_unstale":"2023-11-24T06:31:51.005129+0000","last_undegraded":"2023-11-24T06:31:51.005129+0000","last_fullsized":"2023-11-24T06:31:51.005129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:04.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.013431+0000","last_change":"2023-11-24T06:31:48.984662+0000","last_active":"2023-11-24T06:31:50.013431+0000","last_peered":"2023-11-24T06:31:50.013431+0000","last_clean":"2023-11-24T06:31:50.013431+0000","last_became_active":"2023-11-24T06:31:48.984396+0000","last_became_peered":"2023-11-24T06:31:48.984396+0000","last_unstale":"2023-11-24T06:31:50.013431+0000","last_undegraded":"2023-11-24T06:31:50.013431+0000","last_fullsized":"2023-11-24T06:31:50.013431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:19.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069763+0000","last_change":"2023-11-24T06:31:50.014663+0000","last_active":"2023-11-24T06:31:51.069763+0000","last_peered":"2023-11-24T06:31:51.069763+0000","last_clean":"2023-11-24T06:31:51.069763+0000","last_became_active":"2023-11-24T06:31:50.014403+0000","last_became_peered":"2023-11-24T06:31:50.014403+0000","last_unstale":"2023-11-24T06:31:51.069763+0000","last_undegraded":"2023-11-24T06:31:51.069763+0000","last_fullsized":"2023-11-24T06:31:51.069763+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:34.795846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.006205+0000","last_change":"2023-11-24T06:31:48.993082+0000","last_active":"2023-11-24T06:31:50.006205+0000","last_peered":"2023-11-24T06:31:50.006205+0000","last_clean":"2023-11-24T06:31:50.006205+0000","last_became_active":"2023-11-24T06:31:48.989959+0000","last_became_peered":"2023-11-24T06:31:48.989959+0000","last_unstale":"2023-11-24T06:31:50.006205+0000","last_undegraded":"2023-11-24T06:31:50.006205+0000","last_fullsized":"2023-11-24T06:31:50.006205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:39.332856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.070565+0000","last_change":"2023-11-24T06:31:50.031247+0000","last_active":"2023-11-24T06:31:51.070565+0000","last_peered":"2023-11-24T06:31:51.070565+0000","last_clean":"2023-11-24T06:31:51.070565+0000","last_became_active":"2023-11-24T06:31:50.030979+0000","last_became_peered":"2023-11-24T06:31:50.030979+0000","last_unstale":"2023-11-24T06:31:51.070565+0000","last_undegraded":"2023-11-24T06:31:51.070565+0000","last_fullsized":"2023-11-24T06:31:51.070565+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:19.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.015799+0000","last_change":"2023-11-24T06:31:48.995593+0000","last_active":"2023-11-24T06:31:50.015799+0000","last_peered":"2023-11-24T06:31:50.015799+0000","last_clean":"2023-11-24T06:31:50.015799+0000","last_became_active":"2023-11-24T06:31:48.995241+0000","last_became_peered":"2023-11-24T06:31:48.995241+0000","last_unstale":"2023-11-24T06:31:50.015799+0000","last_undegraded":"2023-11-24T06:31:50.015799+0000","last_fullsized":"2023-11-24T06:31:50.015799+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:16:10.263272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.009773+0000","last_change":"2023-11-24T06:31:50.014926+0000","last_active":"2023-11-24T06:31:51.009773+0000","last_peered":"2023-11-24T06:31:51.009773+0000","last_clean":"2023-11-24T06:31:51.009773+0000","last_became_active":"2023-11-24T06:31:50.014666+0000","last_became_peered":"2023-11-24T06:31:50.014666+0000","last_unstale":"2023-11-24T06:31:51.009773+0000","last_undegraded":"2023-11-24T06:31:51.009773+0000","last_fullsized":"2023-11-24T06:31:51.009773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:22.751967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.006035+0000","last_change":"2023-11-24T06:31:48.990108+0000","last_active":"2023-11-24T06:31:50.006035+0000","last_peered":"2023-11-24T06:31:50.006035+0000","last_clean":"2023-11-24T06:31:50.006035+0000","last_became_active":"2023-11-24T06:31:48.989810+0000","last_became_peered":"2023-11-24T06:31:48.989810+0000","last_unstale":"2023-11-24T06:31:50.006035+0000","last_undegraded":"2023-11-24T06:31:50.006035+0000","last_fullsized":"2023-11-24T06:31:50.006035+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:17.742624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069646+0000","last_change":"2023-11-24T06:31:50.010493+0000","last_active":"2023-11-24T06:31:51.069646+0000","last_peered":"2023-11-24T06:31:51.069646+0000","last_clean":"2023-11-24T06:31:51.069646+0000","last_became_active":"2023-11-24T06:31:50.009812+0000","last_became_peered":"2023-11-24T06:31:50.009812+0000","last_unstale":"2023-11-24T06:31:51.069646+0000","last_undegraded":"2023-11-24T06:31:51.069646+0000","last_fullsized":"2023-11-24T06:31:51.069646+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:11.152419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.003847+0000","last_change":"2023-11-24T06:31:48.981725+0000","last_active":"2023-11-24T06:31:50.003847+0000","last_peered":"2023-11-24T06:31:50.003847+0000","last_clean":"2023-11-24T06:31:50.003847+0000","last_became_active":"2023-11-24T06:31:48.977577+0000","last_became_peered":"2023-11-24T06:31:48.977577+0000","last_unstale":"2023-11-24T06:31:50.003847+0000","last_undegraded":"2023-11-24T06:31:50.003847+0000","last_fullsized":"2023-11-24T06:31:50.003847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:41.793422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:31:51.069426+0000","last_change":"2023-11-24T06:31:50.028343+0000","last_active":"2023-11-24T06:31:51.069426+0000","last_peered":"2023-11-24T06:31:51.069426+0000","last_clean":"2023-11-24T06:31:51.069426+0000","last_became_active":"2023-11-24T06:31:50.028037+0000","last_became_peered":"2023-11-24T06:31:50.028037+0000","last_unstale":"2023-11-24T06:31:51.069426+0000","last_undegraded":"2023-11-24T06:31:51.069426+0000","last_fullsized":"2023-11-24T06:31:51.069426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:48.957326+0000","last_clean_scrub_stamp":"2023-11-24T06:31:48.957326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:11.200059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.007187+0000","last_change":"2023-11-24T06:31:48.982027+0000","last_active":"2023-11-24T06:31:50.007187+0000","last_peered":"2023-11-24T06:31:50.007187+0000","last_clean":"2023-11-24T06:31:50.007187+0000","last_became_active":"2023-11-24T06:31:48.981672+0000","last_became_peered":"2023-11-24T06:31:48.981672+0000","last_unstale":"2023-11-24T06:31:50.007187+0000","last_undegraded":"2023-11-24T06:31:50.007187+0000","last_fullsized":"2023-11-24T06:31:50.007187+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:31:47.954647+0000","last_clean_scrub_stamp":"2023-11-24T06:31:47.954647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:30.863814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:31:50.012006+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:31:50.012006+0000","last_peered":"2023-11-24T06:31:50.012006+0000","last_clean":"2023-11-24T06:31:50.012006+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:31:50.012006+0000","last_undegraded":"2023-11-24T06:31:50.012006+0000","last_fullsized":"2023-11-24T06:31:50.012006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":886777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.417,"15min":1.417},"last":0.629}]},{"osd":1,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90900000000000003,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98899999999999999,"5min":1.7,"15min":1.7},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0049999999999999,"5min":1.96,"15min":1.96},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96599999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95699999999999996,"5min":1.55,"15min":1.55},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":0.996,"15min":0.996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.47299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92600000000000005,"5min":1,"15min":1},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94299999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.746},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":296249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89100000000000001,"5min":2.637,"15min":2.637},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0720000000000001,"5min":1.619,"15min":1.619},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93000000000000005,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97499999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.439},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0980000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.119,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.036,"15min":1.036},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":296901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":1.278,"15min":1.278},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":1.919,"15min":1.919},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91000000000000003,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.624}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95899999999999996,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.04,"5min":1.998,"15min":1.998},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84899999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.46800000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.379}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97399999999999998,"5min":1.462,"15min":1.462},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":297861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.37,"15min":0.37},"max":{"1min":0.86099999999999999,"5min":1.165,"15min":1.165},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88500000000000001,"5min":1.022,"15min":1.022},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95199999999999996,"5min":1.202,"15min":1.202},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86099999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.248,"15min":1.248},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.079,"15min":1.079},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.149,"15min":1.149},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":296305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.62,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63100000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64900000000000002,"5min":1.095,"15min":1.095},"last":0.628}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.753},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97099999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0109999999999999,"5min":1.264,"15min":1.264},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91600000000000004,"5min":1.286,"15min":1.286},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.409,"15min":1.409},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":296305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51500000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98699999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.432}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0609999999999999,"5min":1.075,"15min":1.075},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.65700000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3400000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97799999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.27,"15min":1.27},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.3759999999999999,"5min":1.389,"15min":1.389},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1220000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.101,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.64300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3049999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":712704,"data_stored":296339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.502,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.02,"15min":1.02},"last":0.876},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.032,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.749},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98099999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":887842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.75900000000000001,"5min":1.393,"15min":1.393},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81899999999999995,"5min":1.319,"15min":1.319},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.879,"5min":1.589,"15min":1.589},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.014,"5min":1.206,"15min":1.206},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95899999999999996,"5min":1.778,"15min":1.778},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79600000000000004,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92700000000000005,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92900000000000005,"5min":1.496,"15min":1.496},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82199999999999995,"15min":0.83699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95299999999999996,"5min":1.454,"15min":1.454},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.278,"15min":1.278},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93400000000000005,"5min":1.829,"15min":1.829},"last":0.876}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:31:54.499 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:31:54.499 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:31:54.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.677+0000 7f3fb4ca9640 1 Processor -- start 2023-11-24T06:31:54.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.677+0000 7f3fb4ca9640 1 -- start start 2023-11-24T06:31:54.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fb4ca9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3fb00c9d60 0x7f3fb00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fb4ca9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00abed0 con 0x7f3fb015b220 2023-11-24T06:31:54.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fb4ca9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb0072370 con 0x7f3fb015b600 2023-11-24T06:31:54.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fb4ca9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb0072710 con 0x7f3fb00c9d60 2023-11-24T06:31:54.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fae59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3fb015b220 0x7f3fb006d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34592/0 (socket says 172.21.15.143:34592) 2023-11-24T06:31:54.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fae59c640 1 -- 172.21.15.143:0/3867816358 learned_addr learned my addr 172.21.15.143:0/3867816358 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:54.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3faed9d640 1 --2- 172.21.15.143:0/3867816358 >> v2:172.21.15.143:3300/0 conn(0x7f3fb00c9d60 0x7f3fb00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3faed9d640 1 -- 172.21.15.143:0/3867816358 >> v1:172.21.15.146:6789/0 conn(0x7f3fb015b600 legacy=0x7f3fb00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3faed9d640 1 -- 172.21.15.143:0/3867816358 >> v1:172.21.15.143:6789/0 conn(0x7f3fb015b220 legacy=0x7f3fb006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3faed9d640 1 -- 172.21.15.143:0/3867816358 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0070670 con 0x7f3fb00c9d60 2023-11-24T06:31:54.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.681+0000 7f3fadd9b640 1 -- 172.21.15.143:0/3867816358 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827274291 0 0) 0x7f3fb00abed0 con 0x7f3fb015b220 2023-11-24T06:31:54.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3faed9d640 1 --2- 172.21.15.143:0/3867816358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb00c9d60 0x7f3fb00cada0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80097c0 tx=0x7f3fa801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f83a6675a366894 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:54.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fadd9b640 1 -- 172.21.15.143:0/3867816358 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80ab670 con 0x7f3fb00c9d60 2023-11-24T06:31:54.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fadd9b640 1 -- 172.21.15.143:0/3867816358 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa80ab7d0 con 0x7f3fb00c9d60 2023-11-24T06:31:54.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fadd9b640 1 -- 172.21.15.143:0/3867816358 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80abb60 con 0x7f3fb00c9d60 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3867816358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb00c9d60 msgr2=0x7f3fb00cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3867816358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb00c9d60 0x7f3fb00cada0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80097c0 tx=0x7f3fa801c450 comp rx=0 tx=0).stop 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3867816358 shutdown_connections 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3867816358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb00c9d60 0x7f3fb00cada0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3867816358 >> 172.21.15.143:0/3867816358 conn(0x7f3fb00b0bf0 msgr2=0x7f3fb00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3867816358 shutdown_connections 2023-11-24T06:31:54.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3867816358 wait complete. 2023-11-24T06:31:54.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 Processor -- start 2023-11-24T06:31:54.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.685+0000 7f3fb4ca9640 1 -- start start 2023-11-24T06:31:54.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb00c9d60 0x7f3fb00ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb015b220 0x7f3fb015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 0x7f3fb0159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ceab0 con 0x7f3fb015b600 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00c60d0 con 0x7f3fb015b220 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00c63b0 con 0x7f3fb00c9d60 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 0x7f3fb0159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 0x7f3fb0159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53134/0 (socket says 172.21.15.143:53134) 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 -- 172.21.15.143:0/3732731926 learned_addr learned my addr 172.21.15.143:0/3732731926 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:54.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fae59c640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb00c9d60 0x7f3fb00ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fa5d9b640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb015b220 0x7f3fb015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 -- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb00c9d60 msgr2=0x7f3fb00ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb00c9d60 0x7f3fb00ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 -- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb015b220 msgr2=0x7f3fb015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb015b220 0x7f3fb015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 -- 172.21.15.143:0/3732731926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009420 con 0x7f3fb015b600 2023-11-24T06:31:54.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3faed9d640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 0x7f3fb0159b80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80ad040 tx=0x7f3fa801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:54.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80b5810 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa80b5970 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00c6690 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80b5d00 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb015a870 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb009d250 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.689+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f3fa80bf410 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.693+0000 7f3fa77fe640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f90066700 0x7f3f90068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.693+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fa811f0d0 con 0x7f3fb015b600 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.693+0000 7f3fae59c640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f90066700 0x7f3f90068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:54.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.693+0000 7f3fae59c640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f90066700 0x7f3f90068bc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00012f0 tx=0x7f3fa0004d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:54.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.697+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fa80ec240 con 0x7f3fb015b600 2023-11-24T06:31:54.904 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.897+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3fb00c6b40 con 0x7f3fb015b600 2023-11-24T06:31:54.907 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.901+0000 7f3fa77fe640 1 -- 172.21.15.143:0/3732731926 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3fa80b5e60 con 0x7f3fb015b600 2023-11-24T06:31:54.907 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-11-24T06:31:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:31:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: caps mds = "allow" 2023-11-24T06:31:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: caps mon = "allow r" 2023-11-24T06:31:54.908 INFO:teuthology.orchestra.run.smithi143.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:31:54.908 INFO:teuthology.orchestra.run.smithi143.stderr:updated caps for client.0 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f90066700 msgr2=0x7f3f90068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f90066700 0x7f3f90068bc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00012f0 tx=0x7f3fa0004d50 comp rx=0 tx=0).stop 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 msgr2=0x7f3fb0159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 0x7f3fb0159b80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80ad040 tx=0x7f3fa801ac90 comp rx=0 tx=0).stop 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 shutdown_connections 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3f90066700 0x7f3f90068bc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3fb015b600 0x7f3fb0159b80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb015b220 0x7f3fb015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 --2- 172.21.15.143:0/3732731926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb00c9d60 0x7f3fb00ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 >> 172.21.15.143:0/3732731926 conn(0x7f3fb00b0bf0 msgr2=0x7f3fb015de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:54.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 shutdown_connections 2023-11-24T06:31:54.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:54.905+0000 7f3fb4ca9640 1 -- 172.21.15.143:0/3732731926 wait complete. 2023-11-24T06:31:54.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:31:55.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.061+0000 7f1a2932a640 1 Processor -- start 2023-11-24T06:31:55.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.061+0000 7f1a2932a640 1 -- start start 2023-11-24T06:31:55.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.061+0000 7f1a2932a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a240b1ef0 0x7f1a24164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a2932a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2415a700 con 0x7f1a2415a320 2023-11-24T06:31:55.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a2932a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a240b2380 con 0x7f1a240b36c0 2023-11-24T06:31:55.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a2932a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a240b2620 con 0x7f1a240b1ef0 2023-11-24T06:31:55.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a22ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1a2415a320 0x7f1a24070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34602/0 (socket says 172.21.15.143:34602) 2023-11-24T06:31:55.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a22ffd640 1 -- 172.21.15.143:0/1535324359 learned_addr learned my addr 172.21.15.143:0/1535324359 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:55.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a237fe640 1 --2- 172.21.15.143:0/1535324359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a240b1ef0 0x7f1a24164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729698518 0 0) 0x7f1a2415a700 con 0x7f1a2415a320 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a10005740 con 0x7f1a2415a320 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129432393 0 0) 0x7f1a240b2380 con 0x7f1a240b36c0 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a2415a700 con 0x7f1a240b36c0 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a237fe640 1 -- 172.21.15.143:0/1535324359 >> v1:172.21.15.146:6789/0 conn(0x7f1a240b36c0 legacy=0x7f1a24070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a237fe640 1 -- 172.21.15.143:0/1535324359 >> v1:172.21.15.143:6789/0 conn(0x7f1a2415a320 legacy=0x7f1a24070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a237fe640 1 -- 172.21.15.143:0/1535324359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a240b2900 con 0x7f1a240b1ef0 2023-11-24T06:31:55.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.065+0000 7f1a237fe640 1 --2- 172.21.15.143:0/1535324359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a240b1ef0 0x7f1a24164f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097f0 tx=0x7f1a1c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d519808d262abad5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ac620 con 0x7f1a240b1ef0 2023-11-24T06:31:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0ac780 con 0x7f1a240b1ef0 2023-11-24T06:31:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a227fc640 1 -- 172.21.15.143:0/1535324359 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0acb10 con 0x7f1a240b1ef0 2023-11-24T06:31:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 -- 172.21.15.143:0/1535324359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a240b1ef0 msgr2=0x7f1a24164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 --2- 172.21.15.143:0/1535324359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a240b1ef0 0x7f1a24164f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097f0 tx=0x7f1a1c01c4c0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 -- 172.21.15.143:0/1535324359 shutdown_connections 2023-11-24T06:31:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 --2- 172.21.15.143:0/1535324359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a240b1ef0 0x7f1a24164f50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 -- 172.21.15.143:0/1535324359 >> 172.21.15.143:0/1535324359 conn(0x7f1a240b0bf0 msgr2=0x7f1a240b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 -- 172.21.15.143:0/1535324359 shutdown_connections 2023-11-24T06:31:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.069+0000 7f1a2932a640 1 -- 172.21.15.143:0/1535324359 wait complete. 2023-11-24T06:31:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 Processor -- start 2023-11-24T06:31:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 -- start start 2023-11-24T06:31:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a240b1ef0 0x7f1a2414d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 0x7f1a24158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a2415a320 0x7f1a2414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241f9260 con 0x7f1a240b36c0 2023-11-24T06:31:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241f9540 con 0x7f1a240b1ef0 2023-11-24T06:31:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241f9820 con 0x7f1a2415a320 2023-11-24T06:31:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 0x7f1a24158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 0x7f1a24158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53136/0 (socket says 172.21.15.143:53136) 2023-11-24T06:31:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 -- 172.21.15.143:0/859046383 learned_addr learned my addr 172.21.15.143:0/859046383 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a237fe640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a2415a320 0x7f1a2414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a22ffd640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a240b1ef0 0x7f1a2414d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 -- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a2415a320 msgr2=0x7f1a2414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a2415a320 0x7f1a2414c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 -- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a240b1ef0 msgr2=0x7f1a2414d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a240b1ef0 0x7f1a2414d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 -- 172.21.15.143:0/859046383 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009420 con 0x7f1a240b36c0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1a7fc640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 0x7f1a24158380 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c490 tx=0x7f1a0c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0052d0 con 0x7f1a240b36c0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c005430 con 0x7f1a240b36c0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c012870 con 0x7f1a240b36c0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a241f9b00 con 0x7f1a240b36c0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.073+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a24159490 con 0x7f1a240b36c0 2023-11-24T06:31:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.077+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24067520 con 0x7f1a240b36c0 2023-11-24T06:31:55.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.077+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f1a0c0129d0 con 0x7f1a240b36c0 2023-11-24T06:31:55.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.077+0000 7f1a1bfff640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a040666b0 0x7f1a04068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.077+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a0c083e40 con 0x7f1a240b36c0 2023-11-24T06:31:55.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.077+0000 7f1a22ffd640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a040666b0 0x7f1a04068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.077+0000 7f1a22ffd640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a040666b0 0x7f1a04068b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a14001570 tx=0x7f1a14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.081+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a0c050ec0 con 0x7f1a240b36c0 2023-11-24T06:31:55.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.261+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a240b1070 con 0x7f1a240b36c0 2023-11-24T06:31:55.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.261+0000 7f1a1bfff640 1 -- 172.21.15.143:0/859046383 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f1a0c0544e0 con 0x7f1a240b36c0 2023-11-24T06:31:55.268 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:31:55.269 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:49.351133+0000","modified":"2023-11-24T06:31:52.429632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/290735663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":290735663},{"type":"v1","addr":"172.21.15.146:6835","nonce":290735663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:31:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 35 2023-11-24T06:31:55.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a040666b0 msgr2=0x7f1a04068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a040666b0 0x7f1a04068b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a14001570 tx=0x7f1a14009040 comp rx=0 tx=0).stop 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 msgr2=0x7f1a24158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 0x7f1a24158380 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c490 tx=0x7f1a0c00c950 comp rx=0 tx=0).stop 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 shutdown_connections 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1a040666b0 0x7f1a04068b70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a2415a320 0x7f1a2414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a240b36c0 0x7f1a24158380 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 --2- 172.21.15.143:0/859046383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a240b1ef0 0x7f1a2414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 >> 172.21.15.143:0/859046383 conn(0x7f1a240b0bf0 msgr2=0x7f1a240b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 shutdown_connections 2023-11-24T06:31:55.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.265+0000 7f1a2932a640 1 -- 172.21.15.143:0/859046383 wait complete. 2023-11-24T06:31:55.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:31:49.351133+0000', 'modified': '2023-11-24T06:31:52.429632+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6117': {'gid': 6117, 'name': 'b', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/290735663', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 290735663}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 290735663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:31:55.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:31:55.692 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T06:31:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 Processor -- start 2023-11-24T06:31:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 -- start start 2023-11-24T06:31:55.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26cc15d720 0x7f26cc0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f26cc0d3a50 0x7f26cc0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc06d050 con 0x7f26cc0b25c0 2023-11-24T06:31:55.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0d2240 con 0x7f26cc0d3a50 2023-11-24T06:31:55.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.825+0000 7f26d15aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc06d4e0 con 0x7f26cc15d720 2023-11-24T06:31:55.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26c3fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f26cc0b25c0 0x7f26cc0d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34616/0 (socket says 172.21.15.143:34616) 2023-11-24T06:31:55.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26c3fff640 1 -- 172.21.15.143:0/4174851235 learned_addr learned my addr 172.21.15.143:0/4174851235 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:55.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/4174851235 >> v2:172.21.15.143:3300/0 conn(0x7f26cc0d3a50 0x7f26cc0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26caffd640 1 --2- 172.21.15.143:0/4174851235 >> v2:172.21.15.146:3300/0 conn(0x7f26cc15d720 0x7f26cc0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26ca7fc640 1 -- 172.21.15.143:0/4174851235 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710374080 0 0) 0x7f26cc06d050 con 0x7f26cc0b25c0 2023-11-24T06:31:55.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26ca7fc640 1 -- 172.21.15.143:0/4174851235 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b8003530 con 0x7f26cc0b25c0 2023-11-24T06:31:55.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26cb7fe640 1 -- 172.21.15.143:0/4174851235 >> v2:172.21.15.146:3300/0 conn(0x7f26cc15d720 msgr2=0x7f26cc0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/4174851235 >> v2:172.21.15.146:3300/0 conn(0x7f26cc15d720 0x7f26cc0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26cb7fe640 1 -- 172.21.15.143:0/4174851235 >> v1:172.21.15.143:6789/0 conn(0x7f26cc0b25c0 legacy=0x7f26cc0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26cb7fe640 1 -- 172.21.15.143:0/4174851235 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc06c720 con 0x7f26cc0d3a50 2023-11-24T06:31:55.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/4174851235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc0d3a50 0x7f26cc0cde10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009d90 tx=0x7f26c401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fe164e20e02b02 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26ca7fc640 1 -- 172.21.15.143:0/4174851235 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40a59a0 con 0x7f26cc0d3a50 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26ca7fc640 1 -- 172.21.15.143:0/4174851235 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c40a5b00 con 0x7f26cc0d3a50 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.829+0000 7f26ca7fc640 1 -- 172.21.15.143:0/4174851235 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40a5e90 con 0x7f26cc0d3a50 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- 172.21.15.143:0/4174851235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc0d3a50 msgr2=0x7f26cc0cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 --2- 172.21.15.143:0/4174851235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc0d3a50 0x7f26cc0cde10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009d90 tx=0x7f26c401c8e0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- 172.21.15.143:0/4174851235 shutdown_connections 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 --2- 172.21.15.143:0/4174851235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc0d3a50 0x7f26cc0cde10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 --2- 172.21.15.143:0/4174851235 >> v2:172.21.15.146:3300/0 conn(0x7f26cc15d720 0x7f26cc0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- 172.21.15.143:0/4174851235 >> 172.21.15.143:0/4174851235 conn(0x7f26cc08af70 msgr2=0x7f26cc09c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- 172.21.15.143:0/4174851235 shutdown_connections 2023-11-24T06:31:55.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- 172.21.15.143:0/4174851235 wait complete. 2023-11-24T06:31:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 Processor -- start 2023-11-24T06:31:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- start start 2023-11-24T06:31:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc0b25c0 0x7f26cc0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc0d3a50 0x7f26cc15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 0x7f26cc0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15cc80 con 0x7f26cc15d720 2023-11-24T06:31:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc154ab0 con 0x7f26cc0b25c0 2023-11-24T06:31:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26d15aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0b87b0 con 0x7f26cc0d3a50 2023-11-24T06:31:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 0x7f26cc0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 0x7f26cc0c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53158/0 (socket says 172.21.15.143:53158) 2023-11-24T06:31:55.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 -- 172.21.15.143:0/2634637814 learned_addr learned my addr 172.21.15.143:0/2634637814 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:55.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26c3fff640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc0d3a50 0x7f26cc15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26caffd640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc0b25c0 0x7f26cc0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 -- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc0d3a50 msgr2=0x7f26cc15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc0d3a50 0x7f26cc15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 -- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc0b25c0 msgr2=0x7f26cc0b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc0b25c0 0x7f26cc0b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26cb7fe640 1 -- 172.21.15.143:0/2634637814 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c4009a70 con 0x7f26cc15d720 2023-11-24T06:31:55.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.833+0000 7f26c3fff640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc0d3a50 0x7f26cc15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:55.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 0x7f26cc0c9870 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f26c40b0040 tx=0x7f26c4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26c37fe640 1 -- 172.21.15.143:0/2634637814 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40adce0 con 0x7f26cc15d720 2023-11-24T06:31:55.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26c37fe640 1 -- 172.21.15.143:0/2634637814 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c40ade40 con 0x7f26cc15d720 2023-11-24T06:31:55.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26c37fe640 1 -- 172.21.15.143:0/2634637814 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40b9690 con 0x7f26cc15d720 2023-11-24T06:31:55.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc0c9db0 con 0x7f26cc15d720 2023-11-24T06:31:55.848 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc0b8d10 con 0x7f26cc15d720 2023-11-24T06:31:55.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.837+0000 7f26c37fe640 1 -- 172.21.15.143:0/2634637814 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f26c40b97f0 con 0x7f26cc15d720 2023-11-24T06:31:55.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26c37fe640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26ac0666b0 0x7f26ac068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26c37fe640 1 -- 172.21.15.143:0/2634637814 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26c411f8c0 con 0x7f26cc15d720 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26ac0666b0 0x7f26ac068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 Processor -- start 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- start start 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26ac0666b0 0x7f26ac068b70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009a50 tx=0x7f26bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec87070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec3cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec3d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aeaa7130 con 0x5613aec86c90 2023-11-24T06:31:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aea949a0 con 0x5613aec3d320 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613aea91ed0 con 0x5613aec875b0 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec87070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec87070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53172/0 (socket says 172.21.15.143:53172) 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 -- 172.21.15.143:0/3515824366 learned_addr learned my addr 172.21.15.143:0/3515824366 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26c3fff640 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec3cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec3d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 -- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 msgr2=0x5613aec3cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec3cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 -- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 msgr2=0x5613aec3d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec3d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 -- 172.21.15.143:0/3515824366 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ae785890 con 0x5613aec86c90 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26caffd640 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec87070 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f26bc011ce0 tx=0x7f26bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13d94265e9f9bb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26c0ff9640 1 -- 172.21.15.143:0/3515824366 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc011d10 con 0x5613aec86c90 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26c0ff9640 1 -- 172.21.15.143:0/3515824366 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc011e70 con 0x5613aec86c90 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26c0ff9640 1 -- 172.21.15.143:0/3515824366 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc021640 con 0x5613aec86c90 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- 172.21.15.143:0/3515824366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 msgr2=0x5613aec87070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec87070 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f26bc011ce0 tx=0x7f26bc014000 comp rx=0 tx=0).stop 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- 172.21.15.143:0/3515824366 shutdown_connections 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec3d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec3cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 --2- 172.21.15.143:0/3515824366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec87070 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- 172.21.15.143:0/3515824366 >> 172.21.15.143:0/3515824366 conn(0x5613aec392d0 msgr2=0x5613aec3b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- 172.21.15.143:0/3515824366 shutdown_connections 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.841+0000 7f26d4910000 1 -- 172.21.15.143:0/3515824366 wait complete. 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- start start 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 Processor -- start 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec6bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec6bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec6c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aea8d7c0 con 0x5613aec86c90 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aea45bf0 con 0x5613aec3d320 2023-11-24T06:31:55.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613aea4ba90 con 0x5613aec875b0 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 10 client.0 _ll_register_callbacks cb 0x5613aec283c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec6bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec6bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53178/0 (socket says 172.21.15.143:53178) 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 -- 172.21.15.143:0/3228973394 learned_addr learned my addr 172.21.15.143:0/3228973394 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26caffd640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec6bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec6c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 -- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 msgr2=0x5613aec6c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec6c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 -- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 msgr2=0x5613aec6bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec6bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 -- 172.21.15.143:0/3228973394 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc0119c0 con 0x5613aec86c90 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26c3fff640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec6bff0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f26b4000f70 tx=0x7f26b40012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32a557a73fd29e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26a9ffb640 1 -- 172.21.15.143:0/3228973394 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4001cf0 con 0x5613aec86c90 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26a9ffb640 1 -- 172.21.15.143:0/3228973394 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b4014400 con 0x5613aec86c90 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613aea4f470 con 0x5613aec86c90 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26a9ffb640 1 -- 172.21.15.143:0/3228973394 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b40145c0 con 0x5613aec86c90 2023-11-24T06:31:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 10 client.6252 fetch_fsmap learned FSMap version 35 2023-11-24T06:31:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5613aea4e190 con 0x5613aec86c90 2023-11-24T06:31:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26a9ffb640 1 -- 172.21.15.143:0/3228973394 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613aea4f470 con 0x5613aec86c90 2023-11-24T06:31:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26a9ffb640 1 -- 172.21.15.143:0/3228973394 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26b4014720 con 0x5613aec86c90 2023-11-24T06:31:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 10 client.6252 fetch_fsmap finished waiting for FSMap version 35 2023-11-24T06:31:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 10 client.6252 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:31:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 20 client.6252 populate_metadata read hostname 'smithi143' 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aec6cf40 0x5613aec98f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 4 client.6252 mds_command: new command op to 6117 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 --> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613aea52b50 con 0x5613aec6cf40 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.845+0000 7f26caffd640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aec6cf40 0x5613aec98f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26caffd640 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aec6cf40 0x5613aec98f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9a312bc9bd85da server_cookie=2d65e1d34202f1db in_seq=0 out_seq=0 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26a9ffb640 10 client.6252 ms_handle_connect on v2:172.21.15.146:6833/290735663 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26a9ffb640 1 -- 172.21.15.143:0/3228973394 <== mds.0 v2:172.21.15.146:6833/290735663 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5613aea52b50 con 0x5613aec6cf40 2023-11-24T06:31:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26a9ffb640 10 client.6252 handle_command_reply: tid=0 2023-11-24T06:31:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 client.6252 shutdown 2023-11-24T06:31:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 msgr2=0x5613aec6bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec6bff0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f26b4000f70 tx=0x7f26b40012e0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 shutdown_connections 2023-11-24T06:31:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aec6cf40 0x5613aec98f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec6c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec86c90 0x5613aec6bff0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26a9ffb640 0 client.6252 ms_handle_reset on v2:172.21.15.146:6833/290735663 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 --2- 172.21.15.143:0/3228973394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec6bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 >> 172.21.15.143:0/3228973394 conn(0x5613aec392d0 msgr2=0x5613aec3b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 shutdown_connections 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 1 -- 172.21.15.143:0/3228973394 wait complete. 2023-11-24T06:31:55.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.849+0000 7f26d4910000 20 client.6252 trim_cache size 0 max 16384 2023-11-24T06:31:55.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 Processor -- start 2023-11-24T06:31:55.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 -- start start 2023-11-24T06:31:55.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec86330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec86c90 0x5613aec853e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 0x5613aec85920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ae746940 con 0x5613aec875b0 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aea67e30 con 0x5613aec3d320 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613aea8abc0 con 0x5613aec86c90 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 0x5613aec85920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 0x5613aec85920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53194/0 (socket says 172.21.15.143:53194) 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 -- 172.21.15.143:0/3672494866 learned_addr learned my addr 172.21.15.143:0/3672494866 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:55.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26c3fff640 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec86c90 0x5613aec853e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26caffd640 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec86330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 -- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec86c90 msgr2=0x5613aec853e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec86c90 0x5613aec853e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 -- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 msgr2=0x5613aec86330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec86330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 -- 172.21.15.143:0/3672494866 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613aea34490 con 0x5613aec875b0 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26caffd640 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec86330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26cb7fe640 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 0x5613aec85920 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ecd50 tx=0x7f26c40ecb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d0c14ef946b58b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26c17fa640 1 -- 172.21.15.143:0/3672494866 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40f0850 con 0x5613aec875b0 2023-11-24T06:31:55.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26c17fa640 1 -- 172.21.15.143:0/3672494866 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c40f49a0 con 0x5613aec875b0 2023-11-24T06:31:55.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26c17fa640 1 -- 172.21.15.143:0/3672494866 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40f8b50 con 0x5613aec875b0 2023-11-24T06:31:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 -- 172.21.15.143:0/3672494866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 msgr2=0x5613aec85920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 0x5613aec85920 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ecd50 tx=0x7f26c40ecb90 comp rx=0 tx=0).stop 2023-11-24T06:31:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 -- 172.21.15.143:0/3672494866 shutdown_connections 2023-11-24T06:31:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec875b0 0x5613aec85920 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec86c90 0x5613aec853e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.865+0000 7f26d4910000 1 --2- 172.21.15.143:0/3672494866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec3d320 0x5613aec86330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- 172.21.15.143:0/3672494866 >> 172.21.15.143:0/3672494866 conn(0x5613aec392d0 msgr2=0x5613aec94280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- 172.21.15.143:0/3672494866 shutdown_connections 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- 172.21.15.143:0/3672494866 wait complete. 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- start start 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 Processor -- start 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 0x5613aec3ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec86c90 0x5613aec99fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec9a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aea4a9b0 con 0x5613aec3d320 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613aea576c0 con 0x5613aec86c90 2023-11-24T06:31:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613aea52b50 con 0x5613aec875b0 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 10 client.0 _ll_register_callbacks cb 0x5613aeadbc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 0x5613aec3ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 0x5613aec3ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53204/0 (socket says 172.21.15.143:53204) 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 -- 172.21.15.143:0/2468437000 learned_addr learned my addr 172.21.15.143:0/2468437000 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 -- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 msgr2=0x5613aec9a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec9a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 -- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec86c90 msgr2=0x5613aec99fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26c3fff640 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec86c90 0x5613aec99fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec86c90 0x5613aec99fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 -- 172.21.15.143:0/2468437000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc0b8d10 con 0x5613aec3d320 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26caffd640 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 0x5613aec3ea90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f26bc008010 tx=0x7f26bc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575f9567ab16c849 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:31:55.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26a9ffb640 1 -- 172.21.15.143:0/2468437000 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc030040 con 0x5613aec3d320 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26a9ffb640 1 -- 172.21.15.143:0/2468437000 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26bc03d070 con 0x5613aec3d320 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613aea8c110 con 0x5613aec3d320 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26a9ffb640 1 -- 172.21.15.143:0/2468437000 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26bc0373b0 con 0x5613aec3d320 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 10 client.6258 fetch_fsmap learned FSMap version 35 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5613ae785cc0 con 0x5613aec3d320 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26a9ffb640 1 -- 172.21.15.143:0/2468437000 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613aea8c110 con 0x5613aec3d320 2023-11-24T06:31:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26a9ffb640 1 -- 172.21.15.143:0/2468437000 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26bc037510 con 0x5613aec3d320 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 10 client.6258 fetch_fsmap finished waiting for FSMap version 35 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 10 client.6258 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 20 client.6258 populate_metadata read hostname 'smithi143' 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aecef610 0x5613aecef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 4 client.6258 mds_command: new command op to 6117 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 --> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5613aeabb9a0 con 0x5613aecef610 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.869+0000 7f26c3fff640 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aecef610 0x5613aecef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:55.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26a9ffb640 10 client.6258 ms_handle_connect on v2:172.21.15.146:6833/290735663 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26c3fff640 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aecef610 0x5613aecef9f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73cbcf2ac3eea274 server_cookie=bff06b0402450ee0 in_seq=0 out_seq=0 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26a9ffb640 1 -- 172.21.15.143:0/2468437000 <== mds.0 v2:172.21.15.146:6833/290735663 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5613aeabb9a0 con 0x5613aecef610 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26a9ffb640 10 client.6258 handle_command_reply: tid=0 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 client.6258 shutdown 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 msgr2=0x5613aec3ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 0x5613aec3ea90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f26bc008010 tx=0x7f26bc0046d0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 shutdown_connections 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:6833/290735663,v1:172.21.15.146:6835/290735663] conn(0x5613aecef610 0x5613aecef9f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613aec875b0 0x5613aec9a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5613aec86c90 0x5613aec99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 --2- 172.21.15.143:0/2468437000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613aec3d320 0x5613aec3ea90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 >> 172.21.15.143:0/2468437000 conn(0x5613aec392d0 msgr2=0x5613aec3b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26a9ffb640 0 client.6258 ms_handle_reset on v2:172.21.15.146:6833/290735663 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 shutdown_connections 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 1 -- 172.21.15.143:0/2468437000 wait complete. 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d4910000 20 client.6258 trim_cache size 0 max 16384 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:31:55.885 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "039ed6d4-b5c2-4e8e-a15f-05a601a78248", 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 6117, 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 5.8591308209999999, 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 35, 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 59, 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 59, 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 11.114655822 2023-11-24T06:31:55.886 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:31:55.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26ac0666b0 msgr2=0x7f26ac068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26ac0666b0 0x7f26ac068b70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009a50 tx=0x7f26bc008040 comp rx=0 tx=0).stop 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 msgr2=0x7f26cc0c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 0x7f26cc0c9870 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f26c40b0040 tx=0x7f26c4019680 comp rx=0 tx=0).stop 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 shutdown_connections 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f26ac0666b0 0x7f26ac068b70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26cc15d720 0x7f26cc0c9870 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc0d3a50 0x7f26cc15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 --2- 172.21.15.143:0/2634637814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc0b25c0 0x7f26cc0b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 >> 172.21.15.143:0/2634637814 conn(0x7f26cc08af70 msgr2=0x7f26cc156420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:55.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 shutdown_connections 2023-11-24T06:31:55.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:55.873+0000 7f26d15aa640 1 -- 172.21.15.143:0/2634637814 wait complete. 2023-11-24T06:31:55.897 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:31:55.946 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-11-24T06:31:55.940+0000 7f0b6560a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:31:56.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 Processor -- start 2023-11-24T06:31:56.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 -- start start 2023-11-24T06:31:56.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2be00d3020 0x7f2be00d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2be00ce8b0 0x7f2be00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be00d39c0 con 0x7f2be00d3020 2023-11-24T06:31:56.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be00d1cc0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2be5cd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00d1fa0 con 0x7f2be015d570 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2bdeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2be00d3020 0x7f2be00d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2bdeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2be00d3020 0x7f2be00d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53208/0 (socket says 172.21.15.143:53208) 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2bdeffd640 1 -- 172.21.15.143:0/2323254441 learned_addr learned my addr 172.21.15.143:0/2323254441 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2bdf7fe640 1 --2- 172.21.15.143:0/2323254441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.029+0000 7f2bdffff640 1 --2- 172.21.15.143:0/2323254441 >> v2:172.21.15.146:3300/0 conn(0x7f2be00ce8b0 0x7f2be00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bdeffd640 1 -- 172.21.15.143:0/2323254441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 msgr2=0x7f2be006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bdeffd640 1 --2- 172.21.15.143:0/2323254441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bdeffd640 1 -- 172.21.15.143:0/2323254441 >> v2:172.21.15.146:3300/0 conn(0x7f2be00ce8b0 msgr2=0x7f2be00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bdeffd640 1 --2- 172.21.15.143:0/2323254441 >> v2:172.21.15.146:3300/0 conn(0x7f2be00ce8b0 0x7f2be00ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bdeffd640 1 -- 172.21.15.143:0/2323254441 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00ce0b0 con 0x7f2be00d3020 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bdeffd640 1 --2- 172.21.15.143:0/2323254441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00d3020 0x7f2be00d3480 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2be00c6e60 tx=0x7f2bd401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da043b4f2f96439a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bde7fc640 1 -- 172.21.15.143:0/2323254441 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40aa610 con 0x7f2be00d3020 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bde7fc640 1 -- 172.21.15.143:0/2323254441 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40a6040 con 0x7f2be00d3020 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2bde7fc640 1 -- 172.21.15.143:0/2323254441 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40aa990 con 0x7f2be00d3020 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 -- 172.21.15.143:0/2323254441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00d3020 msgr2=0x7f2be00d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/2323254441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00d3020 0x7f2be00d3480 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2be00c6e60 tx=0x7f2bd401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 -- 172.21.15.143:0/2323254441 shutdown_connections 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/2323254441 >> v2:172.21.15.146:3300/0 conn(0x7f2be00ce8b0 0x7f2be00ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/2323254441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00d3020 0x7f2be00d3480 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/2323254441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.033+0000 7f2be5cd6640 1 -- 172.21.15.143:0/2323254441 >> 172.21.15.143:0/2323254441 conn(0x7f2be008ceb0 msgr2=0x7f2be009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 -- 172.21.15.143:0/2323254441 shutdown_connections 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 -- 172.21.15.143:0/2323254441 wait complete. 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 Processor -- start 2023-11-24T06:31:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 -- start start 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 0x7f2be00b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be00d3020 0x7f2be00b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be00b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be015dc50 con 0x7f2be00ce8b0 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be015ada0 con 0x7f2be00d3020 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2be5cd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00c9ca0 con 0x7f2be015d570 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 0x7f2be00b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 0x7f2be00b8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53224/0 (socket says 172.21.15.143:53224) 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 -- 172.21.15.143:0/833232766 learned_addr learned my addr 172.21.15.143:0/833232766 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdeffd640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be00d3020 0x7f2be00b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdffff640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be00b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 -- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 msgr2=0x7f2be00b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be00b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 -- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be00d3020 msgr2=0x7f2be00b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be00d3020 0x7f2be00b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.037+0000 7f2bdf7fe640 1 -- 172.21.15.143:0/833232766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40094d0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bdf7fe640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 0x7f2be00b8740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000e930 tx=0x7f2bd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:56.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0009690 con 0x7f2be00ce8b0 2023-11-24T06:31:56.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd000ca00 con 0x7f2be00ce8b0 2023-11-24T06:31:56.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000cd70 con 0x7f2be00ce8b0 2023-11-24T06:31:56.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be015a790 con 0x7f2be00ce8b0 2023-11-24T06:31:56.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be00b78d0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be0067520 con 0x7f2be00ce8b0 2023-11-24T06:31:56.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f2bd0013470 con 0x7f2be00ce8b0 2023-11-24T06:31:56.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bc7fff640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2bcc0666b0 0x7f2bcc068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:56.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bd00847b0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.041+0000 7f2bdeffd640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2bcc0666b0 0x7f2bcc068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:56.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.045+0000 7f2bdeffd640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2bcc0666b0 0x7f2bcc068b70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ae000 tx=0x7f2bd40b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:56.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.045+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bd0051ad0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2be006b7b0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2bc7fff640 1 -- 172.21.15.143:0/833232766 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2bd00550f0 con 0x7f2be00ce8b0 2023-11-24T06:31:56.239 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:31:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2bcc0666b0 msgr2=0x7f2bcc068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:56.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2bcc0666b0 0x7f2bcc068b70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ae000 tx=0x7f2bd40b5040 comp rx=0 tx=0).stop 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 msgr2=0x7f2be00b8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 0x7f2be00b8740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000e930 tx=0x7f2bd000edf0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 shutdown_connections 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2bcc0666b0 0x7f2bcc068b70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be015d570 0x7f2be00b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be00d3020 0x7f2be00b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 --2- 172.21.15.143:0/833232766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be00ce8b0 0x7f2be00b8740 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 >> 172.21.15.143:0/833232766 conn(0x7f2be008ceb0 msgr2=0x7f2be006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 shutdown_connections 2023-11-24T06:31:56.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:56.233+0000 7f2be5cd6640 1 -- 172.21.15.143:0/833232766 wait complete. 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:31:56.260 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:31:56.261 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:31:56.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.261 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:31:56.270 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:56.271 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42247sec preferred_lft 42247sec 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:31:56.272 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.273 INFO:teuthology.orchestra.run.smithi143.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:56.274 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:31:56.274 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:31:56.274 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:56.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.275 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:31:56.335 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:31:56.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.337 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:31:56.392 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:31:56.392 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:31:56.393 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:31:56.393 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:31:56.393 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:31:56.393 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:31:56.393 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:56.394 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:56.394 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:56.394 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:31:56.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.395 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:31:56.395 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:31:56.395 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:31:56.396 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:31:56.396 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:31:56.396 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:31:56.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.488 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:31:56.497 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:31:56.498 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:31:56.498 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:31:56.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.498 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-11-24T06:31:56.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:56.565 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:56.622 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:31:56.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:56.623 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:56.676 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:31:56.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.677 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:56.767 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:56.767 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:56.781 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:56.781 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:56.782 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:31:56.782 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:31:56.782 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:31:56.784 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:31:56.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.784 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:31:56.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:56.805 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:31:56.872 INFO:teuthology.orchestra.run.smithi143.stdout:client6267 2023-11-24T06:31:56.873 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:31:56.873 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:56.921 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:31:57.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.097+0000 7f5baa467640 1 Processor -- start 2023-11-24T06:31:57.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.097+0000 7f5baa467640 1 -- start start 2023-11-24T06:31:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5baa467640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ba40b0660 0x7f5ba406e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5baa467640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ba406eb40 0x7f5ba406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:57.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5baa467640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba406be30 con 0x7f5ba406bff0 2023-11-24T06:31:57.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5baa467640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba406d720 con 0x7f5ba40b0660 2023-11-24T06:31:57.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5baa467640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba40ce580 con 0x7f5ba406eb40 2023-11-24T06:31:57.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba9465640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5ba406bff0 0x7f5ba406c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:34620/0 (socket says 172.21.15.143:34620) 2023-11-24T06:31:57.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba9465640 1 -- 172.21.15.143:0/2079168792 learned_addr learned my addr 172.21.15.143:0/2079168792 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:57.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba8c64640 1 --2- 172.21.15.143:0/2079168792 >> v2:172.21.15.143:3300/0 conn(0x7f5ba40b0660 0x7f5ba406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:57.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba9c66640 1 --2- 172.21.15.143:0/2079168792 >> v2:172.21.15.146:3300/0 conn(0x7f5ba406eb40 0x7f5ba406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:57.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5b9bfff640 1 -- 172.21.15.143:0/2079168792 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522282014 0 0) 0x7f5ba0001120 con 0x7f5ba406bff0 2023-11-24T06:31:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba8c64640 1 -- 172.21.15.143:0/2079168792 >> v2:172.21.15.146:3300/0 conn(0x7f5ba406eb40 msgr2=0x7f5ba406ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba8c64640 1 --2- 172.21.15.143:0/2079168792 >> v2:172.21.15.146:3300/0 conn(0x7f5ba406eb40 0x7f5ba406ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba8c64640 1 -- 172.21.15.143:0/2079168792 >> v1:172.21.15.143:6789/0 conn(0x7f5ba406bff0 legacy=0x7f5ba406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.101+0000 7f5ba8c64640 1 -- 172.21.15.143:0/2079168792 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba406b6c0 con 0x7f5ba40b0660 2023-11-24T06:31:57.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5ba8c64640 1 --2- 172.21.15.143:0/2079168792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba40b0660 0x7f5ba406e600 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40cda10 tx=0x7f5b9401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191f34c23b07b3b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5b9bfff640 1 -- 172.21.15.143:0/2079168792 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940ac630 con 0x7f5ba40b0660 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5b9bfff640 1 -- 172.21.15.143:0/2079168792 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b940ac790 con 0x7f5ba40b0660 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5b9bfff640 1 -- 172.21.15.143:0/2079168792 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940acb20 con 0x7f5ba40b0660 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 -- 172.21.15.143:0/2079168792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba40b0660 msgr2=0x7f5ba406e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 --2- 172.21.15.143:0/2079168792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba40b0660 0x7f5ba406e600 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40cda10 tx=0x7f5b9401c3d0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 -- 172.21.15.143:0/2079168792 shutdown_connections 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 --2- 172.21.15.143:0/2079168792 >> v2:172.21.15.146:3300/0 conn(0x7f5ba406eb40 0x7f5ba406ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 --2- 172.21.15.143:0/2079168792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba40b0660 0x7f5ba406e600 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 -- 172.21.15.143:0/2079168792 >> 172.21.15.143:0/2079168792 conn(0x7f5ba40cda60 msgr2=0x7f5ba40cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 -- 172.21.15.143:0/2079168792 shutdown_connections 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 -- 172.21.15.143:0/2079168792 wait complete. 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 Processor -- start 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.105+0000 7f5baa467640 1 -- start start 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 0x7f5ba41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ba406eb40 0x7f5ba415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ba40b0660 0x7f5ba415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415b600 con 0x7f5ba406bff0 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415bfd0 con 0x7f5ba406eb40 2023-11-24T06:31:57.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40c76f0 con 0x7f5ba40b0660 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 0x7f5ba41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 0x7f5ba41551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:53244/0 (socket says 172.21.15.143:53244) 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 -- 172.21.15.143:0/3624481614 learned_addr learned my addr 172.21.15.143:0/3624481614 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 -- 172.21.15.143:0/3624481614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ba40b0660 msgr2=0x7f5ba415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ba40b0660 0x7f5ba415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 -- 172.21.15.143:0/3624481614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ba406eb40 msgr2=0x7f5ba415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ba406eb40 0x7f5ba415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 -- 172.21.15.143:0/3624481614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009420 con 0x7f5ba406bff0 2023-11-24T06:31:57.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5ba9465640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 0x7f5ba41551e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c480 tx=0x7f5ba000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:57.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00074e0 con 0x7f5ba406bff0 2023-11-24T06:31:57.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0007660 con 0x7f5ba406bff0 2023-11-24T06:31:57.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba40c79d0 con 0x7f5ba406bff0 2023-11-24T06:31:57.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0004a30 con 0x7f5ba406bff0 2023-11-24T06:31:57.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba415af80 con 0x7f5ba406bff0 2023-11-24T06:31:57.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba404e850 con 0x7f5ba406bff0 2023-11-24T06:31:57.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.109+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f5ba0004b90 con 0x7f5ba406bff0 2023-11-24T06:31:57.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.113+0000 7f5b99ffb640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b880666e0 0x7f5b88068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:57.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.113+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba0083f10 con 0x7f5ba406bff0 2023-11-24T06:31:57.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.113+0000 7f5ba8c64640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b880666e0 0x7f5b88068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:57.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.113+0000 7f5ba8c64640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b880666e0 0x7f5b88068ba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5b940ae000 tx=0x7f5b94004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:57.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.117+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ba0054a20 con 0x7f5ba406bff0 2023-11-24T06:31:57.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.297+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ba406be30 con 0x7f5ba406bff0 2023-11-24T06:31:57.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.297+0000 7f5b99ffb640 1 -- 172.21.15.143:0/3624481614 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ba406be30 con 0x7f5ba406bff0 2023-11-24T06:31:57.304 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b880666e0 msgr2=0x7f5b88068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b880666e0 0x7f5b88068ba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5b940ae000 tx=0x7f5b94004740 comp rx=0 tx=0).stop 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 msgr2=0x7f5ba41551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 0x7f5ba41551e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c480 tx=0x7f5ba000c940 comp rx=0 tx=0).stop 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 shutdown_connections 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b880666e0 0x7f5b88068ba0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ba40b0660 0x7f5ba415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ba406eb40 0x7f5ba415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 --2- 172.21.15.143:0/3624481614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ba406bff0 0x7f5ba41551e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:57.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 >> 172.21.15.143:0/3624481614 conn(0x7f5ba40cda60 msgr2=0x7f5ba40cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:57.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 shutdown_connections 2023-11-24T06:31:57.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:57.301+0000 7f5baa467640 1 -- 172.21.15.143:0/3624481614 wait complete. 2023-11-24T06:31:57.324 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:31:57.325 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:31:57.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.325 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:31:57.336 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:31:57.336 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:31:57.336 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:31:57.336 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.336 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:31:57.337 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42277sec preferred_lft 42277sec 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:31:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:31:57.339 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:31:57.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.340 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:31:57.402 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:31:57.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.405 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:31:57.461 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:31:57.461 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:31:57.461 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:31:57.461 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:31:57.461 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:31:57.462 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:31:57.462 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:57.462 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:57.462 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:31:57.462 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:31:57.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.463 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:31:57.463 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:31:57.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:31:57.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:31:57.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:31:57.464 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:31:57.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.556 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:31:57.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:31:57.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:31:57.566 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:31:57.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-11-24T06:31:57.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:57.630 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:57.687 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:31:57.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:31:57.687 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:57.738 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:31:57.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.738 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:57.835 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:57.835 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:57.848 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:31:57.848 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:31:57.848 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:31:57.848 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 1@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:31:57.848 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:31:57.851 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:31:57.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:31:57.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:31:57.872 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:31:57.925 INFO:teuthology.orchestra.run.smithi146.stdout:client5414 2023-11-24T06:31:57.925 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:31:57.925 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:31:57.974 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:31:58.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.117+0000 7f543032a640 1 Processor -- start 2023-11-24T06:31:58.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.117+0000 7f543032a640 1 -- start start 2023-11-24T06:31:58.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f543032a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54280ad5e0 0x7f5428159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:58.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f543032a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280ae950 con 0x7f542806cd60 2023-11-24T06:31:58.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f543032a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280b1ef0 con 0x7f542806de50 2023-11-24T06:31:58.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f543032a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5428159fc0 con 0x7f54280ad5e0 2023-11-24T06:31:58.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542e8c7640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f542806cd60 0x7f542806d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33614/0 (socket says 172.21.15.143:33614) 2023-11-24T06:31:58.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542e8c7640 1 -- 172.21.15.143:0/1073268134 learned_addr learned my addr 172.21.15.143:0/1073268134 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:58.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542d8c5640 1 --2- 172.21.15.143:0/1073268134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54280ad5e0 0x7f5428159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:58.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542d8c5640 1 -- 172.21.15.143:0/1073268134 >> v1:172.21.15.146:6789/0 conn(0x7f542806de50 legacy=0x7f542806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542d8c5640 1 -- 172.21.15.143:0/1073268134 >> v1:172.21.15.143:6789/0 conn(0x7f542806cd60 legacy=0x7f542806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542d0c4640 1 -- 172.21.15.143:0/1073268134 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853283706 0 0) 0x7f54280b1ef0 con 0x7f542806de50 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.121+0000 7f542d8c5640 1 -- 172.21.15.143:0/1073268134 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280ada40 con 0x7f54280ad5e0 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f542d8c5640 1 --2- 172.21.15.143:0/1073268134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54280ad5e0 0x7f5428159a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f54180097f0 tx=0x7f541801e560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe31a28460bbb3f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f542d0c4640 1 -- 172.21.15.143:0/1073268134 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180ac670 con 0x7f54280ad5e0 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f542d0c4640 1 -- 172.21.15.143:0/1073268134 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54180ac7d0 con 0x7f54280ad5e0 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f542d0c4640 1 -- 172.21.15.143:0/1073268134 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180acb60 con 0x7f54280ad5e0 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 -- 172.21.15.143:0/1073268134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54280ad5e0 msgr2=0x7f5428159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 --2- 172.21.15.143:0/1073268134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54280ad5e0 0x7f5428159a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f54180097f0 tx=0x7f541801e560 comp rx=0 tx=0).stop 2023-11-24T06:31:58.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 -- 172.21.15.143:0/1073268134 shutdown_connections 2023-11-24T06:31:58.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 --2- 172.21.15.143:0/1073268134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54280ad5e0 0x7f5428159a80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:58.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 -- 172.21.15.143:0/1073268134 >> 172.21.15.143:0/1073268134 conn(0x7f54280b0bf0 msgr2=0x7f54280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:58.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 -- 172.21.15.143:0/1073268134 shutdown_connections 2023-11-24T06:31:58.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 -- 172.21.15.143:0/1073268134 wait complete. 2023-11-24T06:31:58.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 Processor -- start 2023-11-24T06:31:58.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.125+0000 7f543032a640 1 -- start start 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542806cd60 0x7f542814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f542806de50 0x7f54281f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 0x7f5428149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54281f2bb0 con 0x7f54280ad5e0 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542814a220 con 0x7f542806cd60 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542814a500 con 0x7f542806de50 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542e8c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 0x7f5428149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542e8c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 0x7f5428149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45144/0 (socket says 172.21.15.143:45144) 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f542806de50 0x7f54281f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:58.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542e8c7640 1 -- 172.21.15.143:0/1367257477 learned_addr learned my addr 172.21.15.143:0/1367257477 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542e0c6640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542806cd60 0x7f542814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 -- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542806cd60 msgr2=0x7f542814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542806cd60 0x7f542814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 -- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 msgr2=0x7f5428149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 0x7f5428149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 -- 172.21.15.143:0/1367257477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009420 con 0x7f542806de50 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542e8c7640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 0x7f5428149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:58.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f542d8c5640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f542806de50 0x7f54281f2670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54180ad000 tx=0x7f541801cda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:58.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180abb90 con 0x7f542806de50 2023-11-24T06:31:58.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54180abcf0 con 0x7f542806de50 2023-11-24T06:31:58.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800e1d0 con 0x7f542806de50 2023-11-24T06:31:58.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542814a7e0 con 0x7f542806de50 2023-11-24T06:31:58.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542814ada0 con 0x7f542806de50 2023-11-24T06:31:58.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.129+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428067520 con 0x7f542806de50 2023-11-24T06:31:58.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.133+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f54180c13f0 con 0x7f542806de50 2023-11-24T06:31:58.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.133+0000 7f541effd640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f540c0666a0 0x7f540c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:58.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.133+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f541811e250 con 0x7f542806de50 2023-11-24T06:31:58.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.133+0000 7f542e0c6640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f540c0666a0 0x7f540c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:58.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.133+0000 7f542e0c6640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f540c0666a0 0x7f540c068b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5424000f70 tx=0x7f5424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:58.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.137+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54180eb270 con 0x7f542806de50 2023-11-24T06:31:58.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:58.321+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f542814a640 con 0x7f542806de50 2023-11-24T06:31:59.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.093+0000 7f541effd640 1 -- 172.21.15.143:0/1367257477 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 136+0+0 (secure 0 0 0) 0x7f542814a640 con 0x7f542806de50 2023-11-24T06:31:59.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f540c0666a0 msgr2=0x7f540c068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f540c0666a0 0x7f540c068b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5424000f70 tx=0x7f5424009040 comp rx=0 tx=0).stop 2023-11-24T06:31:59.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f542806de50 msgr2=0x7f54281f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f542806de50 0x7f54281f2670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54180ad000 tx=0x7f541801cda0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 shutdown_connections 2023-11-24T06:31:59.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f540c0666a0 0x7f540c068b60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54280ad5e0 0x7f5428149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f542806de50 0x7f54281f2670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 --2- 172.21.15.143:0/1367257477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542806cd60 0x7f542814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 >> 172.21.15.143:0/1367257477 conn(0x7f54280b0bf0 msgr2=0x7f542815c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:59.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 shutdown_connections 2023-11-24T06:31:59.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.097+0000 7f543032a640 1 -- 172.21.15.143:0/1367257477 wait complete. 2023-11-24T06:31:59.126 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:31:59.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.261+0000 7f0843432640 1 Processor -- start 2023-11-24T06:31:59.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.261+0000 7f0843432640 1 -- start start 2023-11-24T06:31:59.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f0843432640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c15a4d0 0x7f083c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f0843432640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f083c0cad20 0x7f083c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f0843432640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c15a8b0 con 0x7f083c06d740 2023-11-24T06:31:59.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f0843432640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c0c9c30 con 0x7f083c0cad20 2023-11-24T06:31:59.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f0843432640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c15ee80 con 0x7f083c15a4d0 2023-11-24T06:31:59.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08411ce640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c15a4d0 0x7f083c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08409cd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f083c0cad20 0x7f083c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08419cf640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f083c06d740 0x7f083c0cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:38512/0 (socket says 172.21.15.143:38512) 2023-11-24T06:31:59.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08419cf640 1 -- 172.21.15.143:0/3339207488 learned_addr learned my addr 172.21.15.143:0/3339207488 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:59.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08409cd640 1 -- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c15a4d0 msgr2=0x7f083c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:59.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08409cd640 1 --2- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c15a4d0 0x7f083c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08409cd640 1 -- 172.21.15.143:0/3339207488 >> v1:172.21.15.146:6789/0 conn(0x7f083c06d740 legacy=0x7f083c0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08409cd640 1 -- 172.21.15.143:0/3339207488 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c0c9f60 con 0x7f083c0cad20 2023-11-24T06:31:59.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.265+0000 7f08411ce640 1 --2- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c15a4d0 0x7f083c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:59.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f08409cd640 1 --2- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c0cad20 0x7f083c15e940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f082c0097c0 tx=0x7f082c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=154bb4fe6580e490 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0833fff640 1 -- 172.21.15.143:0/3339207488 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c0ac620 con 0x7f083c0cad20 2023-11-24T06:31:59.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0833fff640 1 -- 172.21.15.143:0/3339207488 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c0ac780 con 0x7f083c0cad20 2023-11-24T06:31:59.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0833fff640 1 -- 172.21.15.143:0/3339207488 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c0acb10 con 0x7f083c0cad20 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 -- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c0cad20 msgr2=0x7f083c15e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 --2- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c0cad20 0x7f083c15e940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f082c0097c0 tx=0x7f082c01c3c0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 -- 172.21.15.143:0/3339207488 shutdown_connections 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 --2- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c0cad20 0x7f083c15e940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 --2- 172.21.15.143:0/3339207488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c15a4d0 0x7f083c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 -- 172.21.15.143:0/3339207488 >> 172.21.15.143:0/3339207488 conn(0x7f083c0b0bf0 msgr2=0x7f083c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 -- 172.21.15.143:0/3339207488 shutdown_connections 2023-11-24T06:31:59.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.269+0000 7f0843432640 1 -- 172.21.15.143:0/3339207488 wait complete. 2023-11-24T06:31:59.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 Processor -- start 2023-11-24T06:31:59.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- start start 2023-11-24T06:31:59.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c06d740 0x7f083c15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 0x7f083c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c15a4d0 0x7f083c0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c15da30 con 0x7f083c0cad20 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c09a6a0 con 0x7f083c15a4d0 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c15d470 con 0x7f083c06d740 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 0x7f083c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 0x7f083c15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45158/0 (socket says 172.21.15.143:45158) 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 -- 172.21.15.143:0/719615136 learned_addr learned my addr 172.21.15.143:0/719615136 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08411ce640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c06d740 0x7f083c15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08419cf640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c15a4d0 0x7f083c0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 -- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c06d740 msgr2=0x7f083c15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c06d740 0x7f083c15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 -- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c15a4d0 msgr2=0x7f083c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c15a4d0 0x7f083c0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 -- 172.21.15.143:0/719615136 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083800b6c0 con 0x7f083c0cad20 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f08409cd640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 0x7f083c15ca90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f082c0af040 tx=0x7f082c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b5410 con 0x7f083c0cad20 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c0b5590 con 0x7f083c0cad20 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b5940 con 0x7f083c0cad20 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c009420 con 0x7f083c0cad20 2023-11-24T06:31:59.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c06e0e0 con 0x7f083c0cad20 2023-11-24T06:31:59.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.273+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c09d250 con 0x7f083c0cad20 2023-11-24T06:31:59.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.277+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f082c0b3040 con 0x7f083c0cad20 2023-11-24T06:31:59.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.277+0000 7f0831ffb640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08200666b0 0x7f0820068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.277+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f082c11e4f0 con 0x7f083c0cad20 2023-11-24T06:31:59.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.277+0000 7f08411ce640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08200666b0 0x7f0820068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.277+0000 7f08411ce640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08200666b0 0x7f0820068b70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f083800bdd0 tx=0x7f083800b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.281+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f082c0eb510 con 0x7f083c0cad20 2023-11-24T06:31:59.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.453+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f083c06df60 con 0x7f08200666b0 2023-11-24T06:31:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0831ffb640 1 -- 172.21.15.143:0/719615136 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f083800ba20 con 0x7f08200666b0 2023-11-24T06:31:59.462 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:31:59.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:31:59.462 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "cephfs" 2023-11-24T06:31:59.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:31:59.462 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:31:59.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08200666b0 msgr2=0x7f0820068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08200666b0 0x7f0820068b70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f083800bdd0 tx=0x7f083800b3a0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 msgr2=0x7f083c15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 0x7f083c15ca90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f082c0af040 tx=0x7f082c019160 comp rx=0 tx=0).stop 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 shutdown_connections 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08200666b0 0x7f0820068b70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083c15a4d0 0x7f083c0aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cad20 0x7f083c15ca90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 --2- 172.21.15.143:0/719615136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f083c06d740 0x7f083c15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 >> 172.21.15.143:0/719615136 conn(0x7f083c0b0bf0 msgr2=0x7f083c06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 shutdown_connections 2023-11-24T06:31:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.457+0000 7f0843432640 1 -- 172.21.15.143:0/719615136 wait complete. 2023-11-24T06:31:59.483 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:31:59.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3bc557640 1 Processor -- start 2023-11-24T06:31:59.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3bc557640 1 -- start start 2023-11-24T06:31:59.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3bc557640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b415ec60 0x7ff3b40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3bc557640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b4070f00 con 0x7ff3b415a290 2023-11-24T06:31:59.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3bc557640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b4071170 con 0x7ff3b40cc6b0 2023-11-24T06:31:59.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3bc557640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40cb690 con 0x7ff3b415ec60 2023-11-24T06:31:59.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3ba2f3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff3b415a290 0x7ff3b40707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33620/0 (socket says 172.21.15.143:33620) 2023-11-24T06:31:59.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.617+0000 7ff3ba2f3640 1 -- 172.21.15.143:0/83763861 learned_addr learned my addr 172.21.15.143:0/83763861 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b415ec60 0x7ff3b40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589088884 0 0) 0x7ff3b4070f00 con 0x7ff3b415a290 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a0005740 con 0x7ff3b415a290 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132034877 0 0) 0x7ff3b4071170 con 0x7ff3b40cc6b0 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b4070f00 con 0x7ff3b40cc6b0 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136246483 0 0) 0x7ff3a0005740 con 0x7ff3b415a290 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b415ec60 msgr2=0x7ff3b40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:59.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b415ec60 0x7ff3b40cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 >> v1:172.21.15.146:6789/0 conn(0x7ff3b40cc6b0 legacy=0x7ff3b40b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b40cb970 con 0x7ff3b415a290 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7ff3a8001680 con 0x7ff3b415a290 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 >> v1:172.21.15.143:6789/0 conn(0x7ff3b415a290 legacy=0x7ff3b40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3a0005d50 0x7ff3a0006130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3a00069e0 0x7ff3a0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00073a0 0x7ff3a000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40cb690 con 0x7ff3a0005d50 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a000e1c0 con 0x7ff3a00073a0 2023-11-24T06:31:59.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00035b0 con 0x7ff3a00069e0 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b415ec60 0x7ff3b40cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3a0005d50 0x7ff3a0006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3baaf4640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00073a0 0x7ff3a000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3a00069e0 0x7ff3a0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3ba2f3640 1 -- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3a00069e0 msgr2=0x7ff3a0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3a00069e0 0x7ff3a0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3ba2f3640 1 -- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00073a0 msgr2=0x7ff3a000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00073a0 0x7ff3a000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3ba2f3640 1 -- 172.21.15.143:0/83763861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0005740 con 0x7ff3a0005d50 2023-11-24T06:31:59.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.621+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3a00069e0 0x7ff3a0006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:31:59.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3a0005d50 0x7ff3a0006130 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800c160 tx=0x7ff3a801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b710242d2d30869f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80058e0 con 0x7ff3a0005d50 2023-11-24T06:31:59.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a8005a40 con 0x7ff3a0005d50 2023-11-24T06:31:59.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3b92f1640 1 -- 172.21.15.143:0/83763861 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8005df0 con 0x7ff3a0005d50 2023-11-24T06:31:59.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 -- 172.21.15.143:0/83763861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3a0005d50 msgr2=0x7ff3a0006130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 --2- 172.21.15.143:0/83763861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3a0005d50 0x7ff3a0006130 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800c160 tx=0x7ff3a801cb90 comp rx=0 tx=0).stop 2023-11-24T06:31:59.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3baaf4640 1 -- 172.21.15.143:0/83763861 reap_dead start 2023-11-24T06:31:59.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 -- 172.21.15.143:0/83763861 shutdown_connections 2023-11-24T06:31:59.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 -- 172.21.15.143:0/83763861 >> 172.21.15.143:0/83763861 conn(0x7ff3b40b0c80 msgr2=0x7ff3b40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:59.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 -- 172.21.15.143:0/83763861 shutdown_connections 2023-11-24T06:31:59.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 -- 172.21.15.143:0/83763861 wait complete. 2023-11-24T06:31:59.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 Processor -- start 2023-11-24T06:31:59.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.625+0000 7ff3bc557640 1 -- start start 2023-11-24T06:31:59.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a0005d50 0x7ff3b4158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 0x7ff3b4150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b413e4c0 0x7ff3b413e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4151f50 con 0x7ff3b4157ef0 2023-11-24T06:31:59.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4159140 con 0x7ff3a0005d50 2023-11-24T06:31:59.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4151340 con 0x7ff3b413e4c0 2023-11-24T06:31:59.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 0x7ff3b4150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 0x7ff3b4150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45176/0 (socket says 172.21.15.143:45176) 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 -- 172.21.15.143:0/2912708931 learned_addr learned my addr 172.21.15.143:0/2912708931 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a0005d50 0x7ff3b4158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3baaf4640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b413e4c0 0x7ff3b413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 -- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b413e4c0 msgr2=0x7ff3b413e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b413e4c0 0x7ff3b413e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 -- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a0005d50 msgr2=0x7ff3b4158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a0005d50 0x7ff3b4158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 -- 172.21.15.143:0/2912708931 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4151620 con 0x7ff3b4157ef0 2023-11-24T06:31:59.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3b9af2640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 0x7ff3b4150350 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0010810 tx=0x7ff3b0010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000eb60 con 0x7ff3b4157ef0 2023-11-24T06:31:59.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000ecc0 con 0x7ff3b4157ef0 2023-11-24T06:31:59.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b001c400 con 0x7ff3b4157ef0 2023-11-24T06:31:59.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b4151900 con 0x7ff3b4157ef0 2023-11-24T06:31:59.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b4150890 con 0x7ff3b4157ef0 2023-11-24T06:31:59.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b404e8c0 con 0x7ff3b4157ef0 2023-11-24T06:31:59.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.629+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7ff3b001c560 con 0x7ff3b4157ef0 2023-11-24T06:31:59.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.633+0000 7ff3a6ffd640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff3980666b0 0x7ff398068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.633+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3b0084820 con 0x7ff3b4157ef0 2023-11-24T06:31:59.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.633+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff3980666b0 0x7ff398068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.633+0000 7ff3ba2f3640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff3980666b0 0x7ff398068b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80aa000 tx=0x7ff3a8001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.637+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3b00518a0 con 0x7ff3b4157ef0 2023-11-24T06:31:59.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.785+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff3b4152090 con 0x7ff3b4157ef0 2023-11-24T06:31:59.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.785+0000 7ff3a6ffd640 1 -- 172.21.15.143:0/2912708931 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3b0054ec0 con 0x7ff3b4157ef0 2023-11-24T06:31:59.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.785+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff3980666b0 msgr2=0x7ff398068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.785+0000 7ff3bc557640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff3980666b0 0x7ff398068b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80aa000 tx=0x7ff3a8001a00 comp rx=0 tx=0).stop 2023-11-24T06:31:59.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.785+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 msgr2=0x7ff3b4150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.785+0000 7ff3bc557640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 0x7ff3b4150350 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0010810 tx=0x7ff3b0010cd0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 shutdown_connections 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff3980666b0 0x7ff398068b70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b413e4c0 0x7ff3b413e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3b4157ef0 0x7ff3b4150350 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 --2- 172.21.15.143:0/2912708931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a0005d50 0x7ff3b4158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 >> 172.21.15.143:0/2912708931 conn(0x7ff3b40b0c80 msgr2=0x7ff3b40b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 shutdown_connections 2023-11-24T06:31:59.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.789+0000 7ff3bc557640 1 -- 172.21.15.143:0/2912708931 wait complete. 2023-11-24T06:31:59.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol8322 2023-11-24T06:31:59.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.945+0000 7f5a9ebd0640 1 Processor -- start 2023-11-24T06:31:59.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.945+0000 7f5a9ebd0640 1 -- start start 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9ebd0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a980cdb30 0x7f5a9815da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9ebd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdf10 0x7f5a980cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9ebd0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a98161570 0x7f5a98161a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9ebd0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a98161f40 con 0x7f5a98161570 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9ebd0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a98161090 con 0x7f5a980cdb30 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9ebd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9815e010 con 0x7f5a980cdf10 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a98161570 0x7f5a98161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a98161570 0x7f5a98161a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45178/0 (socket says 172.21.15.143:45178) 2023-11-24T06:31:59.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 -- 172.21.15.143:0/1043907932 learned_addr learned my addr 172.21.15.143:0/1043907932 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:59.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9dbce640 1 --2- 172.21.15.143:0/1043907932 >> v2:172.21.15.146:3300/0 conn(0x7f5a980cdb30 0x7f5a9815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9d3cd640 1 --2- 172.21.15.143:0/1043907932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdf10 0x7f5a980cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 -- 172.21.15.143:0/1043907932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdf10 msgr2=0x7f5a980cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:59.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 --2- 172.21.15.143:0/1043907932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdf10 0x7f5a980cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 -- 172.21.15.143:0/1043907932 >> v2:172.21.15.146:3300/0 conn(0x7f5a980cdb30 msgr2=0x7f5a9815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:31:59.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 --2- 172.21.15.143:0/1043907932 >> v2:172.21.15.146:3300/0 conn(0x7f5a980cdb30 0x7f5a9815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.949+0000 7f5a9e3cf640 1 -- 172.21.15.143:0/1043907932 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9815e2f0 con 0x7f5a98161570 2023-11-24T06:31:59.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9e3cf640 1 --2- 172.21.15.143:0/1043907932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a98161570 0x7f5a98161a00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5a980b3d20 tx=0x7f5a9001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc520747098c767 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9cbcc640 1 -- 172.21.15.143:0/1043907932 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a5730 con 0x7f5a98161570 2023-11-24T06:31:59.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9cbcc640 1 -- 172.21.15.143:0/1043907932 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a900a5890 con 0x7f5a98161570 2023-11-24T06:31:59.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9cbcc640 1 -- 172.21.15.143:0/1043907932 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a5c20 con 0x7f5a98161570 2023-11-24T06:31:59.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/1043907932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a98161570 msgr2=0x7f5a98161a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/1043907932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a98161570 0x7f5a98161a00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5a980b3d20 tx=0x7f5a9001c9a0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/1043907932 shutdown_connections 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/1043907932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a98161570 0x7f5a98161a00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/1043907932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdf10 0x7f5a980cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/1043907932 >> v2:172.21.15.146:3300/0 conn(0x7f5a980cdb30 0x7f5a9815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/1043907932 >> 172.21.15.143:0/1043907932 conn(0x7f5a98060fd0 msgr2=0x7f5a980613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/1043907932 shutdown_connections 2023-11-24T06:31:59.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/1043907932 wait complete. 2023-11-24T06:31:59.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 Processor -- start 2023-11-24T06:31:59.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- start start 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdb30 0x7f5a980b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 0x7f5a980c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a98161570 0x7f5a980c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814f2f0 con 0x7f5a980cdf10 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814d210 con 0x7f5a98161570 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.953+0000 7f5a9ebd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814d4f0 con 0x7f5a980cdb30 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 0x7f5a980c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9dbce640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdb30 0x7f5a980b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 0x7f5a980c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45194/0 (socket says 172.21.15.143:45194) 2023-11-24T06:31:59.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 -- 172.21.15.143:0/3794987803 learned_addr learned my addr 172.21.15.143:0/3794987803 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9e3cf640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a98161570 0x7f5a980c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 -- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdb30 msgr2=0x7f5a980b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdb30 0x7f5a980b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 -- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a98161570 msgr2=0x7f5a980c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a98161570 0x7f5a980c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 -- 172.21.15.143:0/3794987803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009b30 con 0x7f5a980cdf10 2023-11-24T06:31:59.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9d3cd640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 0x7f5a980c81a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800d7d0 tx=0x7f5a8800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88018070 con 0x7f5a980cdf10 2023-11-24T06:31:59.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88004020 con 0x7f5a980cdf10 2023-11-24T06:31:59.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880041d0 con 0x7f5a980cdf10 2023-11-24T06:31:59.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9814d7d0 con 0x7f5a980cdf10 2023-11-24T06:31:59.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9814dd90 con 0x7f5a980cdf10 2023-11-24T06:31:59.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9814df50 con 0x7f5a980cdf10 2023-11-24T06:31:59.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.957+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f5a88004330 con 0x7f5a980cdf10 2023-11-24T06:31:59.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.961+0000 7f5a8e7fc640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a7c0666b0 0x7f5a7c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:31:59.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.961+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a88083ff0 con 0x7f5a980cdf10 2023-11-24T06:31:59.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.961+0000 7f5a9dbce640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a7c0666b0 0x7f5a7c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:31:59.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.961+0000 7f5a9dbce640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a7c0666b0 0x7f5a7c068b70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5a9806c220 tx=0x7f5a94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:31:59.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:31:59.965+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a880511d0 con 0x7f5a980cdf10 2023-11-24T06:32:00.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.141+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol8322", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a9804e850 con 0x7f5a7c0666b0 2023-11-24T06:32:00.156 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:00.149+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:00.156 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:00.149+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:00.156 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:00.149+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:00.156 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:00.149+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:00.156 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:00.149+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:00.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a8e7fc640 1 -- 172.21.15.143:0/3794987803 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5a9804e850 con 0x7f5a7c0666b0 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a7c0666b0 msgr2=0x7f5a7c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a7c0666b0 0x7f5a7c068b70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5a9806c220 tx=0x7f5a94008040 comp rx=0 tx=0).stop 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 msgr2=0x7f5a980c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 0x7f5a980c81a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800d7d0 tx=0x7f5a8800dc90 comp rx=0 tx=0).stop 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 shutdown_connections 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5a7c0666b0 0x7f5a7c068b70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a98161570 0x7f5a980c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a980cdf10 0x7f5a980c81a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 --2- 172.21.15.143:0/3794987803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a980cdb30 0x7f5a980b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 >> 172.21.15.143:0/3794987803 conn(0x7f5a98060fd0 msgr2=0x7f5a9815b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:00.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 shutdown_connections 2023-11-24T06:32:00.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.189+0000 7f5a9ebd0640 1 -- 172.21.15.143:0/3794987803 wait complete. 2023-11-24T06:32:00.217 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol8322 subvol_snap3236 2023-11-24T06:32:00.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.357+0000 7f6c39216640 1 Processor -- start 2023-11-24T06:32:00.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.357+0000 7f6c39216640 1 -- start start 2023-11-24T06:32:00.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c39216640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c3415d570 0x7f6c3406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c39216640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c340d14b0 0x7f6c340cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c39216640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340d05b0 con 0x7f6c340d3020 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c39216640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340d0890 con 0x7f6c3415d570 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c39216640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340d0b70 con 0x7f6c340d14b0 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c3415d570 0x7f6c3406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c3415d570 0x7f6c3406bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45232/0 (socket says 172.21.15.143:45232) 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3745632296 learned_addr learned my addr 172.21.15.143:0/3745632296 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c2bfff640 1 --2- 172.21.15.143:0/3745632296 >> v2:172.21.15.146:3300/0 conn(0x7f6c340d14b0 0x7f6c340cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3745632296 >> v2:172.21.15.146:3300/0 conn(0x7f6c340d14b0 msgr2=0x7f6c340cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 --2- 172.21.15.143:0/3745632296 >> v2:172.21.15.146:3300/0 conn(0x7f6c340d14b0 0x7f6c340cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3745632296 >> v1:172.21.15.146:6789/0 conn(0x7f6c340d3020 legacy=0x7f6c340d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3745632296 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340ce2f0 con 0x7f6c3415d570 2023-11-24T06:32:00.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c2bfff640 1 --2- 172.21.15.143:0/3745632296 >> v2:172.21.15.146:3300/0 conn(0x7f6c340d14b0 0x7f6c340cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:00.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c32d9d640 1 --2- 172.21.15.143:0/3745632296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c3415d570 0x7f6c3406bba0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6c340b2e30 tx=0x7f6c2401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848368758c72a5ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:00.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c3259c640 1 -- 172.21.15.143:0/3745632296 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab600 con 0x7f6c3415d570 2023-11-24T06:32:00.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.361+0000 7f6c3259c640 1 -- 172.21.15.143:0/3745632296 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240a7050 con 0x7f6c3415d570 2023-11-24T06:32:00.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c3259c640 1 -- 172.21.15.143:0/3745632296 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab980 con 0x7f6c3415d570 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- 172.21.15.143:0/3745632296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c3415d570 msgr2=0x7f6c3406bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 --2- 172.21.15.143:0/3745632296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c3415d570 0x7f6c3406bba0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6c340b2e30 tx=0x7f6c2401c440 comp rx=0 tx=0).stop 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- 172.21.15.143:0/3745632296 shutdown_connections 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 --2- 172.21.15.143:0/3745632296 >> v2:172.21.15.146:3300/0 conn(0x7f6c340d14b0 0x7f6c340cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 --2- 172.21.15.143:0/3745632296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c3415d570 0x7f6c3406bba0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- 172.21.15.143:0/3745632296 >> 172.21.15.143:0/3745632296 conn(0x7f6c3408ceb0 msgr2=0x7f6c3409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:00.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- 172.21.15.143:0/3745632296 shutdown_connections 2023-11-24T06:32:00.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- 172.21.15.143:0/3745632296 wait complete. 2023-11-24T06:32:00.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 Processor -- start 2023-11-24T06:32:00.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- start start 2023-11-24T06:32:00.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 0x7f6c34160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c340d3020 0x7f6c34159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c3415d570 0x7f6c340b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341618b0 con 0x7f6c340d14b0 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34160ca0 con 0x7f6c340d3020 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c39216640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34160f80 con 0x7f6c3415d570 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c32d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 0x7f6c34160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c32d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 0x7f6c34160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45246/0 (socket says 172.21.15.143:45246) 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3660967091 learned_addr learned my addr 172.21.15.143:0/3660967091 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c2bfff640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c340d3020 0x7f6c34159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.365+0000 7f6c3359e640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c3415d570 0x7f6c340b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c3415d570 msgr2=0x7f6c340b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c32d9d640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c3415d570 0x7f6c340b81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c340d3020 msgr2=0x7f6c34159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c32d9d640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c340d3020 0x7f6c34159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c32d9d640 1 -- 172.21.15.143:0/3660967091 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240094d0 con 0x7f6c340d14b0 2023-11-24T06:32:00.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c32d9d640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 0x7f6c34160630 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6c240ae040 tx=0x7f6c2401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b6620 con 0x7f6c340d14b0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240abe90 con 0x7f6c340d14b0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b69e0 con 0x7f6c340d14b0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34161260 con 0x7f6c340d14b0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c34159690 con 0x7f6c340d14b0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34067520 con 0x7f6c340d14b0 2023-11-24T06:32:00.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.369+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f6c240b2040 con 0x7f6c340d14b0 2023-11-24T06:32:00.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.373+0000 7f6c2b7fe640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c140666b0 0x7f6c14068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.373+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c2411e670 con 0x7f6c340d14b0 2023-11-24T06:32:00.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.373+0000 7f6c2bfff640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c140666b0 0x7f6c14068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.373+0000 7f6c2bfff640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c140666b0 0x7f6c14068b70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c340b9320 tx=0x7f6c1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:00.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.377+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c240eb7f0 con 0x7f6c340d14b0 2023-11-24T06:32:00.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.553+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol8322", "snap_name": "subvol_snap3236", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c3409cd70 con 0x7f6c140666b0 2023-11-24T06:32:00.574 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c2b7fe640 1 -- 172.21.15.143:0/3660967091 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6c3409cd70 con 0x7f6c140666b0 2023-11-24T06:32:00.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c140666b0 msgr2=0x7f6c14068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c140666b0 0x7f6c14068b70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c340b9320 tx=0x7f6c1c008040 comp rx=0 tx=0).stop 2023-11-24T06:32:00.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 msgr2=0x7f6c34160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 0x7f6c34160630 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6c240ae040 tx=0x7f6c2401ac80 comp rx=0 tx=0).stop 2023-11-24T06:32:00.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 shutdown_connections 2023-11-24T06:32:00.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6c140666b0 0x7f6c14068b70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c3415d570 0x7f6c340b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c340d3020 0x7f6c34159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 --2- 172.21.15.143:0/3660967091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c340d14b0 0x7f6c34160630 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 >> 172.21.15.143:0/3660967091 conn(0x7f6c3408ceb0 msgr2=0x7f6c340b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:00.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 shutdown_connections 2023-11-24T06:32:00.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.569+0000 7f6c39216640 1 -- 172.21.15.143:0/3660967091 wait complete. 2023-11-24T06:32:00.596 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol8322 subvol_snap3236 2023-11-24T06:32:00.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 Processor -- start 2023-11-24T06:32:00.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 -- start start 2023-11-24T06:32:00.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48c4070da0 0x7f48c415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c415a700 con 0x7f48c40b36c0 2023-11-24T06:32:00.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40b2430 con 0x7f48c4070da0 2023-11-24T06:32:00.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cc7b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40b2620 con 0x7f48c415a320 2023-11-24T06:32:00.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48ca554640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cad55640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48c4070da0 0x7f48c415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48c9d53640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48c40b36c0 0x7f48c4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:38544/0 (socket says 172.21.15.143:38544) 2023-11-24T06:32:00.741 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48c9d53640 1 -- 172.21.15.143:0/175228906 learned_addr learned my addr 172.21.15.143:0/175228906 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:00.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48ca554640 1 -- 172.21.15.143:0/175228906 >> v2:172.21.15.146:3300/0 conn(0x7f48c4070da0 msgr2=0x7f48c415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:00.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48ca554640 1 --2- 172.21.15.143:0/175228906 >> v2:172.21.15.146:3300/0 conn(0x7f48c4070da0 0x7f48c415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48ca554640 1 -- 172.21.15.143:0/175228906 >> v1:172.21.15.146:6789/0 conn(0x7f48c40b36c0 legacy=0x7f48c4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48ca554640 1 -- 172.21.15.143:0/175228906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40b2900 con 0x7f48c415a320 2023-11-24T06:32:00.743 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48cad55640 1 --2- 172.21.15.143:0/175228906 >> v2:172.21.15.146:3300/0 conn(0x7f48c4070da0 0x7f48c415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:00.743 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.733+0000 7f48c9552640 1 -- 172.21.15.143:0/175228906 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177971812 0 0) 0x7f48c415a700 con 0x7f48c40b36c0 2023-11-24T06:32:00.743 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48ca554640 1 --2- 172.21.15.143:0/175228906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c40b1ef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48c000ba60 tx=0x7f48c001eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb3e82bbbcfb1daa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:00.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48c9552640 1 -- 172.21.15.143:0/175228906 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00a7b00 con 0x7f48c415a320 2023-11-24T06:32:00.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48c9552640 1 -- 172.21.15.143:0/175228906 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c00a7c60 con 0x7f48c415a320 2023-11-24T06:32:00.744 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48c9552640 1 -- 172.21.15.143:0/175228906 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00af440 con 0x7f48c415a320 2023-11-24T06:32:00.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 -- 172.21.15.143:0/175228906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 msgr2=0x7f48c40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/175228906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c40b1ef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48c000ba60 tx=0x7f48c001eb20 comp rx=0 tx=0).stop 2023-11-24T06:32:00.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 -- 172.21.15.143:0/175228906 shutdown_connections 2023-11-24T06:32:00.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/175228906 >> v2:172.21.15.146:3300/0 conn(0x7f48c4070da0 0x7f48c415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/175228906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c40b1ef0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 -- 172.21.15.143:0/175228906 >> 172.21.15.143:0/175228906 conn(0x7f48c40b0bf0 msgr2=0x7f48c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:00.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 -- 172.21.15.143:0/175228906 shutdown_connections 2023-11-24T06:32:00.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.737+0000 7f48cc7b8640 1 -- 172.21.15.143:0/175228906 wait complete. 2023-11-24T06:32:00.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 Processor -- start 2023-11-24T06:32:00.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 -- start start 2023-11-24T06:32:00.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 0x7f48c40aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c40b36c0 0x7f48c4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4147410 con 0x7f48c4070da0 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4156840 con 0x7f48c40b36c0 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415a8a0 con 0x7f48c415a320 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 0x7f48c40aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 0x7f48c40aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45262/0 (socket says 172.21.15.143:45262) 2023-11-24T06:32:00.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 -- 172.21.15.143:0/2572656604 learned_addr learned my addr 172.21.15.143:0/2572656604 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:00.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cad55640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48c9d53640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c40b36c0 0x7f48c4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 -- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 msgr2=0x7f48c4146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c4146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 -- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c40b36c0 msgr2=0x7f48c4146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c40b36c0 0x7f48c4146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 -- 172.21.15.143:0/2572656604 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc009a70 con 0x7f48c4070da0 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48ca554640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 0x7f48c40aff40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f48c001c750 tx=0x7f48c001b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00b9600 con 0x7f48c4070da0 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c00b9780 con 0x7f48c4070da0 2023-11-24T06:32:00.752 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c000b6c0 con 0x7f48c4070da0 2023-11-24T06:32:00.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00b9b30 con 0x7f48c4070da0 2023-11-24T06:32:00.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.741+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c415ae60 con 0x7f48c4070da0 2023-11-24T06:32:00.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.745+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c4067520 con 0x7f48c4070da0 2023-11-24T06:32:00.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.745+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 8) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f48c00b9c90 con 0x7f48c4070da0 2023-11-24T06:32:00.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.745+0000 7f48baffd640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f48a80666b0 0x7f48a8068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:00.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.745+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48c0121a00 con 0x7f48c4070da0 2023-11-24T06:32:00.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.745+0000 7f48c9d53640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f48a80666b0 0x7f48a8068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:00.754 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.745+0000 7f48c9d53640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f48a80666b0 0x7f48a8068b70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f48c406e800 tx=0x7f48b4007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:00.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.749+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48c00eece0 con 0x7f48c4070da0 2023-11-24T06:32:00.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.925+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol8322", "snap_name": "subvol_snap3236", "target": ["mon-mgr", ""]}) v1 -- 0x7f48c406b670 con 0x7f48a80666b0 2023-11-24T06:32:00.956 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.949+0000 7f48baffd640 1 -- 172.21.15.143:0/2572656604 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f48c406b670 con 0x7f48a80666b0 2023-11-24T06:32:00.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f48a80666b0 msgr2=0x7f48a8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f48a80666b0 0x7f48a8068b70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f48c406e800 tx=0x7f48b4007d60 comp rx=0 tx=0).stop 2023-11-24T06:32:00.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 msgr2=0x7f48c40aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:00.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 0x7f48c40aff40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f48c001c750 tx=0x7f48c001b8c0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 shutdown_connections 2023-11-24T06:32:00.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f48a80666b0 0x7f48a8068b70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48c415a320 0x7f48c4146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c40b36c0 0x7f48c4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 --2- 172.21.15.143:0/2572656604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48c4070da0 0x7f48c40aff40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:00.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 >> 172.21.15.143:0/2572656604 conn(0x7f48c40b0bf0 msgr2=0x7f48c40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:00.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 shutdown_connections 2023-11-24T06:32:00.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:00.953+0000 7f48cc7b8640 1 -- 172.21.15.143:0/2572656604 wait complete. 2023-11-24T06:32:00.977 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol8322 subvol_snap3236 2023-11-24T06:32:01.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d77479640 1 Processor -- start 2023-11-24T06:32:01.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d77479640 1 -- start start 2023-11-24T06:32:01.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d77479640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d70070ec0 0x7f1d7016c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d77479640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7006dc20 con 0x7f1d70158a50 2023-11-24T06:32:01.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d77479640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7006cd60 con 0x7f1d7006e340 2023-11-24T06:32:01.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d77479640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7006e0b0 con 0x7f1d70070ec0 2023-11-24T06:32:01.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d75215640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1d70158a50 0x7f1d7006c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33628/0 (socket says 172.21.15.143:33628) 2023-11-24T06:32:01.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d75215640 1 -- 172.21.15.143:0/2054837812 learned_addr learned my addr 172.21.15.143:0/2054837812 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:01.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d75a16640 1 --2- 172.21.15.143:0/2054837812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d70070ec0 0x7f1d7016c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d67fff640 1 -- 172.21.15.143:0/2054837812 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75986736 0 0) 0x7f1d7006dc20 con 0x7f1d70158a50 2023-11-24T06:32:01.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d67fff640 1 -- 172.21.15.143:0/2054837812 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5c003530 con 0x7f1d70158a50 2023-11-24T06:32:01.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d67fff640 1 -- 172.21.15.143:0/2054837812 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608662414 0 0) 0x7f1d7006cd60 con 0x7f1d7006e340 2023-11-24T06:32:01.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d75a16640 1 -- 172.21.15.143:0/2054837812 >> v1:172.21.15.146:6789/0 conn(0x7f1d7006e340 legacy=0x7f1d700707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d75a16640 1 -- 172.21.15.143:0/2054837812 >> v1:172.21.15.143:6789/0 conn(0x7f1d70158a50 legacy=0x7f1d7006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.117+0000 7f1d75a16640 1 -- 172.21.15.143:0/2054837812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700b3620 con 0x7f1d70070ec0 2023-11-24T06:32:01.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d75a16640 1 --2- 172.21.15.143:0/2054837812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d70070ec0 0x7f1d7016c6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009dc0 tx=0x7f1d6801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec8e42cd2d7bc7c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:01.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d67fff640 1 -- 172.21.15.143:0/2054837812 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680a5a00 con 0x7f1d70070ec0 2023-11-24T06:32:01.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d67fff640 1 -- 172.21.15.143:0/2054837812 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680a5b60 con 0x7f1d70070ec0 2023-11-24T06:32:01.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d67fff640 1 -- 172.21.15.143:0/2054837812 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680ad440 con 0x7f1d70070ec0 2023-11-24T06:32:01.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 -- 172.21.15.143:0/2054837812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d70070ec0 msgr2=0x7f1d7016c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 --2- 172.21.15.143:0/2054837812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d70070ec0 0x7f1d7016c6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009dc0 tx=0x7f1d6801c940 comp rx=0 tx=0).stop 2023-11-24T06:32:01.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 -- 172.21.15.143:0/2054837812 shutdown_connections 2023-11-24T06:32:01.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 --2- 172.21.15.143:0/2054837812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d70070ec0 0x7f1d7016c6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 -- 172.21.15.143:0/2054837812 >> 172.21.15.143:0/2054837812 conn(0x7f1d700b0bf0 msgr2=0x7f1d700b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:01.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 -- 172.21.15.143:0/2054837812 shutdown_connections 2023-11-24T06:32:01.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.121+0000 7f1d77479640 1 -- 172.21.15.143:0/2054837812 wait complete. 2023-11-24T06:32:01.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 Processor -- start 2023-11-24T06:32:01.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 -- start start 2023-11-24T06:32:01.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d7006e340 0x7f1d700cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d70070ec0 0x7f1d70150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d70158a50 0x7f1d700cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7015d750 con 0x7f1d70158a50 2023-11-24T06:32:01.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700ae340 con 0x7f1d70070ec0 2023-11-24T06:32:01.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7015dfd0 con 0x7f1d7006e340 2023-11-24T06:32:01.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d70158a50 0x7f1d700cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d70158a50 0x7f1d700cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45272/0 (socket says 172.21.15.143:45272) 2023-11-24T06:32:01.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 -- 172.21.15.143:0/894045983 learned_addr learned my addr 172.21.15.143:0/894045983 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d74a14640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d70070ec0 0x7f1d70150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75215640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d7006e340 0x7f1d700cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 -- 172.21.15.143:0/894045983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d7006e340 msgr2=0x7f1d700cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d7006e340 0x7f1d700cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 -- 172.21.15.143:0/894045983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d70070ec0 msgr2=0x7f1d70150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d70070ec0 0x7f1d70150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 -- 172.21.15.143:0/894045983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009a70 con 0x7f1d70158a50 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d75a16640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d70158a50 0x7f1d700cc8c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1d68098520 tx=0x7f1d680196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:01.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680adcd0 con 0x7f1d70158a50 2023-11-24T06:32:01.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680ade30 con 0x7f1d70158a50 2023-11-24T06:32:01.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680b9670 con 0x7f1d70158a50 2023-11-24T06:32:01.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 -- 172.21.15.143:0/894045983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d70151430 con 0x7f1d70158a50 2023-11-24T06:32:01.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.125+0000 7f1d77479640 1 -- 172.21.15.143:0/894045983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7015d980 con 0x7f1d70158a50 2023-11-24T06:32:01.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.129+0000 7f1d77479640 1 -- 172.21.15.143:0/894045983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7015e160 con 0x7f1d70158a50 2023-11-24T06:32:01.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.129+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 9) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f1d680b97d0 con 0x7f1d70158a50 2023-11-24T06:32:01.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.129+0000 7f1d65ffb640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d54066740 0x7f1d54068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.129+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d6811f8a0 con 0x7f1d70158a50 2023-11-24T06:32:01.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.129+0000 7f1d75215640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d54066740 0x7f1d54068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.129+0000 7f1d75215640 1 --2- 172.21.15.143:0/894045983 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d54066740 0x7f1d54068c00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c007fd0 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:01.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.133+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d680ecad0 con 0x7f1d70158a50 2023-11-24T06:32:01.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.313+0000 7f1d77479640 1 -- 172.21.15.143:0/894045983 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol8322", "snap_name": "subvol_snap3236", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d7006d8b0 con 0x7f1d54066740 2023-11-24T06:32:01.334 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.329+0000 7f509801b640 -1 mgr.server reply reply (2) No such file or directory snapshot 'b'subvol_snap3236'' does not exist 2023-11-24T06:32:01.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.329+0000 7f1d65ffb640 1 -- 172.21.15.143:0/894045983 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: -2 snapshot 'b'subvol_snap3236'' does not exist) v1 ==== 52+0+0 (secure 0 0 0) 0x7f1d6c001520 con 0x7f1d54066740 2023-11-24T06:32:01.334 INFO:teuthology.orchestra.run.smithi143.stderr:Error ENOENT: snapshot 'b'subvol_snap3236'' does not exist 2023-11-24T06:32:01.343 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-24T06:32:01.344 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol8322 2023-11-24T06:32:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.477+0000 7f27267e7640 1 Processor -- start 2023-11-24T06:32:01.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.477+0000 7f27267e7640 1 -- start start 2023-11-24T06:32:01.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f27267e7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f272015d630 0x7f27200cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f27267e7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27200ce200 0x7f27200cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f27267e7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272006c620 con 0x7f27200cf300 2023-11-24T06:32:01.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f27267e7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200cf790 con 0x7f272015d630 2023-11-24T06:32:01.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f27267e7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200cbd80 con 0x7f27200ce200 2023-11-24T06:32:01.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f272015d630 0x7f27200cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f272015d630 0x7f27200cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45282/0 (socket says 172.21.15.143:45282) 2023-11-24T06:32:01.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 -- 172.21.15.143:0/2777889670 learned_addr learned my addr 172.21.15.143:0/2777889670 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:01.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271f7fe640 1 --2- 172.21.15.143:0/2777889670 >> v2:172.21.15.146:3300/0 conn(0x7f27200ce200 0x7f27200cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 -- 172.21.15.143:0/2777889670 >> v2:172.21.15.146:3300/0 conn(0x7f27200ce200 msgr2=0x7f27200cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:01.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 --2- 172.21.15.143:0/2777889670 >> v2:172.21.15.146:3300/0 conn(0x7f27200ce200 0x7f27200cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 -- 172.21.15.143:0/2777889670 >> v1:172.21.15.146:6789/0 conn(0x7f27200cf300 legacy=0x7f272006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:01.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271ffff640 1 -- 172.21.15.143:0/2777889670 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272006ba10 con 0x7f272015d630 2023-11-24T06:32:01.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.481+0000 7f271f7fe640 1 --2- 172.21.15.143:0/2777889670 >> v2:172.21.15.146:3300/0 conn(0x7f27200ce200 0x7f27200cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:01.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f271ffff640 1 --2- 172.21.15.143:0/2777889670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27200cb840 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f272006e1d0 tx=0x7f271001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a463e4ba22ee0194 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:01.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f271effd640 1 -- 172.21.15.143:0/2777889670 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100aa430 con 0x7f272015d630 2023-11-24T06:32:01.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f271effd640 1 -- 172.21.15.143:0/2777889670 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100aa590 con 0x7f272015d630 2023-11-24T06:32:01.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f271effd640 1 -- 172.21.15.143:0/2777889670 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100aa920 con 0x7f272015d630 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 -- 172.21.15.143:0/2777889670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 msgr2=0x7f27200cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 --2- 172.21.15.143:0/2777889670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27200cb840 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f272006e1d0 tx=0x7f271001c4d0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 -- 172.21.15.143:0/2777889670 shutdown_connections 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 --2- 172.21.15.143:0/2777889670 >> v2:172.21.15.146:3300/0 conn(0x7f27200ce200 0x7f27200cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 --2- 172.21.15.143:0/2777889670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27200cb840 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 -- 172.21.15.143:0/2777889670 >> 172.21.15.143:0/2777889670 conn(0x7f272006e860 msgr2=0x7f272006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:01.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 -- 172.21.15.143:0/2777889670 shutdown_connections 2023-11-24T06:32:01.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 -- 172.21.15.143:0/2777889670 wait complete. 2023-11-24T06:32:01.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 Processor -- start 2023-11-24T06:32:01.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.485+0000 7f27267e7640 1 -- start start 2023-11-24T06:32:01.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200ce200 0x7f27200b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27200cf300 0x7f27200c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27201f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720159200 con 0x7f272015d630 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200c9e80 con 0x7f27200cf300 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200ca160 con 0x7f27200ce200 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27201f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27201f94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45286/0 (socket says 172.21.15.143:45286) 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 -- 172.21.15.143:0/3985275601 learned_addr learned my addr 172.21.15.143:0/3985275601 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271ffff640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200ce200 0x7f27200b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271f7fe640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27200cf300 0x7f27200c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 -- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200ce200 msgr2=0x7f27200b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200ce200 0x7f27200b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 -- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27200cf300 msgr2=0x7f27200c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27200cf300 0x7f27200c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 -- 172.21.15.143:0/3985275601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094d0 con 0x7f272015d630 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271f7fe640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27200cf300 0x7f27200c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f2724d84640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27201f94b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f271800c770 tx=0x7f271800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718003b80 con 0x7f272015d630 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718003ce0 con 0x7f272015d630 2023-11-24T06:32:01.499 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2720159450 con 0x7f272015d630 2023-11-24T06:32:01.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800aa90 con 0x7f272015d630 2023-11-24T06:32:01.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27200b2aa0 con 0x7f272015d630 2023-11-24T06:32:01.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272004e8c0 con 0x7f272015d630 2023-11-24T06:32:01.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.489+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 9) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f271800abf0 con 0x7f272015d630 2023-11-24T06:32:01.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.493+0000 7f271cff9640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f270c066770 0x7f270c068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:01.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.493+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2718083f90 con 0x7f272015d630 2023-11-24T06:32:01.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.493+0000 7f271ffff640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f270c066770 0x7f270c068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:01.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.493+0000 7f271ffff640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f270c066770 0x7f270c068c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae000 tx=0x7f27100b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:01.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.497+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2718051150 con 0x7f272015d630 2023-11-24T06:32:01.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.669+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol8322", "target": ["mon-mgr", ""]}) v1 -- 0x7f272006b6c0 con 0x7f270c066770 2023-11-24T06:32:01.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.685+0000 7f271cff9640 1 -- 172.21.15.143:0/3985275601 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f27100aa960 con 0x7f270c066770 2023-11-24T06:32:01.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f270c066770 msgr2=0x7f270c068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f270c066770 0x7f270c068c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae000 tx=0x7f27100b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:01.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 msgr2=0x7f27201f94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:01.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27201f94b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f271800c770 tx=0x7f271800cc30 comp rx=0 tx=0).stop 2023-11-24T06:32:01.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 shutdown_connections 2023-11-24T06:32:01.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f270c066770 0x7f270c068c30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f272015d630 0x7f27201f94b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27200cf300 0x7f27200c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 --2- 172.21.15.143:0/3985275601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200ce200 0x7f27200b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:01.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 >> 172.21.15.143:0/3985275601 conn(0x7f272006e860 msgr2=0x7f272015e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:01.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 shutdown_connections 2023-11-24T06:32:01.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:01.689+0000 7f27267e7640 1 -- 172.21.15.143:0/3985275601 wait complete. 2023-11-24T06:32:01.699 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.693+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.699 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.693+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.700 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.693+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.700 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.693+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.700 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.693+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.713 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.709+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.713 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.709+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.714 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.709+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.714 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.709+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.714 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:01.709+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:01.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:01.720 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T06:32:01.736 INFO:teuthology.orchestra.run.smithi143.stdout:2 2023-11-24T06:32:01.739 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:32:01.739 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:01.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:01.966 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:32:01.966 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:01.966 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:01.977 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:01.977 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:02.025 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:02.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 Processor -- start 2023-11-24T06:32:02.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 -- start start 2023-11-24T06:32:02.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a94160be0 0x7f6a9415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6a940b37b0 0x7f6a940b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9415e660 con 0x7f6a9415db40 2023-11-24T06:32:02.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9406c650 con 0x7f6a940b37b0 2023-11-24T06:32:02.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9b901640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a940b4180 con 0x7f6a94160be0 2023-11-24T06:32:02.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a98e9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6a940b37b0 0x7f6a940b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a99e9e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6a9415db40 0x7f6a9415df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33642/0 (socket says 172.21.15.143:33642) 2023-11-24T06:32:02.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a99e9e640 1 -- 172.21.15.143:0/1276429667 learned_addr learned my addr 172.21.15.143:0/1276429667 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:02.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.201+0000 7f6a9969d640 1 --2- 172.21.15.143:0/1276429667 >> v2:172.21.15.146:3300/0 conn(0x7f6a94160be0 0x7f6a9415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a98e9c640 1 -- 172.21.15.143:0/1276429667 >> v2:172.21.15.146:3300/0 conn(0x7f6a94160be0 msgr2=0x7f6a9415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:02.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a98e9c640 1 --2- 172.21.15.143:0/1276429667 >> v2:172.21.15.146:3300/0 conn(0x7f6a94160be0 0x7f6a9415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a98e9c640 1 -- 172.21.15.143:0/1276429667 >> v1:172.21.15.143:6789/0 conn(0x7f6a9415db40 legacy=0x7f6a9415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a8bfff640 1 -- 172.21.15.143:0/1276429667 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594352498 0 0) 0x7f6a9415e660 con 0x7f6a9415db40 2023-11-24T06:32:02.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a98e9c640 1 -- 172.21.15.143:0/1276429667 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9415e900 con 0x7f6a940b37b0 2023-11-24T06:32:02.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a98e9c640 1 --2- 172.21.15.143:0/1276429667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a940b37b0 0x7f6a940b3c40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6a9406b600 tx=0x7f6a8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485e203995b40df3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a8bfff640 1 -- 172.21.15.143:0/1276429667 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840a7070 con 0x7f6a940b37b0 2023-11-24T06:32:02.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a8bfff640 1 -- 172.21.15.143:0/1276429667 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a840ab430 con 0x7f6a940b37b0 2023-11-24T06:32:02.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a8bfff640 1 -- 172.21.15.143:0/1276429667 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840ab7c0 con 0x7f6a940b37b0 2023-11-24T06:32:02.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a9b901640 1 -- 172.21.15.143:0/1276429667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a940b37b0 msgr2=0x7f6a940b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a9b901640 1 --2- 172.21.15.143:0/1276429667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a940b37b0 0x7f6a940b3c40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6a9406b600 tx=0x7f6a8401c430 comp rx=0 tx=0).stop 2023-11-24T06:32:02.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a9b901640 1 -- 172.21.15.143:0/1276429667 shutdown_connections 2023-11-24T06:32:02.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a9b901640 1 --2- 172.21.15.143:0/1276429667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a940b37b0 0x7f6a940b3c40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a9b901640 1 --2- 172.21.15.143:0/1276429667 >> v2:172.21.15.146:3300/0 conn(0x7f6a94160be0 0x7f6a9415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.205+0000 7f6a9b901640 1 -- 172.21.15.143:0/1276429667 >> 172.21.15.143:0/1276429667 conn(0x7f6a940b0bf0 msgr2=0x7f6a940b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:02.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- 172.21.15.143:0/1276429667 shutdown_connections 2023-11-24T06:32:02.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- 172.21.15.143:0/1276429667 wait complete. 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 Processor -- start 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- start start 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940b37b0 0x7f6a9415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 0x7f6a940999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a94160be0 0x7f6a94099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9413d560 con 0x7f6a9415db40 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9415a200 con 0x7f6a940b37b0 2023-11-24T06:32:02.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941595f0 con 0x7f6a94160be0 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 0x7f6a940999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 0x7f6a940999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45340/0 (socket says 172.21.15.143:45340) 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 -- 172.21.15.143:0/4278616522 learned_addr learned my addr 172.21.15.143:0/4278616522 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9969d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940b37b0 0x7f6a9415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a99e9e640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a94160be0 0x7f6a94099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 -- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a94160be0 msgr2=0x7f6a94099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a94160be0 0x7f6a94099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 -- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940b37b0 msgr2=0x7f6a9415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940b37b0 0x7f6a9415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 -- 172.21.15.143:0/4278616522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009420 con 0x7f6a9415db40 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a99e9e640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a94160be0 0x7f6a94099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:02.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a98e9c640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 0x7f6a940999e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6a84019040 tx=0x7f6a8401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840b5610 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a840b5790 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a941598d0 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.209+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840b5b40 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a94159e90 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a94067520 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 9) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f6a840b5ca0 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a89ffb640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a78066740 0x7f6a78068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a8411ee30 con 0x7f6a9415db40 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a9969d640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a78066740 0x7f6a78068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.213+0000 7f6a9969d640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a78066740 0x7f6a78068c00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009ac0 tx=0x7f6a90009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.217+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a840ebec0 con 0x7f6a9415db40 2023-11-24T06:32:02.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.365+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a9415efe0 con 0x7f6a9415db40 2023-11-24T06:32:02.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a89ffb640 1 -- 172.21.15.143:0/4278616522 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f6a840ef4e0 con 0x7f6a9415db40 2023-11-24T06:32:02.374 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:02.374 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":59,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:51.000119+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:02.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a78066740 msgr2=0x7f6a78068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a78066740 0x7f6a78068c00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009ac0 tx=0x7f6a90009190 comp rx=0 tx=0).stop 2023-11-24T06:32:02.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 msgr2=0x7f6a940999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 0x7f6a940999e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6a84019040 tx=0x7f6a8401ac70 comp rx=0 tx=0).stop 2023-11-24T06:32:02.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 shutdown_connections 2023-11-24T06:32:02.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a78066740 0x7f6a78068c00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a94160be0 0x7f6a94099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a9415db40 0x7f6a940999e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 --2- 172.21.15.143:0/4278616522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940b37b0 0x7f6a9415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 >> 172.21.15.143:0/4278616522 conn(0x7f6a940b0bf0 msgr2=0x7f6a9415cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:02.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 shutdown_connections 2023-11-24T06:32:02.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.369+0000 7f6a9b901640 1 -- 172.21.15.143:0/4278616522 wait complete. 2023-11-24T06:32:02.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:31:47.711527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:31:48.345537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:02.396 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:02.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 Processor -- start 2023-11-24T06:32:02.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 -- start start 2023-11-24T06:32:02.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce415da40 0x7f2ce415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ce406c5a0 0x7f2ce406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce415e4e0 con 0x7f2ce41543f0 2023-11-24T06:32:02.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40b44b0 con 0x7f2ce406c5a0 2023-11-24T06:32:02.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.529+0000 7f2ce9565640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b20e0 con 0x7f2ce415da40 2023-11-24T06:32:02.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce37fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ce406c5a0 0x7f2ce406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce2ffd640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ce41543f0 0x7f2ce40cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:38568/0 (socket says 172.21.15.143:38568) 2023-11-24T06:32:02.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2cdbfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce415da40 0x7f2ce415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce2ffd640 1 -- 172.21.15.143:0/724795222 learned_addr learned my addr 172.21.15.143:0/724795222 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:02.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce37fe640 1 -- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce415da40 msgr2=0x7f2ce415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:02.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce37fe640 1 --2- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce415da40 0x7f2ce415dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce37fe640 1 -- 172.21.15.143:0/724795222 >> v1:172.21.15.146:6789/0 conn(0x7f2ce41543f0 legacy=0x7f2ce40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce37fe640 1 -- 172.21.15.143:0/724795222 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce415e7c0 con 0x7f2ce406c5a0 2023-11-24T06:32:02.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce27fc640 1 -- 172.21.15.143:0/724795222 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268503659 0 0) 0x7f2ce415e4e0 con 0x7f2ce41543f0 2023-11-24T06:32:02.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.533+0000 7f2ce37fe640 1 --2- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce406c5a0 0x7f2ce406ca10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40b2220 tx=0x7f2cdc01f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c265fb566134225 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce27fc640 1 -- 172.21.15.143:0/724795222 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0af600 con 0x7f2ce406c5a0 2023-11-24T06:32:02.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce27fc640 1 -- 172.21.15.143:0/724795222 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0ab050 con 0x7f2ce406c5a0 2023-11-24T06:32:02.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce27fc640 1 -- 172.21.15.143:0/724795222 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0af980 con 0x7f2ce406c5a0 2023-11-24T06:32:02.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce406c5a0 msgr2=0x7f2ce406ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 --2- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce406c5a0 0x7f2ce406ca10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40b2220 tx=0x7f2cdc01f110 comp rx=0 tx=0).stop 2023-11-24T06:32:02.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- 172.21.15.143:0/724795222 shutdown_connections 2023-11-24T06:32:02.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 --2- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce406c5a0 0x7f2ce406ca10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 --2- 172.21.15.143:0/724795222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce415da40 0x7f2ce415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- 172.21.15.143:0/724795222 >> 172.21.15.143:0/724795222 conn(0x7f2ce406dcc0 msgr2=0x7f2ce406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:02.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- 172.21.15.143:0/724795222 shutdown_connections 2023-11-24T06:32:02.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- 172.21.15.143:0/724795222 wait complete. 2023-11-24T06:32:02.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 Processor -- start 2023-11-24T06:32:02.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- start start 2023-11-24T06:32:02.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce406c5a0 0x7f2ce41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 0x7f2ce4152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce415da40 0x7f2ce415c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce415d890 con 0x7f2ce41543f0 2023-11-24T06:32:02.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4158120 con 0x7f2ce415da40 2023-11-24T06:32:02.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce9565640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce41558e0 con 0x7f2ce406c5a0 2023-11-24T06:32:02.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2cdbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 0x7f2ce4152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce406c5a0 0x7f2ce41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2cdbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 0x7f2ce4152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45356/0 (socket says 172.21.15.143:45356) 2023-11-24T06:32:02.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.537+0000 7f2cdbfff640 1 -- 172.21.15.143:0/4118608371 learned_addr learned my addr 172.21.15.143:0/4118608371 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:02.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2ce37fe640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce415da40 0x7f2ce415c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdbfff640 1 -- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce406c5a0 msgr2=0x7f2ce41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdbfff640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce406c5a0 0x7f2ce41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdbfff640 1 -- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce415da40 msgr2=0x7f2ce415c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdbfff640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce415da40 0x7f2ce415c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdbfff640 1 -- 172.21.15.143:0/4118608371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc009a70 con 0x7f2ce41543f0 2023-11-24T06:32:02.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdbfff640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 0x7f2ce4152e70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00e8a0 tx=0x7f2ccc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc009510 con 0x7f2ce41543f0 2023-11-24T06:32:02.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc00c940 con 0x7f2ce41543f0 2023-11-24T06:32:02.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce4155bc0 con 0x7f2ce41543f0 2023-11-24T06:32:02.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00ccb0 con 0x7f2ce41543f0 2023-11-24T06:32:02.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce4156180 con 0x7f2ce41543f0 2023-11-24T06:32:02.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce404e850 con 0x7f2ce41543f0 2023-11-24T06:32:02.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 9) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f2ccc013470 con 0x7f2ce41543f0 2023-11-24T06:32:02.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.541+0000 7f2cdb7fe640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2cc4066740 0x7f2cc4068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.545+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ccc084380 con 0x7f2ce41543f0 2023-11-24T06:32:02.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.545+0000 7f2ce2ffd640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2cc4066740 0x7f2cc4068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.545+0000 7f2ce2ffd640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2cc4066740 0x7f2cc4068c00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4007fd0 tx=0x7f2cd4007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.549+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ccc051520 con 0x7f2ce41543f0 2023-11-24T06:32:02.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ce41582b0 con 0x7f2ce41543f0 2023-11-24T06:32:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2cdb7fe640 1 -- 172.21.15.143:0/4118608371 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ccc054b40 con 0x7f2ce41543f0 2023-11-24T06:32:02.703 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2cc4066740 msgr2=0x7f2cc4068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2cc4066740 0x7f2cc4068c00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4007fd0 tx=0x7f2cd4007d60 comp rx=0 tx=0).stop 2023-11-24T06:32:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 msgr2=0x7f2ce4152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 0x7f2ce4152e70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00e8a0 tx=0x7f2ccc00eca0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 shutdown_connections 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2cc4066740 0x7f2cc4068c00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce415da40 0x7f2ce415c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ce41543f0 0x7f2ce4152e70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 --2- 172.21.15.143:0/4118608371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce406c5a0 0x7f2ce41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 >> 172.21.15.143:0/4118608371 conn(0x7f2ce406dcc0 msgr2=0x7f2ce40ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 shutdown_connections 2023-11-24T06:32:02.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.697+0000 7f2ce9565640 1 -- 172.21.15.143:0/4118608371 wait complete. 2023-11-24T06:32:02.724 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:32:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.857+0000 7f9f2aad6640 1 Processor -- start 2023-11-24T06:32:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.857+0000 7f9f2aad6640 1 -- start start 2023-11-24T06:32:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f2aad6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9f2415a290 0x7f9f240707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f2aad6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f24071170 con 0x7f9f240b1f80 2023-11-24T06:32:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f2aad6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240cb690 con 0x7f9f2415ec60 2023-11-24T06:32:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f2aad6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240cb970 con 0x7f9f2415a290 2023-11-24T06:32:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f28872640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9f2415a290 0x7f9f240707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f29073640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9f240b1f80 0x7f9f2406d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33646/0 (socket says 172.21.15.143:33646) 2023-11-24T06:32:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f29073640 1 -- 172.21.15.143:0/3052109460 learned_addr learned my addr 172.21.15.143:0/3052109460 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f28872640 1 -- 172.21.15.143:0/3052109460 >> v1:172.21.15.146:6789/0 conn(0x7f9f2415ec60 legacy=0x7f9f240cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f28872640 1 -- 172.21.15.143:0/3052109460 >> v1:172.21.15.143:6789/0 conn(0x7f9f240b1f80 legacy=0x7f9f2406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f28872640 1 -- 172.21.15.143:0/3052109460 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240cbc50 con 0x7f9f2415a290 2023-11-24T06:32:02.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f1b7fe640 1 -- 172.21.15.143:0/3052109460 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604765130 0 0) 0x7f9f24071170 con 0x7f9f240b1f80 2023-11-24T06:32:02.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f28872640 1 --2- 172.21.15.143:0/3052109460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415a290 0x7f9f240707f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097c0 tx=0x7f9f2001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc12fedc15eb0dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.861+0000 7f9f1b7fe640 1 -- 172.21.15.143:0/3052109460 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200ac630 con 0x7f9f2415a290 2023-11-24T06:32:02.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f1b7fe640 1 -- 172.21.15.143:0/3052109460 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f200ac790 con 0x7f9f2415a290 2023-11-24T06:32:02.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f1b7fe640 1 -- 172.21.15.143:0/3052109460 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200acb20 con 0x7f9f2415a290 2023-11-24T06:32:02.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3052109460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415a290 msgr2=0x7f9f240707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3052109460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415a290 0x7f9f240707f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097c0 tx=0x7f9f2001c3b0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3052109460 shutdown_connections 2023-11-24T06:32:02.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3052109460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415a290 0x7f9f240707f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3052109460 >> 172.21.15.143:0/3052109460 conn(0x7f9f240b0c80 msgr2=0x7f9f240b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:02.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3052109460 shutdown_connections 2023-11-24T06:32:02.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3052109460 wait complete. 2023-11-24T06:32:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 Processor -- start 2023-11-24T06:32:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- start start 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f240b1f80 0x7f9f24152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f2415a290 0x7f9f241f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 0x7f9f241f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240abf60 con 0x7f9f2415ec60 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f241f6fd0 con 0x7f9f2415a290 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f2aad6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24163e80 con 0x7f9f240b1f80 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f29073640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 0x7f9f241f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f29073640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 0x7f9f241f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45384/0 (socket says 172.21.15.143:45384) 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.865+0000 7f9f29073640 1 -- 172.21.15.143:0/3454381257 learned_addr learned my addr 172.21.15.143:0/3454381257 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f28872640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f240b1f80 0x7f9f24152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f1bfff640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f2415a290 0x7f9f241f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f29073640 1 -- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f240b1f80 msgr2=0x7f9f24152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f29073640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f240b1f80 0x7f9f24152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f29073640 1 -- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f2415a290 msgr2=0x7f9f241f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f29073640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f2415a290 0x7f9f241f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f29073640 1 -- 172.21.15.143:0/3454381257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f20009420 con 0x7f9f2415ec60 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f28872640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f240b1f80 0x7f9f24152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f29073640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 0x7f9f241f65c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c001570 tx=0x7f9f1c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00a640 con 0x7f9f2415ec60 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c00a7c0 con 0x7f9f2415ec60 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f24070f40 con 0x7f9f2415ec60 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00ab70 con 0x7f9f2415ec60 2023-11-24T06:32:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24164440 con 0x7f9f2415ec60 2023-11-24T06:32:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f240ac110 con 0x7f9f2415ec60 2023-11-24T06:32:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.869+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 9) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f9f1c00acd0 con 0x7f9f2415ec60 2023-11-24T06:32:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.873+0000 7f9f197fa640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9f10066770 0x7f9f10068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.873+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f1c083ae0 con 0x7f9f2415ec60 2023-11-24T06:32:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.873+0000 7f9f28872640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9f10066770 0x7f9f10068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.873+0000 7f9f28872640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9f10066770 0x7f9f10068c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9f200ae000 tx=0x7f9f200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:02.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:02.877+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f240ac110 con 0x7f9f2415ec60 2023-11-24T06:32:03.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f2404e8c0 con 0x7f9f2415ec60 2023-11-24T06:32:03.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f197fa640 1 -- 172.21.15.143:0/3454381257 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f1c0180a0 con 0x7f9f2415ec60 2023-11-24T06:32:03.031 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9f10066770 msgr2=0x7f9f10068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9f10066770 0x7f9f10068c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9f200ae000 tx=0x7f9f200a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 msgr2=0x7f9f241f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 0x7f9f241f65c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c001570 tx=0x7f9f1c00cca0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 shutdown_connections 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9f10066770 0x7f9f10068c30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f2415ec60 0x7f9f241f65c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f2415a290 0x7f9f241f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 --2- 172.21.15.143:0/3454381257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f240b1f80 0x7f9f24152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 >> 172.21.15.143:0/3454381257 conn(0x7f9f240b0c80 msgr2=0x7f9f240ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:03.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 shutdown_connections 2023-11-24T06:32:03.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.025+0000 7f9f2aad6640 1 -- 172.21.15.143:0/3454381257 wait complete. 2023-11-24T06:32:03.052 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:32:03.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.189+0000 7fe4ab4fe640 1 Processor -- start 2023-11-24T06:32:03.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.189+0000 7fe4ab4fe640 1 -- start start 2023-11-24T06:32:03.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4ab4fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4a40cd850 0x7fe4a415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4ab4fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40b3510 con 0x7fe4a40ce420 2023-11-24T06:32:03.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4ab4fe640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40b37f0 con 0x7fe4a40ae4a0 2023-11-24T06:32:03.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4ab4fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40b3ad0 con 0x7fe4a40cd850 2023-11-24T06:32:03.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a9a9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4a40cd850 0x7fe4a415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a8a99640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe4a40ce420 0x7fe4a406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33650/0 (socket says 172.21.15.143:33650) 2023-11-24T06:32:03.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a9a9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4a40cd850 0x7fe4a415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45392/0 (socket says 172.21.15.143:45392) 2023-11-24T06:32:03.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a8a99640 1 -- 172.21.15.143:0/1871285216 learned_addr learned my addr 172.21.15.143:0/1871285216 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:03.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a9a9b640 1 -- 172.21.15.143:0/1871285216 >> v1:172.21.15.146:6789/0 conn(0x7fe4a40ae4a0 legacy=0x7fe4a40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a9a9b640 1 -- 172.21.15.143:0/1871285216 >> v1:172.21.15.143:6789/0 conn(0x7fe4a40ce420 legacy=0x7fe4a406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.193+0000 7fe4a9a9b640 1 -- 172.21.15.143:0/1871285216 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40b3db0 con 0x7fe4a40cd850 2023-11-24T06:32:03.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4a9a9b640 1 --2- 172.21.15.143:0/1871285216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40cd850 0x7fe4a415ba00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009d90 tx=0x7fe49c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4d743824de4ba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:03.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe49bfff640 1 -- 172.21.15.143:0/1871285216 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0a5a00 con 0x7fe4a40cd850 2023-11-24T06:32:03.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe49bfff640 1 -- 172.21.15.143:0/1871285216 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c0a5b60 con 0x7fe4a40cd850 2023-11-24T06:32:03.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe49bfff640 1 -- 172.21.15.143:0/1871285216 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0ad440 con 0x7fe4a40cd850 2023-11-24T06:32:03.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/1871285216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40cd850 msgr2=0x7fe4a415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/1871285216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40cd850 0x7fe4a415ba00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009d90 tx=0x7fe49c01c920 comp rx=0 tx=0).stop 2023-11-24T06:32:03.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/1871285216 shutdown_connections 2023-11-24T06:32:03.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/1871285216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40cd850 0x7fe4a415ba00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/1871285216 >> 172.21.15.143:0/1871285216 conn(0x7fe4a40b0c80 msgr2=0x7fe4a40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:03.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/1871285216 shutdown_connections 2023-11-24T06:32:03.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/1871285216 wait complete. 2023-11-24T06:32:03.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 Processor -- start 2023-11-24T06:32:03.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.197+0000 7fe4ab4fe640 1 -- start start 2023-11-24T06:32:03.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a40ae4a0 0x7fe4a4155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a40cd850 0x7fe4a414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40ce420 0x7fe4a409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4155a60 con 0x7fe4a40ce420 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4154480 con 0x7fe4a40ae4a0 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4154760 con 0x7fe4a40cd850 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a929a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a40ae4a0 0x7fe4a4155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40ce420 0x7fe4a409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a929a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a40ae4a0 0x7fe4a4155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:56044/0 (socket says 172.21.15.143:56044) 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a929a640 1 -- 172.21.15.143:0/2144110225 learned_addr learned my addr 172.21.15.143:0/2144110225 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a8a99640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a40cd850 0x7fe4a414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 -- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a40cd850 msgr2=0x7fe4a414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a40cd850 0x7fe4a414d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 -- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a40ae4a0 msgr2=0x7fe4a4155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a40ae4a0 0x7fe4a4155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 -- 172.21.15.143:0/2144110225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009a70 con 0x7fe4a40ce420 2023-11-24T06:32:03.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4a9a9b640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40ce420 0x7fe4a409ca60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0ac000 tx=0x7fe49c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0ade60 con 0x7fe4a40ce420 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c0b9450 con 0x7fe4a40ce420 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0b9800 con 0x7fe4a40ce420 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a4154a40 con 0x7fe4a40ce420 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4155000 con 0x7fe4a40ce420 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a41551f0 con 0x7fe4a40ce420 2023-11-24T06:32:03.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.201+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fe49c0b9960 con 0x7fe4a40ce420 2023-11-24T06:32:03.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.205+0000 7fe499ffb640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066860 0x7fe488068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.205+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe49c11ef40 con 0x7fe4a40ce420 2023-11-24T06:32:03.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.205+0000 7fe4a929a640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066860 0x7fe488068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.205+0000 7fe4a929a640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066860 0x7fe488068d20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00018b0 tx=0x7fe4a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:03.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.209+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe49c0ebe90 con 0x7fe4a40ce420 2023-11-24T06:32:03.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.361+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4a404e8c0 con 0x7fe4a40ce420 2023-11-24T06:32:03.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.361+0000 7fe499ffb640 1 -- 172.21.15.143:0/2144110225 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe49c0ef4b0 con 0x7fe4a40ce420 2023-11-24T06:32:03.368 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:32:03.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066860 msgr2=0x7fe488068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066860 0x7fe488068d20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00018b0 tx=0x7fe4a0009040 comp rx=0 tx=0).stop 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40ce420 msgr2=0x7fe4a409ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40ce420 0x7fe4a409ca60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0ac000 tx=0x7fe49c0196c0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 shutdown_connections 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066860 0x7fe488068d20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a40ce420 0x7fe4a409ca60 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a40cd850 0x7fe4a414d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 --2- 172.21.15.143:0/2144110225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a40ae4a0 0x7fe4a4155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 >> 172.21.15.143:0/2144110225 conn(0x7fe4a40b0c80 msgr2=0x7fe4a415cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 shutdown_connections 2023-11-24T06:32:03.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.365+0000 7fe4ab4fe640 1 -- 172.21.15.143:0/2144110225 wait complete. 2023-11-24T06:32:03.389 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:32:03.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 Processor -- start 2023-11-24T06:32:03.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 -- start start 2023-11-24T06:32:03.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdfac0cad20 0x7fdfac0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac06e0d0 con 0x7fdfac15a4d0 2023-11-24T06:32:03.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac15a8b0 con 0x7fdfac0cad20 2023-11-24T06:32:03.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfb153e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0c9c30 con 0x7fdfac06d740 2023-11-24T06:32:03.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdfac0cad20 0x7fdfac0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdfac0cad20 0x7fdfac0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45404/0 (socket says 172.21.15.143:45404) 2023-11-24T06:32:03.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 -- 172.21.15.143:0/3356945767 learned_addr learned my addr 172.21.15.143:0/3356945767 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:03.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfaaffd640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdfac15a4d0 0x7fdfac15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:38592/0 (socket says 172.21.15.143:38592) 2023-11-24T06:32:03.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfab7fe640 1 --2- 172.21.15.143:0/3356945767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 -- 172.21.15.143:0/3356945767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 msgr2=0x7fdfac06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:03.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 --2- 172.21.15.143:0/3356945767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 -- 172.21.15.143:0/3356945767 >> v1:172.21.15.146:6789/0 conn(0x7fdfac15a4d0 legacy=0x7fdfac15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfa27fc640 1 -- 172.21.15.143:0/3356945767 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0c9f60 con 0x7fdfac0cad20 2023-11-24T06:32:03.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.521+0000 7fdfaa7fc640 1 -- 172.21.15.143:0/3356945767 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754932274 0 0) 0x7fdf9c0014a0 con 0x7fdfac15a4d0 2023-11-24T06:32:03.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfa27fc640 1 --2- 172.21.15.143:0/3356945767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac0cad20 0x7fdfac0c9650 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400bb10 tx=0x7fdf9401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446510867cace722 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:03.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfaa7fc640 1 -- 172.21.15.143:0/3356945767 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940a7c20 con 0x7fdfac0cad20 2023-11-24T06:32:03.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfaa7fc640 1 -- 172.21.15.143:0/3356945767 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf940a7d80 con 0x7fdfac0cad20 2023-11-24T06:32:03.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfaa7fc640 1 -- 172.21.15.143:0/3356945767 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940af660 con 0x7fdfac0cad20 2023-11-24T06:32:03.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 -- 172.21.15.143:0/3356945767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac0cad20 msgr2=0x7fdfac0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 --2- 172.21.15.143:0/3356945767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac0cad20 0x7fdfac0c9650 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400bb10 tx=0x7fdf9401eb50 comp rx=0 tx=0).stop 2023-11-24T06:32:03.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 -- 172.21.15.143:0/3356945767 shutdown_connections 2023-11-24T06:32:03.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 --2- 172.21.15.143:0/3356945767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 --2- 172.21.15.143:0/3356945767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac0cad20 0x7fdfac0c9650 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 -- 172.21.15.143:0/3356945767 >> 172.21.15.143:0/3356945767 conn(0x7fdfac0b0bf0 msgr2=0x7fdfac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:03.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 -- 172.21.15.143:0/3356945767 shutdown_connections 2023-11-24T06:32:03.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.525+0000 7fdfb153e640 1 -- 172.21.15.143:0/3356945767 wait complete. 2023-11-24T06:32:03.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 Processor -- start 2023-11-24T06:32:03.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 -- start start 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac09a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfac0cad20 0x7fdfac1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 0x7fdfac0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac09a010 con 0x7fdfac15a4d0 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0aff30 con 0x7fdfac0cad20 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0999e0 con 0x7fdfac06d740 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 0x7fdfac0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 0x7fdfac0af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45414/0 (socket says 172.21.15.143:45414) 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 -- 172.21.15.143:0/2501662978 learned_addr learned my addr 172.21.15.143:0/2501662978 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfaaffd640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac09a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfa27fc640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfac0cad20 0x7fdfac1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 -- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 msgr2=0x7fdfac09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac09a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 -- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfac0cad20 msgr2=0x7fdfac1590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfac0cad20 0x7fdfac1590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 -- 172.21.15.143:0/2501662978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9400b770 con 0x7fdfac15a4d0 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfaaffd640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac09a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfa27fc640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfac0cad20 0x7fdfac1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:03.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfab7fe640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 0x7fdfac0af9f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400e930 tx=0x7fdfa400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:03.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40096b0 con 0x7fdfac15a4d0 2023-11-24T06:32:03.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa400c9a0 con 0x7fdfac15a4d0 2023-11-24T06:32:03.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac0b4b30 con 0x7fdfac15a4d0 2023-11-24T06:32:03.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400cd30 con 0x7fdfac15a4d0 2023-11-24T06:32:03.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.529+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac099c30 con 0x7fdfac15a4d0 2023-11-24T06:32:03.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.533+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac09a150 con 0x7fdfac15a4d0 2023-11-24T06:32:03.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.533+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fdfa4013470 con 0x7fdfac15a4d0 2023-11-24T06:32:03.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.533+0000 7fdfa3fff640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf8c066860 0x7fdf8c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:03.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.533+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfa4084770 con 0x7fdfac15a4d0 2023-11-24T06:32:03.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.533+0000 7fdfaaffd640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf8c066860 0x7fdf8c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:03.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.533+0000 7fdfaaffd640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf8c066860 0x7fdf8c068d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c007fd0 tx=0x7fdf9c005b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:03.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.537+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdfac09a150 con 0x7fdfac15a4d0 2023-11-24T06:32:03.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.697+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdfac09a150 con 0x7fdfac15a4d0 2023-11-24T06:32:03.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.697+0000 7fdfa3fff640 1 -- 172.21.15.143:0/2501662978 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdfac09a150 con 0x7fdfac15a4d0 2023-11-24T06:32:03.704 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:32:03.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf8c066860 msgr2=0x7fdf8c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf8c066860 0x7fdf8c068d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c007fd0 tx=0x7fdf9c005b80 comp rx=0 tx=0).stop 2023-11-24T06:32:03.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 msgr2=0x7fdfac0af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:03.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 0x7fdfac0af9f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400e930 tx=0x7fdfa400edf0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 shutdown_connections 2023-11-24T06:32:03.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fdf8c066860 0x7fdf8c068d20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfac15a4d0 0x7fdfac0af9f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfac0cad20 0x7fdfac1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 --2- 172.21.15.143:0/2501662978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfac06d740 0x7fdfac09a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:03.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 >> 172.21.15.143:0/2501662978 conn(0x7fdfac0b0bf0 msgr2=0x7fdfac0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:03.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 shutdown_connections 2023-11-24T06:32:03.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:03.701+0000 7fdfb153e640 1 -- 172.21.15.143:0/2501662978 wait complete. 2023-11-24T06:32:03.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:32:03.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:03.726 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:32:03.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:32:03.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:03.754 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:32:03.806 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:03.806 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:03.818 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:03.818 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:03.870 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:04.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6fc06640 1 Processor -- start 2023-11-24T06:32:04.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6fc06640 1 -- start start 2023-11-24T06:32:04.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6fc06640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f6815d570 0x7f0f6806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6fc06640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f680d1cc0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6fc06640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f680d1fa0 con 0x7f0f680d3020 2023-11-24T06:32:04.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6fc06640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f680ce0b0 con 0x7f0f6815d570 2023-11-24T06:32:04.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6e1a3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0f680ce8b0 0x7f0f680ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33658/0 (socket says 172.21.15.143:33658) 2023-11-24T06:32:04.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6e1a3640 1 -- 172.21.15.143:0/2799722782 learned_addr learned my addr 172.21.15.143:0/2799722782 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:04.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6d9a2640 1 --2- 172.21.15.143:0/2799722782 >> v2:172.21.15.146:3300/0 conn(0x7f0f6815d570 0x7f0f6806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185449950 0 0) 0x7f0f680d1cc0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f54003530 con 0x7f0f680ce8b0 2023-11-24T06:32:04.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184557134 0 0) 0x7f0f680d1fa0 con 0x7f0f680d3020 2023-11-24T06:32:04.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f680d1cc0 con 0x7f0f680d3020 2023-11-24T06:32:04.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2799722782 >> v1:172.21.15.146:6789/0 conn(0x7f0f680d3020 legacy=0x7f0f680d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2799722782 >> v1:172.21.15.143:6789/0 conn(0x7f0f680ce8b0 legacy=0x7f0f680ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757381504 0 0) 0x7f0f54003530 con 0x7f0f680ce8b0 2023-11-24T06:32:04.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.001+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2799722782 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f680ce390 con 0x7f0f6815d570 2023-11-24T06:32:04.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6d9a2640 1 --2- 172.21.15.143:0/2799722782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6815d570 0x7f0f6806b9d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097c0 tx=0x7f0f6401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd3a757b9d083fbb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60001a00 con 0x7f0f6815d570 2023-11-24T06:32:04.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640a7050 con 0x7f0f6815d570 2023-11-24T06:32:04.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6c9a0640 1 -- 172.21.15.143:0/2799722782 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640ab620 con 0x7f0f6815d570 2023-11-24T06:32:04.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2799722782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6815d570 msgr2=0x7f0f6806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2799722782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6815d570 0x7f0f6806b9d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097c0 tx=0x7f0f6401c3a0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2799722782 shutdown_connections 2023-11-24T06:32:04.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2799722782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6815d570 0x7f0f6806b9d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.005+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2799722782 >> 172.21.15.143:0/2799722782 conn(0x7f0f6808ceb0 msgr2=0x7f0f6809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:04.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2799722782 shutdown_connections 2023-11-24T06:32:04.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2799722782 wait complete. 2023-11-24T06:32:04.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 Processor -- start 2023-11-24T06:32:04.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- start start 2023-11-24T06:32:04.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 0x7f0f6815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f680d3020 0x7f0f6814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f6815d570 0x7f0f680ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c9df0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680cbe70 con 0x7f0f680d3020 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680cc150 con 0x7f0f6815d570 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 0x7f0f6815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 0x7f0f6815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45420/0 (socket says 172.21.15.143:45420) 2023-11-24T06:32:04.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2913452916 learned_addr learned my addr 172.21.15.143:0/2913452916 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:04.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d1a1640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f680d3020 0x7f0f6814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6e1a3640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f6815d570 0x7f0f680ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f6815d570 msgr2=0x7f0f680ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f6815d570 0x7f0f680ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f680d3020 msgr2=0x7f0f6814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f680d3020 0x7f0f6814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 -- 172.21.15.143:0/2913452916 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009420 con 0x7f0f680ce8b0 2023-11-24T06:32:04.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6d9a2640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 0x7f0f6815c8d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097c0 tx=0x7f0f6401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640abcd0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640abe30 con 0x7f0f680ce8b0 2023-11-24T06:32:04.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004260 con 0x7f0f680ce8b0 2023-11-24T06:32:04.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.009+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f680cc430 con 0x7f0f680ce8b0 2023-11-24T06:32:04.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f680cbab0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f68067520 con 0x7f0f680ce8b0 2023-11-24T06:32:04.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f0f640043c0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f5e7fc640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f4c066860 0x7f0f4c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f6411e710 con 0x7f0f680ce8b0 2023-11-24T06:32:04.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f6d1a1640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f4c066860 0x7f0f4c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.013+0000 7f0f6d1a1640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f4c066860 0x7f0f4c068d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f680b9350 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.017+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f640eb550 con 0x7f0f680ce8b0 2023-11-24T06:32:04.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.169+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f680cc8e0 con 0x7f0f680ce8b0 2023-11-24T06:32:04.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f5e7fc640 1 -- 172.21.15.143:0/2913452916 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f0f640eeb70 con 0x7f0f680ce8b0 2023-11-24T06:32:04.178 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:04.178 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":59,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:31:51.000119+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:04.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f4c066860 msgr2=0x7f0f4c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f4c066860 0x7f0f4c068d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f680b9350 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2023-11-24T06:32:04.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 msgr2=0x7f0f6815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 0x7f0f6815c8d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097c0 tx=0x7f0f6401abe0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 shutdown_connections 2023-11-24T06:32:04.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f4c066860 0x7f0f4c068d20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f6815d570 0x7f0f680ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f680d3020 0x7f0f6814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 --2- 172.21.15.143:0/2913452916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f680ce8b0 0x7f0f6815c8d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 >> 172.21.15.143:0/2913452916 conn(0x7f0f6808ceb0 msgr2=0x7f0f68158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:04.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 shutdown_connections 2023-11-24T06:32:04.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.173+0000 7f0f6fc06640 1 -- 172.21.15.143:0/2913452916 wait complete. 2023-11-24T06:32:04.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:31:47.711527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:31:48.345537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:04.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:04.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 Processor -- start 2023-11-24T06:32:04.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 -- start start 2023-11-24T06:32:04.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f711815d7f0 0x7f71180d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f711806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180d3c60 con 0x7f71180d37e0 2023-11-24T06:32:04.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711806b980 con 0x7f711815d7f0 2023-11-24T06:32:04.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f712032a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180b0090 con 0x7f711806cce0 2023-11-24T06:32:04.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711e8c7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f711806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711e0c6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f711815d7f0 0x7f71180d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711d8c5640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f71180d37e0 0x7f71180b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:38610/0 (socket says 172.21.15.143:38610) 2023-11-24T06:32:04.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711d8c5640 1 -- 172.21.15.143:0/318306863 learned_addr learned my addr 172.21.15.143:0/318306863 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:04.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711e0c6640 1 -- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 msgr2=0x7f711806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:04.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711e0c6640 1 --2- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f711806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711e0c6640 1 -- 172.21.15.143:0/318306863 >> v1:172.21.15.146:6789/0 conn(0x7f71180d37e0 legacy=0x7f71180b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.337+0000 7f711e0c6640 1 -- 172.21.15.143:0/318306863 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711806d6b0 con 0x7f711815d7f0 2023-11-24T06:32:04.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f711e0c6640 1 --2- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711815d7f0 0x7f71180d32a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71140097c0 tx=0x7f711401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d46cf4db2a7a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f711d0c4640 1 -- 172.21.15.143:0/318306863 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140ab600 con 0x7f711815d7f0 2023-11-24T06:32:04.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f711d0c4640 1 -- 172.21.15.143:0/318306863 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71140a7050 con 0x7f711815d7f0 2023-11-24T06:32:04.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f711d0c4640 1 -- 172.21.15.143:0/318306863 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140ab980 con 0x7f711815d7f0 2023-11-24T06:32:04.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 -- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711815d7f0 msgr2=0x7f71180d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 --2- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711815d7f0 0x7f71180d32a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71140097c0 tx=0x7f711401c480 comp rx=0 tx=0).stop 2023-11-24T06:32:04.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 -- 172.21.15.143:0/318306863 shutdown_connections 2023-11-24T06:32:04.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 --2- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f711806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 --2- 172.21.15.143:0/318306863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711815d7f0 0x7f71180d32a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 -- 172.21.15.143:0/318306863 >> 172.21.15.143:0/318306863 conn(0x7f711809c790 msgr2=0x7f711808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:04.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 -- 172.21.15.143:0/318306863 shutdown_connections 2023-11-24T06:32:04.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.341+0000 7f712032a640 1 -- 172.21.15.143:0/318306863 wait complete. 2023-11-24T06:32:04.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 Processor -- start 2023-11-24T06:32:04.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 -- start start 2023-11-24T06:32:04.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f71180c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71180d37e0 0x7f71181f9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 0x7f71181f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180b33b0 con 0x7f711815d7f0 2023-11-24T06:32:04.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180d08c0 con 0x7f71180d37e0 2023-11-24T06:32:04.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180d0ba0 con 0x7f711806cce0 2023-11-24T06:32:04.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 0x7f71181f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 0x7f71181f9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45430/0 (socket says 172.21.15.143:45430) 2023-11-24T06:32:04.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 -- 172.21.15.143:0/4190032897 learned_addr learned my addr 172.21.15.143:0/4190032897 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:04.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e0c6640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f71180c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711d8c5640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71180d37e0 0x7f71181f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 -- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 msgr2=0x7f71180c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f71180c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 -- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71180d37e0 msgr2=0x7f71181f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71180d37e0 0x7f71181f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 -- 172.21.15.143:0/4190032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009420 con 0x7f711815d7f0 2023-11-24T06:32:04.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f711e8c7640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 0x7f71181f9b60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f711000efc0 tx=0x7f711000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110009b10 con 0x7f711815d7f0 2023-11-24T06:32:04.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000f040 con 0x7f711815d7f0 2023-11-24T06:32:04.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100146c0 con 0x7f711815d7f0 2023-11-24T06:32:04.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180b2d60 con 0x7f711815d7f0 2023-11-24T06:32:04.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.345+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71180b6540 con 0x7f711815d7f0 2023-11-24T06:32:04.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.349+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71180b3520 con 0x7f711815d7f0 2023-11-24T06:32:04.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.349+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f7110014820 con 0x7f711815d7f0 2023-11-24T06:32:04.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.349+0000 7f710effd640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f70fc066860 0x7f70fc068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.349+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71100854a0 con 0x7f711815d7f0 2023-11-24T06:32:04.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.349+0000 7f711e0c6640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f70fc066860 0x7f70fc068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.349+0000 7f711e0c6640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f70fc066860 0x7f70fc068d20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f71140ad000 tx=0x7f71140a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.353+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71100521f0 con 0x7f711815d7f0 2023-11-24T06:32:04.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.513+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f711804e8c0 con 0x7f711815d7f0 2023-11-24T06:32:04.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.513+0000 7f710effd640 1 -- 172.21.15.143:0/4190032897 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7110055810 con 0x7f711815d7f0 2023-11-24T06:32:04.520 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f70fc066860 msgr2=0x7f70fc068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f70fc066860 0x7f70fc068d20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f71140ad000 tx=0x7f71140a6000 comp rx=0 tx=0).stop 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 msgr2=0x7f71181f9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 0x7f71181f9b60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f711000efc0 tx=0x7f711000c490 comp rx=0 tx=0).stop 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 shutdown_connections 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f70fc066860 0x7f70fc068d20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f711815d7f0 0x7f71181f9b60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71180d37e0 0x7f71181f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 --2- 172.21.15.143:0/4190032897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f711806cce0 0x7f71180c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 >> 172.21.15.143:0/4190032897 conn(0x7f711809c790 msgr2=0x7f711815c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:04.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 shutdown_connections 2023-11-24T06:32:04.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.517+0000 7f712032a640 1 -- 172.21.15.143:0/4190032897 wait complete. 2023-11-24T06:32:04.541 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:32:04.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2283557640 1 Processor -- start 2023-11-24T06:32:04.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2283557640 1 -- start start 2023-11-24T06:32:04.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2283557640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f227c15a290 0x7f227c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2283557640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c071170 con 0x7f227c15ec60 2023-11-24T06:32:04.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2283557640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c0cb690 con 0x7f227c0b1f80 2023-11-24T06:32:04.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2283557640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0cb970 con 0x7f227c15a290 2023-11-24T06:32:04.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2280af2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f227c15ec60 0x7f227c0cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33664/0 (socket says 172.21.15.143:33664) 2023-11-24T06:32:04.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2280af2640 1 -- 172.21.15.143:0/4190683018 learned_addr learned my addr 172.21.15.143:0/4190683018 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:04.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f22812f3640 1 --2- 172.21.15.143:0/4190683018 >> v2:172.21.15.143:3300/0 conn(0x7f227c15a290 0x7f227c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2273fff640 1 -- 172.21.15.143:0/4190683018 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192388977 0 0) 0x7f227c071170 con 0x7f227c15ec60 2023-11-24T06:32:04.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f2273fff640 1 -- 172.21.15.143:0/4190683018 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2268003530 con 0x7f227c15ec60 2023-11-24T06:32:04.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f22812f3640 1 -- 172.21.15.143:0/4190683018 >> v1:172.21.15.146:6789/0 conn(0x7f227c0b1f80 legacy=0x7f227c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f22812f3640 1 -- 172.21.15.143:0/4190683018 >> v1:172.21.15.143:6789/0 conn(0x7f227c15ec60 legacy=0x7f227c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.677+0000 7f22812f3640 1 -- 172.21.15.143:0/4190683018 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0cbc50 con 0x7f227c15a290 2023-11-24T06:32:04.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f22812f3640 1 --2- 172.21.15.143:0/4190683018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15a290 0x7f227c0707f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f22780097c0 tx=0x7f227801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48c16757ffff890 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2273fff640 1 -- 172.21.15.143:0/4190683018 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780ab610 con 0x7f227c15a290 2023-11-24T06:32:04.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2273fff640 1 -- 172.21.15.143:0/4190683018 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780ab770 con 0x7f227c15a290 2023-11-24T06:32:04.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2273fff640 1 -- 172.21.15.143:0/4190683018 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780abb00 con 0x7f227c15a290 2023-11-24T06:32:04.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 -- 172.21.15.143:0/4190683018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15a290 msgr2=0x7f227c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 --2- 172.21.15.143:0/4190683018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15a290 0x7f227c0707f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f22780097c0 tx=0x7f227801c3f0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 -- 172.21.15.143:0/4190683018 shutdown_connections 2023-11-24T06:32:04.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 --2- 172.21.15.143:0/4190683018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15a290 0x7f227c0707f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 -- 172.21.15.143:0/4190683018 >> 172.21.15.143:0/4190683018 conn(0x7f227c0b0c80 msgr2=0x7f227c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:04.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 -- 172.21.15.143:0/4190683018 shutdown_connections 2023-11-24T06:32:04.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.681+0000 7f2283557640 1 -- 172.21.15.143:0/4190683018 wait complete. 2023-11-24T06:32:04.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 Processor -- start 2023-11-24T06:32:04.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 -- start start 2023-11-24T06:32:04.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f227c0b1f80 0x7f227c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f227c15a290 0x7f227c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 0x7f227c0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c163d30 con 0x7f227c15ec60 2023-11-24T06:32:04.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0add40 con 0x7f227c0b1f80 2023-11-24T06:32:04.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c14e990 con 0x7f227c15a290 2023-11-24T06:32:04.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 0x7f227c0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 0x7f227c0ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45438/0 (socket says 172.21.15.143:45438) 2023-11-24T06:32:04.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 -- 172.21.15.143:0/1816075435 learned_addr learned my addr 172.21.15.143:0/1816075435 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:04.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2280af2640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f227c15a290 0x7f227c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f22812f3640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f227c0b1f80 0x7f227c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 -- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f227c15a290 msgr2=0x7f227c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f227c15a290 0x7f227c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 -- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f227c0b1f80 msgr2=0x7f227c14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f227c0b1f80 0x7f227c14e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 -- 172.21.15.143:0/1816075435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009420 con 0x7f227c15ec60 2023-11-24T06:32:04.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2281af4640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 0x7f227c0ad2c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f227400c7a0 tx=0x7f227400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274003b80 con 0x7f227c15ec60 2023-11-24T06:32:04.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274003ce0 con 0x7f227c15ec60 2023-11-24T06:32:04.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c070f40 con 0x7f227c15ec60 2023-11-24T06:32:04.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400aa90 con 0x7f227c15ec60 2023-11-24T06:32:04.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.685+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c164240 con 0x7f227c15ec60 2023-11-24T06:32:04.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.689+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c04e8c0 con 0x7f227c15ec60 2023-11-24T06:32:04.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.689+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f227400abf0 con 0x7f227c15ec60 2023-11-24T06:32:04.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.689+0000 7f2271ffb640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2260066860 0x7f2260068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:04.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.689+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2274084310 con 0x7f227c15ec60 2023-11-24T06:32:04.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.689+0000 7f22812f3640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2260066860 0x7f2260068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:04.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.689+0000 7f22812f3640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2260066860 0x7f2260068d20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f22780af000 tx=0x7f22780a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:04.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.693+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2274051220 con 0x7f227c15ec60 2023-11-24T06:32:04.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.845+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f227c0b4380 con 0x7f227c15ec60 2023-11-24T06:32:04.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.845+0000 7f2271ffb640 1 -- 172.21.15.143:0/1816075435 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2274054840 con 0x7f227c15ec60 2023-11-24T06:32:04.851 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2260066860 msgr2=0x7f2260068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2260066860 0x7f2260068d20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f22780af000 tx=0x7f22780a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 msgr2=0x7f227c0ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 0x7f227c0ad2c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f227400c7a0 tx=0x7f227400cc60 comp rx=0 tx=0).stop 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 shutdown_connections 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2260066860 0x7f2260068d20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f227c15ec60 0x7f227c0ad2c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f227c15a290 0x7f227c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 --2- 172.21.15.143:0/1816075435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f227c0b1f80 0x7f227c14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:04.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 >> 172.21.15.143:0/1816075435 conn(0x7f227c0b0c80 msgr2=0x7f227c158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:04.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 shutdown_connections 2023-11-24T06:32:04.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:04.849+0000 7f2283557640 1 -- 172.21.15.143:0/1816075435 wait complete. 2023-11-24T06:32:04.872 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:32:05.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 Processor -- start 2023-11-24T06:32:05.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 -- start start 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3aa40aec90 0x7f3aa40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa41598b0 0x7f3aa4060fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa40b2cf0 con 0x7f3aa4159cf0 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa406d1d0 con 0x7f3aa40aec90 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aab6c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa406e0f0 con 0x7f3aa41598b0 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aa9465640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3aa40aec90 0x7f3aa40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aa9465640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3aa40aec90 0x7f3aa40ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45450/0 (socket says 172.21.15.143:45450) 2023-11-24T06:32:05.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aa9465640 1 -- 172.21.15.143:0/57886817 learned_addr learned my addr 172.21.15.143:0/57886817 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:05.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.009+0000 7f3aa8c64640 1 --2- 172.21.15.143:0/57886817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa41598b0 0x7f3aa4060fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aa9465640 1 -- 172.21.15.143:0/57886817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa41598b0 msgr2=0x7f3aa4060fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:05.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aa9465640 1 --2- 172.21.15.143:0/57886817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa41598b0 0x7f3aa4060fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aa9465640 1 -- 172.21.15.143:0/57886817 >> v1:172.21.15.146:6789/0 conn(0x7f3aa4159cf0 legacy=0x7f3aa40b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aa9465640 1 -- 172.21.15.143:0/57886817 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa406e3d0 con 0x7f3aa40aec90 2023-11-24T06:32:05.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aa9465640 1 --2- 172.21.15.143:0/57886817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa40aec90 0x7f3aa40ae6b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009870 tx=0x7f3aa001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbe254ee610a32f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3a9bfff640 1 -- 172.21.15.143:0/57886817 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00a95f0 con 0x7f3aa40aec90 2023-11-24T06:32:05.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3a9bfff640 1 -- 172.21.15.143:0/57886817 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa00a9750 con 0x7f3aa40aec90 2023-11-24T06:32:05.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3a9bfff640 1 -- 172.21.15.143:0/57886817 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00a9ae0 con 0x7f3aa40aec90 2023-11-24T06:32:05.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aab6c9640 1 -- 172.21.15.143:0/57886817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa40aec90 msgr2=0x7f3aa40ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/57886817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa40aec90 0x7f3aa40ae6b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009870 tx=0x7f3aa001c510 comp rx=0 tx=0).stop 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aab6c9640 1 -- 172.21.15.143:0/57886817 shutdown_connections 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/57886817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa41598b0 0x7f3aa4060fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/57886817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa40aec90 0x7f3aa40ae6b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.013+0000 7f3aab6c9640 1 -- 172.21.15.143:0/57886817 >> 172.21.15.143:0/57886817 conn(0x7f3aa40cf8f0 msgr2=0x7f3aa40cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- 172.21.15.143:0/57886817 shutdown_connections 2023-11-24T06:32:05.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- 172.21.15.143:0/57886817 wait complete. 2023-11-24T06:32:05.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 Processor -- start 2023-11-24T06:32:05.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- start start 2023-11-24T06:32:05.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa40aec90 0x7f3aa4147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 0x7f3aa415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa41481b0 0x7f3aa415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4147ff0 con 0x7f3aa41598b0 2023-11-24T06:32:05.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa415d280 con 0x7f3aa41481b0 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40af6b0 con 0x7f3aa40aec90 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 0x7f3aa415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 0x7f3aa415ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45460/0 (socket says 172.21.15.143:45460) 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 -- 172.21.15.143:0/402139379 learned_addr learned my addr 172.21.15.143:0/402139379 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa9465640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa40aec90 0x7f3aa4147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa9c66640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa41481b0 0x7f3aa415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 -- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa40aec90 msgr2=0x7f3aa4147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa40aec90 0x7f3aa4147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 -- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa41481b0 msgr2=0x7f3aa415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa41481b0 0x7f3aa415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 -- 172.21.15.143:0/402139379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa00094d0 con 0x7f3aa41598b0 2023-11-24T06:32:05.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aa8c64640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 0x7f3aa415ca30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400d800 tx=0x7f3a9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400b6c0 con 0x7f3aa41598b0 2023-11-24T06:32:05.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9400b820 con 0x7f3aa41598b0 2023-11-24T06:32:05.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400bb90 con 0x7f3aa41598b0 2023-11-24T06:32:05.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.017+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa40af990 con 0x7f3aa41598b0 2023-11-24T06:32:05.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa40aff50 con 0x7f3aa41598b0 2023-11-24T06:32:05.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa40b0110 con 0x7f3aa41598b0 2023-11-24T06:32:05.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f3a9400bcf0 con 0x7f3aa41598b0 2023-11-24T06:32:05.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3a99ffb640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a88066890 0x7f3a88068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a94084950 con 0x7f3aa41598b0 2023-11-24T06:32:05.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3aa9465640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a88066890 0x7f3a88068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.021+0000 7f3aa9465640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a88066890 0x7f3a88068d50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00ae000 tx=0x7f3aa00b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.025+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a940518f0 con 0x7f3aa41598b0 2023-11-24T06:32:05.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3aa40af7f0 con 0x7f3aa41598b0 2023-11-24T06:32:05.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3a99ffb640 1 -- 172.21.15.143:0/402139379 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3aa40af7f0 con 0x7f3aa41598b0 2023-11-24T06:32:05.191 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:32:05.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a88066890 msgr2=0x7f3a88068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a88066890 0x7f3a88068d50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00ae000 tx=0x7f3aa00b3040 comp rx=0 tx=0).stop 2023-11-24T06:32:05.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 msgr2=0x7f3aa415ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 0x7f3aa415ca30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400d800 tx=0x7f3a9400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 shutdown_connections 2023-11-24T06:32:05.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3a88066890 0x7f3a88068d50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa41481b0 0x7f3aa415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aa41598b0 0x7f3aa415ca30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 --2- 172.21.15.143:0/402139379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aa40aec90 0x7f3aa4147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 >> 172.21.15.143:0/402139379 conn(0x7f3aa40cf8f0 msgr2=0x7f3aa40b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:05.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 shutdown_connections 2023-11-24T06:32:05.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.185+0000 7f3aab6c9640 1 -- 172.21.15.143:0/402139379 wait complete. 2023-11-24T06:32:05.212 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:32:05.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 Processor -- start 2023-11-24T06:32:05.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 -- start start 2023-11-24T06:32:05.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1fc15a4d0 0x7fd1fc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1fc15a8b0 con 0x7fd1fc06d740 2023-11-24T06:32:05.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc0c9c30 con 0x7fd1fc15a4d0 2023-11-24T06:32:05.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd2040e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc15ee80 con 0x7fd1fc0cad20 2023-11-24T06:32:05.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd201e7f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1fc15a4d0 0x7fd1fc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd202680640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd1fc06d740 0x7fd1fc0cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33668/0 (socket says 172.21.15.143:33668) 2023-11-24T06:32:05.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd202680640 1 -- 172.21.15.143:0/2160572533 learned_addr learned my addr 172.21.15.143:0/2160572533 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:05.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd20167e640 1 --2- 172.21.15.143:0/2160572533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd201e7f640 1 -- 172.21.15.143:0/2160572533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 msgr2=0x7fd1fc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:05.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd201e7f640 1 --2- 172.21.15.143:0/2160572533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd201e7f640 1 -- 172.21.15.143:0/2160572533 >> v1:172.21.15.143:6789/0 conn(0x7fd1fc06d740 legacy=0x7fd1fc0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd201e7f640 1 -- 172.21.15.143:0/2160572533 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0c9f60 con 0x7fd1fc15a4d0 2023-11-24T06:32:05.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.349+0000 7fd200e7d640 1 -- 172.21.15.143:0/2160572533 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727147187 0 0) 0x7fd1fc15a8b0 con 0x7fd1fc06d740 2023-11-24T06:32:05.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd201e7f640 1 --2- 172.21.15.143:0/2160572533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc0c9650 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097c0 tx=0x7fd1f801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef33ddf2afc122a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd200e7d640 1 -- 172.21.15.143:0/2160572533 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80ac620 con 0x7fd1fc15a4d0 2023-11-24T06:32:05.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd200e7d640 1 -- 172.21.15.143:0/2160572533 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80ac780 con 0x7fd1fc15a4d0 2023-11-24T06:32:05.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd200e7d640 1 -- 172.21.15.143:0/2160572533 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80acb10 con 0x7fd1fc15a4d0 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 -- 172.21.15.143:0/2160572533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc15a4d0 msgr2=0x7fd1fc0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 --2- 172.21.15.143:0/2160572533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc0c9650 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097c0 tx=0x7fd1f801c3c0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 -- 172.21.15.143:0/2160572533 shutdown_connections 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 --2- 172.21.15.143:0/2160572533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 --2- 172.21.15.143:0/2160572533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc0c9650 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 -- 172.21.15.143:0/2160572533 >> 172.21.15.143:0/2160572533 conn(0x7fd1fc0b0bf0 msgr2=0x7fd1fc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 -- 172.21.15.143:0/2160572533 shutdown_connections 2023-11-24T06:32:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.353+0000 7fd2040e3640 1 -- 172.21.15.143:0/2160572533 wait complete. 2023-11-24T06:32:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 Processor -- start 2023-11-24T06:32:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 -- start start 2023-11-24T06:32:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 0x7fd1fc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc09b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc163560 con 0x7fd1fc06d740 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0c4c30 con 0x7fd1fc15a4d0 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0c4f10 con 0x7fd1fc0cad20 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 0x7fd1fc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 0x7fd1fc1586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45480/0 (socket says 172.21.15.143:45480) 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 -- 172.21.15.143:0/3508916995 learned_addr learned my addr 172.21.15.143:0/3508916995 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd20167e640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd202680640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc09b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 -- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 msgr2=0x7fd1fc0c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc0c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 -- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1fc15a4d0 msgr2=0x7fd1fc09b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc09b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 -- 172.21.15.143:0/3508916995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8009420 con 0x7fd1fc06d740 2023-11-24T06:32:05.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd201e7f640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 0x7fd1fc1586b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8019ff0 tx=0x7fd1f801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80b8450 con 0x7fd1fc06d740 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80b85b0 con 0x7fd1fc06d740 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80b8960 con 0x7fd1fc06d740 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc06e0e0 con 0x7fd1fc06d740 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.357+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc0c54d0 con 0x7fd1fc06d740 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.361+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc09d250 con 0x7fd1fc06d740 2023-11-24T06:32:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.361+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fd1f80aa070 con 0x7fd1fc06d740 2023-11-24T06:32:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.361+0000 7fd1f27fc640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1e0066860 0x7fd1e0068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.361+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fd1f811ede0 con 0x7fd1fc06d740 2023-11-24T06:32:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.361+0000 7fd20167e640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1e0066860 0x7fd1e0068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.361+0000 7fd20167e640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1e0066860 0x7fd1e0068d20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc1f9d80 tx=0x7fd1ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.365+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1f80ebb80 con 0x7fd1fc06d740 2023-11-24T06:32:05.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.525+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd1fc072530 con 0x7fd1fc06d740 2023-11-24T06:32:05.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.525+0000 7fd1f27fc640 1 -- 172.21.15.143:0/3508916995 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd1f80bc080 con 0x7fd1fc06d740 2023-11-24T06:32:05.533 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:32:05.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1e0066860 msgr2=0x7fd1e0068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1e0066860 0x7fd1e0068d20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc1f9d80 tx=0x7fd1ec008040 comp rx=0 tx=0).stop 2023-11-24T06:32:05.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 msgr2=0x7fd1fc1586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 0x7fd1fc1586b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8019ff0 tx=0x7fd1f801ac00 comp rx=0 tx=0).stop 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 shutdown_connections 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1e0066860 0x7fd1e0068d20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1fc15a4d0 0x7fd1fc09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1fc0cad20 0x7fd1fc0c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 --2- 172.21.15.143:0/3508916995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1fc06d740 0x7fd1fc1586b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 >> 172.21.15.143:0/3508916995 conn(0x7fd1fc0b0bf0 msgr2=0x7fd1fc071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 shutdown_connections 2023-11-24T06:32:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.529+0000 7fd2040e3640 1 -- 172.21.15.143:0/3508916995 wait complete. 2023-11-24T06:32:05.554 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:32:05.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:05.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:32:05.589 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:32:05.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:05.589 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:32:05.639 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:05.639 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:05.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:32:05.648 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:05.649 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:05.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:32:05.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:05.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 Processor -- start 2023-11-24T06:32:05.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 -- start start 2023-11-24T06:32:05.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffabc0ae9c0 0x7ffabc161c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc15e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc1617f0 con 0x7ffabc0ce770 2023-11-24T06:32:05.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc15e7d0 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.825+0000 7ffac0957640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc15eab0 con 0x7ffabc15dd10 2023-11-24T06:32:05.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffab9d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffabad9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffabc0ce770 0x7ffabc0cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:38644/0 (socket says 172.21.15.143:38644) 2023-11-24T06:32:05.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffaba59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffabc0ae9c0 0x7ffabc161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffabad9d640 1 -- 172.21.15.143:0/319981115 learned_addr learned my addr 172.21.15.143:0/319981115 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:05.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffab959a640 1 -- 172.21.15.143:0/319981115 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619380452 0 0) 0x7ffabc1617f0 con 0x7ffabc0ce770 2023-11-24T06:32:05.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffaba59c640 1 -- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 msgr2=0x7ffabc15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:05.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffaba59c640 1 --2- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc15e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffaba59c640 1 -- 172.21.15.143:0/319981115 >> v1:172.21.15.146:6789/0 conn(0x7ffabc0ce770 legacy=0x7ffabc0cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffaba59c640 1 -- 172.21.15.143:0/319981115 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc161480 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffab9d9b640 1 --2- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:05.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffaba59c640 1 --2- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc161c80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0097c0 tx=0x7ffaac01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4767025ed9fe5aa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffab959a640 1 -- 172.21.15.143:0/319981115 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac004230 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.829+0000 7ffab959a640 1 -- 172.21.15.143:0/319981115 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac0a7050 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffab959a640 1 -- 172.21.15.143:0/319981115 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac003620 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ae9c0 msgr2=0x7ffabc161c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 --2- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc161c80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0097c0 tx=0x7ffaac01c3f0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- 172.21.15.143:0/319981115 shutdown_connections 2023-11-24T06:32:05.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 --2- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 --2- 172.21.15.143:0/319981115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc161c80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- 172.21.15.143:0/319981115 >> 172.21.15.143:0/319981115 conn(0x7ffabc0b1180 msgr2=0x7ffabc0b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:05.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- 172.21.15.143:0/319981115 shutdown_connections 2023-11-24T06:32:05.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- 172.21.15.143:0/319981115 wait complete. 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 Processor -- start 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- start start 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ce770 0x7ffabc150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc153c40 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.841 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc153ee0 con 0x7ffabc0ce770 2023-11-24T06:32:05.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffac0957640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1541c0 con 0x7ffabc15dd10 2023-11-24T06:32:05.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc14f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45494/0 (socket says 172.21.15.143:45494) 2023-11-24T06:32:05.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffaba59c640 1 -- 172.21.15.143:0/3689107130 learned_addr learned my addr 172.21.15.143:0/3689107130 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:05.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffab9d9b640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ce770 0x7ffabc150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.833+0000 7ffabad9d640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaba59c640 1 -- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 msgr2=0x7ffabc151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaba59c640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaba59c640 1 -- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ce770 msgr2=0x7ffabc150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:05.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaba59c640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ce770 0x7ffabc150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaba59c640 1 -- 172.21.15.143:0/3689107130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00093b0 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaba59c640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc14f8c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ffaac01aaa0 tx=0x7ffaac019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac003b70 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac003cd0 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac009420 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab680 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc154780 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc154970 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.837+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7ffaac0b2050 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.841+0000 7ffaaaffd640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa9c066860 0x7ffa9c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:05.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.841+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7ffaac11ec80 con 0x7ffabc0ae9c0 2023-11-24T06:32:05.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.841+0000 7ffab9d9b640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa9c066860 0x7ffa9c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:05.847 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.841+0000 7ffab9d9b640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa9c066860 0x7ffa9c068d20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0c97a0 tx=0x7ffab0006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:05.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:05.845+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffaac0eba90 con 0x7ffabc0ae9c0 2023-11-24T06:32:06.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffabc067520 con 0x7ffabc0ae9c0 2023-11-24T06:32:06.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffaaaffd640 1 -- 172.21.15.143:0/3689107130 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4913 (secure 0 0 0) 0x7ffaac10d070 con 0x7ffabc0ae9c0 2023-11-24T06:32:06.034 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:06.034 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:49.351133+0000","modified":"2023-11-24T06:31:52.429632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/290735663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":290735663},{"type":"v1","addr":"172.21.15.146:6835","nonce":290735663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:32:06.035 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 36 2023-11-24T06:32:06.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa9c066860 msgr2=0x7ffa9c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa9c066860 0x7ffa9c068d20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0c97a0 tx=0x7ffab0006f90 comp rx=0 tx=0).stop 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 msgr2=0x7ffabc14f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc14f8c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ffaac01aaa0 tx=0x7ffaac019190 comp rx=0 tx=0).stop 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 shutdown_connections 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa9c066860 0x7ffa9c068d20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffabc15dd10 0x7ffabc151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffabc0ce770 0x7ffabc150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 --2- 172.21.15.143:0/3689107130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffabc0ae9c0 0x7ffabc14f8c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 >> 172.21.15.143:0/3689107130 conn(0x7ffabc0b1180 msgr2=0x7ffabc0cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 shutdown_connections 2023-11-24T06:32:06.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.029+0000 7ffac0957640 1 -- 172.21.15.143:0/3689107130 wait complete. 2023-11-24T06:32:06.056 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:06.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.189+0000 7ff4782a9640 1 Processor -- start 2023-11-24T06:32:06.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.189+0000 7ff4782a9640 1 -- start start 2023-11-24T06:32:06.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff4782a9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff470158a50 0x7ff47006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff4782a9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff4782a9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff47006cb90 0x7ff470070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff4782a9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47006e0b0 con 0x7ff470158a50 2023-11-24T06:32:06.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff4782a9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47006dc20 con 0x7ff47006cb90 2023-11-24T06:32:06.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff4782a9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700b3620 con 0x7ff47006e340 2023-11-24T06:32:06.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff470158a50 0x7ff47006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff470158a50 0x7ff47006c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45510/0 (socket says 172.21.15.143:45510) 2023-11-24T06:32:06.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 -- 172.21.15.143:0/2140383248 learned_addr learned my addr 172.21.15.143:0/2140383248 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:06.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 -- 172.21.15.143:0/2140383248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 msgr2=0x7ff4700707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:06.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 --2- 172.21.15.143:0/2140383248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 -- 172.21.15.143:0/2140383248 >> v2:172.21.15.146:3300/0 conn(0x7ff47006cb90 msgr2=0x7ff470070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:06.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 --2- 172.21.15.143:0/2140383248 >> v2:172.21.15.146:3300/0 conn(0x7ff47006cb90 0x7ff470070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 -- 172.21.15.143:0/2140383248 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470158e30 con 0x7ff470158a50 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff476045640 1 --2- 172.21.15.143:0/2140383248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff47006c650 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff47006b5e0 tx=0x7ff46c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c214bb34b5d2b4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff475043640 1 -- 172.21.15.143:0/2140383248 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0aa5f0 con 0x7ff470158a50 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff475043640 1 -- 172.21.15.143:0/2140383248 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0aa750 con 0x7ff470158a50 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.193+0000 7ff475043640 1 -- 172.21.15.143:0/2140383248 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0aaae0 con 0x7ff470158a50 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- 172.21.15.143:0/2140383248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 msgr2=0x7ff47006c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- 172.21.15.143:0/2140383248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff47006c650 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff47006b5e0 tx=0x7ff46c01c4d0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- 172.21.15.143:0/2140383248 shutdown_connections 2023-11-24T06:32:06.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- 172.21.15.143:0/2140383248 >> v2:172.21.15.146:3300/0 conn(0x7ff47006cb90 0x7ff470070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- 172.21.15.143:0/2140383248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- 172.21.15.143:0/2140383248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff47006c650 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- 172.21.15.143:0/2140383248 >> 172.21.15.143:0/2140383248 conn(0x7ff4700b0bf0 msgr2=0x7ff4700b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- 172.21.15.143:0/2140383248 shutdown_connections 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- 172.21.15.143:0/2140383248 wait complete. 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 Processor -- start 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- start start 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47006cb90 0x7ff470159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff470152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700ac7e0 con 0x7ff470158a50 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700acac0 con 0x7ff47006cb90 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff4782a9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700acda0 con 0x7ff47006e340 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff476846640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff470152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff476846640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff470152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45526/0 (socket says 172.21.15.143:45526) 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff476846640 1 -- 172.21.15.143:0/364725373 learned_addr learned my addr 172.21.15.143:0/364725373 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.197+0000 7ff476045640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47006cb90 0x7ff470159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff475844640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff476846640 1 -- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 msgr2=0x7ff4700999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff476846640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff476846640 1 -- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47006cb90 msgr2=0x7ff470159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff476846640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47006cb90 0x7ff470159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff476846640 1 -- 172.21.15.143:0/364725373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0094d0 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff476846640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff470152c80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff46800b9e0 tx=0x7ff46800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800cb20 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800cca0 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4700ad080 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468014680 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff470099f20 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff470067520 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7ff46801d3b0 con 0x7ff470158a50 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff466ffd640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff454066860 0x7ff454068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.201+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7ff468084520 con 0x7ff470158a50 2023-11-24T06:32:06.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.205+0000 7ff476045640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff454066860 0x7ff454068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.205+0000 7ff476045640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff454066860 0x7ff454068d20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0ae000 tx=0x7ff46c0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.205+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4680513f0 con 0x7ff470158a50 2023-11-24T06:32:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.357+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4700af630 con 0x7ff470158a50 2023-11-24T06:32:06.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff466ffd640 1 -- 172.21.15.143:0/364725373 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16721 (secure 0 0 0) 0x7ff468054a10 con 0x7ff470158a50 2023-11-24T06:32:06.366 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:06.366 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":60,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:05.116822+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":60,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:06.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff454066860 msgr2=0x7ff454068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff454066860 0x7ff454068d20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0ae000 tx=0x7ff46c0b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 msgr2=0x7ff470152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff470152c80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff46800b9e0 tx=0x7ff46800bea0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 shutdown_connections 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff454066860 0x7ff454068d20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff470158a50 0x7ff470152c80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff47006e340 0x7ff4700999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 --2- 172.21.15.143:0/364725373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47006cb90 0x7ff470159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 >> 172.21.15.143:0/364725373 conn(0x7ff4700b0bf0 msgr2=0x7ff4700aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 shutdown_connections 2023-11-24T06:32:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.361+0000 7ff4782a9640 1 -- 172.21.15.143:0/364725373 wait complete. 2023-11-24T06:32:06.388 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:31:47.711527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:31:48.345537+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:06.388 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:06.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb29c365640 1 Processor -- start 2023-11-24T06:32:06.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb29c365640 1 -- start start 2023-11-24T06:32:06.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb29c365640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2940cd850 0x7fb29415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb29c365640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2940b3510 con 0x7fb2940ce420 2023-11-24T06:32:06.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb29c365640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2940b37f0 con 0x7fb2940ae4a0 2023-11-24T06:32:06.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb29c365640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940b3ad0 con 0x7fb2940cd850 2023-11-24T06:32:06.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb299900640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb2940ce420 0x7fb29406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33680/0 (socket says 172.21.15.143:33680) 2023-11-24T06:32:06.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.525+0000 7fb299900640 1 -- 172.21.15.143:0/3975062257 learned_addr learned my addr 172.21.15.143:0/3975062257 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb29a902640 1 --2- 172.21.15.143:0/3975062257 >> v2:172.21.15.146:3300/0 conn(0x7fb2940cd850 0x7fb29415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726272409 0 0) 0x7fb2940b3510 con 0x7fb2940ce420 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb280003530 con 0x7fb2940ce420 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268915479 0 0) 0x7fb2940b37f0 con 0x7fb2940ae4a0 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2940b3510 con 0x7fb2940ae4a0 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb29a902640 1 -- 172.21.15.143:0/3975062257 >> v1:172.21.15.146:6789/0 conn(0x7fb2940ae4a0 legacy=0x7fb2940cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb29a902640 1 -- 172.21.15.143:0/3975062257 >> v1:172.21.15.143:6789/0 conn(0x7fb2940ce420 legacy=0x7fb29406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb29a902640 1 -- 172.21.15.143:0/3975062257 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940b3db0 con 0x7fb2940cd850 2023-11-24T06:32:06.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb29a902640 1 --2- 172.21.15.143:0/3975062257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940cd850 0x7fb29415ba00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009d90 tx=0x7fb28c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de769bc300076ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0a5a00 con 0x7fb2940cd850 2023-11-24T06:32:06.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c0a5b60 con 0x7fb2940cd850 2023-11-24T06:32:06.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.529+0000 7fb2990ff640 1 -- 172.21.15.143:0/3975062257 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0ad440 con 0x7fb2940cd850 2023-11-24T06:32:06.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- 172.21.15.143:0/3975062257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940cd850 msgr2=0x7fb29415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 --2- 172.21.15.143:0/3975062257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940cd850 0x7fb29415ba00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009d90 tx=0x7fb28c01c920 comp rx=0 tx=0).stop 2023-11-24T06:32:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- 172.21.15.143:0/3975062257 shutdown_connections 2023-11-24T06:32:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 --2- 172.21.15.143:0/3975062257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940cd850 0x7fb29415ba00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- 172.21.15.143:0/3975062257 >> 172.21.15.143:0/3975062257 conn(0x7fb2940b0c80 msgr2=0x7fb2940b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- 172.21.15.143:0/3975062257 shutdown_connections 2023-11-24T06:32:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- 172.21.15.143:0/3975062257 wait complete. 2023-11-24T06:32:06.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 Processor -- start 2023-11-24T06:32:06.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- start start 2023-11-24T06:32:06.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2940ae4a0 0x7fb2941543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 0x7fb29414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940ce420 0x7fb29409c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941549f0 con 0x7fb2940cd850 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294152a60 con 0x7fb2940ce420 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29c365640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb294152d40 con 0x7fb2940ae4a0 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 0x7fb29414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 0x7fb29414ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45540/0 (socket says 172.21.15.143:45540) 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 -- 172.21.15.143:0/384367379 learned_addr learned my addr 172.21.15.143:0/384367379 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29a902640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940ce420 0x7fb29409c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb29a101640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2940ae4a0 0x7fb2941543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 -- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2940ae4a0 msgr2=0x7fb2941543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2940ae4a0 0x7fb2941543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 -- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940ce420 msgr2=0x7fb29409c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940ce420 0x7fb29409c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.533+0000 7fb299900640 1 -- 172.21.15.143:0/384367379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009a70 con 0x7fb2940cd850 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb299900640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 0x7fb29414ddf0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb284005890 tx=0x7fb28400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284005cf0 con 0x7fb2940cd850 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284005e50 con 0x7fb2940cd850 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2840072d0 con 0x7fb2940cd850 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb294153020 con 0x7fb2940cd850 2023-11-24T06:32:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb294155a40 con 0x7fb2940cd850 2023-11-24T06:32:06.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294154b60 con 0x7fb2940cd850 2023-11-24T06:32:06.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fb284007430 con 0x7fb2940cd850 2023-11-24T06:32:06.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb28affd640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb278066860 0x7fb278068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fb284083af0 con 0x7fb2940cd850 2023-11-24T06:32:06.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.537+0000 7fb29a101640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb278066860 0x7fb278068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.541+0000 7fb29a101640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb278066860 0x7fb278068d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb2940b0460 tx=0x7fb290009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.541+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb284050a00 con 0x7fb2940cd850 2023-11-24T06:32:06.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.693+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb29404e8c0 con 0x7fb2940cd850 2023-11-24T06:32:06.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.693+0000 7fb28affd640 1 -- 172.21.15.143:0/384367379 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2840170a0 con 0x7fb2940cd850 2023-11-24T06:32:06.699 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:06.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb278066860 msgr2=0x7fb278068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb278066860 0x7fb278068d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb2940b0460 tx=0x7fb290009040 comp rx=0 tx=0).stop 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 msgr2=0x7fb29414ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 0x7fb29414ddf0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb284005890 tx=0x7fb28400c8b0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 shutdown_connections 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb278066860 0x7fb278068d20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2940ce420 0x7fb29409c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2940cd850 0x7fb29414ddf0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 --2- 172.21.15.143:0/384367379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2940ae4a0 0x7fb2941543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 >> 172.21.15.143:0/384367379 conn(0x7fb2940b0c80 msgr2=0x7fb2940aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:06.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 shutdown_connections 2023-11-24T06:32:06.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.697+0000 7fb29c365640 1 -- 172.21.15.143:0/384367379 wait complete. 2023-11-24T06:32:06.721 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:32:06.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 Processor -- start 2023-11-24T06:32:06.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 -- start start 2023-11-24T06:32:06.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4d0015a290 0x7f4d000707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0015ec60 0x7f4d000cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d00071170 con 0x7f4d000cc6b0 2023-11-24T06:32:06.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d000cb690 con 0x7f4d0015a290 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4d05d1d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000cb970 con 0x7f4d0015ec60 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4d0015a290 0x7f4d000707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4d0015a290 0x7f4d000707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45552/0 (socket says 172.21.15.143:45552) 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 -- 172.21.15.143:0/1909805777 learned_addr learned my addr 172.21.15.143:0/1909805777 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cf7fff640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0015ec60 0x7f4d000cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 -- 172.21.15.143:0/1909805777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0015ec60 msgr2=0x7f4d000cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0015ec60 0x7f4d000cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 -- 172.21.15.143:0/1909805777 >> v1:172.21.15.146:6789/0 conn(0x7f4d000cc6b0 legacy=0x7f4d000b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cff7fe640 1 -- 172.21.15.143:0/1909805777 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000cbc50 con 0x7f4d0015a290 2023-11-24T06:32:06.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.857+0000 7f4cf7fff640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0015ec60 0x7f4d000cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:06.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4cff7fe640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015a290 0x7f4d000707f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000bb10 tx=0x7f4cf001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e3545aefe3aec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4cfeffd640 1 -- 172.21.15.143:0/1909805777 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00a7c70 con 0x7f4d0015a290 2023-11-24T06:32:06.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4cfeffd640 1 -- 172.21.15.143:0/1909805777 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf00a7dd0 con 0x7f4d0015a290 2023-11-24T06:32:06.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4cfeffd640 1 -- 172.21.15.143:0/1909805777 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00af660 con 0x7f4d0015a290 2023-11-24T06:32:06.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 -- 172.21.15.143:0/1909805777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015a290 msgr2=0x7f4d000707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015a290 0x7f4d000707f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000bb10 tx=0x7f4cf001eb80 comp rx=0 tx=0).stop 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 -- 172.21.15.143:0/1909805777 shutdown_connections 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0015ec60 0x7f4d000cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/1909805777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015a290 0x7f4d000707f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 -- 172.21.15.143:0/1909805777 >> 172.21.15.143:0/1909805777 conn(0x7f4d000b0c80 msgr2=0x7f4d000b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 -- 172.21.15.143:0/1909805777 shutdown_connections 2023-11-24T06:32:06.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 -- 172.21.15.143:0/1909805777 wait complete. 2023-11-24T06:32:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.861+0000 7f4d05d1d640 1 Processor -- start 2023-11-24T06:32:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- start start 2023-11-24T06:32:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d000cc6b0 0x7f4d001580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0015a290 0x7f4d001f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 0x7f4d001fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000b0950 con 0x7f4d0015ec60 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001539b0 con 0x7f4d0015a290 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000b00b0 con 0x7f4d000cc6b0 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 0x7f4d001fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 0x7f4d001fa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45566/0 (socket says 172.21.15.143:45566) 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 -- 172.21.15.143:0/2514238476 learned_addr learned my addr 172.21.15.143:0/2514238476 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cf7fff640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0015a290 0x7f4d001f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cff7fe640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d000cc6b0 0x7f4d001580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 -- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d000cc6b0 msgr2=0x7f4d001580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d000cc6b0 0x7f4d001580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 -- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0015a290 msgr2=0x7f4d001f9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0015a290 0x7f4d001f9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 -- 172.21.15.143:0/2514238476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf000b770 con 0x7f4d0015ec60 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfffff640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 0x7f4d001fa0f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c770 tx=0x7f4cf800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8003b80 con 0x7f4d0015ec60 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8003ce0 con 0x7f4d0015ec60 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d000b0390 con 0x7f4d0015ec60 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800aa90 con 0x7f4d0015ec60 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d000afd10 con 0x7f4d0015ec60 2023-11-24T06:32:06.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.865+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d00153b40 con 0x7f4d0015ec60 2023-11-24T06:32:06.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.869+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f4cf800abf0 con 0x7f4d0015ec60 2023-11-24T06:32:06.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.869+0000 7f4cfcff9640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ce0066890 0x7f4ce0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:06.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.869+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f4cf8084300 con 0x7f4d0015ec60 2023-11-24T06:32:06.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.869+0000 7f4cff7fe640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ce0066890 0x7f4ce0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:06.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.869+0000 7f4cff7fe640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ce0066890 0x7f4ce0068d50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00b1000 tx=0x7f4cf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:06.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:06.873+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cf80511d0 con 0x7f4d0015ec60 2023-11-24T06:32:07.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.021+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d0004e8c0 con 0x7f4d0015ec60 2023-11-24T06:32:07.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.021+0000 7f4cfcff9640 1 -- 172.21.15.143:0/2514238476 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4cf80547f0 con 0x7f4d0015ec60 2023-11-24T06:32:07.028 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:32:07.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ce0066890 msgr2=0x7f4ce0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ce0066890 0x7f4ce0068d50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00b1000 tx=0x7f4cf0008040 comp rx=0 tx=0).stop 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 msgr2=0x7f4d001fa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 0x7f4d001fa0f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c770 tx=0x7f4cf800cc30 comp rx=0 tx=0).stop 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 shutdown_connections 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ce0066890 0x7f4ce0068d50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d0015ec60 0x7f4d001fa0f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0015a290 0x7f4d001f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 --2- 172.21.15.143:0/2514238476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d000cc6b0 0x7f4d001580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 >> 172.21.15.143:0/2514238476 conn(0x7f4d000b0c80 msgr2=0x7f4d000b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 shutdown_connections 2023-11-24T06:32:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.025+0000 7f4d05d1d640 1 -- 172.21.15.143:0/2514238476 wait complete. 2023-11-24T06:32:07.049 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:32:07.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 Processor -- start 2023-11-24T06:32:07.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 -- start start 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9740ce420 0x7fe97415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe9740cd850 0x7fe97406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9740b3510 con 0x7fe9740ae4a0 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9740b37f0 con 0x7fe9740cd850 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe979679640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9740b3ad0 con 0x7fe9740ce420 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe972ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe9740ae4a0 0x7fe9740cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33684/0 (socket says 172.21.15.143:33684) 2023-11-24T06:32:07.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe972ffd640 1 -- 172.21.15.143:0/2738800760 learned_addr learned my addr 172.21.15.143:0/2738800760 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:07.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9737fe640 1 --2- 172.21.15.143:0/2738800760 >> v2:172.21.15.143:3300/0 conn(0x7fe9740cd850 0x7fe97406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe96a7fc640 1 --2- 172.21.15.143:0/2738800760 >> v2:172.21.15.146:3300/0 conn(0x7fe9740ce420 0x7fe97415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9727fc640 1 -- 172.21.15.143:0/2738800760 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833013016 0 0) 0x7fe9740b3510 con 0x7fe9740ae4a0 2023-11-24T06:32:07.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9727fc640 1 -- 172.21.15.143:0/2738800760 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe960003530 con 0x7fe9740ae4a0 2023-11-24T06:32:07.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9737fe640 1 -- 172.21.15.143:0/2738800760 >> v2:172.21.15.146:3300/0 conn(0x7fe9740ce420 msgr2=0x7fe97415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:07.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9737fe640 1 --2- 172.21.15.143:0/2738800760 >> v2:172.21.15.146:3300/0 conn(0x7fe9740ce420 0x7fe97415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9737fe640 1 -- 172.21.15.143:0/2738800760 >> v1:172.21.15.143:6789/0 conn(0x7fe9740ae4a0 legacy=0x7fe9740cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe9737fe640 1 -- 172.21.15.143:0/2738800760 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740b3db0 con 0x7fe9740cd850 2023-11-24T06:32:07.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.185+0000 7fe96a7fc640 1 --2- 172.21.15.143:0/2738800760 >> v2:172.21.15.146:3300/0 conn(0x7fe9740ce420 0x7fe97415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:07.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe9737fe640 1 --2- 172.21.15.143:0/2738800760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740cd850 0x7fe97406c640 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe9740b45b0 tx=0x7fe96c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d643a1cc8eda8f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe9727fc640 1 -- 172.21.15.143:0/2738800760 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0a59c0 con 0x7fe9740cd850 2023-11-24T06:32:07.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe9727fc640 1 -- 172.21.15.143:0/2738800760 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0a5b20 con 0x7fe9740cd850 2023-11-24T06:32:07.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe9727fc640 1 -- 172.21.15.143:0/2738800760 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0ad440 con 0x7fe9740cd850 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 -- 172.21.15.143:0/2738800760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740cd850 msgr2=0x7fe97406c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 --2- 172.21.15.143:0/2738800760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740cd850 0x7fe97406c640 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe9740b45b0 tx=0x7fe96c01c8e0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 -- 172.21.15.143:0/2738800760 shutdown_connections 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 --2- 172.21.15.143:0/2738800760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740cd850 0x7fe97406c640 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 --2- 172.21.15.143:0/2738800760 >> v2:172.21.15.146:3300/0 conn(0x7fe9740ce420 0x7fe97415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 -- 172.21.15.143:0/2738800760 >> 172.21.15.143:0/2738800760 conn(0x7fe9740b0c80 msgr2=0x7fe9740b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 -- 172.21.15.143:0/2738800760 shutdown_connections 2023-11-24T06:32:07.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.189+0000 7fe979679640 1 -- 172.21.15.143:0/2738800760 wait complete. 2023-11-24T06:32:07.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 Processor -- start 2023-11-24T06:32:07.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 -- start start 2023-11-24T06:32:07.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 0x7fe9740987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9740cd850 0x7fe97414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9740ce420 0x7fe97414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974152fa0 con 0x7fe9740ae4a0 2023-11-24T06:32:07.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740705e0 con 0x7fe9740ce420 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415ba10 con 0x7fe9740cd850 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 0x7fe9740987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 0x7fe9740987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45576/0 (socket says 172.21.15.143:45576) 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 -- 172.21.15.143:0/3728119518 learned_addr learned my addr 172.21.15.143:0/3728119518 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe9737fe640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9740ce420 0x7fe97414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe96a7fc640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9740cd850 0x7fe97414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 -- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9740cd850 msgr2=0x7fe97414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9740cd850 0x7fe97414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 -- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9740ce420 msgr2=0x7fe97414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9740ce420 0x7fe97414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 -- 172.21.15.143:0/3728119518 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c009a70 con 0x7fe9740ae4a0 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe9737fe640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9740ce420 0x7fe97414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe972ffd640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 0x7fe9740987f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c500 tx=0x7fe96400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964005cf0 con 0x7fe9740ae4a0 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe964005e50 con 0x7fe9740ae4a0 2023-11-24T06:32:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9640072f0 con 0x7fe9740ae4a0 2023-11-24T06:32:07.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe974153180 con 0x7fe9740ae4a0 2023-11-24T06:32:07.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.193+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe974153740 con 0x7fe9740ae4a0 2023-11-24T06:32:07.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.197+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97404e8c0 con 0x7fe9740ae4a0 2023-11-24T06:32:07.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.197+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fe964007450 con 0x7fe9740ae4a0 2023-11-24T06:32:07.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.197+0000 7fe96bfff640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe954066860 0x7fe954068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.197+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fe964083b10 con 0x7fe9740ae4a0 2023-11-24T06:32:07.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.197+0000 7fe96a7fc640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe954066860 0x7fe954068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.197+0000 7fe96a7fc640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe954066860 0x7fe954068d20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe97409d2b0 tx=0x7fe95c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.201+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe964050a70 con 0x7fe9740ae4a0 2023-11-24T06:32:07.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.349+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe97406b5c0 con 0x7fe9740ae4a0 2023-11-24T06:32:07.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.349+0000 7fe96bfff640 1 -- 172.21.15.143:0/3728119518 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe964017020 con 0x7fe9740ae4a0 2023-11-24T06:32:07.357 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe954066860 msgr2=0x7fe954068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe954066860 0x7fe954068d20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe97409d2b0 tx=0x7fe95c008040 comp rx=0 tx=0).stop 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 msgr2=0x7fe9740987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 0x7fe9740987f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c500 tx=0x7fe96400c9c0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 shutdown_connections 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe954066860 0x7fe954068d20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9740ce420 0x7fe97414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9740cd850 0x7fe97414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 --2- 172.21.15.143:0/3728119518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9740ae4a0 0x7fe9740987f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 >> 172.21.15.143:0/3728119518 conn(0x7fe9740b0c80 msgr2=0x7fe97415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 shutdown_connections 2023-11-24T06:32:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.353+0000 7fe979679640 1 -- 172.21.15.143:0/3728119518 wait complete. 2023-11-24T06:32:07.379 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:07.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.509+0000 7f189d52e640 1 Processor -- start 2023-11-24T06:32:07.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.509+0000 7f189d52e640 1 -- start start 2023-11-24T06:32:07.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f189d52e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1898144030 0x7f189806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f189d52e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189806d8b0 con 0x7f18980709c0 2023-11-24T06:32:07.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f189d52e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189809d0a0 con 0x7f189809cc20 2023-11-24T06:32:07.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f189d52e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1898145020 con 0x7f1898144030 2023-11-24T06:32:07.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18977fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f18980709c0 0x7f1898070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51294/0 (socket says 172.21.15.143:51294) 2023-11-24T06:32:07.520 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18977fe640 1 -- 172.21.15.143:0/1052282398 learned_addr learned my addr 172.21.15.143:0/1052282398 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 --2- 172.21.15.143:0/1052282398 >> v2:172.21.15.146:3300/0 conn(0x7f1898144030 0x7f189806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901664420 0 0) 0x7f189806d8b0 con 0x7f18980709c0 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1884003530 con 0x7f18980709c0 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442649496 0 0) 0x7f189809d0a0 con 0x7f189809cc20 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f189806d8b0 con 0x7f189809cc20 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142166653 0 0) 0x7f1884003530 con 0x7f18980709c0 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 >> v2:172.21.15.146:3300/0 conn(0x7f1898144030 msgr2=0x7f189806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 --2- 172.21.15.143:0/1052282398 >> v2:172.21.15.146:3300/0 conn(0x7f1898144030 0x7f189806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 >> v1:172.21.15.146:6789/0 conn(0x7f189809cc20 legacy=0x7f189806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189806cca0 con 0x7f18980709c0 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 --2- 172.21.15.143:0/1052282398 >> v2:172.21.15.146:3300/0 conn(0x7f1898144030 0x7f189806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f1890001680 con 0x7f18980709c0 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 >> v1:172.21.15.143:6789/0 conn(0x7f18980709c0 legacy=0x7f1898070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1884003b60 0x7f1884003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840047d0 0x7f1884004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884005190 0x7f188400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188400c060 con 0x7f1884003b60 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188400c1a0 con 0x7f1884005190 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188400c360 con 0x7f18840047d0 2023-11-24T06:32:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1884003b60 0x7f1884003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f188e7fc640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840047d0 0x7f1884004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18977fe640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884005190 0x7f188400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 -- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840047d0 msgr2=0x7f1884004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840047d0 0x7f1884004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 -- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884005190 msgr2=0x7f188400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884005190 0x7f188400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f1896ffd640 1 -- 172.21.15.143:0/1052282398 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884003530 con 0x7f1884003b60 2023-11-24T06:32:07.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.513+0000 7f18977fe640 1 -- 172.21.15.143:0/1052282398 reap_dead start 2023-11-24T06:32:07.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f1896ffd640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1884003b60 0x7f1884003f60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f188800e350 tx=0x7f188801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9ef1206558c8b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880a5e50 con 0x7f1884003b60 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188800f040 con 0x7f1884003b60 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f18967fc640 1 -- 172.21.15.143:0/1052282398 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880ad640 con 0x7f1884003b60 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 -- 172.21.15.143:0/1052282398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1884003b60 msgr2=0x7f1884003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1884003b60 0x7f1884003f60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f188800e350 tx=0x7f188801cdb0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 -- 172.21.15.143:0/1052282398 shutdown_connections 2023-11-24T06:32:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 --2- 172.21.15.143:0/1052282398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1884003b60 0x7f1884003f60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 -- 172.21.15.143:0/1052282398 >> 172.21.15.143:0/1052282398 conn(0x7f18980b0bf0 msgr2=0x7f18980b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:07.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 -- 172.21.15.143:0/1052282398 shutdown_connections 2023-11-24T06:32:07.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.517+0000 7f189d52e640 1 -- 172.21.15.143:0/1052282398 wait complete. 2023-11-24T06:32:07.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 Processor -- start 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- start start 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884003b60 0x7f189815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 0x7f18980af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f189815f6c0 0x7f18980af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980cf5c0 con 0x7f189815f240 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980ce730 con 0x7f1884003b60 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980ce9b0 con 0x7f189815f6c0 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 0x7f18980af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f18977fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f189815f6c0 0x7f18980af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 0x7f18980af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50174/0 (socket says 172.21.15.143:50174) 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 -- 172.21.15.143:0/2344439972 learned_addr learned my addr 172.21.15.143:0/2344439972 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f1896ffd640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884003b60 0x7f189815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 -- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f189815f6c0 msgr2=0x7f18980af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f189815f6c0 0x7f18980af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 -- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884003b60 msgr2=0x7f189815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884003b60 0x7f189815a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 -- 172.21.15.143:0/2344439972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980cec90 con 0x7f189815f240 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188e7fc640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 0x7f18980af3f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f188000f730 tx=0x7f188000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188000fe40 con 0x7f189815f240 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18800052e0 con 0x7f189815f240 2023-11-24T06:32:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18980cef70 con 0x7f189815f240 2023-11-24T06:32:07.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188000d8f0 con 0x7f189815f240 2023-11-24T06:32:07.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189813ee80 con 0x7f189815f240 2023-11-24T06:32:07.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.521+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189806ca60 con 0x7f189815f240 2023-11-24T06:32:07.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.525+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f188000da50 con 0x7f189815f240 2023-11-24T06:32:07.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.525+0000 7f188ffff640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1878066860 0x7f1878068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.525+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1880084430 con 0x7f189815f240 2023-11-24T06:32:07.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.525+0000 7f1896ffd640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1878066860 0x7f1878068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.525+0000 7f1896ffd640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1878066860 0x7f1878068d20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f18880af000 tx=0x7f1888004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.529+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f189806ca60 con 0x7f189815f240 2023-11-24T06:32:07.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.705+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f189806ca60 con 0x7f189815f240 2023-11-24T06:32:07.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.705+0000 7f188ffff640 1 -- 172.21.15.143:0/2344439972 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f189806ca60 con 0x7f189815f240 2023-11-24T06:32:07.713 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:07.713 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:49.351133+0000","modified":"2023-11-24T06:31:52.429632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/290735663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":290735663},{"type":"v1","addr":"172.21.15.146:6835","nonce":290735663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:32:07.713 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 36 2023-11-24T06:32:07.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1878066860 msgr2=0x7f1878068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1878066860 0x7f1878068d20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f18880af000 tx=0x7f1888004ac0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 msgr2=0x7f18980af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 0x7f18980af3f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f188000f730 tx=0x7f188000fbf0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 shutdown_connections 2023-11-24T06:32:07.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1878066860 0x7f1878068d20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f189815f6c0 0x7f18980af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f189815f240 0x7f18980af3f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 --2- 172.21.15.143:0/2344439972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1884003b60 0x7f189815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 >> 172.21.15.143:0/2344439972 conn(0x7f18980b0bf0 msgr2=0x7f189809a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:07.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 shutdown_connections 2023-11-24T06:32:07.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.709+0000 7f189d52e640 1 -- 172.21.15.143:0/2344439972 wait complete. 2023-11-24T06:32:07.734 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:07.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.865+0000 7f6bee157640 1 Processor -- start 2023-11-24T06:32:07.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.865+0000 7f6bee157640 1 -- start start 2023-11-24T06:32:07.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6bee157640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6be806c650 0x7f6be809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6bee157640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6be80709c0 0x7f6be8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6bee157640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be806d8b0 con 0x7f6be8144030 2023-11-24T06:32:07.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6bee157640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be8145020 con 0x7f6be80709c0 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6bee157640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be8071370 con 0x7f6be806c650 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6be80709c0 0x7f6be8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6be80709c0 0x7f6be8070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50176/0 (socket says 172.21.15.143:50176) 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 -- 172.21.15.143:0/393330902 learned_addr learned my addr 172.21.15.143:0/393330902 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be6ffd640 1 --2- 172.21.15.143:0/393330902 >> v2:172.21.15.146:3300/0 conn(0x7f6be806c650 0x7f6be809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 -- 172.21.15.143:0/393330902 >> v2:172.21.15.146:3300/0 conn(0x7f6be806c650 msgr2=0x7f6be809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:07.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 --2- 172.21.15.143:0/393330902 >> v2:172.21.15.146:3300/0 conn(0x7f6be806c650 0x7f6be809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 -- 172.21.15.143:0/393330902 >> v1:172.21.15.146:6789/0 conn(0x7f6be8144030 legacy=0x7f6be806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.869+0000 7f6be7fff640 1 -- 172.21.15.143:0/393330902 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be806cca0 con 0x7f6be80709c0 2023-11-24T06:32:07.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6be7fff640 1 --2- 172.21.15.143:0/393330902 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be80709c0 0x7f6be8070e30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6be80700a0 tx=0x7f6be001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6757644397bb397 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6be67fc640 1 -- 172.21.15.143:0/393330902 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00a5780 con 0x7f6be80709c0 2023-11-24T06:32:07.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6be67fc640 1 -- 172.21.15.143:0/393330902 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be00a58e0 con 0x7f6be80709c0 2023-11-24T06:32:07.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6be67fc640 1 -- 172.21.15.143:0/393330902 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00a5c70 con 0x7f6be80709c0 2023-11-24T06:32:07.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 -- 172.21.15.143:0/393330902 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be80709c0 msgr2=0x7f6be8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 --2- 172.21.15.143:0/393330902 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be80709c0 0x7f6be8070e30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6be80700a0 tx=0x7f6be001c9d0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 -- 172.21.15.143:0/393330902 shutdown_connections 2023-11-24T06:32:07.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 --2- 172.21.15.143:0/393330902 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be80709c0 0x7f6be8070e30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 --2- 172.21.15.143:0/393330902 >> v2:172.21.15.146:3300/0 conn(0x7f6be806c650 0x7f6be809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 -- 172.21.15.143:0/393330902 >> 172.21.15.143:0/393330902 conn(0x7f6be80b0bf0 msgr2=0x7f6be80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:07.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 -- 172.21.15.143:0/393330902 shutdown_connections 2023-11-24T06:32:07.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 -- 172.21.15.143:0/393330902 wait complete. 2023-11-24T06:32:07.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 Processor -- start 2023-11-24T06:32:07.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.873+0000 7f6bee157640 1 -- start start 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6be806c650 0x7f6be813ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6be80709c0 0x7f6be81598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 0x7f6be8159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815a880 con 0x7f6be8144030 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be813ab60 con 0x7f6be80709c0 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815a320 con 0x7f6be806c650 2023-11-24T06:32:07.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 0x7f6be8159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 0x7f6be8159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50178/0 (socket says 172.21.15.143:50178) 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 -- 172.21.15.143:0/2532672889 learned_addr learned my addr 172.21.15.143:0/2532672889 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be6ffd640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6be80709c0 0x7f6be81598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be77fe640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6be806c650 0x7f6be813ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 -- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6be806c650 msgr2=0x7f6be813ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6be806c650 0x7f6be813ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 -- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6be80709c0 msgr2=0x7f6be81598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6be80709c0 0x7f6be81598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 -- 172.21.15.143:0/2532672889 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009b30 con 0x7f6be8144030 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6be7fff640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 0x7f6be8159de0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6be001a600 tx=0x7f6be0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00b6680 con 0x7f6be8144030 2023-11-24T06:32:07.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be00b67e0 con 0x7f6be8144030 2023-11-24T06:32:07.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be8139da0 con 0x7f6be8144030 2023-11-24T06:32:07.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00b6b90 con 0x7f6be8144030 2023-11-24T06:32:07.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be813a360 con 0x7f6be8144030 2023-11-24T06:32:07.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be806e3d0 con 0x7f6be8144030 2023-11-24T06:32:07.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.877+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f6be00b6cf0 con 0x7f6be8144030 2023-11-24T06:32:07.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.881+0000 7f6bcffff640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6bd4066860 0x7f6bd4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:07.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.881+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f6be011f720 con 0x7f6be8144030 2023-11-24T06:32:07.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.881+0000 7f6be77fe640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6bd4066860 0x7f6bd4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:07.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.881+0000 7f6be77fe640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6bd4066860 0x7f6bd4068d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6be815b280 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:07.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:07.885+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6be00ec8c0 con 0x7f6be8144030 2023-11-24T06:32:08.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.033+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6be8067520 con 0x7f6be8144030 2023-11-24T06:32:08.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.033+0000 7f6bcffff640 1 -- 172.21.15.143:0/2532672889 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16721 (secure 0 0 0) 0x7f6be00efee0 con 0x7f6be8144030 2023-11-24T06:32:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:08.041 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":60,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:05.116822+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":60,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6bd4066860 msgr2=0x7f6bd4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6bd4066860 0x7f6bd4068d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6be815b280 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 msgr2=0x7f6be8159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 0x7f6be8159de0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6be001a600 tx=0x7f6be0019770 comp rx=0 tx=0).stop 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 shutdown_connections 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6bd4066860 0x7f6bd4068d20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6be8144030 0x7f6be8159de0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6be80709c0 0x7f6be81598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 --2- 172.21.15.143:0/2532672889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6be806c650 0x7f6be813ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 >> 172.21.15.143:0/2532672889 conn(0x7f6be80b0bf0 msgr2=0x7f6be80723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:08.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 shutdown_connections 2023-11-24T06:32:08.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.037+0000 7f6bee157640 1 -- 172.21.15.143:0/2532672889 wait complete. 2023-11-24T06:32:08.062 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:32:08.063 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:08.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 Processor -- start 2023-11-24T06:32:08.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 -- start start 2023-11-24T06:32:08.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 0x7fbb2c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb2c0ce8b0 0x7fbb2c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0d1cc0 con 0x7fbb2c0d3020 2023-11-24T06:32:08.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0d1fa0 con 0x7fbb2c0ce8b0 2023-11-24T06:32:08.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb30d94640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ce0b0 con 0x7fbb2c15d570 2023-11-24T06:32:08.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb21d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fbb2c0d3020 0x7fbb2c0d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51310/0 (socket says 172.21.15.143:51310) 2023-11-24T06:32:08.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb21d9b640 1 -- 172.21.15.143:0/784954302 learned_addr learned my addr 172.21.15.143:0/784954302 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:08.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb2a59c640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 0x7fbb2c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/784954302 >> v2:172.21.15.146:3300/0 conn(0x7fbb2c0ce8b0 0x7fbb2c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589641836 0 0) 0x7fbb2c0d1cc0 con 0x7fbb2c0d3020 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb18003530 con 0x7fbb2c0d3020 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836907014 0 0) 0x7fbb18003530 con 0x7fbb2c0d3020 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 msgr2=0x7fbb2c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 0x7fbb2c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 >> v2:172.21.15.146:3300/0 conn(0x7fbb2c0ce8b0 msgr2=0x7fbb2c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 --2- 172.21.15.143:0/784954302 >> v2:172.21.15.146:3300/0 conn(0x7fbb2c0ce8b0 0x7fbb2c0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0ce390 con 0x7fbb2c0d3020 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fbb1c001680 con 0x7fbb2c0d3020 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 >> v1:172.21.15.143:6789/0 conn(0x7fbb2c0d3020 legacy=0x7fbb2c0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 0x7fbb18003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb18004d10 0x7fbb18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0d1fa0 con 0x7fbb18004d10 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ce0b0 con 0x7fbb18003f00 2023-11-24T06:32:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1800b990 con 0x7fbb2c15d570 2023-11-24T06:32:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb18004d10 0x7fbb18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb21d9b640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.197+0000 7fbb2a59c640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 0x7fbb18003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 msgr2=0x7fbb18003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c15d570 0x7fbb18003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18003f00 msgr2=0x7fbb180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:08.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/784954302 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18003530 con 0x7fbb18004d10 2023-11-24T06:32:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb18004d10 0x7fbb18005190 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009fc0 tx=0x7fbb2401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602d54c8ffb9c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240a5cb0 con 0x7fbb18004d10 2023-11-24T06:32:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400f040 con 0x7fbb18004d10 2023-11-24T06:32:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb29d9b640 1 -- 172.21.15.143:0/784954302 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240ad680 con 0x7fbb18004d10 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb30d94640 1 -- 172.21.15.143:0/784954302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb18004d10 msgr2=0x7fbb18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb30d94640 1 --2- 172.21.15.143:0/784954302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb18004d10 0x7fbb18005190 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009fc0 tx=0x7fbb2401cc40 comp rx=0 tx=0).stop 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/784954302 reap_dead start 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb30d94640 1 -- 172.21.15.143:0/784954302 shutdown_connections 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb30d94640 1 -- 172.21.15.143:0/784954302 >> 172.21.15.143:0/784954302 conn(0x7fbb2c08ceb0 msgr2=0x7fbb2c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb30d94640 1 -- 172.21.15.143:0/784954302 shutdown_connections 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.201+0000 7fbb30d94640 1 -- 172.21.15.143:0/784954302 wait complete. 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 Processor -- start 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 -- start start 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18004d10 0x7fbb2c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c0ca4d0 0x7fbb2c160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 0x7fbb2c0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0b2210 con 0x7fbb2c0b1850 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0cc970 con 0x7fbb18004d10 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb30d94640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ccc50 con 0x7fbb2c0ca4d0 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 0x7fbb2c0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 0x7fbb2c0b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50202/0 (socket says 172.21.15.143:50202) 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/3158174320 learned_addr learned my addr 172.21.15.143:0/3158174320 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2a59c640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18004d10 0x7fbb2c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb21d9b640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c0ca4d0 0x7fbb2c160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c0ca4d0 msgr2=0x7fbb2c160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c0ca4d0 0x7fbb2c160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18004d10 msgr2=0x7fbb2c152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18004d10 0x7fbb2c152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 -- 172.21.15.143:0/3158174320 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0ccf30 con 0x7fbb2c0b1850 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2a59c640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18004d10 0x7fbb2c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb21d9b640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c0ca4d0 0x7fbb2c160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.205+0000 7fbb2ad9d640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 0x7fbb2c0b1cd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbb240b0040 tx=0x7fbb24009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240aeab0 con 0x7fbb2c0b1850 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb240aec10 con 0x7fbb2c0b1850 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240039a0 con 0x7fbb2c0b1850 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c0cd210 con 0x7fbb2c0b1850 2023-11-24T06:32:08.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c152ec0 con 0x7fbb2c0b1850 2023-11-24T06:32:08.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c067520 con 0x7fbb2c0b1850 2023-11-24T06:32:08.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fbb240b4040 con 0x7fbb2c0b1850 2023-11-24T06:32:08.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb237fe640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbb0c066890 0x7fbb0c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fbb2411e440 con 0x7fbb2c0b1850 2023-11-24T06:32:08.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.209+0000 7fbb2a59c640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbb0c066890 0x7fbb0c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.213+0000 7fbb2a59c640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbb0c066890 0x7fbb0c068d50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009ad0 tx=0x7fbb14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.213+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb240eb430 con 0x7fbb2c0b1850 2023-11-24T06:32:08.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb2c0ca290 con 0x7fbb2c0b1850 2023-11-24T06:32:08.402 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:32:08.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb237fe640 1 -- 172.21.15.143:0/3158174320 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fbb240eea50 con 0x7fbb2c0b1850 2023-11-24T06:32:08.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:08.403 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:49.351133+0000","modified":"2023-11-24T06:31:52.429632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/290735663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":290735663},{"type":"v1","addr":"172.21.15.146:6835","nonce":290735663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:32:08.404 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 36 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbb0c066890 msgr2=0x7fbb0c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbb0c066890 0x7fbb0c068d50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009ad0 tx=0x7fbb14008040 comp rx=0 tx=0).stop 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 msgr2=0x7fbb2c0b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 0x7fbb2c0b1cd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbb240b0040 tx=0x7fbb24009750 comp rx=0 tx=0).stop 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 shutdown_connections 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbb0c066890 0x7fbb0c068d50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2c0b1850 0x7fbb2c0b1cd0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c0ca4d0 0x7fbb2c160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 --2- 172.21.15.143:0/3158174320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb18004d10 0x7fbb2c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 >> 172.21.15.143:0/3158174320 conn(0x7fbb2c08ceb0 msgr2=0x7fbb2c0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 shutdown_connections 2023-11-24T06:32:08.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.397+0000 7fbb30d94640 1 -- 172.21.15.143:0/3158174320 wait complete. 2023-11-24T06:32:08.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:32:08.424 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:08.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.633+0000 7f2ff2101640 1 Processor -- start 2023-11-24T06:32:08.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.633+0000 7f2ff2101640 1 -- start start 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2ff2101640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2ff2101640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fec15e250 0x7f2fec0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2ff2101640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0b4150 con 0x7f2fec0b37b0 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2ff2101640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec06c650 con 0x7f2fec15e250 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2ff2101640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15e6a0 con 0x7f2fec160be0 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2febfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fec15e250 0x7f2fec0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2fe3fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f2fec0b37b0 0x7f2fec15db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51320/0 (socket says 172.21.15.143:51320) 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2fe3fff640 1 -- 172.21.15.143:0/3211243665 learned_addr learned my addr 172.21.15.143:0/3211243665 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:08.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2feb7fe640 1 --2- 172.21.15.143:0/3211243665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2febfff640 1 -- 172.21.15.143:0/3211243665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 msgr2=0x7f2fec15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:08.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2febfff640 1 --2- 172.21.15.143:0/3211243665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2febfff640 1 -- 172.21.15.143:0/3211243665 >> v1:172.21.15.143:6789/0 conn(0x7f2fec0b37b0 legacy=0x7f2fec15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2febfff640 1 -- 172.21.15.143:0/3211243665 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec15e900 con 0x7f2fec15e250 2023-11-24T06:32:08.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.637+0000 7f2feaffd640 1 -- 172.21.15.143:0/3211243665 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84543690 0 0) 0x7f2fec0b4150 con 0x7f2fec0b37b0 2023-11-24T06:32:08.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2febfff640 1 --2- 172.21.15.143:0/3211243665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec0b3c10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009d90 tx=0x7f2fe401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214f952b5a56c4e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:08.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2feaffd640 1 -- 172.21.15.143:0/3211243665 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40a59e0 con 0x7f2fec15e250 2023-11-24T06:32:08.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2feaffd640 1 -- 172.21.15.143:0/3211243665 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe40a5b40 con 0x7f2fec15e250 2023-11-24T06:32:08.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2feaffd640 1 -- 172.21.15.143:0/3211243665 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40ad440 con 0x7f2fec15e250 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 -- 172.21.15.143:0/3211243665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 msgr2=0x7f2fec0b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 --2- 172.21.15.143:0/3211243665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec0b3c10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009d90 tx=0x7f2fe401c920 comp rx=0 tx=0).stop 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 -- 172.21.15.143:0/3211243665 shutdown_connections 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 --2- 172.21.15.143:0/3211243665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec0b3c10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 --2- 172.21.15.143:0/3211243665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 -- 172.21.15.143:0/3211243665 >> 172.21.15.143:0/3211243665 conn(0x7f2fec0b0bf0 msgr2=0x7f2fec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 -- 172.21.15.143:0/3211243665 shutdown_connections 2023-11-24T06:32:08.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 -- 172.21.15.143:0/3211243665 wait complete. 2023-11-24T06:32:08.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 Processor -- start 2023-11-24T06:32:08.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.641+0000 7f2ff2101640 1 -- start start 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fec0b37b0 0x7f2fec14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec155490 con 0x7f2fec15e250 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec154320 con 0x7f2fec0b37b0 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec152200 con 0x7f2fec160be0 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50220/0 (socket says 172.21.15.143:50220) 2023-11-24T06:32:08.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 -- 172.21.15.143:0/202382660 learned_addr learned my addr 172.21.15.143:0/202382660 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:08.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 -- 172.21.15.143:0/202382660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 msgr2=0x7f2fec15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 -- 172.21.15.143:0/202382660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fec0b37b0 msgr2=0x7f2fec14a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fec0b37b0 0x7f2fec14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 -- 172.21.15.143:0/202382660 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009a70 con 0x7f2fec15e250 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe3fff640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec152fc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40011f0 tx=0x7f2fd400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40074e0 con 0x7f2fec15e250 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4007640 con 0x7f2fec15e250 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec1524e0 con 0x7f2fec15e250 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4004a10 con 0x7f2fec15e250 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec152aa0 con 0x7f2fec15e250 2023-11-24T06:32:08.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec152c90 con 0x7f2fec15e250 2023-11-24T06:32:08.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.645+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f2fd4004bb0 con 0x7f2fec15e250 2023-11-24T06:32:08.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.649+0000 7f2fe8ff9640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fcc066860 0x7f2fcc068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.649+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f2fd40837f0 con 0x7f2fec15e250 2023-11-24T06:32:08.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.649+0000 7f2feb7fe640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fcc066860 0x7f2fcc068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.649+0000 7f2feb7fe640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fcc066860 0x7f2fcc068d20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00b850 tx=0x7f2fdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:08.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.653+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fd4050660 con 0x7f2fec15e250 2023-11-24T06:32:08.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.829+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fec067520 con 0x7f2fec15e250 2023-11-24T06:32:08.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2fe8ff9640 1 -- 172.21.15.143:0/202382660 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2fd4004e60 con 0x7f2fec15e250 2023-11-24T06:32:08.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:08.838 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:31:49.351133+0000","modified":"2023-11-24T06:31:52.429632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/290735663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":290735663},{"type":"v1","addr":"172.21.15.146:6835","nonce":290735663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:32:08.838 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 36 2023-11-24T06:32:08.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fcc066860 msgr2=0x7f2fcc068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fcc066860 0x7f2fcc068d20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00b850 tx=0x7f2fdc008040 comp rx=0 tx=0).stop 2023-11-24T06:32:08.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 msgr2=0x7f2fec152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec152fc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40011f0 tx=0x7f2fd400c9b0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 shutdown_connections 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2fcc066860 0x7f2fcc068d20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fec160be0 0x7f2fec15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fec15e250 0x7f2fec152fc0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 --2- 172.21.15.143:0/202382660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fec0b37b0 0x7f2fec14a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 >> 172.21.15.143:0/202382660 conn(0x7f2fec0b0bf0 msgr2=0x7f2fec0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 shutdown_connections 2023-11-24T06:32:08.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.833+0000 7f2ff2101640 1 -- 172.21.15.143:0/202382660 wait complete. 2023-11-24T06:32:08.859 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:08.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.989+0000 7f86c8b65640 1 Processor -- start 2023-11-24T06:32:08.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.989+0000 7f86c8b65640 1 -- start start 2023-11-24T06:32:08.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c8b65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c40b36c0 0x7f86c40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c8b65640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86c4070da0 0x7f86c415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:08.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c8b65640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c415a700 con 0x7f86c415a320 2023-11-24T06:32:08.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c8b65640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40b2430 con 0x7f86c4070da0 2023-11-24T06:32:08.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c8b65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40b2620 con 0x7f86c40b36c0 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c2d9d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86c4070da0 0x7f86c415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c40b36c0 0x7f86c40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c259c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f86c415a320 0x7f86c4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:47056/0 (socket says 172.21.15.143:47056) 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c259c640 1 -- 172.21.15.143:0/34760431 learned_addr learned my addr 172.21.15.143:0/34760431 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c1d9b640 1 -- 172.21.15.143:0/34760431 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549175122 0 0) 0x7f86c415a700 con 0x7f86c415a320 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c1d9b640 1 -- 172.21.15.143:0/34760431 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0003530 con 0x7f86c415a320 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86bbfff640 1 -- 172.21.15.143:0/34760431 >> v2:172.21.15.146:3300/0 conn(0x7f86c4070da0 msgr2=0x7f86c415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86bbfff640 1 --2- 172.21.15.143:0/34760431 >> v2:172.21.15.146:3300/0 conn(0x7f86c4070da0 0x7f86c415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86bbfff640 1 -- 172.21.15.143:0/34760431 >> v1:172.21.15.146:6789/0 conn(0x7f86c415a320 legacy=0x7f86c4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86bbfff640 1 -- 172.21.15.143:0/34760431 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40b2900 con 0x7f86c40b36c0 2023-11-24T06:32:09.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.993+0000 7f86c2d9d640 1 --2- 172.21.15.143:0/34760431 >> v2:172.21.15.146:3300/0 conn(0x7f86c4070da0 0x7f86c415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:09.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86bbfff640 1 --2- 172.21.15.143:0/34760431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c40b36c0 0x7f86c40b1ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ba60 tx=0x7f86ac01eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6ee93ed76b4cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c1d9b640 1 -- 172.21.15.143:0/34760431 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0a7b00 con 0x7f86c40b36c0 2023-11-24T06:32:09.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c1d9b640 1 -- 172.21.15.143:0/34760431 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac0a7c60 con 0x7f86c40b36c0 2023-11-24T06:32:09.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c1d9b640 1 -- 172.21.15.143:0/34760431 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0af440 con 0x7f86c40b36c0 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 -- 172.21.15.143:0/34760431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c40b36c0 msgr2=0x7f86c40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 --2- 172.21.15.143:0/34760431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c40b36c0 0x7f86c40b1ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ba60 tx=0x7f86ac01eb20 comp rx=0 tx=0).stop 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 -- 172.21.15.143:0/34760431 shutdown_connections 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 --2- 172.21.15.143:0/34760431 >> v2:172.21.15.146:3300/0 conn(0x7f86c4070da0 0x7f86c415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 --2- 172.21.15.143:0/34760431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c40b36c0 0x7f86c40b1ef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 -- 172.21.15.143:0/34760431 >> 172.21.15.143:0/34760431 conn(0x7f86c40b0bf0 msgr2=0x7f86c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 -- 172.21.15.143:0/34760431 shutdown_connections 2023-11-24T06:32:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 -- 172.21.15.143:0/34760431 wait complete. 2023-11-24T06:32:09.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 Processor -- start 2023-11-24T06:32:09.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 -- start start 2023-11-24T06:32:09.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c4070da0 0x7f86c40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:08.997+0000 7f86c8b65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 0x7f86c41569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c415a320 0x7f86c41506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c409a230 con 0x7f86c40b36c0 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41634b0 con 0x7f86c4070da0 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4163790 con 0x7f86c415a320 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 0x7f86c41569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 0x7f86c41569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50228/0 (socket says 172.21.15.143:50228) 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 -- 172.21.15.143:0/1857455940 learned_addr learned my addr 172.21.15.143:0/1857455940 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c259c640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c4070da0 0x7f86c40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 -- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c415a320 msgr2=0x7f86c41506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c415a320 0x7f86c41506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 -- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c4070da0 msgr2=0x7f86c40999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c4070da0 0x7f86c40999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 -- 172.21.15.143:0/1857455940 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009a70 con 0x7f86c40b36c0 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86bbfff640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 0x7f86c41569e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0b2040 tx=0x7f86ac01b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0afce0 con 0x7f86c40b36c0 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac0afe60 con 0x7f86c40b36c0 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac00b6c0 con 0x7f86c40b36c0 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0b8660 con 0x7f86c40b36c0 2023-11-24T06:32:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4163d50 con 0x7f86c40b36c0 2023-11-24T06:32:09.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c4163f40 con 0x7f86c40b36c0 2023-11-24T06:32:09.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f86ac0b6070 con 0x7f86c40b36c0 2023-11-24T06:32:09.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.001+0000 7f86baffd640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86a4066860 0x7f86a4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.005+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f86ac11e600 con 0x7f86c40b36c0 2023-11-24T06:32:09.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.005+0000 7f86c259c640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86a4066860 0x7f86a4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.005+0000 7f86c259c640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86a4066860 0x7f86a4068d20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f86b40011f0 tx=0x7f86b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.005+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86ac0eb4b0 con 0x7f86c40b36c0 2023-11-24T06:32:09.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.157+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86c4067520 con 0x7f86c40b36c0 2023-11-24T06:32:09.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.157+0000 7f86baffd640 1 -- 172.21.15.143:0/1857455940 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16721 (secure 0 0 0) 0x7f86ac0eead0 con 0x7f86c40b36c0 2023-11-24T06:32:09.164 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:09.164 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":60,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:05.116822+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:31:47.711527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:31:48.345537+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":60,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:09.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86a4066860 msgr2=0x7f86a4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86a4066860 0x7f86a4068d20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f86b40011f0 tx=0x7f86b4009040 comp rx=0 tx=0).stop 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 msgr2=0x7f86c41569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 0x7f86c41569e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0b2040 tx=0x7f86ac01b8c0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 shutdown_connections 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86a4066860 0x7f86a4068d20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c415a320 0x7f86c41506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86c40b36c0 0x7f86c41569e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 --2- 172.21.15.143:0/1857455940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c4070da0 0x7f86c40999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 >> 172.21.15.143:0/1857455940 conn(0x7f86c40b0bf0 msgr2=0x7f86c4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 shutdown_connections 2023-11-24T06:32:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.161+0000 7f86c8b65640 1 -- 172.21.15.143:0/1857455940 wait complete. 2023-11-24T06:32:09.186 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:32:09.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.317+0000 7fd5d372a640 1 Processor -- start 2023-11-24T06:32:09.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.317+0000 7fd5d372a640 1 -- start start 2023-11-24T06:32:09.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d372a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 0x7fd5cc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d372a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5cc06d740 0x7fd5cc06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d372a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc06e0d0 con 0x7fd5cc15a4d0 2023-11-24T06:32:09.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d372a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc15a8b0 con 0x7fd5cc06d740 2023-11-24T06:32:09.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d372a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c9c30 con 0x7fd5cc0cad20 2023-11-24T06:32:09.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 0x7fd5cc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 0x7fd5cc0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:45776/0 (socket says 172.21.15.143:45776) 2023-11-24T06:32:09.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d1cc7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5cc06d740 0x7fd5cc06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/1857783900 learned_addr learned my addr 172.21.15.143:0/1857783900 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:09.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d14c6640 1 --1- 172.21.15.143:0/1857783900 >> v1:172.21.15.146:6789/0 conn(0x7fd5cc15a4d0 0x7fd5cc15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:47062/0 (socket says 172.21.15.143:47062) 2023-11-24T06:32:09.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/1857783900 >> v2:172.21.15.146:3300/0 conn(0x7fd5cc06d740 msgr2=0x7fd5cc06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:09.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 --2- 172.21.15.143:0/1857783900 >> v2:172.21.15.146:3300/0 conn(0x7fd5cc06d740 0x7fd5cc06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/1857783900 >> v1:172.21.15.146:6789/0 conn(0x7fd5cc15a4d0 legacy=0x7fd5cc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/1857783900 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0c9f60 con 0x7fd5cc0cad20 2023-11-24T06:32:09.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.321+0000 7fd5d1cc7640 1 --2- 172.21.15.143:0/1857783900 >> v2:172.21.15.146:3300/0 conn(0x7fd5cc06d740 0x7fd5cc06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:09.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d0cc5640 1 --2- 172.21.15.143:0/1857783900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 0x7fd5cc0c9650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009870 tx=0x7fd5bc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7ff770d49c6ca45 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5c3fff640 1 -- 172.21.15.143:0/1857783900 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ab680 con 0x7fd5cc0cad20 2023-11-24T06:32:09.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5c3fff640 1 -- 172.21.15.143:0/1857783900 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0ab7e0 con 0x7fd5cc0cad20 2023-11-24T06:32:09.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5c3fff640 1 -- 172.21.15.143:0/1857783900 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0abb70 con 0x7fd5cc0cad20 2023-11-24T06:32:09.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- 172.21.15.143:0/1857783900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 msgr2=0x7fd5cc0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 --2- 172.21.15.143:0/1857783900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 0x7fd5cc0c9650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009870 tx=0x7fd5bc01c480 comp rx=0 tx=0).stop 2023-11-24T06:32:09.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- 172.21.15.143:0/1857783900 shutdown_connections 2023-11-24T06:32:09.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 --2- 172.21.15.143:0/1857783900 >> v2:172.21.15.146:3300/0 conn(0x7fd5cc06d740 0x7fd5cc06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 --2- 172.21.15.143:0/1857783900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc0cad20 0x7fd5cc0c9650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- 172.21.15.143:0/1857783900 >> 172.21.15.143:0/1857783900 conn(0x7fd5cc0b0bf0 msgr2=0x7fd5cc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:09.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- 172.21.15.143:0/1857783900 shutdown_connections 2023-11-24T06:32:09.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- 172.21.15.143:0/1857783900 wait complete. 2023-11-24T06:32:09.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 Processor -- start 2023-11-24T06:32:09.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- start start 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5cc06d740 0x7fd5cc0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 0x7fd5cc0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc15a4d0 0x7fd5cc0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc15b7a0 con 0x7fd5cc06d740 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc15ba80 con 0x7fd5cc0cad20 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.325+0000 7fd5d372a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc15bd60 con 0x7fd5cc15a4d0 2023-11-24T06:32:09.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d14c6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5cc06d740 0x7fd5cc0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 0x7fd5cc0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 0x7fd5cc0c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:35190/0 (socket says 172.21.15.143:35190) 2023-11-24T06:32:09.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/131918691 learned_addr learned my addr 172.21.15.143:0/131918691 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:09.334 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d1cc7640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc15a4d0 0x7fd5cc0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc15a4d0 msgr2=0x7fd5cc0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc15a4d0 0x7fd5cc0acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5cc06d740 msgr2=0x7fd5cc0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5cc06d740 0x7fd5cc0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 -- 172.21.15.143:0/131918691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009a70 con 0x7fd5cc0cad20 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d1cc7640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc15a4d0 0x7fd5cc0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d14c6640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5cc06d740 0x7fd5cc0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d0cc5640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 0x7fd5cc0c89b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc01a0b0 tx=0x7fd5bc01acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ab680 con 0x7fd5cc0cad20 2023-11-24T06:32:09.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0b4820 con 0x7fd5cc0cad20 2023-11-24T06:32:09.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc0094d0 con 0x7fd5cc0cad20 2023-11-24T06:32:09.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0b4bd0 con 0x7fd5cc0cad20 2023-11-24T06:32:09.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc15c320 con 0x7fd5cc0cad20 2023-11-24T06:32:09.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc15c510 con 0x7fd5cc0cad20 2023-11-24T06:32:09.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.329+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fd5bc0b4d30 con 0x7fd5cc0cad20 2023-11-24T06:32:09.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.333+0000 7fd5c1ffb640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5b0066890 0x7fd5b0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.333+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fd5bc11f370 con 0x7fd5cc0cad20 2023-11-24T06:32:09.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.333+0000 7fd5d14c6640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5b0066890 0x7fd5b0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.333+0000 7fd5d14c6640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5b0066890 0x7fd5b0068d50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8000f70 tx=0x7fd5c8007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.337+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5bc0ec130 con 0x7fd5cc0cad20 2023-11-24T06:32:09.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.521+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd5cc09d250 con 0x7fd5cc0cad20 2023-11-24T06:32:09.528 INFO:tasks.ceph.mon.a.smithi143.stderr:2023-11-24T06:32:09.521+0000 7f12a8d9d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:32:09.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.529+0000 7fd5c1ffb640 1 -- 172.21.15.143:0/131918691 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd5bc0ef750 con 0x7fd5cc0cad20 2023-11-24T06:32:09.536 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:32:09.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5b0066890 msgr2=0x7fd5b0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5b0066890 0x7fd5b0068d50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8000f70 tx=0x7fd5c8007e50 comp rx=0 tx=0).stop 2023-11-24T06:32:09.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 msgr2=0x7fd5cc0c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 0x7fd5cc0c89b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc01a0b0 tx=0x7fd5bc01acc0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 shutdown_connections 2023-11-24T06:32:09.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd5b0066890 0x7fd5b0068d50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5cc15a4d0 0x7fd5cc0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5cc0cad20 0x7fd5cc0c89b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 --2- 172.21.15.143:0/131918691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5cc06d740 0x7fd5cc0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 >> 172.21.15.143:0/131918691 conn(0x7fd5cc0b0bf0 msgr2=0x7fd5cc06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:09.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 shutdown_connections 2023-11-24T06:32:09.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.533+0000 7fd5d372a640 1 -- 172.21.15.143:0/131918691 wait complete. 2023-11-24T06:32:09.557 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:32:09.601 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:32:09.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9f9c1640 1 Processor -- start 2023-11-24T06:32:09.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9f9c1640 1 -- start start 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9f9c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f9815a290 0x7f6f980707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9f9c1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f98071170 con 0x7f6f980b1f80 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9f9c1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980cb690 con 0x7f6f9815ec60 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9f9c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980cb970 con 0x7f6f9815a290 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9d75d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f9815a290 0x7f6f980707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9d75d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f9815a290 0x7f6f980707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50244/0 (socket says 172.21.15.143:50244) 2023-11-24T06:32:09.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9d75d640 1 -- 172.21.15.143:0/368008080 learned_addr learned my addr 172.21.15.143:0/368008080 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:09.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9d75d640 1 -- 172.21.15.143:0/368008080 >> v1:172.21.15.146:6789/0 conn(0x7f6f9815ec60 legacy=0x7f6f980cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9d75d640 1 -- 172.21.15.143:0/368008080 >> v1:172.21.15.143:6789/0 conn(0x7f6f980b1f80 legacy=0x7f6f9806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.693+0000 7f6f9d75d640 1 -- 172.21.15.143:0/368008080 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980cbc50 con 0x7f6f9815a290 2023-11-24T06:32:09.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9d75d640 1 --2- 172.21.15.143:0/368008080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f980707f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400bb10 tx=0x7f6f9401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39c43d0c1e200c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f8ffff640 1 -- 172.21.15.143:0/368008080 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940a7b70 con 0x7f6f9815a290 2023-11-24T06:32:09.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f8ffff640 1 -- 172.21.15.143:0/368008080 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f940a7cd0 con 0x7f6f9815a290 2023-11-24T06:32:09.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f8ffff640 1 -- 172.21.15.143:0/368008080 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940af660 con 0x7f6f9815a290 2023-11-24T06:32:09.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/368008080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 msgr2=0x7f6f980707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/368008080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f980707f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400bb10 tx=0x7f6f9401eb80 comp rx=0 tx=0).stop 2023-11-24T06:32:09.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/368008080 shutdown_connections 2023-11-24T06:32:09.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/368008080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f980707f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/368008080 >> 172.21.15.143:0/368008080 conn(0x7f6f980b0c80 msgr2=0x7f6f980b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:09.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/368008080 shutdown_connections 2023-11-24T06:32:09.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.697+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/368008080 wait complete. 2023-11-24T06:32:09.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 Processor -- start 2023-11-24T06:32:09.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 -- start start 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f980b1f80 0x7f6f98154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f9809ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9815ec60 0x7f6f98099150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98155300 con 0x7f6f9815a290 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9813d6e0 con 0x7f6f980b1f80 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9813d9c0 con 0x7f6f9815ec60 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f9809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9d75d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f980b1f80 0x7f6f98154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f9809ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50252/0 (socket says 172.21.15.143:50252) 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 -- 172.21.15.143:0/3322408510 learned_addr learned my addr 172.21.15.143:0/3322408510 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9df5e640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9815ec60 0x7f6f98099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 -- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9815ec60 msgr2=0x7f6f98099150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9815ec60 0x7f6f98099150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 -- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f980b1f80 msgr2=0x7f6f98154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f980b1f80 0x7f6f98154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:09.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 -- 172.21.15.143:0/3322408510 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9400b770 con 0x7f6f9815a290 2023-11-24T06:32:09.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9cf5c640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f9809ac40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c390 tx=0x7f6f8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880052d0 con 0x7f6f9815a290 2023-11-24T06:32:09.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88005430 con 0x7f6f9815a290 2023-11-24T06:32:09.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98070f40 con 0x7f6f9815a290 2023-11-24T06:32:09.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88003820 con 0x7f6f9815a290 2023-11-24T06:32:09.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.701+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9813df80 con 0x7f6f9815a290 2023-11-24T06:32:09.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.705+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9804e8c0 con 0x7f6f9815a290 2023-11-24T06:32:09.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.705+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f6f88003980 con 0x7f6f9815a290 2023-11-24T06:32:09.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.705+0000 7f6f8dffb640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f7c066890 0x7f6f7c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:09.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.705+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f6f88083ad0 con 0x7f6f9815a290 2023-11-24T06:32:09.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.705+0000 7f6f9d75d640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f7c066890 0x7f6f7c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:09.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.705+0000 7f6f9d75d640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f7c066890 0x7f6f7c068d50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f940b1000 tx=0x7f6f940a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:09.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.709+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f88050970 con 0x7f6f9815a290 2023-11-24T06:32:09.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:09.893+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6f98166130 con 0x7f6f9815a290 2023-11-24T06:32:10.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.525+0000 7f6f8dffb640 1 -- 172.21.15.143:0/3322408510 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6f88053f90 con 0x7f6f9815a290 2023-11-24T06:32:10.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f7c066890 msgr2=0x7f6f7c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:10.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f7c066890 0x7f6f7c068d50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f940b1000 tx=0x7f6f940a9070 comp rx=0 tx=0).stop 2023-11-24T06:32:10.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 msgr2=0x7f6f9809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:10.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f9809ac40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c390 tx=0x7f6f8800c850 comp rx=0 tx=0).stop 2023-11-24T06:32:10.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 shutdown_connections 2023-11-24T06:32:10.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f7c066890 0x7f6f7c068d50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9815ec60 0x7f6f98099150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f9815a290 0x7f6f9809ac40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 --2- 172.21.15.143:0/3322408510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f980b1f80 0x7f6f98154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 >> 172.21.15.143:0/3322408510 conn(0x7f6f980b0c80 msgr2=0x7f6f980b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:10.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 shutdown_connections 2023-11-24T06:32:10.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.529+0000 7f6f9f9c1640 1 -- 172.21.15.143:0/3322408510 wait complete. 2023-11-24T06:32:10.556 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:32:10.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 Processor -- start 2023-11-24T06:32:10.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 -- start start 2023-11-24T06:32:10.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700b2550 0x7f8f7006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:10.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f700d1000 0x7f8f700ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f700ce060 con 0x7f8f700cfe40 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f700d1a10 con 0x7f8f700d1000 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f74f2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700cded0 con 0x7f8f700b2550 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f700d1000 0x7f8f700ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f700d1000 0x7f8f700ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50264/0 (socket says 172.21.15.143:50264) 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 -- 172.21.15.143:0/2038240597 learned_addr learned my addr 172.21.15.143:0/2038240597 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6dd9b640 1 --2- 172.21.15.143:0/2038240597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700b2550 0x7f8f7006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 -- 172.21.15.143:0/2038240597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700b2550 msgr2=0x7f8f7006b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 --2- 172.21.15.143:0/2038240597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700b2550 0x7f8f7006b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 -- 172.21.15.143:0/2038240597 >> v1:172.21.15.146:6789/0 conn(0x7f8f700cfe40 legacy=0x7f8f700d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:10.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.693+0000 7f8f6ed9d640 1 -- 172.21.15.143:0/2038240597 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700d1c20 con 0x7f8f700d1000 2023-11-24T06:32:10.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f6ed9d640 1 --2- 172.21.15.143:0/2038240597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700d1000 0x7f8f700ce4f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009e50 tx=0x7f8f6801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d666b06a85f8eab2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:10.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f6d59a640 1 -- 172.21.15.143:0/2038240597 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680a56a0 con 0x7f8f700d1000 2023-11-24T06:32:10.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f6d59a640 1 -- 172.21.15.143:0/2038240597 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680a5800 con 0x7f8f700d1000 2023-11-24T06:32:10.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f6d59a640 1 -- 172.21.15.143:0/2038240597 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680a5b90 con 0x7f8f700d1000 2023-11-24T06:32:10.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 -- 172.21.15.143:0/2038240597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700d1000 msgr2=0x7f8f700ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/2038240597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700d1000 0x7f8f700ce4f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009e50 tx=0x7f8f6801c8f0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 -- 172.21.15.143:0/2038240597 shutdown_connections 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/2038240597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700d1000 0x7f8f700ce4f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/2038240597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700b2550 0x7f8f7006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 -- 172.21.15.143:0/2038240597 >> 172.21.15.143:0/2038240597 conn(0x7f8f7009c780 msgr2=0x7f8f700d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 -- 172.21.15.143:0/2038240597 shutdown_connections 2023-11-24T06:32:10.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.697+0000 7f8f74f2a640 1 -- 172.21.15.143:0/2038240597 wait complete. 2023-11-24T06:32:10.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 Processor -- start 2023-11-24T06:32:10.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 -- start start 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 0x7f8f70151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700cfe40 0x7f8f700b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f700d1000 0x7f8f700b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700ca500 con 0x7f8f700b2550 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700cad60 con 0x7f8f700d1000 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700b8c50 con 0x7f8f700cfe40 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 0x7f8f70151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 0x7f8f70151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50274/0 (socket says 172.21.15.143:50274) 2023-11-24T06:32:10.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 -- 172.21.15.143:0/3641108638 learned_addr learned my addr 172.21.15.143:0/3641108638 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6dd9b640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700cfe40 0x7f8f700b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6ed9d640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f700d1000 0x7f8f700b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 -- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700cfe40 msgr2=0x7f8f700b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700cfe40 0x7f8f700b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 -- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f700d1000 msgr2=0x7f8f700b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f700d1000 0x7f8f700b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 -- 172.21.15.143:0/3641108638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68009b30 con 0x7f8f700b2550 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f6e59c640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 0x7f8f70151200 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c3c0 tx=0x7f8f6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600052d0 con 0x7f8f700b2550 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60005430 con 0x7f8f700b2550 2023-11-24T06:32:10.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f700ca710 con 0x7f8f700b2550 2023-11-24T06:32:10.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60003840 con 0x7f8f700b2550 2023-11-24T06:32:10.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.701+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f700b62c0 con 0x7f8f700b2550 2023-11-24T06:32:10.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.705+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f700b8f30 con 0x7f8f700b2550 2023-11-24T06:32:10.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.705+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f8f600039a0 con 0x7f8f700b2550 2023-11-24T06:32:10.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.705+0000 7f8f5effd640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066890 0x7f8f50068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:10.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.705+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f8f60083a80 con 0x7f8f700b2550 2023-11-24T06:32:10.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.705+0000 7f8f6dd9b640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066890 0x7f8f50068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:10.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.705+0000 7f8f6dd9b640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066890 0x7f8f50068d50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8f700b6090 tx=0x7f8f64009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:10.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.709+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f60050960 con 0x7f8f700b2550 2023-11-24T06:32:10.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:10.857+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f70067520 con 0x7f8f700b2550 2023-11-24T06:32:11.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.529+0000 7f8f5effd640 1 -- 172.21.15.143:0/3641108638 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8f60053f80 con 0x7f8f700b2550 2023-11-24T06:32:11.535 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:32:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066890 msgr2=0x7f8f50068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066890 0x7f8f50068d50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8f700b6090 tx=0x7f8f64009190 comp rx=0 tx=0).stop 2023-11-24T06:32:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 msgr2=0x7f8f70151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:11.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 0x7f8f70151200 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c3c0 tx=0x7f8f6000c880 comp rx=0 tx=0).stop 2023-11-24T06:32:11.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 shutdown_connections 2023-11-24T06:32:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066890 0x7f8f50068d50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f700d1000 0x7f8f700b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f700cfe40 0x7f8f700b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 --2- 172.21.15.143:0/3641108638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f700b2550 0x7f8f70151200 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 >> 172.21.15.143:0/3641108638 conn(0x7f8f7009c780 msgr2=0x7f8f700d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:11.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 shutdown_connections 2023-11-24T06:32:11.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.533+0000 7f8f74f2a640 1 -- 172.21.15.143:0/3641108638 wait complete. 2023-11-24T06:32:11.566 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:32:11.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 Processor -- start 2023-11-24T06:32:11.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 -- start start 2023-11-24T06:32:11.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb640b13f0 0x7ffb6415f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:11.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb640ae8d0 0x7ffb640aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:11.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb64144720 con 0x7ffb64144340 2023-11-24T06:32:11.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6406b4a0 con 0x7ffb640ae8d0 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6c1df640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb640b1b90 con 0x7ffb640b13f0 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb640ae8d0 0x7ffb640aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb640ae8d0 0x7ffb640aed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50290/0 (socket says 172.21.15.143:50290) 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 -- 172.21.15.143:0/3500093310 learned_addr learned my addr 172.21.15.143:0/3500093310 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6977a640 1 --2- 172.21.15.143:0/3500093310 >> v2:172.21.15.146:3300/0 conn(0x7ffb640b13f0 0x7ffb6415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 -- 172.21.15.143:0/3500093310 >> v2:172.21.15.146:3300/0 conn(0x7ffb640b13f0 msgr2=0x7ffb6415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 --2- 172.21.15.143:0/3500093310 >> v2:172.21.15.146:3300/0 conn(0x7ffb640b13f0 0x7ffb6415f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 -- 172.21.15.143:0/3500093310 >> v1:172.21.15.146:6789/0 conn(0x7ffb64144340 legacy=0x7ffb6415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:11.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.705+0000 7ffb6a77c640 1 -- 172.21.15.143:0/3500093310 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6406a6e0 con 0x7ffb640ae8d0 2023-11-24T06:32:11.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6a77c640 1 --2- 172.21.15.143:0/3500093310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb640ae8d0 0x7ffb640aed00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ffb64071580 tx=0x7ffb5c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50633c00048fc60 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:11.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb68f79640 1 -- 172.21.15.143:0/3500093310 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0a56f0 con 0x7ffb640ae8d0 2023-11-24T06:32:11.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb68f79640 1 -- 172.21.15.143:0/3500093310 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0a5850 con 0x7ffb640ae8d0 2023-11-24T06:32:11.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb68f79640 1 -- 172.21.15.143:0/3500093310 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0a5be0 con 0x7ffb640ae8d0 2023-11-24T06:32:11.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 -- 172.21.15.143:0/3500093310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb640ae8d0 msgr2=0x7ffb640aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:11.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/3500093310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb640ae8d0 0x7ffb640aed00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ffb64071580 tx=0x7ffb5c01c940 comp rx=0 tx=0).stop 2023-11-24T06:32:11.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 -- 172.21.15.143:0/3500093310 shutdown_connections 2023-11-24T06:32:11.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/3500093310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb640ae8d0 0x7ffb640aed00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/3500093310 >> v2:172.21.15.146:3300/0 conn(0x7ffb640b13f0 0x7ffb6415f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 -- 172.21.15.143:0/3500093310 >> 172.21.15.143:0/3500093310 conn(0x7ffb640b55c0 msgr2=0x7ffb640b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:11.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 -- 172.21.15.143:0/3500093310 shutdown_connections 2023-11-24T06:32:11.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.709+0000 7ffb6c1df640 1 -- 172.21.15.143:0/3500093310 wait complete. 2023-11-24T06:32:11.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 Processor -- start 2023-11-24T06:32:11.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- start start 2023-11-24T06:32:11.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb640ae8d0 0x7ffb6413dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:11.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb640b13f0 0x7ffb6414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:11.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 0x7ffb6414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:11.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6413e250 con 0x7ffb64144340 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6415b8d0 con 0x7ffb640b13f0 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6414f660 con 0x7ffb640ae8d0 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 0x7ffb6414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 0x7ffb6414edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50294/0 (socket says 172.21.15.143:50294) 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 -- 172.21.15.143:0/4136038601 learned_addr learned my addr 172.21.15.143:0/4136038601 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 -- 172.21.15.143:0/4136038601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb640ae8d0 msgr2=0x7ffb6413dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb640ae8d0 0x7ffb6413dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 -- 172.21.15.143:0/4136038601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb640b13f0 msgr2=0x7ffb6414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:11.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb640b13f0 0x7ffb6414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:11.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 -- 172.21.15.143:0/4136038601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c009b30 con 0x7ffb64144340 2023-11-24T06:32:11.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6a77c640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 0x7ffb6414edd0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c019550 tx=0x7ffb5c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:11.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0b8670 con 0x7ffb64144340 2023-11-24T06:32:11.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0b87d0 con 0x7ffb64144340 2023-11-24T06:32:11.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6415acc0 con 0x7ffb64144340 2023-11-24T06:32:11.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0b8b80 con 0x7ffb64144340 2023-11-24T06:32:11.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6415b280 con 0x7ffb64144340 2023-11-24T06:32:11.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.713+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb64067520 con 0x7ffb64144340 2023-11-24T06:32:11.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.717+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7ffb5c0b8ce0 con 0x7ffb64144340 2023-11-24T06:32:11.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.717+0000 7ffb5a7fc640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffb48066860 0x7ffb48068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:11.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.717+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5385+0+0 (secure 0 0 0) 0x7ffb5c11fa60 con 0x7ffb64144340 2023-11-24T06:32:11.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.717+0000 7ffb69f7b640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffb48066860 0x7ffb48068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:11.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.717+0000 7ffb69f7b640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffb48066860 0x7ffb48068d20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb60000f70 tx=0x7ffb600079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:11.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.721+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb5c0eca40 con 0x7ffb64144340 2023-11-24T06:32:11.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:11.869+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb6406dab0 con 0x7ffb64144340 2023-11-24T06:32:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.537+0000 7ffb5a7fc640 1 -- 172.21.15.143:0/4136038601 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffb5c0bc0d0 con 0x7ffb64144340 2023-11-24T06:32:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2023-11-24T06:32:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.537+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffb48066860 msgr2=0x7ffb48068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.537+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffb48066860 0x7ffb48068d20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb60000f70 tx=0x7ffb600079c0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.537+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 msgr2=0x7ffb6414edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.537+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 0x7ffb6414edd0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c019550 tx=0x7ffb5c0196e0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.541+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 shutdown_connections 2023-11-24T06:32:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.541+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffb48066860 0x7ffb48068d20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.541+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb64144340 0x7ffb6414edd0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.541+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb640b13f0 0x7ffb6414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.541+0000 7ffb6c1df640 1 --2- 172.21.15.143:0/4136038601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb640ae8d0 0x7ffb6413dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.541+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 >> 172.21.15.143:0/4136038601 conn(0x7ffb640b55c0 msgr2=0x7ffb6415f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.545+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 shutdown_connections 2023-11-24T06:32:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.545+0000 7ffb6c1df640 1 -- 172.21.15.143:0/4136038601 wait complete. 2023-11-24T06:32:12.575 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:32:12.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.709+0000 7f00da0e4640 1 Processor -- start 2023-11-24T06:32:12.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.709+0000 7f00da0e4640 1 -- start start 2023-11-24T06:32:12.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00da0e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 0x7f00d40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00da0e4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d40723c0 con 0x7f00d40ccef0 2023-11-24T06:32:12.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00da0e4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d40726a0 con 0x7f00d41624f0 2023-11-24T06:32:12.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00da0e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4072980 con 0x7f00d40cd380 2023-11-24T06:32:12.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f00d40ccef0 0x7f00d4071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51346/0 (socket says 172.21.15.143:51346) 2023-11-24T06:32:12.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 -- 172.21.15.143:0/3700994959 learned_addr learned my addr 172.21.15.143:0/3700994959 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d3fff640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 0x7f00d40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251965674 0 0) 0x7f00d40723c0 con 0x7f00d40ccef0 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00bc003530 con 0x7f00d40ccef0 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280615389 0 0) 0x7f00bc003530 con 0x7f00d40ccef0 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 msgr2=0x7f00d40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 0x7f00d40cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 >> v1:172.21.15.146:6789/0 conn(0x7f00d41624f0 legacy=0x7f00d41628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d406c7e0 con 0x7f00d40ccef0 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f00c8001680 con 0x7f00d40ccef0 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 >> v1:172.21.15.143:6789/0 conn(0x7f00d40ccef0 legacy=0x7f00d4071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 0x7f00bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc004d10 0x7f00bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4072980 con 0x7f00bc003f30 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc00bb20 con 0x7f00bc004d10 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc00bce0 con 0x7f00d40cd380 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d37fe640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 0x7f00bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d3fff640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc004d10 0x7f00bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 -- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 msgr2=0x7f00bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40cd380 0x7f00bc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 -- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc004d10 msgr2=0x7f00bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:12.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc004d10 0x7f00bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.713+0000 7f00d2ffd640 1 -- 172.21.15.143:0/3700994959 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc003530 con 0x7f00bc003f30 2023-11-24T06:32:12.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00bc0047d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f00c800c240 tx=0x7f00c801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabebb6f15101012 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:12.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8005ae0 con 0x7f00bc003f30 2023-11-24T06:32:12.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8005c40 con 0x7f00bc003f30 2023-11-24T06:32:12.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00d27fc640 1 -- 172.21.15.143:0/3700994959 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a5810 con 0x7f00bc003f30 2023-11-24T06:32:12.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 -- 172.21.15.143:0/3700994959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 msgr2=0x7f00bc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 --2- 172.21.15.143:0/3700994959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00bc0047d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f00c800c240 tx=0x7f00c801cc10 comp rx=0 tx=0).stop 2023-11-24T06:32:12.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00d3fff640 1 -- 172.21.15.143:0/3700994959 reap_dead start 2023-11-24T06:32:12.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 -- 172.21.15.143:0/3700994959 shutdown_connections 2023-11-24T06:32:12.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 -- 172.21.15.143:0/3700994959 >> 172.21.15.143:0/3700994959 conn(0x7f00d40b0c80 msgr2=0x7f00d40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:12.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 -- 172.21.15.143:0/3700994959 shutdown_connections 2023-11-24T06:32:12.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 -- 172.21.15.143:0/3700994959 wait complete. 2023-11-24T06:32:12.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 Processor -- start 2023-11-24T06:32:12.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.717+0000 7f00da0e4640 1 -- start start 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00d40abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00d40add80 0x7f00d414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40ad090 0x7f00d4150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40ac6b0 con 0x7f00bc003f30 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41605e0 con 0x7f00d40add80 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40ac4a0 con 0x7f00d40ad090 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00d40abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00d40abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50316/0 (socket says 172.21.15.143:50316) 2023-11-24T06:32:12.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 -- 172.21.15.143:0/221854298 learned_addr learned my addr 172.21.15.143:0/221854298 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d3fff640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40ad090 0x7f00d4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00d40add80 0x7f00d414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 -- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40ad090 msgr2=0x7f00d4150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40ad090 0x7f00d4150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 -- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00d40add80 msgr2=0x7f00d414fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00d40add80 0x7f00d414fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 -- 172.21.15.143:0/221854298 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4160020 con 0x7f00bc003f30 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d3fff640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40ad090 0x7f00d4150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00d40add80 0x7f00d414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:12.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00d37fe640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00d40abf60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f00c400f820 tx=0x7f00c400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:12.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c40050d0 con 0x7f00bc003f30 2023-11-24T06:32:12.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4005230 con 0x7f00bc003f30 2023-11-24T06:32:12.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400d6d0 con 0x7f00bc003f30 2023-11-24T06:32:12.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4160300 con 0x7f00bc003f30 2023-11-24T06:32:12.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d40acb70 con 0x7f00bc003f30 2023-11-24T06:32:12.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.721+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d404e8c0 con 0x7f00bc003f30 2023-11-24T06:32:12.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.725+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f00c400d830 con 0x7f00bc003f30 2023-11-24T06:32:12.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.725+0000 7f00bbfff640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f00c0066890 0x7f00c0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:12.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.725+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f00c40841d0 con 0x7f00bc003f30 2023-11-24T06:32:12.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.725+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f00c0066890 0x7f00c0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:12.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.725+0000 7f00d2ffd640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f00c0066890 0x7f00c0068d50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f00c800c240 tx=0x7f00c80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:12.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.729+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00c4051350 con 0x7f00bc003f30 2023-11-24T06:32:12.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.885+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f00d4164780 con 0x7f00bc003f30 2023-11-24T06:32:12.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00bbfff640 1 -- 172.21.15.143:0/221854298 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00c4054970 con 0x7f00bc003f30 2023-11-24T06:32:12.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f00c0066890 msgr2=0x7f00c0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f00c0066890 0x7f00c0068d50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f00c800c240 tx=0x7f00c80a7070 comp rx=0 tx=0).stop 2023-11-24T06:32:12.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 msgr2=0x7f00d40abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:12.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00d40abf60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f00c400f820 tx=0x7f00c400fce0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 shutdown_connections 2023-11-24T06:32:12.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f00c0066890 0x7f00c0068d50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00d40ad090 0x7f00d4150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00d40add80 0x7f00d414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 --2- 172.21.15.143:0/221854298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00bc003f30 0x7f00d40abf60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 >> 172.21.15.143:0/221854298 conn(0x7f00d40b0c80 msgr2=0x7f00d40af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 shutdown_connections 2023-11-24T06:32:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:12.889+0000 7f00da0e4640 1 -- 172.21.15.143:0/221854298 wait complete. 2023-11-24T06:32:12.916 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_nonexistent_subvolume_snapshot_rm' 2023-11-24T06:32:13.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 Processor -- start 2023-11-24T06:32:13.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 -- start start 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f12140d3020 0x7f12140d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12140ce8b0 0x7f12140ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121406c0e0 con 0x7f121415d570 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140d39f0 con 0x7f12140d3020 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f121b50f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140d1cc0 con 0x7f12140ce8b0 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f12140d3020 0x7f12140d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f12140d3020 0x7f12140d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50320/0 (socket says 172.21.15.143:50320) 2023-11-24T06:32:13.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 -- 172.21.15.143:0/4221774249 learned_addr learned my addr 172.21.15.143:0/4221774249 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:13.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1219aac640 1 --2- 172.21.15.143:0/4221774249 >> v2:172.21.15.146:3300/0 conn(0x7f12140ce8b0 0x7f12140ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 -- 172.21.15.143:0/4221774249 >> v2:172.21.15.146:3300/0 conn(0x7f12140ce8b0 msgr2=0x7f12140ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:13.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 --2- 172.21.15.143:0/4221774249 >> v2:172.21.15.146:3300/0 conn(0x7f12140ce8b0 0x7f12140ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 -- 172.21.15.143:0/4221774249 >> v1:172.21.15.146:6789/0 conn(0x7f121415d570 legacy=0x7f121406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:13.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.049+0000 7f1218aaa640 1 -- 172.21.15.143:0/4221774249 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140d1fa0 con 0x7f12140d3020 2023-11-24T06:32:13.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f1218aaa640 1 --2- 172.21.15.143:0/4221774249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f12140d34b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f121406d730 tx=0x7f120001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cef6822bfa8e3b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f1213fff640 1 -- 172.21.15.143:0/4221774249 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000aa5f0 con 0x7f12140d3020 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f1213fff640 1 -- 172.21.15.143:0/4221774249 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000aa750 con 0x7f12140d3020 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f1213fff640 1 -- 172.21.15.143:0/4221774249 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000aaae0 con 0x7f12140d3020 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 -- 172.21.15.143:0/4221774249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 msgr2=0x7f12140d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 --2- 172.21.15.143:0/4221774249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f12140d34b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f121406d730 tx=0x7f120001c490 comp rx=0 tx=0).stop 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 -- 172.21.15.143:0/4221774249 shutdown_connections 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 --2- 172.21.15.143:0/4221774249 >> v2:172.21.15.146:3300/0 conn(0x7f12140ce8b0 0x7f12140ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 --2- 172.21.15.143:0/4221774249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f12140d34b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 -- 172.21.15.143:0/4221774249 >> 172.21.15.143:0/4221774249 conn(0x7f121408ceb0 msgr2=0x7f121409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 -- 172.21.15.143:0/4221774249 shutdown_connections 2023-11-24T06:32:13.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.053+0000 7f121b50f640 1 -- 172.21.15.143:0/4221774249 wait complete. 2023-11-24T06:32:13.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 Processor -- start 2023-11-24T06:32:13.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 -- start start 2023-11-24T06:32:13.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12140ce8b0 0x7f12141605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f1214159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121415d570 0x7f12140c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c70b0 con 0x7f12140d3020 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c7390 con 0x7f12140ce8b0 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c7670 con 0x7f121415d570 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f1214159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f1214159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50324/0 (socket says 172.21.15.143:50324) 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 -- 172.21.15.143:0/2971094033 learned_addr learned my addr 172.21.15.143:0/2971094033 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f12192ab640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12140ce8b0 0x7f12141605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1219aac640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121415d570 0x7f12140c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 -- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121415d570 msgr2=0x7f12140c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121415d570 0x7f12140c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 -- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12140ce8b0 msgr2=0x7f12141605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12140ce8b0 0x7f12141605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 -- 172.21.15.143:0/2971094033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000094d0 con 0x7f12140d3020 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f12192ab640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12140ce8b0 0x7f12141605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1218aaa640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f1214159540 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f120001a0c0 tx=0x7f120001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000aa5f0 con 0x7f12140d3020 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000b3800 con 0x7f12140d3020 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140c7950 con 0x7f12140d3020 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000b3b90 con 0x7f12140d3020 2023-11-24T06:32:13.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.057+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1214159a80 con 0x7f12140d3020 2023-11-24T06:32:13.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.061+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1214159c70 con 0x7f12140d3020 2023-11-24T06:32:13.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.061+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f12000b3cf0 con 0x7f12140d3020 2023-11-24T06:32:13.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.061+0000 7f1211ffb640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11f8066860 0x7f11f8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.061+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f12000a7070 con 0x7f12140d3020 2023-11-24T06:32:13.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.061+0000 7f12192ab640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11f8066860 0x7f11f8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.061+0000 7f12192ab640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11f8066860 0x7f11f8068d20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1208009fc0 tx=0x7f1208009550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:13.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.065+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1214159c70 con 0x7f12140d3020 2023-11-24T06:32:13.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.269+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_nonexistent_subvolume_snapshot_rm"]} v 0) v1 -- 0x7f12140c7b90 con 0x7f12140d3020 2023-11-24T06:32:13.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.537+0000 7f1211ffb640 1 -- 172.21.15.143:0/2971094033 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_nonexistent_subvolume_snapshot_rm"]}]=0 v172) v1 ==== 166+0+0 (secure 0 0 0) 0x7f12140c7b90 con 0x7f12140d3020 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11f8066860 msgr2=0x7f11f8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11f8066860 0x7f11f8068d20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1208009fc0 tx=0x7f1208009550 comp rx=0 tx=0).stop 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 msgr2=0x7f1214159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f1214159540 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f120001a0c0 tx=0x7f120001acd0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 shutdown_connections 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11f8066860 0x7f11f8068d20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121415d570 0x7f12140c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12140d3020 0x7f1214159540 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 --2- 172.21.15.143:0/2971094033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12140ce8b0 0x7f12141605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 >> 172.21.15.143:0/2971094033 conn(0x7f121408ceb0 msgr2=0x7f121406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:13.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 shutdown_connections 2023-11-24T06:32:13.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.541+0000 7f121b50f640 1 -- 172.21.15.143:0/2971094033 wait complete. 2023-11-24T06:32:13.566 INFO:tasks.cephfs_test_runner:test_nonexistent_subvolume_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) ... ok 2023-11-24T06:32:13.567 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_inherited_snapshot_info (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) tests the scenario where 'fs subvolume snapshot info' command 2023-11-24T06:32:13.567 INFO:tasks.cephfs_test_runner:test_subvolume_inherited_snapshot_info (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:32:13.567 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:13.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.697+0000 7fe822df5640 1 Processor -- start 2023-11-24T06:32:13.704 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.697+0000 7fe822df5640 1 -- start start 2023-11-24T06:32:13.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe822df5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe81c0b3ec0 0x7fe81c15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe822df5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c15e660 con 0x7fe81c160be0 2023-11-24T06:32:13.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe822df5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c15e900 con 0x7fe81c15db40 2023-11-24T06:32:13.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe822df5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c06c650 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe820b91640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe81c160be0 0x7fe81c0b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51360/0 (socket says 172.21.15.143:51360) 2023-11-24T06:32:13.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe820b91640 1 -- 172.21.15.143:0/3552084023 learned_addr learned my addr 172.21.15.143:0/3552084023 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:13.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81bfff640 1 --2- 172.21.15.143:0/3552084023 >> v2:172.21.15.146:3300/0 conn(0x7fe81c0b3ec0 0x7fe81c15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81b7fe640 1 -- 172.21.15.143:0/3552084023 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823472436 0 0) 0x7fe81c15e660 con 0x7fe81c160be0 2023-11-24T06:32:13.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81b7fe640 1 -- 172.21.15.143:0/3552084023 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003530 con 0x7fe81c160be0 2023-11-24T06:32:13.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81bfff640 1 -- 172.21.15.143:0/3552084023 >> v1:172.21.15.146:6789/0 conn(0x7fe81c15db40 legacy=0x7fe81c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81b7fe640 1 -- 172.21.15.143:0/3552084023 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 927320747 0 0) 0x7fe80c003530 con 0x7fe81c160be0 2023-11-24T06:32:13.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81bfff640 1 -- 172.21.15.143:0/3552084023 >> v1:172.21.15.143:6789/0 conn(0x7fe81c160be0 legacy=0x7fe81c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.701+0000 7fe81bfff640 1 -- 172.21.15.143:0/3552084023 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c06c830 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe81bfff640 1 --2- 172.21.15.143:0/3552084023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c15ed00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097c0 tx=0x7fe80801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca4fd2b3d3e82265 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:13.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe81b7fe640 1 -- 172.21.15.143:0/3552084023 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810001680 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe81b7fe640 1 -- 172.21.15.143:0/3552084023 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080a7050 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe81b7fe640 1 -- 172.21.15.143:0/3552084023 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080ab620 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- 172.21.15.143:0/3552084023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0b3ec0 msgr2=0x7fe81c15ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 --2- 172.21.15.143:0/3552084023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c15ed00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097c0 tx=0x7fe80801c370 comp rx=0 tx=0).stop 2023-11-24T06:32:13.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- 172.21.15.143:0/3552084023 shutdown_connections 2023-11-24T06:32:13.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 --2- 172.21.15.143:0/3552084023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c15ed00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- 172.21.15.143:0/3552084023 >> 172.21.15.143:0/3552084023 conn(0x7fe81c0b0bf0 msgr2=0x7fe81c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:13.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- 172.21.15.143:0/3552084023 shutdown_connections 2023-11-24T06:32:13.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- 172.21.15.143:0/3552084023 wait complete. 2023-11-24T06:32:13.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 Processor -- start 2023-11-24T06:32:13.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- start start 2023-11-24T06:32:13.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c15db40 0x7fe81c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe81c160be0 0x7fe81c145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c15c310 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c09a610 con 0x7fe81c15db40 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.705+0000 7fe822df5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c146360 con 0x7fe81c160be0 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50332/0 (socket says 172.21.15.143:50332) 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 -- 172.21.15.143:0/2853286326 learned_addr learned my addr 172.21.15.143:0/2853286326 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe821392640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe81c160be0 0x7fe81c145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe81bfff640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c15db40 0x7fe81c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 -- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe81c160be0 msgr2=0x7fe81c145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe81c160be0 0x7fe81c145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 -- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c15db40 msgr2=0x7fe81c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c15db40 0x7fe81c15c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 -- 172.21.15.143:0/2853286326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009420 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe820b91640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c149ae0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c750 tx=0x7fe81000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:13.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810005ae0 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810005c40 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c06e070 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8100072b0 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c09ab20 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c067520 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fe810007410 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.709+0000 7fe8197fa640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe800066890 0x7fe800068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:13.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.713+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fe810083950 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.713+0000 7fe81bfff640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe800066890 0x7fe800068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:13.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.713+0000 7fe81bfff640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe800066890 0x7fe800068d50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ad000 tx=0x7fe808008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:13.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.713+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe810050c00 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.865+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81c0b3120 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.865+0000 7fe8197fa640 1 -- 172.21.15.143:0/2853286326 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13077 (secure 0 0 0) 0x7fe810017020 con 0x7fe81c0b3ec0 2023-11-24T06:32:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:13.872 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":63,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:12.534148+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/290735663":"2023-11-25T06:32:09.526913+0000","172.21.15.146:6833/290735663":"2023-11-25T06:32:09.526913+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:13.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe800066890 msgr2=0x7fe800068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe800066890 0x7fe800068d50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ad000 tx=0x7fe808008040 comp rx=0 tx=0).stop 2023-11-24T06:32:13.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 msgr2=0x7fe81c149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:13.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c149ae0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c750 tx=0x7fe81000cc10 comp rx=0 tx=0).stop 2023-11-24T06:32:13.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 shutdown_connections 2023-11-24T06:32:13.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe800066890 0x7fe800068d50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe81c160be0 0x7fe81c145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c15db40 0x7fe81c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 --2- 172.21.15.143:0/2853286326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe81c0b3ec0 0x7fe81c149ae0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:13.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 >> 172.21.15.143:0/2853286326 conn(0x7fe81c0b0bf0 msgr2=0x7fe81c15d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:13.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 shutdown_connections 2023-11-24T06:32:13.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:13.869+0000 7fe822df5640 1 -- 172.21.15.143:0/2853286326 wait complete. 2023-11-24T06:32:13.894 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:13.894 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:14.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 Processor -- start 2023-11-24T06:32:14.036 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 -- start start 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14bc15d7f0 0x7f14bc0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc06cce0 0x7f14bc06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0d3c60 con 0x7f14bc0d37e0 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc06b980 con 0x7f14bc15d7f0 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14c1baa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b0090 con 0x7f14bc06cce0 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14bb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14bc15d7f0 0x7f14bc0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14bb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14bc15d7f0 0x7f14bc0d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50346/0 (socket says 172.21.15.143:50346) 2023-11-24T06:32:14.037 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14bb7fe640 1 -- 172.21.15.143:0/1955209611 learned_addr learned my addr 172.21.15.143:0/1955209611 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:14.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.029+0000 7f14bbfff640 1 --2- 172.21.15.143:0/1955209611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc06cce0 0x7f14bc06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14bb7fe640 1 -- 172.21.15.143:0/1955209611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc06cce0 msgr2=0x7f14bc06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:14.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14bb7fe640 1 --2- 172.21.15.143:0/1955209611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc06cce0 0x7f14bc06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14bb7fe640 1 -- 172.21.15.143:0/1955209611 >> v1:172.21.15.146:6789/0 conn(0x7f14bc0d37e0 legacy=0x7f14bc0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14bb7fe640 1 -- 172.21.15.143:0/1955209611 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc06d6b0 con 0x7f14bc15d7f0 2023-11-24T06:32:14.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14bb7fe640 1 --2- 172.21.15.143:0/1955209611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc15d7f0 0x7f14bc0d32a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009870 tx=0x7f14ac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5731ce5bb3cd1c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:14.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14ba7fc640 1 -- 172.21.15.143:0/1955209611 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0a7070 con 0x7f14bc15d7f0 2023-11-24T06:32:14.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14ba7fc640 1 -- 172.21.15.143:0/1955209611 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac0ab430 con 0x7f14bc15d7f0 2023-11-24T06:32:14.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14ba7fc640 1 -- 172.21.15.143:0/1955209611 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0ab7c0 con 0x7f14bc15d7f0 2023-11-24T06:32:14.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14c1baa640 1 -- 172.21.15.143:0/1955209611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc15d7f0 msgr2=0x7f14bc0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.033+0000 7f14c1baa640 1 --2- 172.21.15.143:0/1955209611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc15d7f0 0x7f14bc0d32a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009870 tx=0x7f14ac01c540 comp rx=0 tx=0).stop 2023-11-24T06:32:14.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- 172.21.15.143:0/1955209611 shutdown_connections 2023-11-24T06:32:14.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 --2- 172.21.15.143:0/1955209611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc06cce0 0x7f14bc06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 --2- 172.21.15.143:0/1955209611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc15d7f0 0x7f14bc0d32a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- 172.21.15.143:0/1955209611 >> 172.21.15.143:0/1955209611 conn(0x7f14bc09c790 msgr2=0x7f14bc08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:14.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- 172.21.15.143:0/1955209611 shutdown_connections 2023-11-24T06:32:14.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- 172.21.15.143:0/1955209611 wait complete. 2023-11-24T06:32:14.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 Processor -- start 2023-11-24T06:32:14.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- start start 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 0x7f14bc0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14bc0d37e0 0x7f14bc0b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc15d7f0 0x7f14bc14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b3550 con 0x7f14bc06cce0 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b88a0 con 0x7f14bc0d37e0 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b2f00 con 0x7f14bc15d7f0 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 0x7f14bc0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 0x7f14bc0d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50358/0 (socket says 172.21.15.143:50358) 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 -- 172.21.15.143:0/3269387863 learned_addr learned my addr 172.21.15.143:0/3269387863 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 -- 172.21.15.143:0/3269387863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc15d7f0 msgr2=0x7f14bc14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.046 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc15d7f0 0x7f14bc14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 -- 172.21.15.143:0/3269387863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14bc0d37e0 msgr2=0x7f14bc0b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14bc0d37e0 0x7f14bc0b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 -- 172.21.15.143:0/3269387863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0094d0 con 0x7f14bc06cce0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14bb7fe640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 0x7f14bc0d05a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0ad040 tx=0x7f14ac0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0bc070 con 0x7f14bc06cce0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac0b4420 con 0x7f14bc06cce0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0b47d0 con 0x7f14bc06cce0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.037+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc0b31e0 con 0x7f14bc06cce0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0d0cb0 con 0x7f14bc06cce0 2023-11-24T06:32:14.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc04e8c0 con 0x7f14bc06cce0 2023-11-24T06:32:14.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f14ac0b4930 con 0x7f14bc06cce0 2023-11-24T06:32:14.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14a3fff640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14a8066860 0x7f14a8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f14ac11dd70 con 0x7f14bc06cce0 2023-11-24T06:32:14.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14baffd640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14a8066860 0x7f14a8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.041+0000 7f14baffd640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14a8066860 0x7f14a8068d20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f70 tx=0x7f14b00079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:14.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.045+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14ac0eae30 con 0x7f14bc06cce0 2023-11-24T06:32:14.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.193+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14bc0b3040 con 0x7f14bc06cce0 2023-11-24T06:32:14.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14a3fff640 1 -- 172.21.15.143:0/3269387863 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14bc0b3040 con 0x7f14bc06cce0 2023-11-24T06:32:14.201 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:14.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14a8066860 msgr2=0x7f14a8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14a8066860 0x7f14a8068d20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f70 tx=0x7f14b00079c0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 msgr2=0x7f14bc0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 0x7f14bc0d05a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0ad040 tx=0x7f14ac0192e0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 shutdown_connections 2023-11-24T06:32:14.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14a8066860 0x7f14a8068d20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14bc15d7f0 0x7f14bc14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14bc0d37e0 0x7f14bc0b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 --2- 172.21.15.143:0/3269387863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14bc06cce0 0x7f14bc0d05a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 >> 172.21.15.143:0/3269387863 conn(0x7f14bc09c790 msgr2=0x7f14bc15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:14.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 shutdown_connections 2023-11-24T06:32:14.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.197+0000 7f14c1baa640 1 -- 172.21.15.143:0/3269387863 wait complete. 2023-11-24T06:32:14.222 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_info' 2023-11-24T06:32:14.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 Processor -- start 2023-11-24T06:32:14.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 -- start start 2023-11-24T06:32:14.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c5415d680 0x7f5c540cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d1eb0 0x7f5c540b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c540b6030 con 0x7f5c540d0080 2023-11-24T06:32:14.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5415da60 con 0x7f5c5415d680 2023-11-24T06:32:14.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c58b10640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540d05c0 con 0x7f5c540d1eb0 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c5415d680 0x7f5c540cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c5415d680 0x7f5c540cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50370/0 (socket says 172.21.15.143:50370) 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 -- 172.21.15.143:0/3194322486 learned_addr learned my addr 172.21.15.143:0/3194322486 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c53fff640 1 --2- 172.21.15.143:0/3194322486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d1eb0 0x7f5c540b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 -- 172.21.15.143:0/3194322486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d1eb0 msgr2=0x7f5c540b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 --2- 172.21.15.143:0/3194322486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d1eb0 0x7f5c540b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 -- 172.21.15.143:0/3194322486 >> v1:172.21.15.146:6789/0 conn(0x7f5c540d0080 legacy=0x7f5c540d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.357+0000 7f5c537fe640 1 -- 172.21.15.143:0/3194322486 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c540b6280 con 0x7f5c5415d680 2023-11-24T06:32:14.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c537fe640 1 --2- 172.21.15.143:0/3194322486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5415d680 0x7f5c540cfb40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5c440098a0 tx=0x7f5c4401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c535cf958e17d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:14.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c527fc640 1 -- 172.21.15.143:0/3194322486 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440aa650 con 0x7f5c5415d680 2023-11-24T06:32:14.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c527fc640 1 -- 172.21.15.143:0/3194322486 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c440aa7b0 con 0x7f5c5415d680 2023-11-24T06:32:14.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c527fc640 1 -- 172.21.15.143:0/3194322486 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440aab40 con 0x7f5c5415d680 2023-11-24T06:32:14.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 -- 172.21.15.143:0/3194322486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5415d680 msgr2=0x7f5c540cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3194322486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5415d680 0x7f5c540cfb40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5c440098a0 tx=0x7f5c4401c4f0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 -- 172.21.15.143:0/3194322486 shutdown_connections 2023-11-24T06:32:14.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3194322486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d1eb0 0x7f5c540b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3194322486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5415d680 0x7f5c540cfb40 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 -- 172.21.15.143:0/3194322486 >> 172.21.15.143:0/3194322486 conn(0x7f5c5409c510 msgr2=0x7f5c540d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:14.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 -- 172.21.15.143:0/3194322486 shutdown_connections 2023-11-24T06:32:14.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 -- 172.21.15.143:0/3194322486 wait complete. 2023-11-24T06:32:14.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.361+0000 7f5c58b10640 1 Processor -- start 2023-11-24T06:32:14.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- start start 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d0080 0x7f5c5415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 0x7f5c540cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c5415d680 0x7f5c54154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5415be60 con 0x7f5c540d1eb0 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5414c880 con 0x7f5c5415d680 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5415c0a0 con 0x7f5c540d0080 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 0x7f5c540cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c537fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d0080 0x7f5c5415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 0x7f5c540cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50372/0 (socket says 172.21.15.143:50372) 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c537fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d0080 0x7f5c5415ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:45938/0 (socket says 172.21.15.143:45938) 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 -- 172.21.15.143:0/3688644344 learned_addr learned my addr 172.21.15.143:0/3688644344 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c53fff640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c5415d680 0x7f5c54154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 -- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d0080 msgr2=0x7f5c5415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d0080 0x7f5c5415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 -- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c5415d680 msgr2=0x7f5c54154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c5415d680 0x7f5c54154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 -- 172.21.15.143:0/3688644344 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440094d0 con 0x7f5c540d1eb0 2023-11-24T06:32:14.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c52ffd640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 0x7f5c540cdfe0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800c4d0 tx=0x7f5c4800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:14.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c480052d0 con 0x7f5c540d1eb0 2023-11-24T06:32:14.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c48005430 con 0x7f5c540d1eb0 2023-11-24T06:32:14.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5415c380 con 0x7f5c540d1eb0 2023-11-24T06:32:14.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48012830 con 0x7f5c540d1eb0 2023-11-24T06:32:14.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c540c6d10 con 0x7f5c540d1eb0 2023-11-24T06:32:14.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.365+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5404e850 con 0x7f5c540d1eb0 2023-11-24T06:32:14.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.369+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f5c48012990 con 0x7f5c540d1eb0 2023-11-24T06:32:14.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.369+0000 7f5c3bfff640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c40066860 0x7f5c40068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:14.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.369+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f5c48083c20 con 0x7f5c540d1eb0 2023-11-24T06:32:14.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.369+0000 7f5c537fe640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c40066860 0x7f5c40068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:14.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.369+0000 7f5c537fe640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c40066860 0x7f5c40068d20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ae000 tx=0x7f5c440b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:14.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.373+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c48050ee0 con 0x7f5c540d1eb0 2023-11-24T06:32:14.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:14.577+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_info"]} v 0) v1 -- 0x7f5c54159450 con 0x7f5c540d1eb0 2023-11-24T06:32:15.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.545+0000 7f5c3bfff640 1 -- 172.21.15.143:0/3688644344 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_info"]}]=0 v174) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5c48054500 con 0x7f5c540d1eb0 2023-11-24T06:32:15.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c40066860 msgr2=0x7f5c40068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c40066860 0x7f5c40068d20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ae000 tx=0x7f5c440b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 msgr2=0x7f5c540cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 0x7f5c540cdfe0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800c4d0 tx=0x7f5c4800c990 comp rx=0 tx=0).stop 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 shutdown_connections 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c40066860 0x7f5c40068d20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c5415d680 0x7f5c54154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c540d1eb0 0x7f5c540cdfe0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 --2- 172.21.15.143:0/3688644344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c540d0080 0x7f5c5415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 >> 172.21.15.143:0/3688644344 conn(0x7f5c5409c510 msgr2=0x7f5c5415c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:15.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 shutdown_connections 2023-11-24T06:32:15.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.549+0000 7f5c58b10640 1 -- 172.21.15.143:0/3688644344 wait complete. 2023-11-24T06:32:15.578 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:32:15.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.717+0000 7f3738a68640 1 Processor -- start 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.717+0000 7f3738a68640 1 -- start start 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.717+0000 7f3738a68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f373415d540 0x7f373406d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3738a68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3734072010 0x7f37340cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3738a68640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373406d9f0 con 0x7f373406d590 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3738a68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340cd400 con 0x7f3734072010 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3738a68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3734072860 con 0x7f373415d540 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3734072010 0x7f37340cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3734072010 0x7f37340cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50374/0 (socket says 172.21.15.143:50374) 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f372bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f373406d590 0x7f3734071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51370/0 (socket says 172.21.15.143:51370) 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 -- 172.21.15.143:0/909673464 learned_addr learned my addr 172.21.15.143:0/909673464 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f373259c640 1 --2- 172.21.15.143:0/909673464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f373415d540 0x7f373406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 -- 172.21.15.143:0/909673464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f373415d540 msgr2=0x7f373406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 --2- 172.21.15.143:0/909673464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f373415d540 0x7f373406d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 -- 172.21.15.143:0/909673464 >> v1:172.21.15.143:6789/0 conn(0x7f373406d590 legacy=0x7f3734071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 -- 172.21.15.143:0/909673464 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373406dc30 con 0x7f3734072010 2023-11-24T06:32:15.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3732d9d640 1 --2- 172.21.15.143:0/909673464 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3734072010 0x7f37340cd890 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f372c009e50 tx=0x7f372c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510709a785fadaa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:15.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.721+0000 7f3731d9b640 1 -- 172.21.15.143:0/909673464 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0a57d0 con 0x7f3734072010 2023-11-24T06:32:15.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3731d9b640 1 -- 172.21.15.143:0/909673464 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c0a5930 con 0x7f3734072010 2023-11-24T06:32:15.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3731d9b640 1 -- 172.21.15.143:0/909673464 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0a5cc0 con 0x7f3734072010 2023-11-24T06:32:15.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- 172.21.15.143:0/909673464 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3734072010 msgr2=0x7f37340cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 --2- 172.21.15.143:0/909673464 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3734072010 0x7f37340cd890 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f372c009e50 tx=0x7f372c01ca10 comp rx=0 tx=0).stop 2023-11-24T06:32:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- 172.21.15.143:0/909673464 shutdown_connections 2023-11-24T06:32:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 --2- 172.21.15.143:0/909673464 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3734072010 0x7f37340cd890 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 --2- 172.21.15.143:0/909673464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f373415d540 0x7f373406d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- 172.21.15.143:0/909673464 >> 172.21.15.143:0/909673464 conn(0x7f37340b0c80 msgr2=0x7f37340b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- 172.21.15.143:0/909673464 shutdown_connections 2023-11-24T06:32:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- 172.21.15.143:0/909673464 wait complete. 2023-11-24T06:32:15.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 Processor -- start 2023-11-24T06:32:15.732 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- start start 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f373406d590 0x7f373415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3734072010 0x7f3734149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 0x7f3734152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734148cd0 con 0x7f373415d540 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734148fb0 con 0x7f373406d590 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.725+0000 7f3738a68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373415f770 con 0x7f3734072010 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 0x7f3734152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 0x7f3734152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50382/0 (socket says 172.21.15.143:50382) 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f372bfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3734072010 0x7f3734149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:15.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f373259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f373406d590 0x7f373415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:15.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 -- 172.21.15.143:0/2844041513 learned_addr learned my addr 172.21.15.143:0/2844041513 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 -- 172.21.15.143:0/2844041513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3734072010 msgr2=0x7f3734149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3734072010 0x7f3734149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 -- 172.21.15.143:0/2844041513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f373406d590 msgr2=0x7f373415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f373406d590 0x7f373415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 -- 172.21.15.143:0/2844041513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c009b30 con 0x7f373415d540 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3732d9d640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 0x7f3734152c60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f372c01a640 tx=0x7f372c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0b8670 con 0x7f373415d540 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c0b87f0 con 0x7f373415d540 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373415fa50 con 0x7f373415d540 2023-11-24T06:32:15.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0b8ba0 con 0x7f373415d540 2023-11-24T06:32:15.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3734149e40 con 0x7f373415d540 2023-11-24T06:32:15.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373415fc90 con 0x7f373415d540 2023-11-24T06:32:15.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.729+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f372c0b8d00 con 0x7f373415d540 2023-11-24T06:32:15.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.733+0000 7f372affd640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3714066890 0x7f3714068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:15.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.733+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f372c11f9c0 con 0x7f373415d540 2023-11-24T06:32:15.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.733+0000 7f373259c640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3714066890 0x7f3714068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:15.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.733+0000 7f373259c640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3714066890 0x7f3714068d50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3724009ac0 tx=0x7f3724009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:15.742 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.737+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f373415fc90 con 0x7f373415d540 2023-11-24T06:32:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.885+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f373415fc90 con 0x7f373415d540 2023-11-24T06:32:15.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.889+0000 7f372affd640 1 -- 172.21.15.143:0/2844041513 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f373415fc90 con 0x7f373415d540 2023-11-24T06:32:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3714066890 msgr2=0x7f3714068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3714066890 0x7f3714068d50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3724009ac0 tx=0x7f3724009190 comp rx=0 tx=0).stop 2023-11-24T06:32:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 msgr2=0x7f3734152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 0x7f3734152c60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f372c01a640 tx=0x7f372c0197b0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 shutdown_connections 2023-11-24T06:32:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3714066890 0x7f3714068d50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f373415d540 0x7f3734152c60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3734072010 0x7f3734149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 --2- 172.21.15.143:0/2844041513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f373406d590 0x7f373415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 >> 172.21.15.143:0/2844041513 conn(0x7f37340b0c80 msgr2=0x7f37340b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 shutdown_connections 2023-11-24T06:32:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:15.893+0000 7f3738a68640 1 -- 172.21.15.143:0/2844041513 wait complete. 2023-11-24T06:32:15.918 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:32:15.918 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:16.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:16.084 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:32:16.084 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:16.084 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:16.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:32:16.093 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:16.094 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:16.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:32:16.104 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:16.104 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:16.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:32:16.149 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:16.149 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:16.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:32:16.159 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:32:16.159 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:16.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2b48ea640 1 Processor -- start 2023-11-24T06:32:16.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2b48ea640 1 -- start start 2023-11-24T06:32:16.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2b48ea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb2b00d3020 0x7fb2b00d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2b48ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b006c0e0 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2b48ea640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00d39f0 con 0x7fb2b015d570 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2b48ea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b00d1cc0 con 0x7fb2b00d3020 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2a7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb2b00d3020 0x7fb2b00d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2ae59c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb2b015d570 0x7fb2b006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:47142/0 (socket says 172.21.15.143:47142) 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2a7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb2b00d3020 0x7fb2b00d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50384/0 (socket says 172.21.15.143:50384) 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2ae59c640 1 -- 172.21.15.143:0/2365315044 learned_addr learned my addr 172.21.15.143:0/2365315044 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2a7fff640 1 -- 172.21.15.143:0/2365315044 >> v1:172.21.15.146:6789/0 conn(0x7fb2b015d570 legacy=0x7fb2b006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2a7fff640 1 -- 172.21.15.143:0/2365315044 >> v1:172.21.15.143:6789/0 conn(0x7fb2b00ce8b0 legacy=0x7fb2b00ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.325+0000 7fb2a7fff640 1 -- 172.21.15.143:0/2365315044 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00d1fa0 con 0x7fb2b00d3020 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2a7fff640 1 --2- 172.21.15.143:0/2365315044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00d3020 0x7fb2b00d34b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb2980097c0 tx=0x7fb29801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c765ad62ae934c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:16.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2add9b640 1 -- 172.21.15.143:0/2365315044 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980ab650 con 0x7fb2b00d3020 2023-11-24T06:32:16.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2add9b640 1 -- 172.21.15.143:0/2365315044 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2980ab7b0 con 0x7fb2b00d3020 2023-11-24T06:32:16.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2add9b640 1 -- 172.21.15.143:0/2365315044 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980abb40 con 0x7fb2b00d3020 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 -- 172.21.15.143:0/2365315044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00d3020 msgr2=0x7fb2b00d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/2365315044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00d3020 0x7fb2b00d34b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb2980097c0 tx=0x7fb29801c450 comp rx=0 tx=0).stop 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 -- 172.21.15.143:0/2365315044 shutdown_connections 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/2365315044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00d3020 0x7fb2b00d34b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 -- 172.21.15.143:0/2365315044 >> 172.21.15.143:0/2365315044 conn(0x7fb2b008ceb0 msgr2=0x7fb2b009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 -- 172.21.15.143:0/2365315044 shutdown_connections 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.329+0000 7fb2b48ea640 1 -- 172.21.15.143:0/2365315044 wait complete. 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 Processor -- start 2023-11-24T06:32:16.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 -- start start 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 0x7fb2b015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2b00d3020 0x7fb2b00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2b015d570 0x7fb2b0154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c6f30 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c9d40 con 0x7fb2b015d570 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0160420 con 0x7fb2b00d3020 2023-11-24T06:32:16.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 0x7fb2b015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 0x7fb2b015fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50386/0 (socket says 172.21.15.143:50386) 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 -- 172.21.15.143:0/1390631452 learned_addr learned my addr 172.21.15.143:0/1390631452 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 -- 172.21.15.143:0/1390631452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2b00d3020 msgr2=0x7fb2b00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2b00d3020 0x7fb2b00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 -- 172.21.15.143:0/1390631452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2b015d570 msgr2=0x7fb2b0154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2b015d570 0x7fb2b0154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 -- 172.21.15.143:0/1390631452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009420 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2ae59c640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 0x7fb2b015fe40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000c400 tx=0x7fb2a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0005cf0 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a0005e50 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00072d0 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b0160700 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.333+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b00c7180 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.337+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b0067520 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.337+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fb2a0007430 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.337+0000 7fb2a6ffd640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb290066860 0x7fb290068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.337+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fb2a00837f0 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.337+0000 7fb2a7fff640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb290066860 0x7fb290068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.337+0000 7fb2a7fff640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb290066860 0x7fb290068d20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb2980af000 tx=0x7fb298008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:16.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.341+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2a00509e0 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2b00d3770 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2a6ffd640 1 -- 172.21.15.143:0/1390631452 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fb2a0054000 con 0x7fb2b00ce8b0 2023-11-24T06:32:16.527 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:16.527 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2208772424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2208772424},{"type":"v1","addr":"172.21.15.143:6836","nonce":2208772424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3506071031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3506071031},{"type":"v1","addr":"172.21.15.143:6837","nonce":3506071031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/9791013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":9791013},{"type":"v1","addr":"172.21.15.146:6834","nonce":9791013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1488906843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1488906843},{"type":"v1","addr":"172.21.15.146:6835","nonce":1488906843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[]} 2023-11-24T06:32:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 38 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb290066860 msgr2=0x7fb290068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb290066860 0x7fb290068d20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb2980af000 tx=0x7fb298008040 comp rx=0 tx=0).stop 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 msgr2=0x7fb2b015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 0x7fb2b015fe40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000c400 tx=0x7fb2a000c8c0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 shutdown_connections 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb290066860 0x7fb290068d20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2b015d570 0x7fb2b0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2b00d3020 0x7fb2b00c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 --2- 172.21.15.143:0/1390631452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2b00ce8b0 0x7fb2b015fe40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 >> 172.21.15.143:0/1390631452 conn(0x7fb2b008ceb0 msgr2=0x7fb2b009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:16.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 shutdown_connections 2023-11-24T06:32:16.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.521+0000 7fb2b48ea640 1 -- 172.21.15.143:0/1390631452 wait complete. 2023-11-24T06:32:16.548 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:32:16.548 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:32:16.548 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:32:16.548 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:16.549 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:32:16.549 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:32:16.549 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:32:16.549 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:16.549 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:32:16.549 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:32:16.549 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:32:16.550 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:16.550 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:32:16.550 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:32:16.550 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:32:16.550 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:16.563 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:32:16.563 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:32:16.564 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:32:16.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:32:16.567 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:32:16.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:32:16.568 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:32:16.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:32:16.611 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:32:16.611 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:16.613 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:32:16.613 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:16.614 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:32:16.614 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:16.615 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:32:16.615 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:16.615 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:32:16.701 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:32:16.701 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:32:16.704 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:32:16.704 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-11-24T06:32:16.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd35953e640 1 Processor -- start 2023-11-24T06:32:16.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd35953e640 1 -- start start 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd35953e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd35415b600 0x7fd3540cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd35953e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540abed0 con 0x7fd35415b220 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd35953e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd354072370 con 0x7fd3540c9650 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd35953e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd354072710 con 0x7fd35415b600 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd352ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd35415b220 0x7fd35406d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:51382/0 (socket says 172.21.15.143:51382) 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd352ffd640 1 -- 172.21.15.143:0/3978721429 learned_addr learned my addr 172.21.15.143:0/3978721429 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:16.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd34a7fc640 1 --2- 172.21.15.143:0/3978721429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd35415b600 0x7fd3540cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd34a7fc640 1 -- 172.21.15.143:0/3978721429 >> v1:172.21.15.146:6789/0 conn(0x7fd3540c9650 legacy=0x7fd3540cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd3527fc640 1 -- 172.21.15.143:0/3978721429 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957474440 0 0) 0x7fd3540abed0 con 0x7fd35415b220 2023-11-24T06:32:16.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd34a7fc640 1 -- 172.21.15.143:0/3978721429 >> v1:172.21.15.143:6789/0 conn(0x7fd35415b220 legacy=0x7fd35406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.757+0000 7fd34a7fc640 1 -- 172.21.15.143:0/3978721429 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354070670 con 0x7fd35415b600 2023-11-24T06:32:16.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd34a7fc640 1 --2- 172.21.15.143:0/3978721429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd35415b600 0x7fd3540cada0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009770 tx=0x7fd33c01c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=689051ba138b8144 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:16.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd3527fc640 1 -- 172.21.15.143:0/3978721429 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0a4dc0 con 0x7fd35415b600 2023-11-24T06:32:16.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd3527fc640 1 -- 172.21.15.143:0/3978721429 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c0ac440 con 0x7fd35415b600 2023-11-24T06:32:16.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd3527fc640 1 -- 172.21.15.143:0/3978721429 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0ac7d0 con 0x7fd35415b600 2023-11-24T06:32:16.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 -- 172.21.15.143:0/3978721429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd35415b600 msgr2=0x7fd3540cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 --2- 172.21.15.143:0/3978721429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd35415b600 0x7fd3540cada0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009770 tx=0x7fd33c01c2c0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 -- 172.21.15.143:0/3978721429 shutdown_connections 2023-11-24T06:32:16.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 --2- 172.21.15.143:0/3978721429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd35415b600 0x7fd3540cada0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 -- 172.21.15.143:0/3978721429 >> 172.21.15.143:0/3978721429 conn(0x7fd3540b0bf0 msgr2=0x7fd3540b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:16.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 -- 172.21.15.143:0/3978721429 shutdown_connections 2023-11-24T06:32:16.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.761+0000 7fd35953e640 1 -- 172.21.15.143:0/3978721429 wait complete. 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 Processor -- start 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- start start 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3540c9650 0x7fd354155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd35415b220 0x7fd3540c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 0x7fd3540c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540c8ed0 con 0x7fd35415b600 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541562a0 con 0x7fd35415b220 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540c8250 con 0x7fd3540c9650 2023-11-24T06:32:16.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 0x7fd3540c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd34a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd35415b220 0x7fd3540c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 0x7fd3540c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50432/0 (socket says 172.21.15.143:50432) 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd352ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3540c9650 0x7fd354155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 -- 172.21.15.143:0/561366688 learned_addr learned my addr 172.21.15.143:0/561366688 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 -- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3540c9650 msgr2=0x7fd354155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3540c9650 0x7fd354155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 -- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd35415b220 msgr2=0x7fd3540c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd35415b220 0x7fd3540c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 -- 172.21.15.143:0/561366688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009420 con 0x7fd35415b600 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd34a7fc640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd35415b220 0x7fd3540c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:16.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd3537fe640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 0x7fd3540c7bf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00c7b0 tx=0x7fd34c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:16.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c005270 con 0x7fd35415b600 2023-11-24T06:32:16.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0053d0 con 0x7fd35415b600 2023-11-24T06:32:16.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3540c8530 con 0x7fd35415b600 2023-11-24T06:32:16.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c003840 con 0x7fd35415b600 2023-11-24T06:32:16.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3540c8af0 con 0x7fd35415b600 2023-11-24T06:32:16.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.765+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3540c9010 con 0x7fd35415b600 2023-11-24T06:32:16.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.769+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fd34c0039a0 con 0x7fd35415b600 2023-11-24T06:32:16.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.769+0000 7fd34bfff640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd334066860 0x7fd334068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:16.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.769+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fd34c0837f0 con 0x7fd35415b600 2023-11-24T06:32:16.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.769+0000 7fd352ffd640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd334066860 0x7fd334068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:16.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.769+0000 7fd352ffd640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd334066860 0x7fd334068d20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd344001950 tx=0x7fd3440018e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:16.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.773+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd34c050b30 con 0x7fd35415b600 2023-11-24T06:32:16.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:16.937+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd35409d250 con 0x7fd35415b600 2023-11-24T06:32:17.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.909+0000 7fd34bfff640 1 -- 172.21.15.143:0/561366688 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd34c017020 con 0x7fd35415b600 2023-11-24T06:32:17.916 INFO:teuthology.orchestra.run.smithi143.stderr: removed all blocklist entries 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd334066860 msgr2=0x7fd334068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd334066860 0x7fd334068d20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd344001950 tx=0x7fd3440018e0 comp rx=0 tx=0).stop 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 msgr2=0x7fd3540c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 0x7fd3540c7bf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00c7b0 tx=0x7fd34c00cbb0 comp rx=0 tx=0).stop 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 shutdown_connections 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd334066860 0x7fd334068d20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd35415b600 0x7fd3540c7bf0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd35415b220 0x7fd3540c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 --2- 172.21.15.143:0/561366688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3540c9650 0x7fd354155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:17.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 >> 172.21.15.143:0/561366688 conn(0x7fd3540b0bf0 msgr2=0x7fd35409ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:17.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 shutdown_connections 2023-11-24T06:32:17.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:17.913+0000 7fd35953e640 1 -- 172.21.15.143:0/561366688 wait complete. 2023-11-24T06:32:17.942 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:32:18.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.077+0000 7f52ce679640 1 Processor -- start 2023-11-24T06:32:18.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.077+0000 7f52ce679640 1 -- start start 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ce679640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52c80d3020 0x7f52c80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ce679640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52c80ce8b0 0x7f52c80ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ce679640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c806c0e0 con 0x7f52c815d570 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ce679640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80d39f0 con 0x7f52c80ce8b0 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ce679640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80d1cc0 con 0x7f52c80d3020 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ccc16640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52c80ce8b0 0x7f52c80ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52c7fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f52c815d570 0x7f52c806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36460/0 (socket says 172.21.15.143:36460) 2023-11-24T06:32:18.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52c7fff640 1 -- 172.21.15.143:0/2905875669 learned_addr learned my addr 172.21.15.143:0/2905875669 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:18.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52c77fe640 1 --2- 172.21.15.143:0/2905875669 >> v2:172.21.15.146:3300/0 conn(0x7f52c80d3020 0x7f52c80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ccc16640 1 -- 172.21.15.143:0/2905875669 >> v2:172.21.15.146:3300/0 conn(0x7f52c80d3020 msgr2=0x7f52c80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:18.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ccc16640 1 --2- 172.21.15.143:0/2905875669 >> v2:172.21.15.146:3300/0 conn(0x7f52c80d3020 0x7f52c80d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ccc16640 1 -- 172.21.15.143:0/2905875669 >> v1:172.21.15.143:6789/0 conn(0x7f52c815d570 legacy=0x7f52c806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52c6ffd640 1 -- 172.21.15.143:0/2905875669 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188284843 0 0) 0x7f52c806c0e0 con 0x7f52c815d570 2023-11-24T06:32:18.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.081+0000 7f52ccc16640 1 -- 172.21.15.143:0/2905875669 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80d1fa0 con 0x7f52c80ce8b0 2023-11-24T06:32:18.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ccc16640 1 --2- 172.21.15.143:0/2905875669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80ce8b0 0x7f52c80ced20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f52c80b5f00 tx=0x7f52c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6493d979bb07b908 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52c6ffd640 1 -- 172.21.15.143:0/2905875669 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00a59a0 con 0x7f52c80ce8b0 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52c6ffd640 1 -- 172.21.15.143:0/2905875669 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00a5b00 con 0x7f52c80ce8b0 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52c6ffd640 1 -- 172.21.15.143:0/2905875669 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00a5e90 con 0x7f52c80ce8b0 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 -- 172.21.15.143:0/2905875669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80ce8b0 msgr2=0x7f52c80ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 --2- 172.21.15.143:0/2905875669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80ce8b0 0x7f52c80ced20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f52c80b5f00 tx=0x7f52c001c8e0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 -- 172.21.15.143:0/2905875669 shutdown_connections 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 --2- 172.21.15.143:0/2905875669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80ce8b0 0x7f52c80ced20 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 --2- 172.21.15.143:0/2905875669 >> v2:172.21.15.146:3300/0 conn(0x7f52c80d3020 0x7f52c80d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 -- 172.21.15.143:0/2905875669 >> 172.21.15.143:0/2905875669 conn(0x7f52c808ceb0 msgr2=0x7f52c809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 -- 172.21.15.143:0/2905875669 shutdown_connections 2023-11-24T06:32:18.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 -- 172.21.15.143:0/2905875669 wait complete. 2023-11-24T06:32:18.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 Processor -- start 2023-11-24T06:32:18.092 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.085+0000 7f52ce679640 1 -- start start 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c80ce8b0 0x7f52c8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 0x7f52c80b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c815d570 0x7f52c80b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8159030 con 0x7f52c80d3020 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c815e480 con 0x7f52c80ce8b0 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8157360 con 0x7f52c815d570 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 0x7f52c80b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.094 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 0x7f52c80b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38236/0 (socket says 172.21.15.143:38236) 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 -- 172.21.15.143:0/4008571934 learned_addr learned my addr 172.21.15.143:0/4008571934 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 -- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c815d570 msgr2=0x7f52c80b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c815d570 0x7f52c80b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 -- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c80ce8b0 msgr2=0x7f52c8156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c7fff640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c80ce8b0 0x7f52c8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c80ce8b0 0x7f52c8156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 -- 172.21.15.143:0/4008571934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0009a70 con 0x7f52c80d3020 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c7fff640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c80ce8b0 0x7f52c8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:18.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c77fe640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 0x7f52c80b0f00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00d800 tx=0x7f52bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00b6c0 con 0x7f52c80d3020 2023-11-24T06:32:18.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00b820 con 0x7f52c80d3020 2023-11-24T06:32:18.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00bb90 con 0x7f52c80d3020 2023-11-24T06:32:18.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c815dc70 con 0x7f52c80d3020 2023-11-24T06:32:18.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c815e1a0 con 0x7f52c80d3020 2023-11-24T06:32:18.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c8067520 con 0x7f52c80d3020 2023-11-24T06:32:18.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.089+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f52bc00bcf0 con 0x7f52c80d3020 2023-11-24T06:32:18.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.093+0000 7f52c4ff9640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f52b4066860 0x7f52b4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.093+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f52bc084870 con 0x7f52c80d3020 2023-11-24T06:32:18.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.093+0000 7f52c7fff640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f52b4066860 0x7f52b4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.093+0000 7f52c7fff640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f52b4066860 0x7f52b4068d20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52b8007fd0 tx=0x7f52b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.097+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52bc051a00 con 0x7f52c80d3020 2023-11-24T06:32:18.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.297+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f52c806b7b0 con 0x7f52c80d3020 2023-11-24T06:32:18.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.297+0000 7f52c4ff9640 1 -- 172.21.15.143:0/4008571934 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f52bc011340 con 0x7f52c80d3020 2023-11-24T06:32:18.304 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:18.304 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "auth_dump": [ 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.a", 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA==", 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.305 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.b", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA==", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.c", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg==", 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.306 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.d", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ==", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:18.307 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.0", 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg==", 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.1", 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg==", 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.309 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.2", 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA==", 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.3", 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw==", 2023-11-24T06:32:18.310 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.4", 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew==", 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.5", 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ==", 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.312 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.6", 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ==", 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.7", 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA==", 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.0", 2023-11-24T06:32:18.314 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA==", 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow r", 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.1", 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w==", 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.315 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.2", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw==", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:32:18.316 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.3", 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw==", 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.317 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.admin", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlFbv3BRAAPWkl+V8uDy+7+/Qdzjn9Fw==", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.x", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ==", 2023-11-24T06:32:18.318 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.y", 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw==", 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:32:18.319 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:18.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:18.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2023-11-24T06:32:18.320 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f52b4066860 msgr2=0x7f52b4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f52b4066860 0x7f52b4068d20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52b8007fd0 tx=0x7f52b8009040 comp rx=0 tx=0).stop 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 msgr2=0x7f52c80b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 0x7f52c80b0f00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00d800 tx=0x7f52bc00dcc0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 shutdown_connections 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f52b4066860 0x7f52b4068d20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c815d570 0x7f52c80b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80d3020 0x7f52c80b0f00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 --2- 172.21.15.143:0/4008571934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c80ce8b0 0x7f52c8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 >> 172.21.15.143:0/4008571934 conn(0x7f52c808ceb0 msgr2=0x7f52c809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:18.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 shutdown_connections 2023-11-24T06:32:18.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.301+0000 7f52ce679640 1 -- 172.21.15.143:0/4008571934 wait complete. 2023-11-24T06:32:18.326 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:18.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.457+0000 7f7f8112a640 1 Processor -- start 2023-11-24T06:32:18.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.457+0000 7f7f8112a640 1 -- start start 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.457+0000 7f7f8112a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7f7c0d3020 0x7f7f7c0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f8112a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f8112a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c06c0e0 con 0x7f7f7c15d570 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f8112a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c0d39f0 con 0x7f7f7c0d3020 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f8112a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0d1cc0 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7f7c0d3020 0x7f7f7c0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7f7c0d3020 0x7f7f7c0d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38240/0 (socket says 172.21.15.143:38240) 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7ad9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f7c15d570 0x7f7f7c06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:35534/0 (socket says 172.21.15.143:35534) 2023-11-24T06:32:18.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 -- 172.21.15.143:0/1756210353 learned_addr learned my addr 172.21.15.143:0/1756210353 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:18.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7b59e640 1 --2- 172.21.15.143:0/1756210353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 -- 172.21.15.143:0/1756210353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0ce8b0 msgr2=0x7f7f7c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:18.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 --2- 172.21.15.143:0/1756210353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 -- 172.21.15.143:0/1756210353 >> v1:172.21.15.146:6789/0 conn(0x7f7f7c15d570 legacy=0x7f7f7c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7a59c640 1 -- 172.21.15.143:0/1756210353 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064765169 0 0) 0x7f7f7c06c0e0 con 0x7f7f7c15d570 2023-11-24T06:32:18.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 -- 172.21.15.143:0/1756210353 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0d1fa0 con 0x7f7f7c0d3020 2023-11-24T06:32:18.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7259c640 1 --2- 172.21.15.143:0/1756210353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c0d3020 0x7f7f7c0d34b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009870 tx=0x7f7f6401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4586f4962858ded server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7a59c640 1 -- 172.21.15.143:0/1756210353 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640aa670 con 0x7f7f7c0d3020 2023-11-24T06:32:18.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7a59c640 1 -- 172.21.15.143:0/1756210353 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f640aa7d0 con 0x7f7f7c0d3020 2023-11-24T06:32:18.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.461+0000 7f7f7a59c640 1 -- 172.21.15.143:0/1756210353 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640aab60 con 0x7f7f7c0d3020 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- 172.21.15.143:0/1756210353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c0d3020 msgr2=0x7f7f7c0d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1756210353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c0d3020 0x7f7f7c0d34b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009870 tx=0x7f7f6401c510 comp rx=0 tx=0).stop 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- 172.21.15.143:0/1756210353 shutdown_connections 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1756210353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1756210353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c0d3020 0x7f7f7c0d34b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- 172.21.15.143:0/1756210353 >> 172.21.15.143:0/1756210353 conn(0x7f7f7c08ceb0 msgr2=0x7f7f7c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- 172.21.15.143:0/1756210353 shutdown_connections 2023-11-24T06:32:18.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- 172.21.15.143:0/1756210353 wait complete. 2023-11-24T06:32:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 Processor -- start 2023-11-24T06:32:18.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- start start 2023-11-24T06:32:18.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0d3020 0x7f7f7c0b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 0x7f7f7c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c160bf0 con 0x7f7f7c15d570 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0c6c60 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f8112a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c160630 con 0x7f7f7c0d3020 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f7b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 0x7f7f7c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.465+0000 7f7f7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 0x7f7f7c0b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38248/0 (socket says 172.21.15.143:38248) 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7b59e640 1 -- 172.21.15.143:0/1713582120 learned_addr learned my addr 172.21.15.143:0/1713582120 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7259c640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0d3020 0x7f7f7c0b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7ad9d640 1 -- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0d3020 msgr2=0x7f7f7c0b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7ad9d640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0d3020 0x7f7f7c0b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7ad9d640 1 -- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 msgr2=0x7f7f7c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7ad9d640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 0x7f7f7c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7ad9d640 1 -- 172.21.15.143:0/1713582120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640094d0 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7b59e640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 0x7f7f7c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:18.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f7ad9d640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0c6720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c410 tx=0x7f7f6c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0074e0 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c007640 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c004a30 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c160910 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c15b580 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c067520 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f7f6c004b90 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f73fff640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7f5c066860 0x7f7f5c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.469+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f7f6c083d70 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.473+0000 7f7f7259c640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7f5c066860 0x7f7f5c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.473+0000 7f7f7259c640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7f5c066860 0x7f7f5c068d20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7f640ae000 tx=0x7f7f640b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.477+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f6c051250 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.629+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f7c06b7b0 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.629+0000 7f7f73fff640 1 -- 172.21.15.143:0/1713582120 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12948 (secure 0 0 0) 0x7f7f6c054870 con 0x7f7f7c0ce8b0 2023-11-24T06:32:18.635 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":68,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:17.912169+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:18.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7f5c066860 msgr2=0x7f7f5c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7f5c066860 0x7f7f5c068d20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7f640ae000 tx=0x7f7f640b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c0ce8b0 msgr2=0x7f7f7c0c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0c6720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c410 tx=0x7f7f6c00c8d0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 shutdown_connections 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7f5c066860 0x7f7f5c068d20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7c15d570 0x7f7f7c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f7c0d3020 0x7f7f7c0b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 --2- 172.21.15.143:0/1713582120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c0ce8b0 0x7f7f7c0c6720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 >> 172.21.15.143:0/1713582120 conn(0x7f7f7c08ceb0 msgr2=0x7f7f7c0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:18.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 shutdown_connections 2023-11-24T06:32:18.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.633+0000 7f7f8112a640 1 -- 172.21.15.143:0/1713582120 wait complete. 2023-11-24T06:32:18.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:18.657 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:18.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.789+0000 7f5663baa640 1 Processor -- start 2023-11-24T06:32:18.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5663baa640 1 -- start start 2023-11-24T06:32:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5663baa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c15ec60 0x7f565c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5663baa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f565c0cc6b0 0x7f565c0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5663baa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c070f00 con 0x7f565c15a290 2023-11-24T06:32:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5663baa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c071170 con 0x7f565c0cc6b0 2023-11-24T06:32:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5663baa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0cb690 con 0x7f565c15ec60 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661145640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c15ec60 0x7f565c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661946640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f565c15a290 0x7f565c0707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:35540/0 (socket says 172.21.15.143:35540) 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661946640 1 -- 172.21.15.143:0/1896989992 learned_addr learned my addr 172.21.15.143:0/1896989992 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5662147640 1 --2- 172.21.15.143:0/1896989992 >> v2:172.21.15.146:3300/0 conn(0x7f565c0cc6b0 0x7f565c0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661145640 1 -- 172.21.15.143:0/1896989992 >> v2:172.21.15.146:3300/0 conn(0x7f565c0cc6b0 msgr2=0x7f565c0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661145640 1 --2- 172.21.15.143:0/1896989992 >> v2:172.21.15.146:3300/0 conn(0x7f565c0cc6b0 0x7f565c0b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661145640 1 -- 172.21.15.143:0/1896989992 >> v1:172.21.15.146:6789/0 conn(0x7f565c15a290 legacy=0x7f565c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5661145640 1 -- 172.21.15.143:0/1896989992 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0cb970 con 0x7f565c15ec60 2023-11-24T06:32:18.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.793+0000 7f5662147640 1 --2- 172.21.15.143:0/1896989992 >> v2:172.21.15.146:3300/0 conn(0x7f565c0cc6b0 0x7f565c0b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:18.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5661145640 1 --2- 172.21.15.143:0/1896989992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c15ec60 0x7f565c0cc170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f564c0097c0 tx=0x7f564c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=524458e2413ef3f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5660944640 1 -- 172.21.15.143:0/1896989992 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0ab600 con 0x7f565c15ec60 2023-11-24T06:32:18.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5660944640 1 -- 172.21.15.143:0/1896989992 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0a7050 con 0x7f565c15ec60 2023-11-24T06:32:18.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5660944640 1 -- 172.21.15.143:0/1896989992 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0ab980 con 0x7f565c15ec60 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 -- 172.21.15.143:0/1896989992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c15ec60 msgr2=0x7f565c0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 --2- 172.21.15.143:0/1896989992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c15ec60 0x7f565c0cc170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f564c0097c0 tx=0x7f564c01c3c0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 -- 172.21.15.143:0/1896989992 shutdown_connections 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 --2- 172.21.15.143:0/1896989992 >> v2:172.21.15.146:3300/0 conn(0x7f565c0cc6b0 0x7f565c0b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 --2- 172.21.15.143:0/1896989992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c15ec60 0x7f565c0cc170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 -- 172.21.15.143:0/1896989992 >> 172.21.15.143:0/1896989992 conn(0x7f565c0b0c80 msgr2=0x7f565c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 -- 172.21.15.143:0/1896989992 shutdown_connections 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.797+0000 7f5663baa640 1 -- 172.21.15.143:0/1896989992 wait complete. 2023-11-24T06:32:18.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 Processor -- start 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- start start 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c0cc6b0 0x7f565c166350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 0x7f565c098920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c15ec60 0x7f565c099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c15d980 con 0x7f565c15a290 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c14f760 con 0x7f565c15ec60 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c098e60 con 0x7f565c0cc6b0 2023-11-24T06:32:18.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 0x7f565c098920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 0x7f565c098920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38250/0 (socket says 172.21.15.143:38250) 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 -- 172.21.15.143:0/3376448969 learned_addr learned my addr 172.21.15.143:0/3376448969 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661946640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c0cc6b0 0x7f565c166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5662147640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c15ec60 0x7f565c099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 -- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c0cc6b0 msgr2=0x7f565c166350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c0cc6b0 0x7f565c166350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 -- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c15ec60 msgr2=0x7f565c099b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c15ec60 0x7f565c099b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 -- 172.21.15.143:0/3376448969 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654009a70 con 0x7f565c15a290 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5661145640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 0x7f565c098920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f564c0ae040 tx=0x7f564c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c006e20 con 0x7f565c15a290 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0b4410 con 0x7f565c15a290 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0b47c0 con 0x7f565c15a290 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c009420 con 0x7f565c15a290 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c15d3c0 con 0x7f565c15a290 2023-11-24T06:32:18.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.801+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c14f530 con 0x7f565c15a290 2023-11-24T06:32:18.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.805+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f564c0b2040 con 0x7f565c15a290 2023-11-24T06:32:18.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.805+0000 7f56527fc640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5640066860 0x7f5640068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:18.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.805+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f564c11e110 con 0x7f565c15a290 2023-11-24T06:32:18.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.805+0000 7f5661946640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5640066860 0x7f5640068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:18.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.805+0000 7f5661946640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5640066860 0x7f5640068d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5658005890 tx=0x7f5658009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:18.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.809+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f565c14f530 con 0x7f565c15a290 2023-11-24T06:32:18.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.961+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f565c14f530 con 0x7f565c15a290 2023-11-24T06:32:18.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.961+0000 7f56527fc640 1 -- 172.21.15.143:0/3376448969 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f565c14f530 con 0x7f565c15a290 2023-11-24T06:32:18.968 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5640066860 msgr2=0x7f5640068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5640066860 0x7f5640068d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5658005890 tx=0x7f5658009040 comp rx=0 tx=0).stop 2023-11-24T06:32:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 msgr2=0x7f565c098920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 0x7f565c098920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f564c0ae040 tx=0x7f564c019160 comp rx=0 tx=0).stop 2023-11-24T06:32:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 shutdown_connections 2023-11-24T06:32:18.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5640066860 0x7f5640068d20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c15ec60 0x7f565c099b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f565c15a290 0x7f565c098920 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 --2- 172.21.15.143:0/3376448969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f565c0cc6b0 0x7f565c166350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:18.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 >> 172.21.15.143:0/3376448969 conn(0x7f565c0b0c80 msgr2=0x7f565c0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:18.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 shutdown_connections 2023-11-24T06:32:18.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:18.965+0000 7f5663baa640 1 -- 172.21.15.143:0/3376448969 wait complete. 2023-11-24T06:32:18.989 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:32:19.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 Processor -- start 2023-11-24T06:32:19.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 -- start start 2023-11-24T06:32:19.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb108144030 0x7fb10806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb10809cc20 0x7fb10806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10806d8b0 con 0x7fb10806e280 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb108145020 con 0x7fb108144030 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10c8d6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10809d0a0 con 0x7fb10809cc20 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb108144030 0x7fb10806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb108144030 0x7fb10806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38258/0 (socket says 172.21.15.143:38258) 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 -- 172.21.15.143:0/1299333201 learned_addr learned my addr 172.21.15.143:0/1299333201 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 -- 172.21.15.143:0/1299333201 >> v2:172.21.15.146:3300/0 conn(0x7fb10809cc20 msgr2=0x7fb10806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb0fdd9b640 1 --2- 172.21.15.143:0/1299333201 >> v2:172.21.15.146:3300/0 conn(0x7fb10809cc20 0x7fb10806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 --2- 172.21.15.143:0/1299333201 >> v2:172.21.15.146:3300/0 conn(0x7fb10809cc20 0x7fb10806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 -- 172.21.15.143:0/1299333201 >> v1:172.21.15.146:6789/0 conn(0x7fb10806e280 legacy=0x7fb1080709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:19.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb10659c640 1 -- 172.21.15.143:0/1299333201 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10806cca0 con 0x7fb108144030 2023-11-24T06:32:19.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.121+0000 7fb0fdd9b640 1 --2- 172.21.15.143:0/1299333201 >> v2:172.21.15.146:3300/0 conn(0x7fb10809cc20 0x7fb10806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:19.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10659c640 1 --2- 172.21.15.143:0/1299333201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb10806c650 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb1080700a0 tx=0x7fb0f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38356d46965d66d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:19.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb105d9b640 1 -- 172.21.15.143:0/1299333201 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80aa5f0 con 0x7fb108144030 2023-11-24T06:32:19.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb105d9b640 1 -- 172.21.15.143:0/1299333201 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80aa750 con 0x7fb108144030 2023-11-24T06:32:19.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb105d9b640 1 -- 172.21.15.143:0/1299333201 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80aaae0 con 0x7fb108144030 2023-11-24T06:32:19.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 -- 172.21.15.143:0/1299333201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 msgr2=0x7fb10806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/1299333201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb10806c650 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb1080700a0 tx=0x7fb0f801c490 comp rx=0 tx=0).stop 2023-11-24T06:32:19.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 -- 172.21.15.143:0/1299333201 shutdown_connections 2023-11-24T06:32:19.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/1299333201 >> v2:172.21.15.146:3300/0 conn(0x7fb10809cc20 0x7fb10806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/1299333201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb10806c650 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 -- 172.21.15.143:0/1299333201 >> 172.21.15.143:0/1299333201 conn(0x7fb1080b0bf0 msgr2=0x7fb1080b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:19.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 -- 172.21.15.143:0/1299333201 shutdown_connections 2023-11-24T06:32:19.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.125+0000 7fb10c8d6640 1 -- 172.21.15.143:0/1299333201 wait complete. 2023-11-24T06:32:19.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 Processor -- start 2023-11-24T06:32:19.134 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 -- start start 2023-11-24T06:32:19.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10806e280 0x7fb10815af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10809cc20 0x7fb108135020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb108132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108133c60 con 0x7fb108144030 2023-11-24T06:32:19.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10813e770 con 0x7fb10806e280 2023-11-24T06:32:19.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10809a590 con 0x7fb10809cc20 2023-11-24T06:32:19.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb0fdd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10809cc20 0x7fb108135020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10806e280 0x7fb10815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb108132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb0fdd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10809cc20 0x7fb108135020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:41234/0 (socket says 172.21.15.143:41234) 2023-11-24T06:32:19.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb0fdd9b640 1 -- 172.21.15.143:0/911082079 learned_addr learned my addr 172.21.15.143:0/911082079 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:19.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 -- 172.21.15.143:0/911082079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10809cc20 msgr2=0x7fb108135020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10809cc20 0x7fb108135020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 -- 172.21.15.143:0/911082079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10806e280 msgr2=0x7fb10815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10806e280 0x7fb10815af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 -- 172.21.15.143:0/911082079 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80094d0 con 0x7fb108144030 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb106d9d640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb108132ea0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c3e0 tx=0x7fb10000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100011790 con 0x7fb108144030 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000118f0 con 0x7fb108144030 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100011ce0 con 0x7fb108144030 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10809a870 con 0x7fb108144030 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.129+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb108135560 con 0x7fb108144030 2023-11-24T06:32:19.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.133+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10809a3c0 con 0x7fb108144030 2023-11-24T06:32:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.133+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fb100005020 con 0x7fb108144030 2023-11-24T06:32:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.133+0000 7fb0ff7fe640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb0e8066860 0x7fb0e8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.133+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4885+0+0 (secure 0 0 0) 0x7fb100083c90 con 0x7fb108144030 2023-11-24T06:32:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.133+0000 7fb10659c640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb0e8066860 0x7fb0e8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.133+0000 7fb10659c640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb0e8066860 0x7fb0e8068d20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ae000 tx=0x7fb0f80b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:19.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.137+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb100050f60 con 0x7fb108144030 2023-11-24T06:32:19.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb108067520 con 0x7fb108144030 2023-11-24T06:32:19.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb0ff7fe640 1 -- 172.21.15.143:0/911082079 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb100054580 con 0x7fb108144030 2023-11-24T06:32:19.294 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:19.295 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:32:19.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:19.295 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2023-11-24T06:32:19.295 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2023-11-24T06:32:19.295 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:19.296 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:32:19.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb0e8066860 msgr2=0x7fb0e8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb0e8066860 0x7fb0e8068d20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ae000 tx=0x7fb0f80b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:19.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 msgr2=0x7fb108132ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb108132ea0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c3e0 tx=0x7fb10000c8a0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 shutdown_connections 2023-11-24T06:32:19.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb0e8066860 0x7fb0e8068d20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb108144030 0x7fb108132ea0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10809cc20 0x7fb108135020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 --2- 172.21.15.143:0/911082079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10806e280 0x7fb10815af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 >> 172.21.15.143:0/911082079 conn(0x7fb1080b0bf0 msgr2=0x7fb10813bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:19.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 shutdown_connections 2023-11-24T06:32:19.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.289+0000 7fb10c8d6640 1 -- 172.21.15.143:0/911082079 wait complete. 2023-11-24T06:32:19.315 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:32:19.315 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:32:19.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 Processor -- start 2023-11-24T06:32:19.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 -- start start 2023-11-24T06:32:19.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c0c160a40 0x7f5c0c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 0x7f5c0c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0c0d0550 con 0x7f5c0c0d1930 2023-11-24T06:32:19.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c0d0830 con 0x7f5c0c160a40 2023-11-24T06:32:19.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c116d6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0d0b10 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 0x7f5c0c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 0x7f5c0c06bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:41248/0 (socket says 172.21.15.143:41248) 2023-11-24T06:32:19.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3376616798 learned_addr learned my addr 172.21.15.143:0/3376616798 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:19.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0b7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5c0c0d1930 0x7f5c0c0ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:35558/0 (socket says 172.21.15.143:35558) 2023-11-24T06:32:19.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0affd640 1 --2- 172.21.15.143:0/3376616798 >> v2:172.21.15.146:3300/0 conn(0x7f5c0c160a40 0x7f5c0c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3376616798 >> v2:172.21.15.146:3300/0 conn(0x7f5c0c160a40 msgr2=0x7f5c0c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:19.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 --2- 172.21.15.143:0/3376616798 >> v2:172.21.15.146:3300/0 conn(0x7f5c0c160a40 0x7f5c0c0cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3376616798 >> v1:172.21.15.146:6789/0 conn(0x7f5c0c0d1930 legacy=0x7f5c0c0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c09ffb640 1 -- 172.21.15.143:0/3376616798 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515566342 0 0) 0x7f5c0c0d0550 con 0x7f5c0c0d1930 2023-11-24T06:32:19.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.453+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3376616798 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0ce000 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c0a7fc640 1 --2- 172.21.15.143:0/3376616798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 0x7f5c0c06bab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009870 tx=0x7f5c0001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e3ab0a40572d2f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:19.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c09ffb640 1 -- 172.21.15.143:0/3376616798 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000a8a30 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c09ffb640 1 -- 172.21.15.143:0/3376616798 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c000a8b90 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c09ffb640 1 -- 172.21.15.143:0/3376616798 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000b0440 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 -- 172.21.15.143:0/3376616798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 msgr2=0x7f5c0c06bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3376616798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 0x7f5c0c06bab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009870 tx=0x7f5c0001ed30 comp rx=0 tx=0).stop 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 -- 172.21.15.143:0/3376616798 shutdown_connections 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3376616798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d3b60 0x7f5c0c06bab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3376616798 >> v2:172.21.15.146:3300/0 conn(0x7f5c0c160a40 0x7f5c0c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 -- 172.21.15.143:0/3376616798 >> 172.21.15.143:0/3376616798 conn(0x7f5c0c08af70 msgr2=0x7f5c0c09c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 -- 172.21.15.143:0/3376616798 shutdown_connections 2023-11-24T06:32:19.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.457+0000 7f5c116d6640 1 -- 172.21.15.143:0/3376616798 wait complete. 2023-11-24T06:32:19.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 Processor -- start 2023-11-24T06:32:19.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- start start 2023-11-24T06:32:19.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d1930 0x7f5c0c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 0x7f5c0c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c160a40 0x7f5c0c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1f6290 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1f3230 con 0x7f5c0c160a40 2023-11-24T06:32:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1f3510 con 0x7f5c0c0d1930 2023-11-24T06:32:19.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 0x7f5c0c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 0x7f5c0c0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38264/0 (socket says 172.21.15.143:38264) 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3308443328 learned_addr learned my addr 172.21.15.143:0/3308443328 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3308443328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d1930 msgr2=0x7f5c0c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d1930 0x7f5c0c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3308443328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c160a40 msgr2=0x7f5c0c1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c160a40 0x7f5c0c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 -- 172.21.15.143:0/3308443328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000094d0 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c0a7fc640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 0x7f5c0c0cc320 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5c000b3040 tx=0x7f5c0001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000b0dd0 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c000bb460 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000bb810 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c1f37f0 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c0cbed0 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.461+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c0cc180 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.465+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f5c000b83f0 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.465+0000 7f5bf37fe640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bf8066860 0x7f5bf8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.465+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f5c00121a50 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.465+0000 7f5c0affd640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bf8066860 0x7f5bf8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:19.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.465+0000 7f5c0affd640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bf8066860 0x7f5bf8068d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006aa0 tx=0x7f5bfc006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:19.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.469+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c0c0cc180 con 0x7f5c0c0d3b60 2023-11-24T06:32:19.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:19.621+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5c0c0cc180 con 0x7f5c0c0d3b60 2023-11-24T06:32:20.574 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.569+0000 7f5bf37fe640 1 -- 172.21.15.143:0/3308443328 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5c0c0cc180 con 0x7f5c0c0d3b60 2023-11-24T06:32:20.574 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2023-11-24T06:32:20.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bf8066860 msgr2=0x7f5bf8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:20.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bf8066860 0x7f5bf8068d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006aa0 tx=0x7f5bfc006a30 comp rx=0 tx=0).stop 2023-11-24T06:32:20.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 msgr2=0x7f5c0c0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:20.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 0x7f5c0c0cc320 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5c000b3040 tx=0x7f5c0001bad0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 shutdown_connections 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5bf8066860 0x7f5bf8068d20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c160a40 0x7f5c0c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c0c0d3b60 0x7f5c0c0cc320 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 --2- 172.21.15.143:0/3308443328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c0d1930 0x7f5c0c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 >> 172.21.15.143:0/3308443328 conn(0x7f5c0c08af70 msgr2=0x7f5c0c0b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:20.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 shutdown_connections 2023-11-24T06:32:20.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.573+0000 7f5c116d6640 1 -- 172.21.15.143:0/3308443328 wait complete. 2023-11-24T06:32:20.606 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:32:20.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.745+0000 7f4eea2c9640 1 Processor -- start 2023-11-24T06:32:20.753 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4eea2c9640 1 -- start start 2023-11-24T06:32:20.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4eea2c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ee415b220 0x7f4ee40cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:20.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4eea2c9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ee415b600 0x7f4ee406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:20.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4eea2c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee40abed0 con 0x7f4ee40c9650 2023-11-24T06:32:20.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4eea2c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee4072710 con 0x7f4ee415b220 2023-11-24T06:32:20.755 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4eea2c9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee4072370 con 0x7f4ee415b600 2023-11-24T06:32:20.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ee415b220 0x7f4ee40cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:20.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ee415b220 0x7f4ee40cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38272/0 (socket says 172.21.15.143:38272) 2023-11-24T06:32:20.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 -- 172.21.15.143:0/686945745 learned_addr learned my addr 172.21.15.143:0/686945745 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:20.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee37fe640 1 --2- 172.21.15.143:0/686945745 >> v2:172.21.15.146:3300/0 conn(0x7f4ee415b600 0x7f4ee406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:20.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 -- 172.21.15.143:0/686945745 >> v2:172.21.15.146:3300/0 conn(0x7f4ee415b600 msgr2=0x7f4ee406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:20.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 --2- 172.21.15.143:0/686945745 >> v2:172.21.15.146:3300/0 conn(0x7f4ee415b600 0x7f4ee406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 -- 172.21.15.143:0/686945745 >> v1:172.21.15.146:6789/0 conn(0x7f4ee40c9650 legacy=0x7f4ee40c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:20.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.749+0000 7f4ee3fff640 1 -- 172.21.15.143:0/686945745 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee406d580 con 0x7f4ee415b220 2023-11-24T06:32:20.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4ee3fff640 1 --2- 172.21.15.143:0/686945745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40cada0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4ee415ef20 tx=0x7f4ed401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a1baa323420604 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:20.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4ee2ffd640 1 -- 172.21.15.143:0/686945745 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40aa430 con 0x7f4ee415b220 2023-11-24T06:32:20.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4ee2ffd640 1 -- 172.21.15.143:0/686945745 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed40aa590 con 0x7f4ee415b220 2023-11-24T06:32:20.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4ee2ffd640 1 -- 172.21.15.143:0/686945745 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40aa920 con 0x7f4ee415b220 2023-11-24T06:32:20.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 -- 172.21.15.143:0/686945745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 msgr2=0x7f4ee40cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:20.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/686945745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40cada0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4ee415ef20 tx=0x7f4ed401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 -- 172.21.15.143:0/686945745 shutdown_connections 2023-11-24T06:32:20.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/686945745 >> v2:172.21.15.146:3300/0 conn(0x7f4ee415b600 0x7f4ee406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/686945745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40cada0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 -- 172.21.15.143:0/686945745 >> 172.21.15.143:0/686945745 conn(0x7f4ee40b0bf0 msgr2=0x7f4ee40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:20.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 -- 172.21.15.143:0/686945745 shutdown_connections 2023-11-24T06:32:20.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 -- 172.21.15.143:0/686945745 wait complete. 2023-11-24T06:32:20.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 Processor -- start 2023-11-24T06:32:20.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.753+0000 7f4eea2c9640 1 -- start start 2023-11-24T06:32:20.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ee40c9650 0x7f4ee409b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:20.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:20.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee415b600 0x7f4ee40c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:20.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c5780 con 0x7f4ee415b220 2023-11-24T06:32:20.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c4b00 con 0x7f4ee415b600 2023-11-24T06:32:20.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c4de0 con 0x7f4ee40c9650 2023-11-24T06:32:20.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:20.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38284/0 (socket says 172.21.15.143:38284) 2023-11-24T06:32:20.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 -- 172.21.15.143:0/3195503105 learned_addr learned my addr 172.21.15.143:0/3195503105 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:20.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee8866640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee415b600 0x7f4ee40c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:20.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee3fff640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ee40c9650 0x7f4ee409b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:20.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 -- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ee40c9650 msgr2=0x7f4ee409b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:20.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ee40c9650 0x7f4ee409b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 -- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee415b600 msgr2=0x7f4ee40c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:20.766 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee415b600 0x7f4ee40c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:20.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 -- 172.21.15.143:0/3195503105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed40094d0 con 0x7f4ee415b220 2023-11-24T06:32:20.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee37fe640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40c8500 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800d5f0 tx=0x7f4ed800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:20.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80125f0 con 0x7f4ee415b220 2023-11-24T06:32:20.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8012750 con 0x7f4ee415b220 2023-11-24T06:32:20.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee40c50c0 con 0x7f4ee415b220 2023-11-24T06:32:20.767 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8012b00 con 0x7f4ee415b220 2023-11-24T06:32:20.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee40c8a40 con 0x7f4ee415b220 2023-11-24T06:32:20.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.757+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee40c58c0 con 0x7f4ee415b220 2023-11-24T06:32:20.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.761+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f4ed8012c60 con 0x7f4ee415b220 2023-11-24T06:32:20.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.761+0000 7f4ee0ff9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ed0066890 0x7f4ed0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:20.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.761+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5255+0+0 (secure 0 0 0) 0x7f4ed8084910 con 0x7f4ee415b220 2023-11-24T06:32:20.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.761+0000 7f4ee3fff640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ed0066890 0x7f4ed0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:20.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.761+0000 7f4ee3fff640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ed0066890 0x7f4ed0068d50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40ae000 tx=0x7f4ed40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:20.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.765+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ed8051970 con 0x7f4ee415b220 2023-11-24T06:32:20.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:20.913+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4ee40c8c60 con 0x7f4ee415b220 2023-11-24T06:32:21.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.569+0000 7f4ee0ff9640 1 -- 172.21.15.143:0/3195503105 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4ed8054f90 con 0x7f4ee415b220 2023-11-24T06:32:21.577 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2023-11-24T06:32:21.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.573+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ed0066890 msgr2=0x7f4ed0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.573+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ed0066890 0x7f4ed0068d50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40ae000 tx=0x7f4ed40a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:21.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.573+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 msgr2=0x7f4ee40c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.580 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.573+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40c8500 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800d5f0 tx=0x7f4ed800dab0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 shutdown_connections 2023-11-24T06:32:21.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ed0066890 0x7f4ed0068d50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee415b600 0x7f4ee40c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee415b220 0x7f4ee40c8500 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 --2- 172.21.15.143:0/3195503105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ee40c9650 0x7f4ee409b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 >> 172.21.15.143:0/3195503105 conn(0x7f4ee40b0bf0 msgr2=0x7f4ee415dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:21.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 shutdown_connections 2023-11-24T06:32:21.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.577+0000 7f4eea2c9640 1 -- 172.21.15.143:0/3195503105 wait complete. 2023-11-24T06:32:21.624 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:32:21.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.757+0000 7f5f762e3640 1 Processor -- start 2023-11-24T06:32:21.765 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.757+0000 7f5f762e3640 1 -- start start 2023-11-24T06:32:21.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f762e3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f700cd850 0x7f5f7015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f762e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f700b3510 con 0x7f5f700ae4a0 2023-11-24T06:32:21.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f762e3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f700b37f0 con 0x7f5f700ce420 2023-11-24T06:32:21.768 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f762e3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f700b3ad0 con 0x7f5f700cd850 2023-11-24T06:32:21.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5f700ae4a0 0x7f5f700cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36462/0 (socket says 172.21.15.143:36462) 2023-11-24T06:32:21.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6ffff640 1 -- 172.21.15.143:0/2981909475 learned_addr learned my addr 172.21.15.143:0/2981909475 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:21.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248465208 0 0) 0x7f5f700b3510 con 0x7f5f700ae4a0 2023-11-24T06:32:21.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f58003530 con 0x7f5f700ae4a0 2023-11-24T06:32:21.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f74880640 1 --2- 172.21.15.143:0/2981909475 >> v2:172.21.15.146:3300/0 conn(0x7f5f700cd850 0x7f5f7015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624724402 0 0) 0x7f5f58003530 con 0x7f5f700ae4a0 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 >> v2:172.21.15.146:3300/0 conn(0x7f5f700cd850 msgr2=0x7f5f7015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 --2- 172.21.15.143:0/2981909475 >> v2:172.21.15.146:3300/0 conn(0x7f5f700cd850 0x7f5f7015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 >> v1:172.21.15.146:6789/0 conn(0x7f5f700ce420 legacy=0x7f5f7006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700b3db0 con 0x7f5f700ae4a0 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f5f60001680 con 0x7f5f700ae4a0 2023-11-24T06:32:21.770 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 >> v1:172.21.15.143:6789/0 conn(0x7f5f700ae4a0 legacy=0x7f5f700cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f58003980 0x7f5f58003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f58004380 0x7f5f58004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58005050 0x7f5f5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700b3ad0 con 0x7f5f58004380 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800bfb0 con 0x7f5f58005050 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800c170 con 0x7f5f58003980 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6f7fe640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f58004380 0x7f5f58004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6ffff640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f58003980 0x7f5f58003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f74880640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58005050 0x7f5f5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6f7fe640 1 -- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f58003980 msgr2=0x7f5f58003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:21.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6f7fe640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f58003980 0x7f5f58003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6f7fe640 1 -- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58005050 msgr2=0x7f5f5800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:21.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6f7fe640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58005050 0x7f5f5800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f6f7fe640 1 -- 172.21.15.143:0/2981909475 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58003530 con 0x7f5f58004380 2023-11-24T06:32:21.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.761+0000 7f5f74880640 1 -- 172.21.15.143:0/2981909475 reap_dead start 2023-11-24T06:32:21.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f6f7fe640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f58004380 0x7f5f58004850 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5f7006be60 tx=0x7f5f6401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d6d87436e0f5dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:21.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640a8810 con 0x7f5f58004380 2023-11-24T06:32:21.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f640a8970 con 0x7f5f58004380 2023-11-24T06:32:21.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f6effd640 1 -- 172.21.15.143:0/2981909475 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640a8d60 con 0x7f5f58004380 2023-11-24T06:32:21.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 -- 172.21.15.143:0/2981909475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f58004380 msgr2=0x7f5f58004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f58004380 0x7f5f58004850 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5f7006be60 tx=0x7f5f6401ebf0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 -- 172.21.15.143:0/2981909475 shutdown_connections 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 --2- 172.21.15.143:0/2981909475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f58004380 0x7f5f58004850 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 -- 172.21.15.143:0/2981909475 >> 172.21.15.143:0/2981909475 conn(0x7f5f700b0c80 msgr2=0x7f5f700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 -- 172.21.15.143:0/2981909475 shutdown_connections 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.765+0000 7f5f762e3640 1 -- 172.21.15.143:0/2981909475 wait complete. 2023-11-24T06:32:21.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 Processor -- start 2023-11-24T06:32:21.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 -- start start 2023-11-24T06:32:21.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58004380 0x7f5f7015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f70099b60 0x7f5f7009c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 0x7f5f7009b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7009ac70 con 0x7f5f70149fa0 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7009a060 con 0x7f5f58004380 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7009a340 con 0x7f5f70099b60 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 0x7f5f7009b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 0x7f5f7009b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38316/0 (socket says 172.21.15.143:38316) 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 -- 172.21.15.143:0/3417454131 learned_addr learned my addr 172.21.15.143:0/3417454131 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f6ffff640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58004380 0x7f5f7015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f6f7fe640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f70099b60 0x7f5f7009c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 -- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f70099b60 msgr2=0x7f5f7009c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f70099b60 0x7f5f7009c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 -- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58004380 msgr2=0x7f5f7015b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58004380 0x7f5f7015b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 -- 172.21.15.143:0/3417454131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7009a620 con 0x7f5f70149fa0 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f74880640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 0x7f5f7009b100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5f7006f9c0 tx=0x7f5f6800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6800e040 con 0x7f5f70149fa0 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6800f040 con 0x7f5f70149fa0 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680039a0 con 0x7f5f70149fa0 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7009a900 con 0x7f5f70149fa0 2023-11-24T06:32:21.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.769+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7009c5d0 con 0x7f5f70149fa0 2023-11-24T06:32:21.779 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.773+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7004e8c0 con 0x7f5f70149fa0 2023-11-24T06:32:21.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.773+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f5f68003b00 con 0x7f5f70149fa0 2023-11-24T06:32:21.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.773+0000 7f5f6cff9640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f5c066860 0x7f5f5c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:21.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.773+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5637+0+0 (secure 0 0 0) 0x7f5f68085ba0 con 0x7f5f70149fa0 2023-11-24T06:32:21.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.773+0000 7f5f6ffff640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f5c066860 0x7f5f5c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:21.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.773+0000 7f5f6ffff640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f5c066860 0x7f5f5c068d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f700682a0 tx=0x7f5f60001c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:21.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.777+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f68052a60 con 0x7f5f70149fa0 2023-11-24T06:32:21.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:21.957+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5f7015daf0 con 0x7f5f70149fa0 2023-11-24T06:32:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.605+0000 7f5f6cff9640 1 -- 172.21.15.143:0/3417454131 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5f68056080 con 0x7f5f70149fa0 2023-11-24T06:32:22.615 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 10 and data pool 11 2023-11-24T06:32:22.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.609+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f5c066860 msgr2=0x7f5f5c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.609+0000 7f5f762e3640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f5c066860 0x7f5f5c068d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f700682a0 tx=0x7f5f60001c00 comp rx=0 tx=0).stop 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.609+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 msgr2=0x7f5f7009b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.609+0000 7f5f762e3640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 0x7f5f7009b100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5f7006f9c0 tx=0x7f5f6800f580 comp rx=0 tx=0).stop 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 shutdown_connections 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5f5c066860 0x7f5f5c068d20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f70149fa0 0x7f5f7009b100 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f70099b60 0x7f5f7009c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 --2- 172.21.15.143:0/3417454131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f58004380 0x7f5f7015b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 >> 172.21.15.143:0/3417454131 conn(0x7f5f700b0c80 msgr2=0x7f5f700cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:22.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 shutdown_connections 2023-11-24T06:32:22.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.613+0000 7f5f762e3640 1 -- 172.21.15.143:0/3417454131 wait complete. 2023-11-24T06:32:22.656 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:22.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 Processor -- start 2023-11-24T06:32:22.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 -- start start 2023-11-24T06:32:22.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8300b36c0 0x7fc8300b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:22.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc830070da0 0x7fc8300711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:22.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83015a700 con 0x7fc83015a320 2023-11-24T06:32:22.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8300b2430 con 0x7fc830070da0 2023-11-24T06:32:22.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.789+0000 7fc835b72640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8300b2620 con 0x7fc8300b36c0 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc830070da0 0x7fc8300711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc83015a320 0x7fc830070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36476/0 (socket says 172.21.15.143:36476) 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82f7fe640 1 -- 172.21.15.143:0/1374698186 learned_addr learned my addr 172.21.15.143:0/1374698186 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82effd640 1 --2- 172.21.15.143:0/1374698186 >> v2:172.21.15.146:3300/0 conn(0x7fc8300b36c0 0x7fc8300b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82ffff640 1 -- 172.21.15.143:0/1374698186 >> v2:172.21.15.146:3300/0 conn(0x7fc8300b36c0 msgr2=0x7fc8300b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82ffff640 1 --2- 172.21.15.143:0/1374698186 >> v2:172.21.15.146:3300/0 conn(0x7fc8300b36c0 0x7fc8300b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82ffff640 1 -- 172.21.15.143:0/1374698186 >> v1:172.21.15.143:6789/0 conn(0x7fc83015a320 legacy=0x7fc830070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82ffff640 1 -- 172.21.15.143:0/1374698186 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300b2900 con 0x7fc830070da0 2023-11-24T06:32:22.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82e7fc640 1 -- 172.21.15.143:0/1374698186 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938694886 0 0) 0x7fc83015a700 con 0x7fc83015a320 2023-11-24T06:32:22.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82ffff640 1 --2- 172.21.15.143:0/1374698186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc830070da0 0x7fc8300711f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc83006c180 tx=0x7fc82801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31b3f061726121 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:22.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82e7fc640 1 -- 172.21.15.143:0/1374698186 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a59a0 con 0x7fc830070da0 2023-11-24T06:32:22.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82e7fc640 1 -- 172.21.15.143:0/1374698186 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280a5b00 con 0x7fc830070da0 2023-11-24T06:32:22.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.793+0000 7fc82e7fc640 1 -- 172.21.15.143:0/1374698186 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5e90 con 0x7fc830070da0 2023-11-24T06:32:22.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- 172.21.15.143:0/1374698186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc830070da0 msgr2=0x7fc8300711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 --2- 172.21.15.143:0/1374698186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc830070da0 0x7fc8300711f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc83006c180 tx=0x7fc82801c8e0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- 172.21.15.143:0/1374698186 shutdown_connections 2023-11-24T06:32:22.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 --2- 172.21.15.143:0/1374698186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc830070da0 0x7fc8300711f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 --2- 172.21.15.143:0/1374698186 >> v2:172.21.15.146:3300/0 conn(0x7fc8300b36c0 0x7fc8300b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- 172.21.15.143:0/1374698186 >> 172.21.15.143:0/1374698186 conn(0x7fc8300b0bf0 msgr2=0x7fc8300b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:22.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- 172.21.15.143:0/1374698186 shutdown_connections 2023-11-24T06:32:22.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- 172.21.15.143:0/1374698186 wait complete. 2023-11-24T06:32:22.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 Processor -- start 2023-11-24T06:32:22.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- start start 2023-11-24T06:32:22.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc830070da0 0x7fc8301443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:22.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8300b36c0 0x7fc8301518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:22.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 0x7fc830151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:22.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014ad20 con 0x7fc83015a320 2023-11-24T06:32:22.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83006d880 con 0x7fc8300b36c0 2023-11-24T06:32:22.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc835b72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014b600 con 0x7fc830070da0 2023-11-24T06:32:22.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 0x7fc830151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:22.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 0x7fc830151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38338/0 (socket says 172.21.15.143:38338) 2023-11-24T06:32:22.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc82ffff640 1 -- 172.21.15.143:0/3192538861 learned_addr learned my addr 172.21.15.143:0/3192538861 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:22.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc82effd640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8300b36c0 0x7fc8301518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:22.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.797+0000 7fc82f7fe640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc830070da0 0x7fc8301443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:22.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc82ffff640 1 -- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc830070da0 msgr2=0x7fc8301443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc82ffff640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc830070da0 0x7fc8301443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc82ffff640 1 -- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8300b36c0 msgr2=0x7fc8301518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc82ffff640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8300b36c0 0x7fc8301518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc82ffff640 1 -- 172.21.15.143:0/3192538861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009a70 con 0x7fc83015a320 2023-11-24T06:32:22.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc82ffff640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 0x7fc830151e00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc8280194f0 tx=0x7fc828019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280bf070 con 0x7fc83015a320 2023-11-24T06:32:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828009450 con 0x7fc83015a320 2023-11-24T06:32:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc830148130 con 0x7fc83015a320 2023-11-24T06:32:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a59a0 con 0x7fc83015a320 2023-11-24T06:32:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83014aa40 con 0x7fc83015a320 2023-11-24T06:32:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc830067520 con 0x7fc83015a320 2023-11-24T06:32:22.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fc8280b4050 con 0x7fc83015a320 2023-11-24T06:32:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.801+0000 7fc817fff640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc81c066860 0x7fc81c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.805+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc82811efb0 con 0x7fc83015a320 2023-11-24T06:32:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.805+0000 7fc82f7fe640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc81c066860 0x7fc81c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:22.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.805+0000 7fc82f7fe640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc81c066860 0x7fc81c068d20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc820000f70 tx=0x7fc820007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:22.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.809+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8280ebea0 con 0x7fc83015a320 2023-11-24T06:32:22.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.957+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc83006db90 con 0x7fc83015a320 2023-11-24T06:32:22.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.957+0000 7fc817fff640 1 -- 172.21.15.143:0/3192538861 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16672 (secure 0 0 0) 0x7fc8280ef4c0 con 0x7fc83015a320 2023-11-24T06:32:22.964 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:22.964 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":71,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:21.960896+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:22.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc81c066860 msgr2=0x7fc81c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc81c066860 0x7fc81c068d20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc820000f70 tx=0x7fc820007df0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 msgr2=0x7fc830151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:22.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 0x7fc830151e00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc8280194f0 tx=0x7fc828019680 comp rx=0 tx=0).stop 2023-11-24T06:32:22.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 shutdown_connections 2023-11-24T06:32:22.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc81c066860 0x7fc81c068d20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc83015a320 0x7fc830151e00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8300b36c0 0x7fc8301518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 --2- 172.21.15.143:0/3192538861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc830070da0 0x7fc8301443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:22.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 >> 172.21.15.143:0/3192538861 conn(0x7fc8300b0bf0 msgr2=0x7fc8300b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:22.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 shutdown_connections 2023-11-24T06:32:22.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:22.961+0000 7fc835b72640 1 -- 172.21.15.143:0/3192538861 wait complete. 2023-11-24T06:32:22.987 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:23.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.117+0000 7f6994335640 1 Processor -- start 2023-11-24T06:32:23.125 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.117+0000 7f6994335640 1 -- start start 2023-11-24T06:32:23.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f6994335640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f698c15a320 0x7f698c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f6994335640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c15a700 con 0x7f698c0b36c0 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f6994335640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c0b2620 con 0x7f698c070da0 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f6994335640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0b2430 con 0x7f698c15a320 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69918d0640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f698c0b36c0 0x7f698c070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36480/0 (socket says 172.21.15.143:36480) 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69918d0640 1 -- 172.21.15.143:0/1536050699 learned_addr learned my addr 172.21.15.143:0/1536050699 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69920d1640 1 --2- 172.21.15.143:0/1536050699 >> v2:172.21.15.146:3300/0 conn(0x7f698c15a320 0x7f698c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481697846 0 0) 0x7f698c15a700 con 0x7f698c0b36c0 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6978003530 con 0x7f698c0b36c0 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243360921 0 0) 0x7f6978003530 con 0x7f698c0b36c0 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 >> v2:172.21.15.146:3300/0 conn(0x7f698c15a320 msgr2=0x7f698c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:23.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 --2- 172.21.15.143:0/1536050699 >> v2:172.21.15.146:3300/0 conn(0x7f698c15a320 0x7f698c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 >> v1:172.21.15.146:6789/0 conn(0x7f698c070da0 legacy=0x7f698c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0b2900 con 0x7f698c0b36c0 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f697c001680 con 0x7f698c0b36c0 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 >> v1:172.21.15.143:6789/0 conn(0x7f698c0b36c0 legacy=0x7f698c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6978003980 0x7f6978003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69780047d0 0x7f6978004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f697800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697800e210 con 0x7f6978005190 2023-11-24T06:32:23.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697800e380 con 0x7f6978003980 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697800e540 con 0x7f69780047d0 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69928d2640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f697800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69920d1640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6978003980 0x7f6978003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69918d0640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69780047d0 0x7f6978004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69928d2640 1 -- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69780047d0 msgr2=0x7f6978004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69928d2640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69780047d0 0x7f6978004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69928d2640 1 -- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6978003980 msgr2=0x7f6978003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69928d2640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6978003980 0x7f6978003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.121+0000 7f69928d2640 1 -- 172.21.15.143:0/1536050699 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978003530 con 0x7f6978005190 2023-11-24T06:32:23.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f69928d2640 1 -- 172.21.15.143:0/1536050699 reap_dead start 2023-11-24T06:32:23.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f69928d2640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f697800dba0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6984001e70 tx=0x7f698401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91185151e2a6d814 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:23.136 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984003b80 con 0x7f6978005190 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984003d20 con 0x7f6978005190 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f69910cf640 1 -- 172.21.15.143:0/1536050699 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984005310 con 0x7f6978005190 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 -- 172.21.15.143:0/1536050699 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 msgr2=0x7f697800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f697800dba0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6984001e70 tx=0x7f698401c7f0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 -- 172.21.15.143:0/1536050699 shutdown_connections 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 --2- 172.21.15.143:0/1536050699 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f697800dba0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 -- 172.21.15.143:0/1536050699 >> 172.21.15.143:0/1536050699 conn(0x7f698c0b0bf0 msgr2=0x7f698c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:23.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 -- 172.21.15.143:0/1536050699 shutdown_connections 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.125+0000 7f6994335640 1 -- 172.21.15.143:0/1536050699 wait complete. 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 Processor -- start 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- start start 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f698c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f698c09c4e0 0x7f698c1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f698c1566c0 0x7f698c156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c157080 con 0x7f6978005190 2023-11-24T06:32:23.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1f29a0 con 0x7f698c1566c0 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c150f80 con 0x7f698c09c4e0 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f698c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f698c1508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38348/0 (socket says 172.21.15.143:38348) 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 -- 172.21.15.143:0/1604871436 learned_addr learned my addr 172.21.15.143:0/1604871436 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69928d2640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f698c1566c0 0x7f698c156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69918d0640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f698c09c4e0 0x7f698c1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 -- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f698c09c4e0 msgr2=0x7f698c1f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f698c09c4e0 0x7f698c1f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 -- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f698c1566c0 msgr2=0x7f698c156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f698c1566c0 0x7f698c156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 -- 172.21.15.143:0/1604871436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c151260 con 0x7f6978005190 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69928d2640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f698c1566c0 0x7f698c156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f69920d1640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f698c1508c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6988011960 tx=0x7f6988011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800faf0 con 0x7f6978005190 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800fc50 con 0x7f6978005190 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988014440 con 0x7f6978005190 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c151540 con 0x7f6978005190 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c09c940 con 0x7f6978005190 2023-11-24T06:32:23.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.129+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c067520 con 0x7f6978005190 2023-11-24T06:32:23.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.133+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f69880145a0 con 0x7f6978005190 2023-11-24T06:32:23.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.133+0000 7f6982ffd640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6970066890 0x7f6970068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.133+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6988084df0 con 0x7f6978005190 2023-11-24T06:32:23.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.133+0000 7f69918d0640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6970066890 0x7f6970068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.133+0000 7f69918d0640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6970066890 0x7f6970068d50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f697c001060 tx=0x7f697c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:23.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.137+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6988051c30 con 0x7f6978005190 2023-11-24T06:32:23.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.289+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f698c0999e0 con 0x7f6978005190 2023-11-24T06:32:23.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6982ffd640 1 -- 172.21.15.143:0/1604871436 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16672 (secure 0 0 0) 0x7f6988055250 con 0x7f6978005190 2023-11-24T06:32:23.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:23.298 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":71,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:21.960896+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:23.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6970066890 msgr2=0x7f6970068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6970066890 0x7f6970068d50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f697c001060 tx=0x7f697c009040 comp rx=0 tx=0).stop 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 msgr2=0x7f698c1508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f698c1508c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6988011960 tx=0x7f6988011e20 comp rx=0 tx=0).stop 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 shutdown_connections 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6970066890 0x7f6970068d50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f698c1566c0 0x7f698c156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f698c09c4e0 0x7f698c1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 --2- 172.21.15.143:0/1604871436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6978005190 0x7f698c1508c0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 >> 172.21.15.143:0/1604871436 conn(0x7f698c0b0bf0 msgr2=0x7f698c0b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 shutdown_connections 2023-11-24T06:32:23.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.293+0000 7f6994335640 1 -- 172.21.15.143:0/1604871436 wait complete. 2023-11-24T06:32:23.320 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:32:23.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.453+0000 7fc20992a640 1 Processor -- start 2023-11-24T06:32:23.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.453+0000 7fc20992a640 1 -- start start 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc20992a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc20406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc20992a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20415a050 con 0x7fc2040ccef0 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc20992a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040722e0 con 0x7fc2040b1f80 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc20992a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc204072860 con 0x7fc2040ce2e0 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc202ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc2040ccef0 0x7fc20406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36484/0 (socket says 172.21.15.143:36484) 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc202ffd640 1 -- 172.21.15.143:0/43293459 learned_addr learned my addr 172.21.15.143:0/43293459 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc1fbfff640 1 --2- 172.21.15.143:0/43293459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc20406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360965870 0 0) 0x7fc20415a050 con 0x7fc2040ccef0 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f0003530 con 0x7fc2040ccef0 2023-11-24T06:32:23.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351773984 0 0) 0x7fc2040722e0 con 0x7fc2040b1f80 2023-11-24T06:32:23.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc20415a050 con 0x7fc2040b1f80 2023-11-24T06:32:23.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc1fbfff640 1 -- 172.21.15.143:0/43293459 >> v1:172.21.15.146:6789/0 conn(0x7fc2040b1f80 legacy=0x7fc204163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc1fbfff640 1 -- 172.21.15.143:0/43293459 >> v1:172.21.15.143:6789/0 conn(0x7fc2040ccef0 legacy=0x7fc20406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.457+0000 7fc1fbfff640 1 -- 172.21.15.143:0/43293459 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040705e0 con 0x7fc2040ce2e0 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc1fbfff640 1 --2- 172.21.15.143:0/43293459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc20406da40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097f0 tx=0x7fc1ec01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de72163e2e5fde3b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0ab610 con 0x7fc2040ce2e0 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0ab770 con 0x7fc2040ce2e0 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc2027fc640 1 -- 172.21.15.143:0/43293459 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0abb00 con 0x7fc2040ce2e0 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 -- 172.21.15.143:0/43293459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 msgr2=0x7fc20406da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 --2- 172.21.15.143:0/43293459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc20406da40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097f0 tx=0x7fc1ec01c490 comp rx=0 tx=0).stop 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 -- 172.21.15.143:0/43293459 shutdown_connections 2023-11-24T06:32:23.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 --2- 172.21.15.143:0/43293459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc20406da40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 -- 172.21.15.143:0/43293459 >> 172.21.15.143:0/43293459 conn(0x7fc2040b0c80 msgr2=0x7fc2040b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:23.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 -- 172.21.15.143:0/43293459 shutdown_connections 2023-11-24T06:32:23.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 -- 172.21.15.143:0/43293459 wait complete. 2023-11-24T06:32:23.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 Processor -- start 2023-11-24T06:32:23.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 -- start start 2023-11-24T06:32:23.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.461+0000 7fc20992a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040b1f80 0x7fc2040add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 0x7fc204152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc2040c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20409b720 con 0x7fc2040ccef0 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20409aaf0 con 0x7fc2040b1f80 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc204153810 con 0x7fc2040ce2e0 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 0x7fc204152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 0x7fc204152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38358/0 (socket says 172.21.15.143:38358) 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 -- 172.21.15.143:0/1039194271 learned_addr learned my addr 172.21.15.143:0/1039194271 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc202ffd640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040b1f80 0x7fc2040add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc2037fe640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc2040c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 -- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 msgr2=0x7fc2040c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc2040c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 -- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040b1f80 msgr2=0x7fc2040add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040b1f80 0x7fc2040add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:23.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 -- 172.21.15.143:0/1039194271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009420 con 0x7fc2040ccef0 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc202ffd640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040b1f80 0x7fc2040add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc2037fe640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc2040c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc1fbfff640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 0x7fc204152720 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0190a0 tx=0x7fc1ec019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0abdb0 con 0x7fc2040ccef0 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0bf450 con 0x7fc2040ccef0 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0bf800 con 0x7fc2040ccef0 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20409ad80 con 0x7fc2040ccef0 2023-11-24T06:32:23.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20409b340 con 0x7fc2040ccef0 2023-11-24T06:32:23.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20409b860 con 0x7fc2040ccef0 2023-11-24T06:32:23.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.465+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fc1ec0bf960 con 0x7fc2040ccef0 2023-11-24T06:32:23.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.469+0000 7fc200ff9640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc1e4066860 0x7fc1e4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:23.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.469+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc1ec11f060 con 0x7fc2040ccef0 2023-11-24T06:32:23.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.469+0000 7fc202ffd640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc1e4066860 0x7fc1e4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:23.474 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.469+0000 7fc202ffd640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc1e4066860 0x7fc1e4068d20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4000f70 tx=0x7fc1f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:23.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.473+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc20409b860 con 0x7fc2040ccef0 2023-11-24T06:32:23.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:23.657+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc20409b860 con 0x7fc2040ccef0 2023-11-24T06:32:24.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.617+0000 7fc200ff9640 1 -- 172.21.15.143:0/1039194271 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc20409b860 con 0x7fc2040ccef0 2023-11-24T06:32:24.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc1e4066860 msgr2=0x7fc1e4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:24.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc1e4066860 0x7fc1e4068d20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4000f70 tx=0x7fc1f4009040 comp rx=0 tx=0).stop 2023-11-24T06:32:24.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 msgr2=0x7fc204152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:24.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 0x7fc204152720 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0190a0 tx=0x7fc1ec019230 comp rx=0 tx=0).stop 2023-11-24T06:32:24.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 shutdown_connections 2023-11-24T06:32:24.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc1e4066860 0x7fc1e4068d20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2040ce2e0 0x7fc2040c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2040ccef0 0x7fc204152720 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 --2- 172.21.15.143:0/1039194271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040b1f80 0x7fc2040add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 >> 172.21.15.143:0/1039194271 conn(0x7fc2040b0c80 msgr2=0x7fc2040b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:24.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 shutdown_connections 2023-11-24T06:32:24.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.621+0000 7fc20992a640 1 -- 172.21.15.143:0/1039194271 wait complete. 2023-11-24T06:32:24.650 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:32:24.650 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:32:24.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 Processor -- start 2023-11-24T06:32:24.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 -- start start 2023-11-24T06:32:24.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815ec60 0x7f0ce80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:24.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ce80cc6b0 0x7f0ce80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:24.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce8070f00 con 0x7f0ce815a290 2023-11-24T06:32:24.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8071170 con 0x7f0ce80cc6b0 2023-11-24T06:32:24.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ced66b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80cb690 con 0x7f0ce815ec60 2023-11-24T06:32:24.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ce6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0ce815a290 0x7f0ce80707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36500/0 (socket says 172.21.15.143:36500) 2023-11-24T06:32:24.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.789+0000 7f0ce6ffd640 1 -- 172.21.15.143:0/2710626278 learned_addr learned my addr 172.21.15.143:0/2710626278 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:24.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce77fe640 1 --2- 172.21.15.143:0/2710626278 >> v2:172.21.15.146:3300/0 conn(0x7f0ce80cc6b0 0x7f0ce80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:24.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0cde7fc640 1 --2- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815ec60 0x7f0ce80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:24.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce67fc640 1 -- 172.21.15.143:0/2710626278 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821336266 0 0) 0x7f0ce8070f00 con 0x7f0ce815a290 2023-11-24T06:32:24.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce67fc640 1 -- 172.21.15.143:0/2710626278 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd4003530 con 0x7f0ce815a290 2023-11-24T06:32:24.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce77fe640 1 -- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815ec60 msgr2=0x7f0ce80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:24.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce77fe640 1 --2- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815ec60 0x7f0ce80cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce77fe640 1 -- 172.21.15.143:0/2710626278 >> v1:172.21.15.143:6789/0 conn(0x7f0ce815a290 legacy=0x7f0ce80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:24.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce77fe640 1 -- 172.21.15.143:0/2710626278 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80cb970 con 0x7f0ce80cc6b0 2023-11-24T06:32:24.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.793+0000 7f0ce77fe640 1 --2- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce80b1f80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009d90 tx=0x7f0ce001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea483ec6b107889 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:24.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ce67fc640 1 -- 172.21.15.143:0/2710626278 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a5860 con 0x7f0ce80cc6b0 2023-11-24T06:32:24.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ce67fc640 1 -- 172.21.15.143:0/2710626278 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00a59c0 con 0x7f0ce80cc6b0 2023-11-24T06:32:24.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ce67fc640 1 -- 172.21.15.143:0/2710626278 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a5d50 con 0x7f0ce80cc6b0 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 msgr2=0x7f0ce80b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 --2- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce80b1f80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009d90 tx=0x7f0ce001c890 comp rx=0 tx=0).stop 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- 172.21.15.143:0/2710626278 shutdown_connections 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 --2- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce80b1f80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 --2- 172.21.15.143:0/2710626278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815ec60 0x7f0ce80cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- 172.21.15.143:0/2710626278 >> 172.21.15.143:0/2710626278 conn(0x7f0ce80b0c80 msgr2=0x7f0ce80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:24.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- 172.21.15.143:0/2710626278 shutdown_connections 2023-11-24T06:32:24.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- 172.21.15.143:0/2710626278 wait complete. 2023-11-24T06:32:24.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 Processor -- start 2023-11-24T06:32:24.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- start start 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce81634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815a290 0x7f0ce81642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 0x7f0ce80af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80acbc0 con 0x7f0ce815ec60 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80ac320 con 0x7f0ce80cc6b0 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.797+0000 7f0ced66b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80ac600 con 0x7f0ce815a290 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 0x7f0ce80af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 0x7f0ce80af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38362/0 (socket says 172.21.15.143:38362) 2023-11-24T06:32:24.805 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 -- 172.21.15.143:0/3350158669 learned_addr learned my addr 172.21.15.143:0/3350158669 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:24.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce6ffd640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce81634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:24.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0cde7fc640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815a290 0x7f0ce81642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 -- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815a290 msgr2=0x7f0ce81642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815a290 0x7f0ce81642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 -- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 msgr2=0x7f0ce81634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce81634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 -- 172.21.15.143:0/3350158669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009a70 con 0x7f0ce815ec60 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ce77fe640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 0x7f0ce80af860 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b0040 tx=0x7f0ce0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:24.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b9650 con 0x7f0ce815ec60 2023-11-24T06:32:24.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00b97b0 con 0x7f0ce815ec60 2023-11-24T06:32:24.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce80ac8e0 con 0x7f0ce815ec60 2023-11-24T06:32:24.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b9b40 con 0x7f0ce815ec60 2023-11-24T06:32:24.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8164810 con 0x7f0ce815ec60 2023-11-24T06:32:24.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce804e8c0 con 0x7f0ce815ec60 2023-11-24T06:32:24.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f0ce00b9ca0 con 0x7f0ce815ec60 2023-11-24T06:32:24.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.801+0000 7f0cdffff640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0cc8066890 0x7f0cc8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:24.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.805+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0ce011f460 con 0x7f0ce815ec60 2023-11-24T06:32:24.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.805+0000 7f0ce6ffd640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0cc8066890 0x7f0cc8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:24.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.805+0000 7f0ce6ffd640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0cc8066890 0x7f0cc8068d50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80011f0 tx=0x7f0cd8007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:24.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.805+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ce00ec480 con 0x7f0ce815ec60 2023-11-24T06:32:24.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:24.989+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ce814b540 con 0x7f0ce815ec60 2023-11-24T06:32:25.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.625+0000 7f0cdffff640 1 -- 172.21.15.143:0/3350158669 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ce00efaa0 con 0x7f0ce815ec60 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0cc8066890 msgr2=0x7f0cc8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0cc8066890 0x7f0cc8068d50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80011f0 tx=0x7f0cd8007d40 comp rx=0 tx=0).stop 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 msgr2=0x7f0ce80af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 0x7f0ce80af860 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b0040 tx=0x7f0ce0019630 comp rx=0 tx=0).stop 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 shutdown_connections 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0cc8066890 0x7f0cc8068d50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ce815ec60 0x7f0ce80af860 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce815a290 0x7f0ce81642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.635 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 --2- 172.21.15.143:0/3350158669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce80cc6b0 0x7f0ce81634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 >> 172.21.15.143:0/3350158669 conn(0x7f0ce80b0c80 msgr2=0x7f0ce80ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:25.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 shutdown_connections 2023-11-24T06:32:25.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.629+0000 7f0ced66b640 1 -- 172.21.15.143:0/3350158669 wait complete. 2023-11-24T06:32:25.656 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:32:25.656 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.789+0000 7f6a4e617640 1 Processor -- start 2023-11-24T06:32:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.789+0000 7f6a4e617640 1 -- start start 2023-11-24T06:32:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4e617640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 0x7f6a48165360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4e617640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a480b0a80 0x7f6a480b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4e617640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a480ae8a0 con 0x7f6a4814b2b0 2023-11-24T06:32:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4e617640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480b1410 con 0x7f6a480b0a80 2023-11-24T06:32:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4e617640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481662e0 con 0x7f6a4806c660 2023-11-24T06:32:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4d615640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6a4814b2b0 0x7f6a480b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36506/0 (socket says 172.21.15.143:36506) 2023-11-24T06:32:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4d615640 1 -- 172.21.15.143:0/4088310463 learned_addr learned my addr 172.21.15.143:0/4088310463 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:25.799 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4de16640 1 --2- 172.21.15.143:0/4088310463 >> v2:172.21.15.146:3300/0 conn(0x7f6a480b0a80 0x7f6a480b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 0x7f6a48165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332391569 0 0) 0x7f6a480ae8a0 con 0x7f6a4814b2b0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a34003530 con 0x7f6a4814b2b0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685637075 0 0) 0x7f6a34003530 con 0x7f6a4814b2b0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 msgr2=0x7f6a48165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 0x7f6a48165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 >> v2:172.21.15.146:3300/0 conn(0x7f6a480b0a80 msgr2=0x7f6a480b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 --2- 172.21.15.143:0/4088310463 >> v2:172.21.15.146:3300/0 conn(0x7f6a480b0a80 0x7f6a480b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480b2500 con 0x7f6a4814b2b0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f6a44001680 con 0x7f6a4814b2b0 2023-11-24T06:32:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 >> v1:172.21.15.143:6789/0 conn(0x7f6a4814b2b0 legacy=0x7f6a480b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a34003980 0x7f6a34003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a34004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 0x7f6a34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480b1410 con 0x7f6a340047d0 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481662e0 con 0x7f6a34003980 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3400b9c0 con 0x7f6a4806c660 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a34004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4d615640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a34003980 0x7f6a34003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4de16640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 0x7f6a34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 -- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 msgr2=0x7f6a34005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a4806c660 0x7f6a34005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 -- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a34003980 msgr2=0x7f6a34003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a34003980 0x7f6a34003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4ce14640 1 -- 172.21.15.143:0/4088310463 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34003530 con 0x7f6a340047d0 2023-11-24T06:32:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.793+0000 7f6a4d615640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a34003980 0x7f6a34003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a34004c50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ae0 tx=0x7f6a3801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353a13551aaecf77 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380a5510 con 0x7f6a340047d0 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a380a5670 con 0x7f6a340047d0 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a3ffff640 1 -- 172.21.15.143:0/4088310463 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380a5a20 con 0x7f6a340047d0 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 -- 172.21.15.143:0/4088310463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 msgr2=0x7f6a34004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 --2- 172.21.15.143:0/4088310463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a34004c50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ae0 tx=0x7f6a3801c9c0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4de16640 1 -- 172.21.15.143:0/4088310463 reap_dead start 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 -- 172.21.15.143:0/4088310463 shutdown_connections 2023-11-24T06:32:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 -- 172.21.15.143:0/4088310463 >> 172.21.15.143:0/4088310463 conn(0x7f6a480cb840 msgr2=0x7f6a480cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:25.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 -- 172.21.15.143:0/4088310463 shutdown_connections 2023-11-24T06:32:25.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 -- 172.21.15.143:0/4088310463 wait complete. 2023-11-24T06:32:25.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 Processor -- start 2023-11-24T06:32:25.804 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.797+0000 7f6a4e617640 1 -- start start 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a48162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a48146d00 0x7f6a48147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a48147e50 0x7f6a481faa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48163c20 con 0x7f6a340047d0 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480a98a0 con 0x7f6a48147e50 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481482e0 con 0x7f6a48146d00 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a48162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a48162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38374/0 (socket says 172.21.15.143:38374) 2023-11-24T06:32:25.806 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 -- 172.21.15.143:0/632134663 learned_addr learned my addr 172.21.15.143:0/632134663 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:25.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 -- 172.21.15.143:0/632134663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a48146d00 msgr2=0x7f6a48147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a48146d00 0x7f6a48147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 -- 172.21.15.143:0/632134663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a48147e50 msgr2=0x7f6a481faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a48147e50 0x7f6a481faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 -- 172.21.15.143:0/632134663 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48162fa0 con 0x7f6a340047d0 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4d615640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a48162910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400e820 tx=0x7f6a4400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400c850 con 0x7f6a340047d0 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400c9b0 con 0x7f6a340047d0 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400cd20 con 0x7f6a340047d0 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a48163280 con 0x7f6a340047d0 2023-11-24T06:32:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a48163840 con 0x7f6a340047d0 2023-11-24T06:32:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.801+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a48163d60 con 0x7f6a340047d0 2023-11-24T06:32:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.805+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f6a4401d460 con 0x7f6a340047d0 2023-11-24T06:32:25.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.805+0000 7f6a3dffb640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a2c066860 0x7f6a2c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:25.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.805+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6a44084570 con 0x7f6a340047d0 2023-11-24T06:32:25.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.805+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a2c066860 0x7f6a2c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:25.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.805+0000 7f6a4ce14640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a2c066860 0x7f6a2c068d20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6a380af000 tx=0x7f6a38004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:25.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.809+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a48163d60 con 0x7f6a340047d0 2023-11-24T06:32:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a48163d60 con 0x7f6a340047d0 2023-11-24T06:32:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a3dffb640 1 -- 172.21.15.143:0/632134663 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f6a48163d60 con 0x7f6a340047d0 2023-11-24T06:32:25.994 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:25.995 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:32:21.961215+0000","modified":"2023-11-24T06:32:24.993795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6567":{"gid":6567,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/492061256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":492061256},{"type":"v1","addr":"172.21.15.143:6837","nonce":492061256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:32:25.995 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 44 2023-11-24T06:32:25.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a2c066860 msgr2=0x7f6a2c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a2c066860 0x7f6a2c068d20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6a380af000 tx=0x7f6a38004740 comp rx=0 tx=0).stop 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 msgr2=0x7f6a48162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a48162910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400e820 tx=0x7f6a4400ece0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 shutdown_connections 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6a2c066860 0x7f6a2c068d20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a48147e50 0x7f6a481faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a48146d00 0x7f6a48147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 --2- 172.21.15.143:0/632134663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a340047d0 0x7f6a48162910 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 >> 172.21.15.143:0/632134663 conn(0x7f6a480cb840 msgr2=0x7f6a4816bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 shutdown_connections 2023-11-24T06:32:25.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:25.989+0000 7f6a4e617640 1 -- 172.21.15.143:0/632134663 wait complete. 2023-11-24T06:32:26.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:26.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.145+0000 7f5573c68640 1 Processor -- start 2023-11-24T06:32:26.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5573c68640 1 -- start start 2023-11-24T06:32:26.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5573c68640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f556c06e340 0x7f556c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5573c68640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c06dc20 con 0x7f556c158a50 2023-11-24T06:32:26.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5573c68640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c06cd60 con 0x7f556c070cf0 2023-11-24T06:32:26.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5573c68640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c06e0b0 con 0x7f556c06e340 2023-11-24T06:32:26.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5571a04640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f556c158a50 0x7f556c06c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36512/0 (socket says 172.21.15.143:36512) 2023-11-24T06:32:26.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5571a04640 1 -- 172.21.15.143:0/35827743 learned_addr learned my addr 172.21.15.143:0/35827743 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:26.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5571203640 1 --2- 172.21.15.143:0/35827743 >> v2:172.21.15.143:3300/0 conn(0x7f556c06e340 0x7f556c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5570a02640 1 -- 172.21.15.143:0/35827743 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624134606 0 0) 0x7f556c06dc20 con 0x7f556c158a50 2023-11-24T06:32:26.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5571203640 1 -- 172.21.15.143:0/35827743 >> v1:172.21.15.146:6789/0 conn(0x7f556c070cf0 legacy=0x7f556c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5571203640 1 -- 172.21.15.143:0/35827743 >> v1:172.21.15.143:6789/0 conn(0x7f556c158a50 legacy=0x7f556c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.149+0000 7f5571203640 1 -- 172.21.15.143:0/35827743 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c071100 con 0x7f556c06e340 2023-11-24T06:32:26.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5571203640 1 --2- 172.21.15.143:0/35827743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c06e340 0x7f556c0707b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f555c0097c0 tx=0x7f555c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af8f67ef21afd80 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5570a02640 1 -- 172.21.15.143:0/35827743 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0ab680 con 0x7f556c06e340 2023-11-24T06:32:26.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5570a02640 1 -- 172.21.15.143:0/35827743 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c0ab7e0 con 0x7f556c06e340 2023-11-24T06:32:26.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5570a02640 1 -- 172.21.15.143:0/35827743 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0abb70 con 0x7f556c06e340 2023-11-24T06:32:26.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 -- 172.21.15.143:0/35827743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c06e340 msgr2=0x7f556c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 --2- 172.21.15.143:0/35827743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c06e340 0x7f556c0707b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f555c0097c0 tx=0x7f555c01c480 comp rx=0 tx=0).stop 2023-11-24T06:32:26.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 -- 172.21.15.143:0/35827743 shutdown_connections 2023-11-24T06:32:26.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 --2- 172.21.15.143:0/35827743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c06e340 0x7f556c0707b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 -- 172.21.15.143:0/35827743 >> 172.21.15.143:0/35827743 conn(0x7f556c0b0bf0 msgr2=0x7f556c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:26.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 -- 172.21.15.143:0/35827743 shutdown_connections 2023-11-24T06:32:26.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.153+0000 7f5573c68640 1 -- 172.21.15.143:0/35827743 wait complete. 2023-11-24T06:32:26.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 Processor -- start 2023-11-24T06:32:26.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- start start 2023-11-24T06:32:26.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c06e340 0x7f556c09c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 0x7f556c16ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c158a50 0x7f556c0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c1605e0 con 0x7f556c070cf0 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c15fdd0 con 0x7f556c158a50 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c15db80 con 0x7f556c06e340 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 0x7f556c16ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 0x7f556c16ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38380/0 (socket says 172.21.15.143:38380) 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 -- 172.21.15.143:0/3253457561 learned_addr learned my addr 172.21.15.143:0/3253457561 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571a04640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c06e340 0x7f556c09c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5572205640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c158a50 0x7f556c0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 -- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c06e340 msgr2=0x7f556c09c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c06e340 0x7f556c09c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 -- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c158a50 msgr2=0x7f556c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c158a50 0x7f556c0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 -- 172.21.15.143:0/3253457561 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c009420 con 0x7f556c070cf0 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5572205640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c158a50 0x7f556c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571a04640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c06e340 0x7f556c09c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5571203640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 0x7f556c16ce90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f555c0ad040 tx=0x7f555c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0aaa30 con 0x7f556c070cf0 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c0aabb0 con 0x7f556c070cf0 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556c160020 con 0x7f556c070cf0 2023-11-24T06:32:26.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0bf410 con 0x7f556c070cf0 2023-11-24T06:32:26.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c16d3d0 con 0x7f556c070cf0 2023-11-24T06:32:26.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.157+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c067520 con 0x7f556c070cf0 2023-11-24T06:32:26.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.161+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f555c0b5400 con 0x7f556c070cf0 2023-11-24T06:32:26.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.161+0000 7f55627fc640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066860 0x7f5550068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.161+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f555c11f940 con 0x7f556c070cf0 2023-11-24T06:32:26.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.161+0000 7f5571a04640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066860 0x7f5550068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.161+0000 7f5571a04640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066860 0x7f5550068d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5568007fd0 tx=0x7f5568007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.165+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f555c0ec700 con 0x7f556c070cf0 2023-11-24T06:32:26.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.317+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f556c0b33e0 con 0x7f556c070cf0 2023-11-24T06:32:26.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f55627fc640 1 -- 172.21.15.143:0/3253457561 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16659 (secure 0 0 0) 0x7f556c0b33e0 con 0x7f556c070cf0 2023-11-24T06:32:26.326 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:26.326 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":72,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:23.588756+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066860 msgr2=0x7f5550068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066860 0x7f5550068d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5568007fd0 tx=0x7f5568007c80 comp rx=0 tx=0).stop 2023-11-24T06:32:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 msgr2=0x7f556c16ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 0x7f556c16ce90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f555c0ad040 tx=0x7f555c01acc0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 shutdown_connections 2023-11-24T06:32:26.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5550066860 0x7f5550068d20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c158a50 0x7f556c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f556c070cf0 0x7f556c16ce90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 --2- 172.21.15.143:0/3253457561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c06e340 0x7f556c09c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 >> 172.21.15.143:0/3253457561 conn(0x7f556c0b0bf0 msgr2=0x7f556c0ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:26.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 shutdown_connections 2023-11-24T06:32:26.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.321+0000 7f5573c68640 1 -- 172.21.15.143:0/3253457561 wait complete. 2023-11-24T06:32:26.347 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:32:26.347 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:32:26.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.477+0000 7f6e795c1640 1 Processor -- start 2023-11-24T06:32:26.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.477+0000 7f6e795c1640 1 -- start start 2023-11-24T06:32:26.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e795c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e7415d460 0x7f6e740cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e795c1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e7406d340 0x7f6e740cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.487 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e795c1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e74070f60 con 0x7f6e7406f3a0 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e795c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e74070070 con 0x7f6e7415d460 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e795c1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e74070350 con 0x7f6e7406d340 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e72ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e7415d460 0x7f6e740cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e737fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6e7406f3a0 0x7f6e7406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36518/0 (socket says 172.21.15.143:36518) 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e737fe640 1 -- 172.21.15.143:0/1334164355 learned_addr learned my addr 172.21.15.143:0/1334164355 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e6a7fc640 1 --2- 172.21.15.143:0/1334164355 >> v2:172.21.15.146:3300/0 conn(0x7f6e7406d340 0x7f6e740cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e72ffd640 1 -- 172.21.15.143:0/1334164355 >> v2:172.21.15.146:3300/0 conn(0x7f6e7406d340 msgr2=0x7f6e740cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e72ffd640 1 --2- 172.21.15.143:0/1334164355 >> v2:172.21.15.146:3300/0 conn(0x7f6e7406d340 0x7f6e740cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e72ffd640 1 -- 172.21.15.143:0/1334164355 >> v1:172.21.15.143:6789/0 conn(0x7f6e7406f3a0 legacy=0x7f6e7406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e72ffd640 1 -- 172.21.15.143:0/1334164355 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74070630 con 0x7f6e7415d460 2023-11-24T06:32:26.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.481+0000 7f6e727fc640 1 -- 172.21.15.143:0/1334164355 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960845252 0 0) 0x7f6e74070f60 con 0x7f6e7406f3a0 2023-11-24T06:32:26.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e72ffd640 1 --2- 172.21.15.143:0/1334164355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e740cb920 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6e7406b480 tx=0x7f6e6401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc962a489b0f06dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e727fc640 1 -- 172.21.15.143:0/1334164355 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640a7070 con 0x7f6e7415d460 2023-11-24T06:32:26.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e727fc640 1 -- 172.21.15.143:0/1334164355 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e640ab430 con 0x7f6e7415d460 2023-11-24T06:32:26.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e727fc640 1 -- 172.21.15.143:0/1334164355 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640ab7c0 con 0x7f6e7415d460 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 -- 172.21.15.143:0/1334164355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 msgr2=0x7f6e740cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1334164355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e740cb920 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6e7406b480 tx=0x7f6e6401c430 comp rx=0 tx=0).stop 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 -- 172.21.15.143:0/1334164355 shutdown_connections 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1334164355 >> v2:172.21.15.146:3300/0 conn(0x7f6e7406d340 0x7f6e740cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1334164355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e740cb920 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 -- 172.21.15.143:0/1334164355 >> 172.21.15.143:0/1334164355 conn(0x7f6e7406e880 msgr2=0x7f6e7406ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 -- 172.21.15.143:0/1334164355 shutdown_connections 2023-11-24T06:32:26.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 -- 172.21.15.143:0/1334164355 wait complete. 2023-11-24T06:32:26.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 Processor -- start 2023-11-24T06:32:26.492 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.485+0000 7f6e795c1640 1 -- start start 2023-11-24T06:32:26.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e7406d340 0x7f6e7415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e7406f3a0 0x7f6e7415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e74157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740ca640 con 0x7f6e7415d460 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740ca920 con 0x7f6e7406d340 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740cac00 con 0x7f6e7406f3a0 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e74157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e74157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38396/0 (socket says 172.21.15.143:38396) 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 -- 172.21.15.143:0/1738802575 learned_addr learned my addr 172.21.15.143:0/1738802575 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e72ffd640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e7406d340 0x7f6e7415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e6a7fc640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e7406f3a0 0x7f6e7415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 -- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e7406f3a0 msgr2=0x7f6e7415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e7406f3a0 0x7f6e7415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 -- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e7406d340 msgr2=0x7f6e7415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e7406d340 0x7f6e7415b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 -- 172.21.15.143:0/1738802575 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e64009420 con 0x7f6e7415d460 2023-11-24T06:32:26.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e737fe640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e74157df0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c7a0 tx=0x7f6e6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00a640 con 0x7f6e7415d460 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00a7a0 con 0x7f6e7415d460 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00abd0 con 0x7f6e7415d460 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740caee0 con 0x7f6e7415d460 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e740ca220 con 0x7f6e7415d460 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.489+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e74067520 con 0x7f6e7415d460 2023-11-24T06:32:26.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.493+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f6e6c00ad30 con 0x7f6e7415d460 2023-11-24T06:32:26.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.493+0000 7f6e6bfff640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e54066860 0x7f6e54068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.493+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6e6c083a70 con 0x7f6e7415d460 2023-11-24T06:32:26.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.493+0000 7f6e72ffd640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e54066860 0x7f6e54068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.493+0000 7f6e72ffd640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e54066860 0x7f6e54068d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6e640af000 tx=0x7f6e640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.497+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e6c0509f0 con 0x7f6e7415d460 2023-11-24T06:32:26.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.645+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e740caa90 con 0x7f6e54066860 2023-11-24T06:32:26.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.653+0000 7f6e6bfff640 1 -- 172.21.15.143:0/1738802575 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288964 (secure 0 0 0) 0x7f6e740caa90 con 0x7f6e54066860 2023-11-24T06:32:26.661 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:26.663 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:32:26.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e54066860 msgr2=0x7f6e54068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e54066860 0x7f6e54068d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6e640af000 tx=0x7f6e640a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:26.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 msgr2=0x7f6e74157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e74157df0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c7a0 tx=0x7f6e6c00cc60 comp rx=0 tx=0).stop 2023-11-24T06:32:26.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 shutdown_connections 2023-11-24T06:32:26.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e54066860 0x7f6e54068d20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e7415d460 0x7f6e74157df0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e7406f3a0 0x7f6e7415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 --2- 172.21.15.143:0/1738802575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e7406d340 0x7f6e7415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 >> 172.21.15.143:0/1738802575 conn(0x7f6e7406e880 msgr2=0x7f6e7415c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:26.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 shutdown_connections 2023-11-24T06:32:26.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.657+0000 7f6e795c1640 1 -- 172.21.15.143:0/1738802575 wait complete. 2023-11-24T06:32:26.681 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-24T06:32:26.236911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253240,"kb_used_data":7912,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721480,"statfs":{"total":773094113280,"available":772834795520,"internally_reserved":0,"allocated":8101888,"data_stored":4083632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.663195"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.623616+0000","last_change":"2023-11-24T06:32:22.611639+0000","last_active":"2023-11-24T06:32:22.623616+0000","last_peered":"2023-11-24T06:32:22.623616+0000","last_clean":"2023-11-24T06:32:22.623616+0000","last_became_active":"2023-11-24T06:32:22.611346+0000","last_became_peered":"2023-11-24T06:32:22.611346+0000","last_unstale":"2023-11-24T06:32:22.623616+0000","last_undegraded":"2023-11-24T06:32:22.623616+0000","last_fullsized":"2023-11-24T06:32:22.623616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:02.288573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.632799+0000","last_change":"2023-11-24T06:32:22.625893+0000","last_active":"2023-11-24T06:32:22.632799+0000","last_peered":"2023-11-24T06:32:22.632799+0000","last_clean":"2023-11-24T06:32:22.632799+0000","last_became_active":"2023-11-24T06:32:22.625595+0000","last_became_peered":"2023-11-24T06:32:22.625595+0000","last_unstale":"2023-11-24T06:32:22.632799+0000","last_undegraded":"2023-11-24T06:32:22.632799+0000","last_fullsized":"2023-11-24T06:32:22.632799+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:33.102952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.616561+0000","last_change":"2023-11-24T06:32:22.610152+0000","last_active":"2023-11-24T06:32:22.616561+0000","last_peered":"2023-11-24T06:32:22.616561+0000","last_clean":"2023-11-24T06:32:22.616561+0000","last_became_active":"2023-11-24T06:32:22.608695+0000","last_became_peered":"2023-11-24T06:32:22.608695+0000","last_unstale":"2023-11-24T06:32:22.616561+0000","last_undegraded":"2023-11-24T06:32:22.616561+0000","last_fullsized":"2023-11-24T06:32:22.616561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:49.894536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619770+0000","last_change":"2023-11-24T06:32:22.609632+0000","last_active":"2023-11-24T06:32:22.619770+0000","last_peered":"2023-11-24T06:32:22.619770+0000","last_clean":"2023-11-24T06:32:22.619770+0000","last_became_active":"2023-11-24T06:32:22.609287+0000","last_became_peered":"2023-11-24T06:32:22.609287+0000","last_unstale":"2023-11-24T06:32:22.619770+0000","last_undegraded":"2023-11-24T06:32:22.619770+0000","last_fullsized":"2023-11-24T06:32:22.619770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:51.660286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627124+0000","last_change":"2023-11-24T06:32:22.612521+0000","last_active":"2023-11-24T06:32:22.627124+0000","last_peered":"2023-11-24T06:32:22.627124+0000","last_clean":"2023-11-24T06:32:22.627124+0000","last_became_active":"2023-11-24T06:32:22.612167+0000","last_became_peered":"2023-11-24T06:32:22.612167+0000","last_unstale":"2023-11-24T06:32:22.627124+0000","last_undegraded":"2023-11-24T06:32:22.627124+0000","last_fullsized":"2023-11-24T06:32:22.627124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:16.969827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.625434+0000","last_change":"2023-11-24T06:32:22.619305+0000","last_active":"2023-11-24T06:32:22.625434+0000","last_peered":"2023-11-24T06:32:22.625434+0000","last_clean":"2023-11-24T06:32:22.625434+0000","last_became_active":"2023-11-24T06:32:22.619053+0000","last_became_peered":"2023-11-24T06:32:22.619053+0000","last_unstale":"2023-11-24T06:32:22.625434+0000","last_undegraded":"2023-11-24T06:32:22.625434+0000","last_fullsized":"2023-11-24T06:32:22.625434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:21.847633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620532+0000","last_change":"2023-11-24T06:32:22.605448+0000","last_active":"2023-11-24T06:32:22.620532+0000","last_peered":"2023-11-24T06:32:22.620532+0000","last_clean":"2023-11-24T06:32:22.620532+0000","last_became_active":"2023-11-24T06:32:22.604884+0000","last_became_peered":"2023-11-24T06:32:22.604884+0000","last_unstale":"2023-11-24T06:32:22.620532+0000","last_undegraded":"2023-11-24T06:32:22.620532+0000","last_fullsized":"2023-11-24T06:32:22.620532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:43.815445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626456+0000","last_change":"2023-11-24T06:32:22.621986+0000","last_active":"2023-11-24T06:32:22.626456+0000","last_peered":"2023-11-24T06:32:22.626456+0000","last_clean":"2023-11-24T06:32:22.626456+0000","last_became_active":"2023-11-24T06:32:22.621429+0000","last_became_peered":"2023-11-24T06:32:22.621429+0000","last_unstale":"2023-11-24T06:32:22.626456+0000","last_undegraded":"2023-11-24T06:32:22.626456+0000","last_fullsized":"2023-11-24T06:32:22.626456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:35.158435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627823+0000","last_change":"2023-11-24T06:32:22.621897+0000","last_active":"2023-11-24T06:32:22.627823+0000","last_peered":"2023-11-24T06:32:22.627823+0000","last_clean":"2023-11-24T06:32:22.627823+0000","last_became_active":"2023-11-24T06:32:22.621189+0000","last_became_peered":"2023-11-24T06:32:22.621189+0000","last_unstale":"2023-11-24T06:32:22.627823+0000","last_undegraded":"2023-11-24T06:32:22.627823+0000","last_fullsized":"2023-11-24T06:32:22.627823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:01:24.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.609700+0000","last_change":"2023-11-24T06:32:22.606083+0000","last_active":"2023-11-24T06:32:22.609700+0000","last_peered":"2023-11-24T06:32:22.609700+0000","last_clean":"2023-11-24T06:32:22.609700+0000","last_became_active":"2023-11-24T06:32:22.605583+0000","last_became_peered":"2023-11-24T06:32:22.605583+0000","last_unstale":"2023-11-24T06:32:22.609700+0000","last_undegraded":"2023-11-24T06:32:22.609700+0000","last_fullsized":"2023-11-24T06:32:22.609700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:40.798204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627056+0000","last_change":"2023-11-24T06:32:22.621428+0000","last_active":"2023-11-24T06:32:22.627056+0000","last_peered":"2023-11-24T06:32:22.627056+0000","last_clean":"2023-11-24T06:32:22.627056+0000","last_became_active":"2023-11-24T06:32:22.621123+0000","last_became_peered":"2023-11-24T06:32:22.621123+0000","last_unstale":"2023-11-24T06:32:22.627056+0000","last_undegraded":"2023-11-24T06:32:22.627056+0000","last_fullsized":"2023-11-24T06:32:22.627056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:00.264144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.615536+0000","last_change":"2023-11-24T06:32:22.607266+0000","last_active":"2023-11-24T06:32:22.615536+0000","last_peered":"2023-11-24T06:32:22.615536+0000","last_clean":"2023-11-24T06:32:22.615536+0000","last_became_active":"2023-11-24T06:32:22.606728+0000","last_became_peered":"2023-11-24T06:32:22.606728+0000","last_unstale":"2023-11-24T06:32:22.615536+0000","last_undegraded":"2023-11-24T06:32:22.615536+0000","last_fullsized":"2023-11-24T06:32:22.615536+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:56.967895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620865+0000","last_change":"2023-11-24T06:32:22.617699+0000","last_active":"2023-11-24T06:32:22.620865+0000","last_peered":"2023-11-24T06:32:22.620865+0000","last_clean":"2023-11-24T06:32:22.620865+0000","last_became_active":"2023-11-24T06:32:22.617420+0000","last_became_peered":"2023-11-24T06:32:22.617420+0000","last_unstale":"2023-11-24T06:32:22.620865+0000","last_undegraded":"2023-11-24T06:32:22.620865+0000","last_fullsized":"2023-11-24T06:32:22.620865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:10.575952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627472+0000","last_change":"2023-11-24T06:32:22.616815+0000","last_active":"2023-11-24T06:32:22.627472+0000","last_peered":"2023-11-24T06:32:22.627472+0000","last_clean":"2023-11-24T06:32:22.627472+0000","last_became_active":"2023-11-24T06:32:22.616386+0000","last_became_peered":"2023-11-24T06:32:22.616386+0000","last_unstale":"2023-11-24T06:32:22.627472+0000","last_undegraded":"2023-11-24T06:32:22.627472+0000","last_fullsized":"2023-11-24T06:32:22.627472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:47.154708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.614493+0000","last_change":"2023-11-24T06:32:22.609471+0000","last_active":"2023-11-24T06:32:22.614493+0000","last_peered":"2023-11-24T06:32:22.614493+0000","last_clean":"2023-11-24T06:32:22.614493+0000","last_became_active":"2023-11-24T06:32:22.609071+0000","last_became_peered":"2023-11-24T06:32:22.609071+0000","last_unstale":"2023-11-24T06:32:22.614493+0000","last_undegraded":"2023-11-24T06:32:22.614493+0000","last_fullsized":"2023-11-24T06:32:22.614493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:06.013197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.625142+0000","last_change":"2023-11-24T06:32:22.618254+0000","last_active":"2023-11-24T06:32:22.625142+0000","last_peered":"2023-11-24T06:32:22.625142+0000","last_clean":"2023-11-24T06:32:22.625142+0000","last_became_active":"2023-11-24T06:32:22.617857+0000","last_became_peered":"2023-11-24T06:32:22.617857+0000","last_unstale":"2023-11-24T06:32:22.625142+0000","last_undegraded":"2023-11-24T06:32:22.625142+0000","last_fullsized":"2023-11-24T06:32:22.625142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:45.979497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627805+0000","last_change":"2023-11-24T06:32:22.621650+0000","last_active":"2023-11-24T06:32:22.627805+0000","last_peered":"2023-11-24T06:32:22.627805+0000","last_clean":"2023-11-24T06:32:22.627805+0000","last_became_active":"2023-11-24T06:32:22.620853+0000","last_became_peered":"2023-11-24T06:32:22.620853+0000","last_unstale":"2023-11-24T06:32:22.627805+0000","last_undegraded":"2023-11-24T06:32:22.627805+0000","last_fullsized":"2023-11-24T06:32:22.627805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:04.481878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.621684+0000","last_change":"2023-11-24T06:32:22.618938+0000","last_active":"2023-11-24T06:32:22.621684+0000","last_peered":"2023-11-24T06:32:22.621684+0000","last_clean":"2023-11-24T06:32:22.621684+0000","last_became_active":"2023-11-24T06:32:22.618628+0000","last_became_peered":"2023-11-24T06:32:22.618628+0000","last_unstale":"2023-11-24T06:32:22.621684+0000","last_undegraded":"2023-11-24T06:32:22.621684+0000","last_fullsized":"2023-11-24T06:32:22.621684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:45.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.621330+0000","last_change":"2023-11-24T06:32:22.615127+0000","last_active":"2023-11-24T06:32:22.621330+0000","last_peered":"2023-11-24T06:32:22.621330+0000","last_clean":"2023-11-24T06:32:22.621330+0000","last_became_active":"2023-11-24T06:32:22.614652+0000","last_became_peered":"2023-11-24T06:32:22.614652+0000","last_unstale":"2023-11-24T06:32:22.621330+0000","last_undegraded":"2023-11-24T06:32:22.621330+0000","last_fullsized":"2023-11-24T06:32:22.621330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:09.156739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.629360+0000","last_change":"2023-11-24T06:32:22.622608+0000","last_active":"2023-11-24T06:32:22.629360+0000","last_peered":"2023-11-24T06:32:22.629360+0000","last_clean":"2023-11-24T06:32:22.629360+0000","last_became_active":"2023-11-24T06:32:22.622226+0000","last_became_peered":"2023-11-24T06:32:22.622226+0000","last_unstale":"2023-11-24T06:32:22.629360+0000","last_undegraded":"2023-11-24T06:32:22.629360+0000","last_fullsized":"2023-11-24T06:32:22.629360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:58.159999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.612080+0000","last_change":"2023-11-24T06:32:22.606847+0000","last_active":"2023-11-24T06:32:22.612080+0000","last_peered":"2023-11-24T06:32:22.612080+0000","last_clean":"2023-11-24T06:32:22.612080+0000","last_became_active":"2023-11-24T06:32:22.606585+0000","last_became_peered":"2023-11-24T06:32:22.606585+0000","last_unstale":"2023-11-24T06:32:22.612080+0000","last_undegraded":"2023-11-24T06:32:22.612080+0000","last_fullsized":"2023-11-24T06:32:22.612080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:35.158435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.613695+0000","last_change":"2023-11-24T06:32:22.608162+0000","last_active":"2023-11-24T06:32:22.613695+0000","last_peered":"2023-11-24T06:32:22.613695+0000","last_clean":"2023-11-24T06:32:22.613695+0000","last_became_active":"2023-11-24T06:32:22.607829+0000","last_became_peered":"2023-11-24T06:32:22.607829+0000","last_unstale":"2023-11-24T06:32:22.613695+0000","last_undegraded":"2023-11-24T06:32:22.613695+0000","last_fullsized":"2023-11-24T06:32:22.613695+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:03.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624911+0000","last_change":"2023-11-24T06:32:22.613782+0000","last_active":"2023-11-24T06:32:22.624911+0000","last_peered":"2023-11-24T06:32:22.624911+0000","last_clean":"2023-11-24T06:32:22.624911+0000","last_became_active":"2023-11-24T06:32:22.613483+0000","last_became_peered":"2023-11-24T06:32:22.613483+0000","last_unstale":"2023-11-24T06:32:22.624911+0000","last_undegraded":"2023-11-24T06:32:22.624911+0000","last_fullsized":"2023-11-24T06:32:22.624911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:01:49.029026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.629736+0000","last_change":"2023-11-24T06:32:22.623764+0000","last_active":"2023-11-24T06:32:22.629736+0000","last_peered":"2023-11-24T06:32:22.629736+0000","last_clean":"2023-11-24T06:32:22.629736+0000","last_became_active":"2023-11-24T06:32:22.623429+0000","last_became_peered":"2023-11-24T06:32:22.623429+0000","last_unstale":"2023-11-24T06:32:22.629736+0000","last_undegraded":"2023-11-24T06:32:22.629736+0000","last_fullsized":"2023-11-24T06:32:22.629736+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:02:37.498806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624992+0000","last_change":"2023-11-24T06:32:22.616366+0000","last_active":"2023-11-24T06:32:22.624992+0000","last_peered":"2023-11-24T06:32:22.624992+0000","last_clean":"2023-11-24T06:32:22.624992+0000","last_became_active":"2023-11-24T06:32:22.611585+0000","last_became_peered":"2023-11-24T06:32:22.611585+0000","last_unstale":"2023-11-24T06:32:22.624992+0000","last_undegraded":"2023-11-24T06:32:22.624992+0000","last_fullsized":"2023-11-24T06:32:22.624992+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:40.383041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626608+0000","last_change":"2023-11-24T06:32:22.622503+0000","last_active":"2023-11-24T06:32:22.626608+0000","last_peered":"2023-11-24T06:32:22.626608+0000","last_clean":"2023-11-24T06:32:22.626608+0000","last_became_active":"2023-11-24T06:32:22.622217+0000","last_became_peered":"2023-11-24T06:32:22.622217+0000","last_unstale":"2023-11-24T06:32:22.626608+0000","last_undegraded":"2023-11-24T06:32:22.626608+0000","last_fullsized":"2023-11-24T06:32:22.626608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:59.608401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.616540+0000","last_change":"2023-11-24T06:32:22.608283+0000","last_active":"2023-11-24T06:32:22.616540+0000","last_peered":"2023-11-24T06:32:22.616540+0000","last_clean":"2023-11-24T06:32:22.616540+0000","last_became_active":"2023-11-24T06:32:22.607975+0000","last_became_peered":"2023-11-24T06:32:22.607975+0000","last_unstale":"2023-11-24T06:32:22.616540+0000","last_undegraded":"2023-11-24T06:32:22.616540+0000","last_fullsized":"2023-11-24T06:32:22.616540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:08.189198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.617082+0000","last_change":"2023-11-24T06:32:22.609181+0000","last_active":"2023-11-24T06:32:22.617082+0000","last_peered":"2023-11-24T06:32:22.617082+0000","last_clean":"2023-11-24T06:32:22.617082+0000","last_became_active":"2023-11-24T06:32:22.608864+0000","last_became_peered":"2023-11-24T06:32:22.608864+0000","last_unstale":"2023-11-24T06:32:22.617082+0000","last_undegraded":"2023-11-24T06:32:22.617082+0000","last_fullsized":"2023-11-24T06:32:22.617082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:43.815445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620189+0000","last_change":"2023-11-24T06:32:22.612786+0000","last_active":"2023-11-24T06:32:22.620189+0000","last_peered":"2023-11-24T06:32:22.620189+0000","last_clean":"2023-11-24T06:32:22.620189+0000","last_became_active":"2023-11-24T06:32:22.609514+0000","last_became_peered":"2023-11-24T06:32:22.609514+0000","last_unstale":"2023-11-24T06:32:22.620189+0000","last_undegraded":"2023-11-24T06:32:22.620189+0000","last_fullsized":"2023-11-24T06:32:22.620189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:43:05.194648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626561+0000","last_change":"2023-11-24T06:32:22.622460+0000","last_active":"2023-11-24T06:32:22.626561+0000","last_peered":"2023-11-24T06:32:22.626561+0000","last_clean":"2023-11-24T06:32:22.626561+0000","last_became_active":"2023-11-24T06:32:22.622111+0000","last_became_peered":"2023-11-24T06:32:22.622111+0000","last_unstale":"2023-11-24T06:32:22.626561+0000","last_undegraded":"2023-11-24T06:32:22.626561+0000","last_fullsized":"2023-11-24T06:32:22.626561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:02:37.498806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620554+0000","last_change":"2023-11-24T06:32:22.605944+0000","last_active":"2023-11-24T06:32:22.620554+0000","last_peered":"2023-11-24T06:32:22.620554+0000","last_clean":"2023-11-24T06:32:22.620554+0000","last_became_active":"2023-11-24T06:32:22.605399+0000","last_became_peered":"2023-11-24T06:32:22.605399+0000","last_unstale":"2023-11-24T06:32:22.620554+0000","last_undegraded":"2023-11-24T06:32:22.620554+0000","last_fullsized":"2023-11-24T06:32:22.620554+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:26.677870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624281+0000","last_change":"2023-11-24T06:32:22.617837+0000","last_active":"2023-11-24T06:32:22.624281+0000","last_peered":"2023-11-24T06:32:22.624281+0000","last_clean":"2023-11-24T06:32:22.624281+0000","last_became_active":"2023-11-24T06:32:22.617510+0000","last_became_peered":"2023-11-24T06:32:22.617510+0000","last_unstale":"2023-11-24T06:32:22.624281+0000","last_undegraded":"2023-11-24T06:32:22.624281+0000","last_fullsized":"2023-11-24T06:32:22.624281+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:40.798204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626861+0000","last_change":"2023-11-24T06:32:22.620370+0000","last_active":"2023-11-24T06:32:22.626861+0000","last_peered":"2023-11-24T06:32:22.626861+0000","last_clean":"2023-11-24T06:32:22.626861+0000","last_became_active":"2023-11-24T06:32:22.620001+0000","last_became_peered":"2023-11-24T06:32:22.620001+0000","last_unstale":"2023-11-24T06:32:22.626861+0000","last_undegraded":"2023-11-24T06:32:22.626861+0000","last_fullsized":"2023-11-24T06:32:22.626861+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:13.354639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639473+0000","last_change":"2023-11-24T06:32:21.601573+0000","last_active":"2023-11-24T06:32:22.639473+0000","last_peered":"2023-11-24T06:32:22.639473+0000","last_clean":"2023-11-24T06:32:22.639473+0000","last_became_active":"2023-11-24T06:32:21.601266+0000","last_became_peered":"2023-11-24T06:32:21.601266+0000","last_unstale":"2023-11-24T06:32:22.639473+0000","last_undegraded":"2023-11-24T06:32:22.639473+0000","last_fullsized":"2023-11-24T06:32:22.639473+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:43.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627783+0000","last_change":"2023-11-24T06:32:22.621465+0000","last_active":"2023-11-24T06:32:22.627783+0000","last_peered":"2023-11-24T06:32:22.627783+0000","last_clean":"2023-11-24T06:32:22.627783+0000","last_became_active":"2023-11-24T06:32:22.620506+0000","last_became_peered":"2023-11-24T06:32:22.620506+0000","last_unstale":"2023-11-24T06:32:22.627783+0000","last_undegraded":"2023-11-24T06:32:22.627783+0000","last_fullsized":"2023-11-24T06:32:22.627783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:28.016840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.635275+0000","last_change":"2023-11-24T06:32:21.593780+0000","last_active":"2023-11-24T06:32:22.635275+0000","last_peered":"2023-11-24T06:32:22.635275+0000","last_clean":"2023-11-24T06:32:22.635275+0000","last_became_active":"2023-11-24T06:32:21.593508+0000","last_became_peered":"2023-11-24T06:32:21.593508+0000","last_unstale":"2023-11-24T06:32:22.635275+0000","last_undegraded":"2023-11-24T06:32:22.635275+0000","last_fullsized":"2023-11-24T06:32:22.635275+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:06.071265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.617277+0000","last_change":"2023-11-24T06:32:22.611981+0000","last_active":"2023-11-24T06:32:22.617277+0000","last_peered":"2023-11-24T06:32:22.617277+0000","last_clean":"2023-11-24T06:32:22.617277+0000","last_became_active":"2023-11-24T06:32:22.610242+0000","last_became_peered":"2023-11-24T06:32:22.610242+0000","last_unstale":"2023-11-24T06:32:22.617277+0000","last_undegraded":"2023-11-24T06:32:22.617277+0000","last_fullsized":"2023-11-24T06:32:22.617277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:08.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639423+0000","last_change":"2023-11-24T06:32:21.604912+0000","last_active":"2023-11-24T06:32:22.639423+0000","last_peered":"2023-11-24T06:32:22.639423+0000","last_clean":"2023-11-24T06:32:22.639423+0000","last_became_active":"2023-11-24T06:32:21.604345+0000","last_became_peered":"2023-11-24T06:32:21.604345+0000","last_unstale":"2023-11-24T06:32:22.639423+0000","last_undegraded":"2023-11-24T06:32:22.639423+0000","last_fullsized":"2023-11-24T06:32:22.639423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:36.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.623909+0000","last_change":"2023-11-24T06:32:22.613429+0000","last_active":"2023-11-24T06:32:22.623909+0000","last_peered":"2023-11-24T06:32:22.623909+0000","last_clean":"2023-11-24T06:32:22.623909+0000","last_became_active":"2023-11-24T06:32:22.612208+0000","last_became_peered":"2023-11-24T06:32:22.612208+0000","last_unstale":"2023-11-24T06:32:22.623909+0000","last_undegraded":"2023-11-24T06:32:22.623909+0000","last_fullsized":"2023-11-24T06:32:22.623909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:40.500091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638032+0000","last_change":"2023-11-24T06:32:21.604075+0000","last_active":"2023-11-24T06:32:22.638032+0000","last_peered":"2023-11-24T06:32:22.638032+0000","last_clean":"2023-11-24T06:32:22.638032+0000","last_became_active":"2023-11-24T06:32:21.603742+0000","last_became_peered":"2023-11-24T06:32:21.603742+0000","last_unstale":"2023-11-24T06:32:22.638032+0000","last_undegraded":"2023-11-24T06:32:22.638032+0000","last_fullsized":"2023-11-24T06:32:22.638032+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:14.405021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626584+0000","last_change":"2023-11-24T06:32:22.622839+0000","last_active":"2023-11-24T06:32:22.626584+0000","last_peered":"2023-11-24T06:32:22.626584+0000","last_clean":"2023-11-24T06:32:22.626584+0000","last_became_active":"2023-11-24T06:32:22.622545+0000","last_became_peered":"2023-11-24T06:32:22.622545+0000","last_unstale":"2023-11-24T06:32:22.626584+0000","last_undegraded":"2023-11-24T06:32:22.626584+0000","last_fullsized":"2023-11-24T06:32:22.626584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:15:35.003585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638847+0000","last_change":"2023-11-24T06:32:21.595822+0000","last_active":"2023-11-24T06:32:22.638847+0000","last_peered":"2023-11-24T06:32:22.638847+0000","last_clean":"2023-11-24T06:32:22.638847+0000","last_became_active":"2023-11-24T06:32:21.595560+0000","last_became_peered":"2023-11-24T06:32:21.595560+0000","last_unstale":"2023-11-24T06:32:22.638847+0000","last_undegraded":"2023-11-24T06:32:22.638847+0000","last_fullsized":"2023-11-24T06:32:22.638847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:25.907609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.615978+0000","last_change":"2023-11-24T06:32:22.611965+0000","last_active":"2023-11-24T06:32:22.615978+0000","last_peered":"2023-11-24T06:32:22.615978+0000","last_clean":"2023-11-24T06:32:22.615978+0000","last_became_active":"2023-11-24T06:32:22.611690+0000","last_became_peered":"2023-11-24T06:32:22.611690+0000","last_unstale":"2023-11-24T06:32:22.615978+0000","last_undegraded":"2023-11-24T06:32:22.615978+0000","last_fullsized":"2023-11-24T06:32:22.615978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:48.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.635426+0000","last_change":"2023-11-24T06:32:21.613159+0000","last_active":"2023-11-24T06:32:22.635426+0000","last_peered":"2023-11-24T06:32:22.635426+0000","last_clean":"2023-11-24T06:32:22.635426+0000","last_became_active":"2023-11-24T06:32:21.612803+0000","last_became_peered":"2023-11-24T06:32:21.612803+0000","last_unstale":"2023-11-24T06:32:22.635426+0000","last_undegraded":"2023-11-24T06:32:22.635426+0000","last_fullsized":"2023-11-24T06:32:22.635426+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:39.987018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619112+0000","last_change":"2023-11-24T06:32:22.608470+0000","last_active":"2023-11-24T06:32:22.619112+0000","last_peered":"2023-11-24T06:32:22.619112+0000","last_clean":"2023-11-24T06:32:22.619112+0000","last_became_active":"2023-11-24T06:32:22.608169+0000","last_became_peered":"2023-11-24T06:32:22.608169+0000","last_unstale":"2023-11-24T06:32:22.619112+0000","last_undegraded":"2023-11-24T06:32:22.619112+0000","last_fullsized":"2023-11-24T06:32:22.619112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:03.015357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595509+0000","last_change":"2023-11-24T06:32:21.605864+0000","last_active":"2023-11-24T06:32:22.595509+0000","last_peered":"2023-11-24T06:32:22.595509+0000","last_clean":"2023-11-24T06:32:22.595509+0000","last_became_active":"2023-11-24T06:32:21.605410+0000","last_became_peered":"2023-11-24T06:32:21.605410+0000","last_unstale":"2023-11-24T06:32:22.595509+0000","last_undegraded":"2023-11-24T06:32:22.595509+0000","last_fullsized":"2023-11-24T06:32:22.595509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:32.096486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.612317+0000","last_change":"2023-11-24T06:32:22.608734+0000","last_active":"2023-11-24T06:32:22.612317+0000","last_peered":"2023-11-24T06:32:22.612317+0000","last_clean":"2023-11-24T06:32:22.612317+0000","last_became_active":"2023-11-24T06:32:22.608448+0000","last_became_peered":"2023-11-24T06:32:22.608448+0000","last_unstale":"2023-11-24T06:32:22.612317+0000","last_undegraded":"2023-11-24T06:32:22.612317+0000","last_fullsized":"2023-11-24T06:32:22.612317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:44.017949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595534+0000","last_change":"2023-11-24T06:32:21.599793+0000","last_active":"2023-11-24T06:32:22.595534+0000","last_peered":"2023-11-24T06:32:22.595534+0000","last_clean":"2023-11-24T06:32:22.595534+0000","last_became_active":"2023-11-24T06:32:21.599528+0000","last_became_peered":"2023-11-24T06:32:21.599528+0000","last_unstale":"2023-11-24T06:32:22.595534+0000","last_undegraded":"2023-11-24T06:32:22.595534+0000","last_fullsized":"2023-11-24T06:32:22.595534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:33:02.874801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624376+0000","last_change":"2023-11-24T06:32:22.613512+0000","last_active":"2023-11-24T06:32:22.624376+0000","last_peered":"2023-11-24T06:32:22.624376+0000","last_clean":"2023-11-24T06:32:22.624376+0000","last_became_active":"2023-11-24T06:32:22.613119+0000","last_became_peered":"2023-11-24T06:32:22.613119+0000","last_unstale":"2023-11-24T06:32:22.624376+0000","last_undegraded":"2023-11-24T06:32:22.624376+0000","last_fullsized":"2023-11-24T06:32:22.624376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:43.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.599130+0000","last_change":"2023-11-24T06:32:21.594630+0000","last_active":"2023-11-24T06:32:22.599130+0000","last_peered":"2023-11-24T06:32:22.599130+0000","last_clean":"2023-11-24T06:32:22.599130+0000","last_became_active":"2023-11-24T06:32:21.594332+0000","last_became_peered":"2023-11-24T06:32:21.594332+0000","last_unstale":"2023-11-24T06:32:22.599130+0000","last_undegraded":"2023-11-24T06:32:22.599130+0000","last_fullsized":"2023-11-24T06:32:22.599130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:33.324066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626137+0000","last_change":"2023-11-24T06:32:22.616575+0000","last_active":"2023-11-24T06:32:22.626137+0000","last_peered":"2023-11-24T06:32:22.626137+0000","last_clean":"2023-11-24T06:32:22.626137+0000","last_became_active":"2023-11-24T06:32:22.616266+0000","last_became_peered":"2023-11-24T06:32:22.616266+0000","last_unstale":"2023-11-24T06:32:22.626137+0000","last_undegraded":"2023-11-24T06:32:22.626137+0000","last_fullsized":"2023-11-24T06:32:22.626137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:41.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.606999+0000","last_change":"2023-11-24T06:32:21.609153+0000","last_active":"2023-11-24T06:32:22.606999+0000","last_peered":"2023-11-24T06:32:22.606999+0000","last_clean":"2023-11-24T06:32:22.606999+0000","last_became_active":"2023-11-24T06:32:21.608869+0000","last_became_peered":"2023-11-24T06:32:21.608869+0000","last_unstale":"2023-11-24T06:32:22.606999+0000","last_undegraded":"2023-11-24T06:32:22.606999+0000","last_fullsized":"2023-11-24T06:32:22.606999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:47.806699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.633354+0000","last_change":"2023-11-24T06:32:22.627512+0000","last_active":"2023-11-24T06:32:22.633354+0000","last_peered":"2023-11-24T06:32:22.633354+0000","last_clean":"2023-11-24T06:32:22.633354+0000","last_became_active":"2023-11-24T06:32:22.627143+0000","last_became_peered":"2023-11-24T06:32:22.627143+0000","last_unstale":"2023-11-24T06:32:22.633354+0000","last_undegraded":"2023-11-24T06:32:22.633354+0000","last_fullsized":"2023-11-24T06:32:22.633354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:59.923786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638182+0000","last_change":"2023-11-24T06:32:21.597547+0000","last_active":"2023-11-24T06:32:22.638182+0000","last_peered":"2023-11-24T06:32:22.638182+0000","last_clean":"2023-11-24T06:32:22.638182+0000","last_became_active":"2023-11-24T06:32:21.597201+0000","last_became_peered":"2023-11-24T06:32:21.597201+0000","last_unstale":"2023-11-24T06:32:22.638182+0000","last_undegraded":"2023-11-24T06:32:22.638182+0000","last_fullsized":"2023-11-24T06:32:22.638182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:47.893873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627068+0000","last_change":"2023-11-24T06:32:22.611556+0000","last_active":"2023-11-24T06:32:22.627068+0000","last_peered":"2023-11-24T06:32:22.627068+0000","last_clean":"2023-11-24T06:32:22.627068+0000","last_became_active":"2023-11-24T06:32:22.611203+0000","last_became_peered":"2023-11-24T06:32:22.611203+0000","last_unstale":"2023-11-24T06:32:22.627068+0000","last_undegraded":"2023-11-24T06:32:22.627068+0000","last_fullsized":"2023-11-24T06:32:22.627068+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:19.726542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.641304+0000","last_change":"2023-11-24T06:32:21.600703+0000","last_active":"2023-11-24T06:32:22.641304+0000","last_peered":"2023-11-24T06:32:22.641304+0000","last_clean":"2023-11-24T06:32:22.641304+0000","last_became_active":"2023-11-24T06:32:21.599490+0000","last_became_peered":"2023-11-24T06:32:21.599490+0000","last_unstale":"2023-11-24T06:32:22.641304+0000","last_undegraded":"2023-11-24T06:32:22.641304+0000","last_fullsized":"2023-11-24T06:32:22.641304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:20.841168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.623886+0000","last_change":"2023-11-24T06:32:22.612959+0000","last_active":"2023-11-24T06:32:22.623886+0000","last_peered":"2023-11-24T06:32:22.623886+0000","last_clean":"2023-11-24T06:32:22.623886+0000","last_became_active":"2023-11-24T06:32:22.612662+0000","last_became_peered":"2023-11-24T06:32:22.612662+0000","last_unstale":"2023-11-24T06:32:22.623886+0000","last_undegraded":"2023-11-24T06:32:22.623886+0000","last_fullsized":"2023-11-24T06:32:22.623886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:23:44.553173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.637305+0000","last_change":"2023-11-24T06:32:21.596710+0000","last_active":"2023-11-24T06:32:22.637305+0000","last_peered":"2023-11-24T06:32:22.637305+0000","last_clean":"2023-11-24T06:32:22.637305+0000","last_became_active":"2023-11-24T06:32:21.596416+0000","last_became_peered":"2023-11-24T06:32:21.596416+0000","last_unstale":"2023-11-24T06:32:22.637305+0000","last_undegraded":"2023-11-24T06:32:22.637305+0000","last_fullsized":"2023-11-24T06:32:22.637305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:21.827281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624041+0000","last_change":"2023-11-24T06:32:22.609593+0000","last_active":"2023-11-24T06:32:22.624041+0000","last_peered":"2023-11-24T06:32:22.624041+0000","last_clean":"2023-11-24T06:32:22.624041+0000","last_became_active":"2023-11-24T06:32:22.609293+0000","last_became_peered":"2023-11-24T06:32:22.609293+0000","last_unstale":"2023-11-24T06:32:22.624041+0000","last_undegraded":"2023-11-24T06:32:22.624041+0000","last_fullsized":"2023-11-24T06:32:22.624041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:24.940269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.601567+0000","last_change":"2023-11-24T06:32:21.607839+0000","last_active":"2023-11-24T06:32:22.601567+0000","last_peered":"2023-11-24T06:32:22.601567+0000","last_clean":"2023-11-24T06:32:22.601567+0000","last_became_active":"2023-11-24T06:32:21.607544+0000","last_became_peered":"2023-11-24T06:32:21.607544+0000","last_unstale":"2023-11-24T06:32:22.601567+0000","last_undegraded":"2023-11-24T06:32:22.601567+0000","last_fullsized":"2023-11-24T06:32:22.601567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:54.799075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.629462+0000","last_change":"2023-11-24T06:32:22.624055+0000","last_active":"2023-11-24T06:32:22.629462+0000","last_peered":"2023-11-24T06:32:22.629462+0000","last_clean":"2023-11-24T06:32:22.629462+0000","last_became_active":"2023-11-24T06:32:22.622631+0000","last_became_peered":"2023-11-24T06:32:22.622631+0000","last_unstale":"2023-11-24T06:32:22.629462+0000","last_undegraded":"2023-11-24T06:32:22.629462+0000","last_fullsized":"2023-11-24T06:32:22.629462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:41.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.596998+0000","last_change":"2023-11-24T06:32:21.595132+0000","last_active":"2023-11-24T06:32:22.596998+0000","last_peered":"2023-11-24T06:32:22.596998+0000","last_clean":"2023-11-24T06:32:22.596998+0000","last_became_active":"2023-11-24T06:32:21.594635+0000","last_became_peered":"2023-11-24T06:32:21.594635+0000","last_unstale":"2023-11-24T06:32:22.596998+0000","last_undegraded":"2023-11-24T06:32:22.596998+0000","last_fullsized":"2023-11-24T06:32:22.596998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:39.376576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627180+0000","last_change":"2023-11-24T06:32:22.614403+0000","last_active":"2023-11-24T06:32:22.627180+0000","last_peered":"2023-11-24T06:32:22.627180+0000","last_clean":"2023-11-24T06:32:22.627180+0000","last_became_active":"2023-11-24T06:32:22.614085+0000","last_became_peered":"2023-11-24T06:32:22.614085+0000","last_unstale":"2023-11-24T06:32:22.627180+0000","last_undegraded":"2023-11-24T06:32:22.627180+0000","last_fullsized":"2023-11-24T06:32:22.627180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:20.586619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.640117+0000","last_change":"2023-11-24T06:32:21.600979+0000","last_active":"2023-11-24T06:32:22.640117+0000","last_peered":"2023-11-24T06:32:22.640117+0000","last_clean":"2023-11-24T06:32:22.640117+0000","last_became_active":"2023-11-24T06:32:21.600688+0000","last_became_peered":"2023-11-24T06:32:21.600688+0000","last_unstale":"2023-11-24T06:32:22.640117+0000","last_undegraded":"2023-11-24T06:32:22.640117+0000","last_fullsized":"2023-11-24T06:32:22.640117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:25.671404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.609682+0000","last_change":"2023-11-24T06:32:22.605856+0000","last_active":"2023-11-24T06:32:22.609682+0000","last_peered":"2023-11-24T06:32:22.609682+0000","last_clean":"2023-11-24T06:32:22.609682+0000","last_became_active":"2023-11-24T06:32:22.605274+0000","last_became_peered":"2023-11-24T06:32:22.605274+0000","last_unstale":"2023-11-24T06:32:22.609682+0000","last_undegraded":"2023-11-24T06:32:22.609682+0000","last_fullsized":"2023-11-24T06:32:22.609682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:17.392040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639014+0000","last_change":"2023-11-24T06:32:21.607013+0000","last_active":"2023-11-24T06:32:22.639014+0000","last_peered":"2023-11-24T06:32:22.639014+0000","last_clean":"2023-11-24T06:32:22.639014+0000","last_became_active":"2023-11-24T06:32:21.606628+0000","last_became_peered":"2023-11-24T06:32:21.606628+0000","last_unstale":"2023-11-24T06:32:22.639014+0000","last_undegraded":"2023-11-24T06:32:22.639014+0000","last_fullsized":"2023-11-24T06:32:22.639014+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:56.645244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626692+0000","last_change":"2023-11-24T06:32:22.617330+0000","last_active":"2023-11-24T06:32:22.626692+0000","last_peered":"2023-11-24T06:32:22.626692+0000","last_clean":"2023-11-24T06:32:22.626692+0000","last_became_active":"2023-11-24T06:32:22.617030+0000","last_became_peered":"2023-11-24T06:32:22.617030+0000","last_unstale":"2023-11-24T06:32:22.626692+0000","last_undegraded":"2023-11-24T06:32:22.626692+0000","last_fullsized":"2023-11-24T06:32:22.626692+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:10.575952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639376+0000","last_change":"2023-11-24T06:32:21.608292+0000","last_active":"2023-11-24T06:32:22.639376+0000","last_peered":"2023-11-24T06:32:22.639376+0000","last_clean":"2023-11-24T06:32:22.639376+0000","last_became_active":"2023-11-24T06:32:21.607954+0000","last_became_peered":"2023-11-24T06:32:21.607954+0000","last_unstale":"2023-11-24T06:32:22.639376+0000","last_undegraded":"2023-11-24T06:32:22.639376+0000","last_fullsized":"2023-11-24T06:32:22.639376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:48:46.197556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.612500+0000","last_change":"2023-11-24T06:32:22.603166+0000","last_active":"2023-11-24T06:32:22.612500+0000","last_peered":"2023-11-24T06:32:22.612500+0000","last_clean":"2023-11-24T06:32:22.612500+0000","last_became_active":"2023-11-24T06:32:22.602632+0000","last_became_peered":"2023-11-24T06:32:22.602632+0000","last_unstale":"2023-11-24T06:32:22.612500+0000","last_undegraded":"2023-11-24T06:32:22.612500+0000","last_fullsized":"2023-11-24T06:32:22.612500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:39.924600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.635334+0000","last_change":"2023-11-24T06:32:21.604015+0000","last_active":"2023-11-24T06:32:22.635334+0000","last_peered":"2023-11-24T06:32:22.635334+0000","last_clean":"2023-11-24T06:32:22.635334+0000","last_became_active":"2023-11-24T06:32:21.603629+0000","last_became_peered":"2023-11-24T06:32:21.603629+0000","last_unstale":"2023-11-24T06:32:22.635334+0000","last_undegraded":"2023-11-24T06:32:22.635334+0000","last_fullsized":"2023-11-24T06:32:22.635334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:36.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619057+0000","last_change":"2023-11-24T06:32:22.606983+0000","last_active":"2023-11-24T06:32:22.619057+0000","last_peered":"2023-11-24T06:32:22.619057+0000","last_clean":"2023-11-24T06:32:22.619057+0000","last_became_active":"2023-11-24T06:32:22.605795+0000","last_became_peered":"2023-11-24T06:32:22.605795+0000","last_unstale":"2023-11-24T06:32:22.619057+0000","last_undegraded":"2023-11-24T06:32:22.619057+0000","last_fullsized":"2023-11-24T06:32:22.619057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:40:10.742205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.599647+0000","last_change":"2023-11-24T06:32:21.606994+0000","last_active":"2023-11-24T06:32:22.599647+0000","last_peered":"2023-11-24T06:32:22.599647+0000","last_clean":"2023-11-24T06:32:22.599647+0000","last_became_active":"2023-11-24T06:32:21.606604+0000","last_became_peered":"2023-11-24T06:32:21.606604+0000","last_unstale":"2023-11-24T06:32:22.599647+0000","last_undegraded":"2023-11-24T06:32:22.599647+0000","last_fullsized":"2023-11-24T06:32:22.599647+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:01:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620164+0000","last_change":"2023-11-24T06:32:22.607821+0000","last_active":"2023-11-24T06:32:22.620164+0000","last_peered":"2023-11-24T06:32:22.620164+0000","last_clean":"2023-11-24T06:32:22.620164+0000","last_became_active":"2023-11-24T06:32:22.607504+0000","last_became_peered":"2023-11-24T06:32:22.607504+0000","last_unstale":"2023-11-24T06:32:22.620164+0000","last_undegraded":"2023-11-24T06:32:22.620164+0000","last_fullsized":"2023-11-24T06:32:22.620164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:05.517929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.601778+0000","last_change":"2023-11-24T06:32:21.604959+0000","last_active":"2023-11-24T06:32:22.601778+0000","last_peered":"2023-11-24T06:32:22.601778+0000","last_clean":"2023-11-24T06:32:22.601778+0000","last_became_active":"2023-11-24T06:32:21.604032+0000","last_became_peered":"2023-11-24T06:32:21.604032+0000","last_unstale":"2023-11-24T06:32:22.601778+0000","last_undegraded":"2023-11-24T06:32:22.601778+0000","last_fullsized":"2023-11-24T06:32:22.601778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:44.973032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.625091+0000","last_change":"2023-11-24T06:32:22.618801+0000","last_active":"2023-11-24T06:32:22.625091+0000","last_peered":"2023-11-24T06:32:22.625091+0000","last_clean":"2023-11-24T06:32:22.625091+0000","last_became_active":"2023-11-24T06:32:22.617801+0000","last_became_peered":"2023-11-24T06:32:22.617801+0000","last_unstale":"2023-11-24T06:32:22.625091+0000","last_undegraded":"2023-11-24T06:32:22.625091+0000","last_fullsized":"2023-11-24T06:32:22.625091+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:02.976397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.597149+0000","last_change":"2023-11-24T06:32:21.594914+0000","last_active":"2023-11-24T06:32:22.597149+0000","last_peered":"2023-11-24T06:32:22.597149+0000","last_clean":"2023-11-24T06:32:22.597149+0000","last_became_active":"2023-11-24T06:32:21.594271+0000","last_became_peered":"2023-11-24T06:32:21.594271+0000","last_unstale":"2023-11-24T06:32:22.597149+0000","last_undegraded":"2023-11-24T06:32:22.597149+0000","last_fullsized":"2023-11-24T06:32:22.597149+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:33.324066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619183+0000","last_change":"2023-11-24T06:32:22.613161+0000","last_active":"2023-11-24T06:32:22.619183+0000","last_peered":"2023-11-24T06:32:22.619183+0000","last_clean":"2023-11-24T06:32:22.619183+0000","last_became_active":"2023-11-24T06:32:22.612854+0000","last_became_peered":"2023-11-24T06:32:22.612854+0000","last_unstale":"2023-11-24T06:32:22.619183+0000","last_undegraded":"2023-11-24T06:32:22.619183+0000","last_fullsized":"2023-11-24T06:32:22.619183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:21.444004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.603541+0000","last_change":"2023-11-24T06:32:21.593591+0000","last_active":"2023-11-24T06:32:22.603541+0000","last_peered":"2023-11-24T06:32:22.603541+0000","last_clean":"2023-11-24T06:32:22.603541+0000","last_became_active":"2023-11-24T06:32:21.593264+0000","last_became_peered":"2023-11-24T06:32:21.593264+0000","last_unstale":"2023-11-24T06:32:22.603541+0000","last_undegraded":"2023-11-24T06:32:22.603541+0000","last_fullsized":"2023-11-24T06:32:22.603541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:20.649413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624516+0000","last_change":"2023-11-24T06:32:22.613718+0000","last_active":"2023-11-24T06:32:22.624516+0000","last_peered":"2023-11-24T06:32:22.624516+0000","last_clean":"2023-11-24T06:32:22.624516+0000","last_became_active":"2023-11-24T06:32:22.613401+0000","last_became_peered":"2023-11-24T06:32:22.613401+0000","last_unstale":"2023-11-24T06:32:22.624516+0000","last_undegraded":"2023-11-24T06:32:22.624516+0000","last_fullsized":"2023-11-24T06:32:22.624516+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:43:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638924+0000","last_change":"2023-11-24T06:32:21.605993+0000","last_active":"2023-11-24T06:32:22.638924+0000","last_peered":"2023-11-24T06:32:22.638924+0000","last_clean":"2023-11-24T06:32:22.638924+0000","last_became_active":"2023-11-24T06:32:21.605707+0000","last_became_peered":"2023-11-24T06:32:21.605707+0000","last_unstale":"2023-11-24T06:32:22.638924+0000","last_undegraded":"2023-11-24T06:32:22.638924+0000","last_fullsized":"2023-11-24T06:32:22.638924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:13:21.672586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626296+0000","last_change":"2023-11-24T06:32:22.619009+0000","last_active":"2023-11-24T06:32:22.626296+0000","last_peered":"2023-11-24T06:32:22.626296+0000","last_clean":"2023-11-24T06:32:22.626296+0000","last_became_active":"2023-11-24T06:32:22.618693+0000","last_became_peered":"2023-11-24T06:32:22.618693+0000","last_unstale":"2023-11-24T06:32:22.626296+0000","last_undegraded":"2023-11-24T06:32:22.626296+0000","last_fullsized":"2023-11-24T06:32:22.626296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:43.292138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.598346+0000","last_change":"2023-11-24T06:32:21.593277+0000","last_active":"2023-11-24T06:32:22.598346+0000","last_peered":"2023-11-24T06:32:22.598346+0000","last_clean":"2023-11-24T06:32:22.598346+0000","last_became_active":"2023-11-24T06:32:21.592976+0000","last_became_peered":"2023-11-24T06:32:21.592976+0000","last_unstale":"2023-11-24T06:32:22.598346+0000","last_undegraded":"2023-11-24T06:32:22.598346+0000","last_fullsized":"2023-11-24T06:32:22.598346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:06.404766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626611+0000","last_change":"2023-11-24T06:32:22.618309+0000","last_active":"2023-11-24T06:32:22.626611+0000","last_peered":"2023-11-24T06:32:22.626611+0000","last_clean":"2023-11-24T06:32:22.626611+0000","last_became_active":"2023-11-24T06:32:22.616733+0000","last_became_peered":"2023-11-24T06:32:22.616733+0000","last_unstale":"2023-11-24T06:32:22.626611+0000","last_undegraded":"2023-11-24T06:32:22.626611+0000","last_fullsized":"2023-11-24T06:32:22.626611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:46:44.828074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.598355+0000","last_change":"2023-11-24T06:32:21.597210+0000","last_active":"2023-11-24T06:32:22.598355+0000","last_peered":"2023-11-24T06:32:22.598355+0000","last_clean":"2023-11-24T06:32:22.598355+0000","last_became_active":"2023-11-24T06:32:21.596929+0000","last_became_peered":"2023-11-24T06:32:21.596929+0000","last_unstale":"2023-11-24T06:32:22.598355+0000","last_undegraded":"2023-11-24T06:32:22.598355+0000","last_fullsized":"2023-11-24T06:32:22.598355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:16:42.874871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626197+0000","last_change":"2023-11-24T06:32:22.614007+0000","last_active":"2023-11-24T06:32:22.626197+0000","last_peered":"2023-11-24T06:32:22.626197+0000","last_clean":"2023-11-24T06:32:22.626197+0000","last_became_active":"2023-11-24T06:32:22.613719+0000","last_became_peered":"2023-11-24T06:32:22.613719+0000","last_unstale":"2023-11-24T06:32:22.626197+0000","last_undegraded":"2023-11-24T06:32:22.626197+0000","last_fullsized":"2023-11-24T06:32:22.626197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.343143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.603646+0000","last_change":"2023-11-24T06:32:21.594654+0000","last_active":"2023-11-24T06:32:22.603646+0000","last_peered":"2023-11-24T06:32:22.603646+0000","last_clean":"2023-11-24T06:32:22.603646+0000","last_became_active":"2023-11-24T06:32:21.594436+0000","last_became_peered":"2023-11-24T06:32:21.594436+0000","last_unstale":"2023-11-24T06:32:22.603646+0000","last_undegraded":"2023-11-24T06:32:22.603646+0000","last_fullsized":"2023-11-24T06:32:22.603646+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:59:16.379006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627494+0000","last_change":"2023-11-24T06:32:22.618903+0000","last_active":"2023-11-24T06:32:22.627494+0000","last_peered":"2023-11-24T06:32:22.627494+0000","last_clean":"2023-11-24T06:32:22.627494+0000","last_became_active":"2023-11-24T06:32:22.618632+0000","last_became_peered":"2023-11-24T06:32:22.618632+0000","last_unstale":"2023-11-24T06:32:22.627494+0000","last_undegraded":"2023-11-24T06:32:22.627494+0000","last_fullsized":"2023-11-24T06:32:22.627494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:30.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595979+0000","last_change":"2023-11-24T06:32:21.593103+0000","last_active":"2023-11-24T06:32:22.595979+0000","last_peered":"2023-11-24T06:32:22.595979+0000","last_clean":"2023-11-24T06:32:22.595979+0000","last_became_active":"2023-11-24T06:32:21.592769+0000","last_became_peered":"2023-11-24T06:32:21.592769+0000","last_unstale":"2023-11-24T06:32:22.595979+0000","last_undegraded":"2023-11-24T06:32:22.595979+0000","last_fullsized":"2023-11-24T06:32:22.595979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:26.000589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.617004+0000","last_change":"2023-11-24T06:32:22.610398+0000","last_active":"2023-11-24T06:32:22.617004+0000","last_peered":"2023-11-24T06:32:22.617004+0000","last_clean":"2023-11-24T06:32:22.617004+0000","last_became_active":"2023-11-24T06:32:22.610064+0000","last_became_peered":"2023-11-24T06:32:22.610064+0000","last_unstale":"2023-11-24T06:32:22.617004+0000","last_undegraded":"2023-11-24T06:32:22.617004+0000","last_fullsized":"2023-11-24T06:32:22.617004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:03.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595385+0000","last_change":"2023-11-24T06:32:21.609986+0000","last_active":"2023-11-24T06:32:22.595385+0000","last_peered":"2023-11-24T06:32:22.595385+0000","last_clean":"2023-11-24T06:32:22.595385+0000","last_became_active":"2023-11-24T06:32:21.609755+0000","last_became_peered":"2023-11-24T06:32:21.609755+0000","last_unstale":"2023-11-24T06:32:22.595385+0000","last_undegraded":"2023-11-24T06:32:22.595385+0000","last_fullsized":"2023-11-24T06:32:22.595385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:58.917321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624064+0000","last_change":"2023-11-24T06:32:22.619665+0000","last_active":"2023-11-24T06:32:22.624064+0000","last_peered":"2023-11-24T06:32:22.624064+0000","last_clean":"2023-11-24T06:32:22.624064+0000","last_became_active":"2023-11-24T06:32:22.618313+0000","last_became_peered":"2023-11-24T06:32:22.618313+0000","last_unstale":"2023-11-24T06:32:22.624064+0000","last_undegraded":"2023-11-24T06:32:22.624064+0000","last_fullsized":"2023-11-24T06:32:22.624064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:46.850581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.596366+0000","last_change":"2023-11-24T06:32:21.601020+0000","last_active":"2023-11-24T06:32:22.596366+0000","last_peered":"2023-11-24T06:32:22.596366+0000","last_clean":"2023-11-24T06:32:22.596366+0000","last_became_active":"2023-11-24T06:32:21.600660+0000","last_became_peered":"2023-11-24T06:32:21.600660+0000","last_unstale":"2023-11-24T06:32:22.596366+0000","last_undegraded":"2023-11-24T06:32:22.596366+0000","last_fullsized":"2023-11-24T06:32:22.596366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:08.150273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624870+0000","last_change":"2023-11-24T06:32:22.617977+0000","last_active":"2023-11-24T06:32:22.624870+0000","last_peered":"2023-11-24T06:32:22.624870+0000","last_clean":"2023-11-24T06:32:22.624870+0000","last_became_active":"2023-11-24T06:32:22.617698+0000","last_became_peered":"2023-11-24T06:32:22.617698+0000","last_unstale":"2023-11-24T06:32:22.624870+0000","last_undegraded":"2023-11-24T06:32:22.624870+0000","last_fullsized":"2023-11-24T06:32:22.624870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:17.244728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.610669+0000","last_change":"2023-11-24T06:32:21.601447+0000","last_active":"2023-11-24T06:32:22.610669+0000","last_peered":"2023-11-24T06:32:22.610669+0000","last_clean":"2023-11-24T06:32:22.610669+0000","last_became_active":"2023-11-24T06:32:21.600786+0000","last_became_peered":"2023-11-24T06:32:21.600786+0000","last_unstale":"2023-11-24T06:32:22.610669+0000","last_undegraded":"2023-11-24T06:32:22.610669+0000","last_fullsized":"2023-11-24T06:32:22.610669+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:48:46.197556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.616634+0000","last_change":"2023-11-24T06:32:22.610420+0000","last_active":"2023-11-24T06:32:22.616634+0000","last_peered":"2023-11-24T06:32:22.616634+0000","last_clean":"2023-11-24T06:32:22.616634+0000","last_became_active":"2023-11-24T06:32:22.610136+0000","last_became_peered":"2023-11-24T06:32:22.610136+0000","last_unstale":"2023-11-24T06:32:22.616634+0000","last_undegraded":"2023-11-24T06:32:22.616634+0000","last_fullsized":"2023-11-24T06:32:22.616634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:16.407250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.637708+0000","last_change":"2023-11-24T06:32:21.602165+0000","last_active":"2023-11-24T06:32:22.637708+0000","last_peered":"2023-11-24T06:32:22.637708+0000","last_clean":"2023-11-24T06:32:22.637708+0000","last_became_active":"2023-11-24T06:32:21.601861+0000","last_became_peered":"2023-11-24T06:32:21.601861+0000","last_unstale":"2023-11-24T06:32:22.637708+0000","last_undegraded":"2023-11-24T06:32:22.637708+0000","last_fullsized":"2023-11-24T06:32:22.637708+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:16.385574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-24T06:32:21.589797+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:32:21.589797+0000","last_peered":"2023-11-24T06:32:21.589797+0000","last_clean":"2023-11-24T06:32:21.589797+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:32:21.589797+0000","last_undegraded":"2023-11-24T06:32:21.589797+0000","last_fullsized":"2023-11-24T06:32:21.589797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":956140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.417,"15min":1.417},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90900000000000003,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98899999999999999,"5min":1.7,"15min":1.7},"last":0.628}]},{"osd":2,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0049999999999999,"5min":1.96,"15min":1.96},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96599999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.505}]},{"osd":3,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95699999999999996,"5min":1.55,"15min":1.55},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":0.996,"15min":0.996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.47299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92600000000000005,"5min":1,"15min":1},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94299999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":365248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89100000000000001,"5min":2.637,"15min":2.637},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0720000000000001,"5min":1.619,"15min":1.619},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93000000000000005,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.745}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97499999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.497}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0980000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.119,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.036,"15min":1.036},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":868352,"data_stored":365246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":1.278,"15min":1.278},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":1.919,"15min":1.919},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91000000000000003,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95899999999999996,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.04,"5min":1.998,"15min":1.998},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84899999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97399999999999998,"5min":1.462,"15min":1.462},"last":0.76000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.37,"15min":0.37},"max":{"1min":0.86099999999999999,"5min":1.165,"15min":1.165},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88500000000000001,"5min":1.022,"15min":1.022},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95199999999999996,"5min":1.202,"15min":1.202},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86099999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.248,"15min":1.248},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.079,"15min":1.079},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.149,"15min":1.149},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.62,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63100000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64900000000000002,"5min":1.095,"15min":1.095},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.753},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97099999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.497},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0109999999999999,"5min":1.264,"15min":1.264},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91600000000000004,"5min":1.286,"15min":1.286},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.409,"15min":1.409},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51500000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98699999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.501}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0609999999999999,"5min":1.075,"15min":1.075},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.65700000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3400000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97799999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.27,"15min":1.27},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.3759999999999999,"5min":1.389,"15min":1.389},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1220000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.101,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.64300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3049999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.82299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":367384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.02,"15min":1.02},"last":0.629},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.032,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.749}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98099999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1454080,"data_stored":954555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.75900000000000001,"5min":1.393,"15min":1.393},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81899999999999995,"5min":1.319,"15min":1.319},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.879,"5min":1.589,"15min":1.589},"last":0.75}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.014,"5min":1.206,"15min":1.206},"last":1.462},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95899999999999996,"5min":1.778,"15min":1.778},"last":1.2849999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79600000000000004,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92700000000000005,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92900000000000005,"5min":1.496,"15min":1.496},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82199999999999995,"15min":0.83699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95299999999999996,"5min":1.454,"15min":1.454},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.514}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.278,"15min":1.278},"last":1.3320000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93400000000000005,"5min":1.829,"15min":1.829},"last":1.446}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:32:26.687 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:32:26.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f81383df640 1 Processor -- start 2023-11-24T06:32:26.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f81383df640 1 -- start start 2023-11-24T06:32:26.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f81383df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 0x7f813009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f81383df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813006d8b0 con 0x7f8130144030 2023-11-24T06:32:26.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f81383df640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813006cca0 con 0x7f81300709c0 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f81383df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8130145020 con 0x7f813006c650 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f813617b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8130144030 0x7f813006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36522/0 (socket says 172.21.15.143:36522) 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f813617b640 1 -- 172.21.15.143:0/2324734732 learned_addr learned my addr 172.21.15.143:0/2324734732 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f813597a640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 0x7f813009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052480616 0 0) 0x7f813006d8b0 con 0x7f8130144030 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f811c003530 con 0x7f8130144030 2023-11-24T06:32:26.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122669555 0 0) 0x7f811c003530 con 0x7f8130144030 2023-11-24T06:32:26.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 msgr2=0x7f813009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:26.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 0x7f813009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 >> v1:172.21.15.146:6789/0 conn(0x7f81300709c0 legacy=0x7f8130070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813006cf80 con 0x7f8130144030 2023-11-24T06:32:26.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f812c001680 con 0x7f8130144030 2023-11-24T06:32:26.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 >> v1:172.21.15.143:6789/0 conn(0x7f8130144030 legacy=0x7f813006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0039b0 0x7f811c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f811c0047d0 0x7f811c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 0x7f811c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c00ba40 con 0x7f811c0047d0 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c00bb80 con 0x7f811c0039b0 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c00bd40 con 0x7f813006c650 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f813597a640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f811c0047d0 0x7f811c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f813617b640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0039b0 0x7f811c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.857+0000 7f813697c640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 0x7f811c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813597a640 1 -- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 msgr2=0x7f811c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:26.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813597a640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813006c650 0x7f811c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813597a640 1 -- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0039b0 msgr2=0x7f811c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:26.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813597a640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0039b0 0x7f811c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813597a640 1 -- 172.21.15.143:0/2324734732 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c003530 con 0x7f811c0047d0 2023-11-24T06:32:26.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813597a640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f811c0047d0 0x7f811c004c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8120009ab0 tx=0x7f812001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9e5c286ef21b76 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200a6510 con 0x7f811c0047d0 2023-11-24T06:32:26.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200a6670 con 0x7f811c0047d0 2023-11-24T06:32:26.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f8135179640 1 -- 172.21.15.143:0/2324734732 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200a6a20 con 0x7f811c0047d0 2023-11-24T06:32:26.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f81383df640 1 -- 172.21.15.143:0/2324734732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f811c0047d0 msgr2=0x7f811c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f81383df640 1 --2- 172.21.15.143:0/2324734732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f811c0047d0 0x7f811c004c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8120009ab0 tx=0x7f812001ca10 comp rx=0 tx=0).stop 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f813697c640 1 -- 172.21.15.143:0/2324734732 reap_dead start 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f81383df640 1 -- 172.21.15.143:0/2324734732 shutdown_connections 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f81383df640 1 -- 172.21.15.143:0/2324734732 >> 172.21.15.143:0/2324734732 conn(0x7f81300b0bf0 msgr2=0x7f81300b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f81383df640 1 -- 172.21.15.143:0/2324734732 shutdown_connections 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.861+0000 7f81383df640 1 -- 172.21.15.143:0/2324734732 wait complete. 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 Processor -- start 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 -- start start 2023-11-24T06:32:26.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0047d0 0x7f813013c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813014c410 0x7f813013db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 0x7f813013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8130099ea0 con 0x7f813013e0a0 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813013c6d0 con 0x7f811c0047d0 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813013ea60 con 0x7f813014c410 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 0x7f813013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 0x7f813013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38414/0 (socket says 172.21.15.143:38414) 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 -- 172.21.15.143:0/1984335576 learned_addr learned my addr 172.21.15.143:0/1984335576 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813617b640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0047d0 0x7f813013c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813597a640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813014c410 0x7f813013db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 -- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813014c410 msgr2=0x7f813013db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813014c410 0x7f813013db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 -- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0047d0 msgr2=0x7f813013c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0047d0 0x7f813013c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 -- 172.21.15.143:0/1984335576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81301e4d70 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f813697c640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 0x7f813013e520 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f81300b4320 tx=0x7f812800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128006d70 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128003980 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128003d30 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.865+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81301e5050 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81301e5330 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8130067520 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f8128005070 con 0x7f813013e0a0 2023-11-24T06:32:26.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f8126ffd640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8114066890 0x7f8114068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:26.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8128083a90 con 0x7f813013e0a0 2023-11-24T06:32:26.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f813617b640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8114066890 0x7f8114068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:26.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.869+0000 7f813617b640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8114066890 0x7f8114068d50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f812c001060 tx=0x7f812c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:26.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:26.873+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81280508d0 con 0x7f813013e0a0 2023-11-24T06:32:27.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.021+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f813006e450 con 0x7f8114066890 2023-11-24T06:32:27.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.029+0000 7f8126ffd640 1 -- 172.21.15.143:0/1984335576 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288964 (secure 0 0 0) 0x7f812c005670 con 0x7f8114066890 2023-11-24T06:32:27.036 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:27.038 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:32:27.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8114066890 msgr2=0x7f8114068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8114066890 0x7f8114068d50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f812c001060 tx=0x7f812c009040 comp rx=0 tx=0).stop 2023-11-24T06:32:27.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 msgr2=0x7f813013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 0x7f813013e520 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f81300b4320 tx=0x7f812800fcd0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 shutdown_connections 2023-11-24T06:32:27.040 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8114066890 0x7f8114068d50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f813013e0a0 0x7f813013e520 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f813014c410 0x7f813013db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 --2- 172.21.15.143:0/1984335576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f811c0047d0 0x7f813013c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 >> 172.21.15.143:0/1984335576 conn(0x7f81300b0bf0 msgr2=0x7f81301431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:27.041 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 shutdown_connections 2023-11-24T06:32:27.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.033+0000 7f81383df640 1 -- 172.21.15.143:0/1984335576 wait complete. 2023-11-24T06:32:27.057 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-24T06:32:26.236911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253240,"kb_used_data":7912,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721480,"statfs":{"total":773094113280,"available":772834795520,"internally_reserved":0,"allocated":8101888,"data_stored":4083632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.663195"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.623616+0000","last_change":"2023-11-24T06:32:22.611639+0000","last_active":"2023-11-24T06:32:22.623616+0000","last_peered":"2023-11-24T06:32:22.623616+0000","last_clean":"2023-11-24T06:32:22.623616+0000","last_became_active":"2023-11-24T06:32:22.611346+0000","last_became_peered":"2023-11-24T06:32:22.611346+0000","last_unstale":"2023-11-24T06:32:22.623616+0000","last_undegraded":"2023-11-24T06:32:22.623616+0000","last_fullsized":"2023-11-24T06:32:22.623616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:02.288573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.632799+0000","last_change":"2023-11-24T06:32:22.625893+0000","last_active":"2023-11-24T06:32:22.632799+0000","last_peered":"2023-11-24T06:32:22.632799+0000","last_clean":"2023-11-24T06:32:22.632799+0000","last_became_active":"2023-11-24T06:32:22.625595+0000","last_became_peered":"2023-11-24T06:32:22.625595+0000","last_unstale":"2023-11-24T06:32:22.632799+0000","last_undegraded":"2023-11-24T06:32:22.632799+0000","last_fullsized":"2023-11-24T06:32:22.632799+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:33.102952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.616561+0000","last_change":"2023-11-24T06:32:22.610152+0000","last_active":"2023-11-24T06:32:22.616561+0000","last_peered":"2023-11-24T06:32:22.616561+0000","last_clean":"2023-11-24T06:32:22.616561+0000","last_became_active":"2023-11-24T06:32:22.608695+0000","last_became_peered":"2023-11-24T06:32:22.608695+0000","last_unstale":"2023-11-24T06:32:22.616561+0000","last_undegraded":"2023-11-24T06:32:22.616561+0000","last_fullsized":"2023-11-24T06:32:22.616561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:49.894536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619770+0000","last_change":"2023-11-24T06:32:22.609632+0000","last_active":"2023-11-24T06:32:22.619770+0000","last_peered":"2023-11-24T06:32:22.619770+0000","last_clean":"2023-11-24T06:32:22.619770+0000","last_became_active":"2023-11-24T06:32:22.609287+0000","last_became_peered":"2023-11-24T06:32:22.609287+0000","last_unstale":"2023-11-24T06:32:22.619770+0000","last_undegraded":"2023-11-24T06:32:22.619770+0000","last_fullsized":"2023-11-24T06:32:22.619770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:51.660286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627124+0000","last_change":"2023-11-24T06:32:22.612521+0000","last_active":"2023-11-24T06:32:22.627124+0000","last_peered":"2023-11-24T06:32:22.627124+0000","last_clean":"2023-11-24T06:32:22.627124+0000","last_became_active":"2023-11-24T06:32:22.612167+0000","last_became_peered":"2023-11-24T06:32:22.612167+0000","last_unstale":"2023-11-24T06:32:22.627124+0000","last_undegraded":"2023-11-24T06:32:22.627124+0000","last_fullsized":"2023-11-24T06:32:22.627124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:16.969827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.625434+0000","last_change":"2023-11-24T06:32:22.619305+0000","last_active":"2023-11-24T06:32:22.625434+0000","last_peered":"2023-11-24T06:32:22.625434+0000","last_clean":"2023-11-24T06:32:22.625434+0000","last_became_active":"2023-11-24T06:32:22.619053+0000","last_became_peered":"2023-11-24T06:32:22.619053+0000","last_unstale":"2023-11-24T06:32:22.625434+0000","last_undegraded":"2023-11-24T06:32:22.625434+0000","last_fullsized":"2023-11-24T06:32:22.625434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:21.847633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620532+0000","last_change":"2023-11-24T06:32:22.605448+0000","last_active":"2023-11-24T06:32:22.620532+0000","last_peered":"2023-11-24T06:32:22.620532+0000","last_clean":"2023-11-24T06:32:22.620532+0000","last_became_active":"2023-11-24T06:32:22.604884+0000","last_became_peered":"2023-11-24T06:32:22.604884+0000","last_unstale":"2023-11-24T06:32:22.620532+0000","last_undegraded":"2023-11-24T06:32:22.620532+0000","last_fullsized":"2023-11-24T06:32:22.620532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:43.815445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626456+0000","last_change":"2023-11-24T06:32:22.621986+0000","last_active":"2023-11-24T06:32:22.626456+0000","last_peered":"2023-11-24T06:32:22.626456+0000","last_clean":"2023-11-24T06:32:22.626456+0000","last_became_active":"2023-11-24T06:32:22.621429+0000","last_became_peered":"2023-11-24T06:32:22.621429+0000","last_unstale":"2023-11-24T06:32:22.626456+0000","last_undegraded":"2023-11-24T06:32:22.626456+0000","last_fullsized":"2023-11-24T06:32:22.626456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:35.158435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627823+0000","last_change":"2023-11-24T06:32:22.621897+0000","last_active":"2023-11-24T06:32:22.627823+0000","last_peered":"2023-11-24T06:32:22.627823+0000","last_clean":"2023-11-24T06:32:22.627823+0000","last_became_active":"2023-11-24T06:32:22.621189+0000","last_became_peered":"2023-11-24T06:32:22.621189+0000","last_unstale":"2023-11-24T06:32:22.627823+0000","last_undegraded":"2023-11-24T06:32:22.627823+0000","last_fullsized":"2023-11-24T06:32:22.627823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:01:24.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.609700+0000","last_change":"2023-11-24T06:32:22.606083+0000","last_active":"2023-11-24T06:32:22.609700+0000","last_peered":"2023-11-24T06:32:22.609700+0000","last_clean":"2023-11-24T06:32:22.609700+0000","last_became_active":"2023-11-24T06:32:22.605583+0000","last_became_peered":"2023-11-24T06:32:22.605583+0000","last_unstale":"2023-11-24T06:32:22.609700+0000","last_undegraded":"2023-11-24T06:32:22.609700+0000","last_fullsized":"2023-11-24T06:32:22.609700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:40.798204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627056+0000","last_change":"2023-11-24T06:32:22.621428+0000","last_active":"2023-11-24T06:32:22.627056+0000","last_peered":"2023-11-24T06:32:22.627056+0000","last_clean":"2023-11-24T06:32:22.627056+0000","last_became_active":"2023-11-24T06:32:22.621123+0000","last_became_peered":"2023-11-24T06:32:22.621123+0000","last_unstale":"2023-11-24T06:32:22.627056+0000","last_undegraded":"2023-11-24T06:32:22.627056+0000","last_fullsized":"2023-11-24T06:32:22.627056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:44:00.264144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.615536+0000","last_change":"2023-11-24T06:32:22.607266+0000","last_active":"2023-11-24T06:32:22.615536+0000","last_peered":"2023-11-24T06:32:22.615536+0000","last_clean":"2023-11-24T06:32:22.615536+0000","last_became_active":"2023-11-24T06:32:22.606728+0000","last_became_peered":"2023-11-24T06:32:22.606728+0000","last_unstale":"2023-11-24T06:32:22.615536+0000","last_undegraded":"2023-11-24T06:32:22.615536+0000","last_fullsized":"2023-11-24T06:32:22.615536+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:56.967895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620865+0000","last_change":"2023-11-24T06:32:22.617699+0000","last_active":"2023-11-24T06:32:22.620865+0000","last_peered":"2023-11-24T06:32:22.620865+0000","last_clean":"2023-11-24T06:32:22.620865+0000","last_became_active":"2023-11-24T06:32:22.617420+0000","last_became_peered":"2023-11-24T06:32:22.617420+0000","last_unstale":"2023-11-24T06:32:22.620865+0000","last_undegraded":"2023-11-24T06:32:22.620865+0000","last_fullsized":"2023-11-24T06:32:22.620865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:10.575952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627472+0000","last_change":"2023-11-24T06:32:22.616815+0000","last_active":"2023-11-24T06:32:22.627472+0000","last_peered":"2023-11-24T06:32:22.627472+0000","last_clean":"2023-11-24T06:32:22.627472+0000","last_became_active":"2023-11-24T06:32:22.616386+0000","last_became_peered":"2023-11-24T06:32:22.616386+0000","last_unstale":"2023-11-24T06:32:22.627472+0000","last_undegraded":"2023-11-24T06:32:22.627472+0000","last_fullsized":"2023-11-24T06:32:22.627472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:47.154708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.614493+0000","last_change":"2023-11-24T06:32:22.609471+0000","last_active":"2023-11-24T06:32:22.614493+0000","last_peered":"2023-11-24T06:32:22.614493+0000","last_clean":"2023-11-24T06:32:22.614493+0000","last_became_active":"2023-11-24T06:32:22.609071+0000","last_became_peered":"2023-11-24T06:32:22.609071+0000","last_unstale":"2023-11-24T06:32:22.614493+0000","last_undegraded":"2023-11-24T06:32:22.614493+0000","last_fullsized":"2023-11-24T06:32:22.614493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:06.013197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.625142+0000","last_change":"2023-11-24T06:32:22.618254+0000","last_active":"2023-11-24T06:32:22.625142+0000","last_peered":"2023-11-24T06:32:22.625142+0000","last_clean":"2023-11-24T06:32:22.625142+0000","last_became_active":"2023-11-24T06:32:22.617857+0000","last_became_peered":"2023-11-24T06:32:22.617857+0000","last_unstale":"2023-11-24T06:32:22.625142+0000","last_undegraded":"2023-11-24T06:32:22.625142+0000","last_fullsized":"2023-11-24T06:32:22.625142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:45.979497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627805+0000","last_change":"2023-11-24T06:32:22.621650+0000","last_active":"2023-11-24T06:32:22.627805+0000","last_peered":"2023-11-24T06:32:22.627805+0000","last_clean":"2023-11-24T06:32:22.627805+0000","last_became_active":"2023-11-24T06:32:22.620853+0000","last_became_peered":"2023-11-24T06:32:22.620853+0000","last_unstale":"2023-11-24T06:32:22.627805+0000","last_undegraded":"2023-11-24T06:32:22.627805+0000","last_fullsized":"2023-11-24T06:32:22.627805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:04.481878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.621684+0000","last_change":"2023-11-24T06:32:22.618938+0000","last_active":"2023-11-24T06:32:22.621684+0000","last_peered":"2023-11-24T06:32:22.621684+0000","last_clean":"2023-11-24T06:32:22.621684+0000","last_became_active":"2023-11-24T06:32:22.618628+0000","last_became_peered":"2023-11-24T06:32:22.618628+0000","last_unstale":"2023-11-24T06:32:22.621684+0000","last_undegraded":"2023-11-24T06:32:22.621684+0000","last_fullsized":"2023-11-24T06:32:22.621684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:45.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.621330+0000","last_change":"2023-11-24T06:32:22.615127+0000","last_active":"2023-11-24T06:32:22.621330+0000","last_peered":"2023-11-24T06:32:22.621330+0000","last_clean":"2023-11-24T06:32:22.621330+0000","last_became_active":"2023-11-24T06:32:22.614652+0000","last_became_peered":"2023-11-24T06:32:22.614652+0000","last_unstale":"2023-11-24T06:32:22.621330+0000","last_undegraded":"2023-11-24T06:32:22.621330+0000","last_fullsized":"2023-11-24T06:32:22.621330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:09.156739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.629360+0000","last_change":"2023-11-24T06:32:22.622608+0000","last_active":"2023-11-24T06:32:22.629360+0000","last_peered":"2023-11-24T06:32:22.629360+0000","last_clean":"2023-11-24T06:32:22.629360+0000","last_became_active":"2023-11-24T06:32:22.622226+0000","last_became_peered":"2023-11-24T06:32:22.622226+0000","last_unstale":"2023-11-24T06:32:22.629360+0000","last_undegraded":"2023-11-24T06:32:22.629360+0000","last_fullsized":"2023-11-24T06:32:22.629360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:58.159999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.612080+0000","last_change":"2023-11-24T06:32:22.606847+0000","last_active":"2023-11-24T06:32:22.612080+0000","last_peered":"2023-11-24T06:32:22.612080+0000","last_clean":"2023-11-24T06:32:22.612080+0000","last_became_active":"2023-11-24T06:32:22.606585+0000","last_became_peered":"2023-11-24T06:32:22.606585+0000","last_unstale":"2023-11-24T06:32:22.612080+0000","last_undegraded":"2023-11-24T06:32:22.612080+0000","last_fullsized":"2023-11-24T06:32:22.612080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:35.158435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.613695+0000","last_change":"2023-11-24T06:32:22.608162+0000","last_active":"2023-11-24T06:32:22.613695+0000","last_peered":"2023-11-24T06:32:22.613695+0000","last_clean":"2023-11-24T06:32:22.613695+0000","last_became_active":"2023-11-24T06:32:22.607829+0000","last_became_peered":"2023-11-24T06:32:22.607829+0000","last_unstale":"2023-11-24T06:32:22.613695+0000","last_undegraded":"2023-11-24T06:32:22.613695+0000","last_fullsized":"2023-11-24T06:32:22.613695+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:03.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624911+0000","last_change":"2023-11-24T06:32:22.613782+0000","last_active":"2023-11-24T06:32:22.624911+0000","last_peered":"2023-11-24T06:32:22.624911+0000","last_clean":"2023-11-24T06:32:22.624911+0000","last_became_active":"2023-11-24T06:32:22.613483+0000","last_became_peered":"2023-11-24T06:32:22.613483+0000","last_unstale":"2023-11-24T06:32:22.624911+0000","last_undegraded":"2023-11-24T06:32:22.624911+0000","last_fullsized":"2023-11-24T06:32:22.624911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:01:49.029026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.629736+0000","last_change":"2023-11-24T06:32:22.623764+0000","last_active":"2023-11-24T06:32:22.629736+0000","last_peered":"2023-11-24T06:32:22.629736+0000","last_clean":"2023-11-24T06:32:22.629736+0000","last_became_active":"2023-11-24T06:32:22.623429+0000","last_became_peered":"2023-11-24T06:32:22.623429+0000","last_unstale":"2023-11-24T06:32:22.629736+0000","last_undegraded":"2023-11-24T06:32:22.629736+0000","last_fullsized":"2023-11-24T06:32:22.629736+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:02:37.498806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624992+0000","last_change":"2023-11-24T06:32:22.616366+0000","last_active":"2023-11-24T06:32:22.624992+0000","last_peered":"2023-11-24T06:32:22.624992+0000","last_clean":"2023-11-24T06:32:22.624992+0000","last_became_active":"2023-11-24T06:32:22.611585+0000","last_became_peered":"2023-11-24T06:32:22.611585+0000","last_unstale":"2023-11-24T06:32:22.624992+0000","last_undegraded":"2023-11-24T06:32:22.624992+0000","last_fullsized":"2023-11-24T06:32:22.624992+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:40.383041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626608+0000","last_change":"2023-11-24T06:32:22.622503+0000","last_active":"2023-11-24T06:32:22.626608+0000","last_peered":"2023-11-24T06:32:22.626608+0000","last_clean":"2023-11-24T06:32:22.626608+0000","last_became_active":"2023-11-24T06:32:22.622217+0000","last_became_peered":"2023-11-24T06:32:22.622217+0000","last_unstale":"2023-11-24T06:32:22.626608+0000","last_undegraded":"2023-11-24T06:32:22.626608+0000","last_fullsized":"2023-11-24T06:32:22.626608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:59.608401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.616540+0000","last_change":"2023-11-24T06:32:22.608283+0000","last_active":"2023-11-24T06:32:22.616540+0000","last_peered":"2023-11-24T06:32:22.616540+0000","last_clean":"2023-11-24T06:32:22.616540+0000","last_became_active":"2023-11-24T06:32:22.607975+0000","last_became_peered":"2023-11-24T06:32:22.607975+0000","last_unstale":"2023-11-24T06:32:22.616540+0000","last_undegraded":"2023-11-24T06:32:22.616540+0000","last_fullsized":"2023-11-24T06:32:22.616540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:08.189198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.617082+0000","last_change":"2023-11-24T06:32:22.609181+0000","last_active":"2023-11-24T06:32:22.617082+0000","last_peered":"2023-11-24T06:32:22.617082+0000","last_clean":"2023-11-24T06:32:22.617082+0000","last_became_active":"2023-11-24T06:32:22.608864+0000","last_became_peered":"2023-11-24T06:32:22.608864+0000","last_unstale":"2023-11-24T06:32:22.617082+0000","last_undegraded":"2023-11-24T06:32:22.617082+0000","last_fullsized":"2023-11-24T06:32:22.617082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:43.815445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620189+0000","last_change":"2023-11-24T06:32:22.612786+0000","last_active":"2023-11-24T06:32:22.620189+0000","last_peered":"2023-11-24T06:32:22.620189+0000","last_clean":"2023-11-24T06:32:22.620189+0000","last_became_active":"2023-11-24T06:32:22.609514+0000","last_became_peered":"2023-11-24T06:32:22.609514+0000","last_unstale":"2023-11-24T06:32:22.620189+0000","last_undegraded":"2023-11-24T06:32:22.620189+0000","last_fullsized":"2023-11-24T06:32:22.620189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:43:05.194648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626561+0000","last_change":"2023-11-24T06:32:22.622460+0000","last_active":"2023-11-24T06:32:22.626561+0000","last_peered":"2023-11-24T06:32:22.626561+0000","last_clean":"2023-11-24T06:32:22.626561+0000","last_became_active":"2023-11-24T06:32:22.622111+0000","last_became_peered":"2023-11-24T06:32:22.622111+0000","last_unstale":"2023-11-24T06:32:22.626561+0000","last_undegraded":"2023-11-24T06:32:22.626561+0000","last_fullsized":"2023-11-24T06:32:22.626561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:02:37.498806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620554+0000","last_change":"2023-11-24T06:32:22.605944+0000","last_active":"2023-11-24T06:32:22.620554+0000","last_peered":"2023-11-24T06:32:22.620554+0000","last_clean":"2023-11-24T06:32:22.620554+0000","last_became_active":"2023-11-24T06:32:22.605399+0000","last_became_peered":"2023-11-24T06:32:22.605399+0000","last_unstale":"2023-11-24T06:32:22.620554+0000","last_undegraded":"2023-11-24T06:32:22.620554+0000","last_fullsized":"2023-11-24T06:32:22.620554+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:26.677870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624281+0000","last_change":"2023-11-24T06:32:22.617837+0000","last_active":"2023-11-24T06:32:22.624281+0000","last_peered":"2023-11-24T06:32:22.624281+0000","last_clean":"2023-11-24T06:32:22.624281+0000","last_became_active":"2023-11-24T06:32:22.617510+0000","last_became_peered":"2023-11-24T06:32:22.617510+0000","last_unstale":"2023-11-24T06:32:22.624281+0000","last_undegraded":"2023-11-24T06:32:22.624281+0000","last_fullsized":"2023-11-24T06:32:22.624281+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:40.798204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626861+0000","last_change":"2023-11-24T06:32:22.620370+0000","last_active":"2023-11-24T06:32:22.626861+0000","last_peered":"2023-11-24T06:32:22.626861+0000","last_clean":"2023-11-24T06:32:22.626861+0000","last_became_active":"2023-11-24T06:32:22.620001+0000","last_became_peered":"2023-11-24T06:32:22.620001+0000","last_unstale":"2023-11-24T06:32:22.626861+0000","last_undegraded":"2023-11-24T06:32:22.626861+0000","last_fullsized":"2023-11-24T06:32:22.626861+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:13.354639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639473+0000","last_change":"2023-11-24T06:32:21.601573+0000","last_active":"2023-11-24T06:32:22.639473+0000","last_peered":"2023-11-24T06:32:22.639473+0000","last_clean":"2023-11-24T06:32:22.639473+0000","last_became_active":"2023-11-24T06:32:21.601266+0000","last_became_peered":"2023-11-24T06:32:21.601266+0000","last_unstale":"2023-11-24T06:32:22.639473+0000","last_undegraded":"2023-11-24T06:32:22.639473+0000","last_fullsized":"2023-11-24T06:32:22.639473+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:43.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627783+0000","last_change":"2023-11-24T06:32:22.621465+0000","last_active":"2023-11-24T06:32:22.627783+0000","last_peered":"2023-11-24T06:32:22.627783+0000","last_clean":"2023-11-24T06:32:22.627783+0000","last_became_active":"2023-11-24T06:32:22.620506+0000","last_became_peered":"2023-11-24T06:32:22.620506+0000","last_unstale":"2023-11-24T06:32:22.627783+0000","last_undegraded":"2023-11-24T06:32:22.627783+0000","last_fullsized":"2023-11-24T06:32:22.627783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:28.016840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.635275+0000","last_change":"2023-11-24T06:32:21.593780+0000","last_active":"2023-11-24T06:32:22.635275+0000","last_peered":"2023-11-24T06:32:22.635275+0000","last_clean":"2023-11-24T06:32:22.635275+0000","last_became_active":"2023-11-24T06:32:21.593508+0000","last_became_peered":"2023-11-24T06:32:21.593508+0000","last_unstale":"2023-11-24T06:32:22.635275+0000","last_undegraded":"2023-11-24T06:32:22.635275+0000","last_fullsized":"2023-11-24T06:32:22.635275+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:06.071265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.617277+0000","last_change":"2023-11-24T06:32:22.611981+0000","last_active":"2023-11-24T06:32:22.617277+0000","last_peered":"2023-11-24T06:32:22.617277+0000","last_clean":"2023-11-24T06:32:22.617277+0000","last_became_active":"2023-11-24T06:32:22.610242+0000","last_became_peered":"2023-11-24T06:32:22.610242+0000","last_unstale":"2023-11-24T06:32:22.617277+0000","last_undegraded":"2023-11-24T06:32:22.617277+0000","last_fullsized":"2023-11-24T06:32:22.617277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:08.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639423+0000","last_change":"2023-11-24T06:32:21.604912+0000","last_active":"2023-11-24T06:32:22.639423+0000","last_peered":"2023-11-24T06:32:22.639423+0000","last_clean":"2023-11-24T06:32:22.639423+0000","last_became_active":"2023-11-24T06:32:21.604345+0000","last_became_peered":"2023-11-24T06:32:21.604345+0000","last_unstale":"2023-11-24T06:32:22.639423+0000","last_undegraded":"2023-11-24T06:32:22.639423+0000","last_fullsized":"2023-11-24T06:32:22.639423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:36.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.623909+0000","last_change":"2023-11-24T06:32:22.613429+0000","last_active":"2023-11-24T06:32:22.623909+0000","last_peered":"2023-11-24T06:32:22.623909+0000","last_clean":"2023-11-24T06:32:22.623909+0000","last_became_active":"2023-11-24T06:32:22.612208+0000","last_became_peered":"2023-11-24T06:32:22.612208+0000","last_unstale":"2023-11-24T06:32:22.623909+0000","last_undegraded":"2023-11-24T06:32:22.623909+0000","last_fullsized":"2023-11-24T06:32:22.623909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:40.500091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638032+0000","last_change":"2023-11-24T06:32:21.604075+0000","last_active":"2023-11-24T06:32:22.638032+0000","last_peered":"2023-11-24T06:32:22.638032+0000","last_clean":"2023-11-24T06:32:22.638032+0000","last_became_active":"2023-11-24T06:32:21.603742+0000","last_became_peered":"2023-11-24T06:32:21.603742+0000","last_unstale":"2023-11-24T06:32:22.638032+0000","last_undegraded":"2023-11-24T06:32:22.638032+0000","last_fullsized":"2023-11-24T06:32:22.638032+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:14.405021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626584+0000","last_change":"2023-11-24T06:32:22.622839+0000","last_active":"2023-11-24T06:32:22.626584+0000","last_peered":"2023-11-24T06:32:22.626584+0000","last_clean":"2023-11-24T06:32:22.626584+0000","last_became_active":"2023-11-24T06:32:22.622545+0000","last_became_peered":"2023-11-24T06:32:22.622545+0000","last_unstale":"2023-11-24T06:32:22.626584+0000","last_undegraded":"2023-11-24T06:32:22.626584+0000","last_fullsized":"2023-11-24T06:32:22.626584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:15:35.003585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638847+0000","last_change":"2023-11-24T06:32:21.595822+0000","last_active":"2023-11-24T06:32:22.638847+0000","last_peered":"2023-11-24T06:32:22.638847+0000","last_clean":"2023-11-24T06:32:22.638847+0000","last_became_active":"2023-11-24T06:32:21.595560+0000","last_became_peered":"2023-11-24T06:32:21.595560+0000","last_unstale":"2023-11-24T06:32:22.638847+0000","last_undegraded":"2023-11-24T06:32:22.638847+0000","last_fullsized":"2023-11-24T06:32:22.638847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:25.907609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.615978+0000","last_change":"2023-11-24T06:32:22.611965+0000","last_active":"2023-11-24T06:32:22.615978+0000","last_peered":"2023-11-24T06:32:22.615978+0000","last_clean":"2023-11-24T06:32:22.615978+0000","last_became_active":"2023-11-24T06:32:22.611690+0000","last_became_peered":"2023-11-24T06:32:22.611690+0000","last_unstale":"2023-11-24T06:32:22.615978+0000","last_undegraded":"2023-11-24T06:32:22.615978+0000","last_fullsized":"2023-11-24T06:32:22.615978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:48.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.635426+0000","last_change":"2023-11-24T06:32:21.613159+0000","last_active":"2023-11-24T06:32:22.635426+0000","last_peered":"2023-11-24T06:32:22.635426+0000","last_clean":"2023-11-24T06:32:22.635426+0000","last_became_active":"2023-11-24T06:32:21.612803+0000","last_became_peered":"2023-11-24T06:32:21.612803+0000","last_unstale":"2023-11-24T06:32:22.635426+0000","last_undegraded":"2023-11-24T06:32:22.635426+0000","last_fullsized":"2023-11-24T06:32:22.635426+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:39.987018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619112+0000","last_change":"2023-11-24T06:32:22.608470+0000","last_active":"2023-11-24T06:32:22.619112+0000","last_peered":"2023-11-24T06:32:22.619112+0000","last_clean":"2023-11-24T06:32:22.619112+0000","last_became_active":"2023-11-24T06:32:22.608169+0000","last_became_peered":"2023-11-24T06:32:22.608169+0000","last_unstale":"2023-11-24T06:32:22.619112+0000","last_undegraded":"2023-11-24T06:32:22.619112+0000","last_fullsized":"2023-11-24T06:32:22.619112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:03.015357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595509+0000","last_change":"2023-11-24T06:32:21.605864+0000","last_active":"2023-11-24T06:32:22.595509+0000","last_peered":"2023-11-24T06:32:22.595509+0000","last_clean":"2023-11-24T06:32:22.595509+0000","last_became_active":"2023-11-24T06:32:21.605410+0000","last_became_peered":"2023-11-24T06:32:21.605410+0000","last_unstale":"2023-11-24T06:32:22.595509+0000","last_undegraded":"2023-11-24T06:32:22.595509+0000","last_fullsized":"2023-11-24T06:32:22.595509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:32.096486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.612317+0000","last_change":"2023-11-24T06:32:22.608734+0000","last_active":"2023-11-24T06:32:22.612317+0000","last_peered":"2023-11-24T06:32:22.612317+0000","last_clean":"2023-11-24T06:32:22.612317+0000","last_became_active":"2023-11-24T06:32:22.608448+0000","last_became_peered":"2023-11-24T06:32:22.608448+0000","last_unstale":"2023-11-24T06:32:22.612317+0000","last_undegraded":"2023-11-24T06:32:22.612317+0000","last_fullsized":"2023-11-24T06:32:22.612317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:44.017949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595534+0000","last_change":"2023-11-24T06:32:21.599793+0000","last_active":"2023-11-24T06:32:22.595534+0000","last_peered":"2023-11-24T06:32:22.595534+0000","last_clean":"2023-11-24T06:32:22.595534+0000","last_became_active":"2023-11-24T06:32:21.599528+0000","last_became_peered":"2023-11-24T06:32:21.599528+0000","last_unstale":"2023-11-24T06:32:22.595534+0000","last_undegraded":"2023-11-24T06:32:22.595534+0000","last_fullsized":"2023-11-24T06:32:22.595534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:33:02.874801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624376+0000","last_change":"2023-11-24T06:32:22.613512+0000","last_active":"2023-11-24T06:32:22.624376+0000","last_peered":"2023-11-24T06:32:22.624376+0000","last_clean":"2023-11-24T06:32:22.624376+0000","last_became_active":"2023-11-24T06:32:22.613119+0000","last_became_peered":"2023-11-24T06:32:22.613119+0000","last_unstale":"2023-11-24T06:32:22.624376+0000","last_undegraded":"2023-11-24T06:32:22.624376+0000","last_fullsized":"2023-11-24T06:32:22.624376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:43.767805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.599130+0000","last_change":"2023-11-24T06:32:21.594630+0000","last_active":"2023-11-24T06:32:22.599130+0000","last_peered":"2023-11-24T06:32:22.599130+0000","last_clean":"2023-11-24T06:32:22.599130+0000","last_became_active":"2023-11-24T06:32:21.594332+0000","last_became_peered":"2023-11-24T06:32:21.594332+0000","last_unstale":"2023-11-24T06:32:22.599130+0000","last_undegraded":"2023-11-24T06:32:22.599130+0000","last_fullsized":"2023-11-24T06:32:22.599130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:33.324066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626137+0000","last_change":"2023-11-24T06:32:22.616575+0000","last_active":"2023-11-24T06:32:22.626137+0000","last_peered":"2023-11-24T06:32:22.626137+0000","last_clean":"2023-11-24T06:32:22.626137+0000","last_became_active":"2023-11-24T06:32:22.616266+0000","last_became_peered":"2023-11-24T06:32:22.616266+0000","last_unstale":"2023-11-24T06:32:22.626137+0000","last_undegraded":"2023-11-24T06:32:22.626137+0000","last_fullsized":"2023-11-24T06:32:22.626137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:41.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.606999+0000","last_change":"2023-11-24T06:32:21.609153+0000","last_active":"2023-11-24T06:32:22.606999+0000","last_peered":"2023-11-24T06:32:22.606999+0000","last_clean":"2023-11-24T06:32:22.606999+0000","last_became_active":"2023-11-24T06:32:21.608869+0000","last_became_peered":"2023-11-24T06:32:21.608869+0000","last_unstale":"2023-11-24T06:32:22.606999+0000","last_undegraded":"2023-11-24T06:32:22.606999+0000","last_fullsized":"2023-11-24T06:32:22.606999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:47.806699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.633354+0000","last_change":"2023-11-24T06:32:22.627512+0000","last_active":"2023-11-24T06:32:22.633354+0000","last_peered":"2023-11-24T06:32:22.633354+0000","last_clean":"2023-11-24T06:32:22.633354+0000","last_became_active":"2023-11-24T06:32:22.627143+0000","last_became_peered":"2023-11-24T06:32:22.627143+0000","last_unstale":"2023-11-24T06:32:22.633354+0000","last_undegraded":"2023-11-24T06:32:22.633354+0000","last_fullsized":"2023-11-24T06:32:22.633354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:59.923786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638182+0000","last_change":"2023-11-24T06:32:21.597547+0000","last_active":"2023-11-24T06:32:22.638182+0000","last_peered":"2023-11-24T06:32:22.638182+0000","last_clean":"2023-11-24T06:32:22.638182+0000","last_became_active":"2023-11-24T06:32:21.597201+0000","last_became_peered":"2023-11-24T06:32:21.597201+0000","last_unstale":"2023-11-24T06:32:22.638182+0000","last_undegraded":"2023-11-24T06:32:22.638182+0000","last_fullsized":"2023-11-24T06:32:22.638182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:47.893873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627068+0000","last_change":"2023-11-24T06:32:22.611556+0000","last_active":"2023-11-24T06:32:22.627068+0000","last_peered":"2023-11-24T06:32:22.627068+0000","last_clean":"2023-11-24T06:32:22.627068+0000","last_became_active":"2023-11-24T06:32:22.611203+0000","last_became_peered":"2023-11-24T06:32:22.611203+0000","last_unstale":"2023-11-24T06:32:22.627068+0000","last_undegraded":"2023-11-24T06:32:22.627068+0000","last_fullsized":"2023-11-24T06:32:22.627068+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:19.726542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.641304+0000","last_change":"2023-11-24T06:32:21.600703+0000","last_active":"2023-11-24T06:32:22.641304+0000","last_peered":"2023-11-24T06:32:22.641304+0000","last_clean":"2023-11-24T06:32:22.641304+0000","last_became_active":"2023-11-24T06:32:21.599490+0000","last_became_peered":"2023-11-24T06:32:21.599490+0000","last_unstale":"2023-11-24T06:32:22.641304+0000","last_undegraded":"2023-11-24T06:32:22.641304+0000","last_fullsized":"2023-11-24T06:32:22.641304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:20.841168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.623886+0000","last_change":"2023-11-24T06:32:22.612959+0000","last_active":"2023-11-24T06:32:22.623886+0000","last_peered":"2023-11-24T06:32:22.623886+0000","last_clean":"2023-11-24T06:32:22.623886+0000","last_became_active":"2023-11-24T06:32:22.612662+0000","last_became_peered":"2023-11-24T06:32:22.612662+0000","last_unstale":"2023-11-24T06:32:22.623886+0000","last_undegraded":"2023-11-24T06:32:22.623886+0000","last_fullsized":"2023-11-24T06:32:22.623886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:23:44.553173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.637305+0000","last_change":"2023-11-24T06:32:21.596710+0000","last_active":"2023-11-24T06:32:22.637305+0000","last_peered":"2023-11-24T06:32:22.637305+0000","last_clean":"2023-11-24T06:32:22.637305+0000","last_became_active":"2023-11-24T06:32:21.596416+0000","last_became_peered":"2023-11-24T06:32:21.596416+0000","last_unstale":"2023-11-24T06:32:22.637305+0000","last_undegraded":"2023-11-24T06:32:22.637305+0000","last_fullsized":"2023-11-24T06:32:22.637305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:21.827281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624041+0000","last_change":"2023-11-24T06:32:22.609593+0000","last_active":"2023-11-24T06:32:22.624041+0000","last_peered":"2023-11-24T06:32:22.624041+0000","last_clean":"2023-11-24T06:32:22.624041+0000","last_became_active":"2023-11-24T06:32:22.609293+0000","last_became_peered":"2023-11-24T06:32:22.609293+0000","last_unstale":"2023-11-24T06:32:22.624041+0000","last_undegraded":"2023-11-24T06:32:22.624041+0000","last_fullsized":"2023-11-24T06:32:22.624041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:24.940269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.601567+0000","last_change":"2023-11-24T06:32:21.607839+0000","last_active":"2023-11-24T06:32:22.601567+0000","last_peered":"2023-11-24T06:32:22.601567+0000","last_clean":"2023-11-24T06:32:22.601567+0000","last_became_active":"2023-11-24T06:32:21.607544+0000","last_became_peered":"2023-11-24T06:32:21.607544+0000","last_unstale":"2023-11-24T06:32:22.601567+0000","last_undegraded":"2023-11-24T06:32:22.601567+0000","last_fullsized":"2023-11-24T06:32:22.601567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:54.799075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.629462+0000","last_change":"2023-11-24T06:32:22.624055+0000","last_active":"2023-11-24T06:32:22.629462+0000","last_peered":"2023-11-24T06:32:22.629462+0000","last_clean":"2023-11-24T06:32:22.629462+0000","last_became_active":"2023-11-24T06:32:22.622631+0000","last_became_peered":"2023-11-24T06:32:22.622631+0000","last_unstale":"2023-11-24T06:32:22.629462+0000","last_undegraded":"2023-11-24T06:32:22.629462+0000","last_fullsized":"2023-11-24T06:32:22.629462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:41.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.596998+0000","last_change":"2023-11-24T06:32:21.595132+0000","last_active":"2023-11-24T06:32:22.596998+0000","last_peered":"2023-11-24T06:32:22.596998+0000","last_clean":"2023-11-24T06:32:22.596998+0000","last_became_active":"2023-11-24T06:32:21.594635+0000","last_became_peered":"2023-11-24T06:32:21.594635+0000","last_unstale":"2023-11-24T06:32:22.596998+0000","last_undegraded":"2023-11-24T06:32:22.596998+0000","last_fullsized":"2023-11-24T06:32:22.596998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:39.376576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627180+0000","last_change":"2023-11-24T06:32:22.614403+0000","last_active":"2023-11-24T06:32:22.627180+0000","last_peered":"2023-11-24T06:32:22.627180+0000","last_clean":"2023-11-24T06:32:22.627180+0000","last_became_active":"2023-11-24T06:32:22.614085+0000","last_became_peered":"2023-11-24T06:32:22.614085+0000","last_unstale":"2023-11-24T06:32:22.627180+0000","last_undegraded":"2023-11-24T06:32:22.627180+0000","last_fullsized":"2023-11-24T06:32:22.627180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:20.586619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.640117+0000","last_change":"2023-11-24T06:32:21.600979+0000","last_active":"2023-11-24T06:32:22.640117+0000","last_peered":"2023-11-24T06:32:22.640117+0000","last_clean":"2023-11-24T06:32:22.640117+0000","last_became_active":"2023-11-24T06:32:21.600688+0000","last_became_peered":"2023-11-24T06:32:21.600688+0000","last_unstale":"2023-11-24T06:32:22.640117+0000","last_undegraded":"2023-11-24T06:32:22.640117+0000","last_fullsized":"2023-11-24T06:32:22.640117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:25.671404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.609682+0000","last_change":"2023-11-24T06:32:22.605856+0000","last_active":"2023-11-24T06:32:22.609682+0000","last_peered":"2023-11-24T06:32:22.609682+0000","last_clean":"2023-11-24T06:32:22.609682+0000","last_became_active":"2023-11-24T06:32:22.605274+0000","last_became_peered":"2023-11-24T06:32:22.605274+0000","last_unstale":"2023-11-24T06:32:22.609682+0000","last_undegraded":"2023-11-24T06:32:22.609682+0000","last_fullsized":"2023-11-24T06:32:22.609682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:17.392040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639014+0000","last_change":"2023-11-24T06:32:21.607013+0000","last_active":"2023-11-24T06:32:22.639014+0000","last_peered":"2023-11-24T06:32:22.639014+0000","last_clean":"2023-11-24T06:32:22.639014+0000","last_became_active":"2023-11-24T06:32:21.606628+0000","last_became_peered":"2023-11-24T06:32:21.606628+0000","last_unstale":"2023-11-24T06:32:22.639014+0000","last_undegraded":"2023-11-24T06:32:22.639014+0000","last_fullsized":"2023-11-24T06:32:22.639014+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:56.645244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626692+0000","last_change":"2023-11-24T06:32:22.617330+0000","last_active":"2023-11-24T06:32:22.626692+0000","last_peered":"2023-11-24T06:32:22.626692+0000","last_clean":"2023-11-24T06:32:22.626692+0000","last_became_active":"2023-11-24T06:32:22.617030+0000","last_became_peered":"2023-11-24T06:32:22.617030+0000","last_unstale":"2023-11-24T06:32:22.626692+0000","last_undegraded":"2023-11-24T06:32:22.626692+0000","last_fullsized":"2023-11-24T06:32:22.626692+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:10.575952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.639376+0000","last_change":"2023-11-24T06:32:21.608292+0000","last_active":"2023-11-24T06:32:22.639376+0000","last_peered":"2023-11-24T06:32:22.639376+0000","last_clean":"2023-11-24T06:32:22.639376+0000","last_became_active":"2023-11-24T06:32:21.607954+0000","last_became_peered":"2023-11-24T06:32:21.607954+0000","last_unstale":"2023-11-24T06:32:22.639376+0000","last_undegraded":"2023-11-24T06:32:22.639376+0000","last_fullsized":"2023-11-24T06:32:22.639376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:48:46.197556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.612500+0000","last_change":"2023-11-24T06:32:22.603166+0000","last_active":"2023-11-24T06:32:22.612500+0000","last_peered":"2023-11-24T06:32:22.612500+0000","last_clean":"2023-11-24T06:32:22.612500+0000","last_became_active":"2023-11-24T06:32:22.602632+0000","last_became_peered":"2023-11-24T06:32:22.602632+0000","last_unstale":"2023-11-24T06:32:22.612500+0000","last_undegraded":"2023-11-24T06:32:22.612500+0000","last_fullsized":"2023-11-24T06:32:22.612500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:39.924600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.635334+0000","last_change":"2023-11-24T06:32:21.604015+0000","last_active":"2023-11-24T06:32:22.635334+0000","last_peered":"2023-11-24T06:32:22.635334+0000","last_clean":"2023-11-24T06:32:22.635334+0000","last_became_active":"2023-11-24T06:32:21.603629+0000","last_became_peered":"2023-11-24T06:32:21.603629+0000","last_unstale":"2023-11-24T06:32:22.635334+0000","last_undegraded":"2023-11-24T06:32:22.635334+0000","last_fullsized":"2023-11-24T06:32:22.635334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:36.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619057+0000","last_change":"2023-11-24T06:32:22.606983+0000","last_active":"2023-11-24T06:32:22.619057+0000","last_peered":"2023-11-24T06:32:22.619057+0000","last_clean":"2023-11-24T06:32:22.619057+0000","last_became_active":"2023-11-24T06:32:22.605795+0000","last_became_peered":"2023-11-24T06:32:22.605795+0000","last_unstale":"2023-11-24T06:32:22.619057+0000","last_undegraded":"2023-11-24T06:32:22.619057+0000","last_fullsized":"2023-11-24T06:32:22.619057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:40:10.742205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.599647+0000","last_change":"2023-11-24T06:32:21.606994+0000","last_active":"2023-11-24T06:32:22.599647+0000","last_peered":"2023-11-24T06:32:22.599647+0000","last_clean":"2023-11-24T06:32:22.599647+0000","last_became_active":"2023-11-24T06:32:21.606604+0000","last_became_peered":"2023-11-24T06:32:21.606604+0000","last_unstale":"2023-11-24T06:32:22.599647+0000","last_undegraded":"2023-11-24T06:32:22.599647+0000","last_fullsized":"2023-11-24T06:32:22.599647+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:01:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.620164+0000","last_change":"2023-11-24T06:32:22.607821+0000","last_active":"2023-11-24T06:32:22.620164+0000","last_peered":"2023-11-24T06:32:22.620164+0000","last_clean":"2023-11-24T06:32:22.620164+0000","last_became_active":"2023-11-24T06:32:22.607504+0000","last_became_peered":"2023-11-24T06:32:22.607504+0000","last_unstale":"2023-11-24T06:32:22.620164+0000","last_undegraded":"2023-11-24T06:32:22.620164+0000","last_fullsized":"2023-11-24T06:32:22.620164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:05.517929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.601778+0000","last_change":"2023-11-24T06:32:21.604959+0000","last_active":"2023-11-24T06:32:22.601778+0000","last_peered":"2023-11-24T06:32:22.601778+0000","last_clean":"2023-11-24T06:32:22.601778+0000","last_became_active":"2023-11-24T06:32:21.604032+0000","last_became_peered":"2023-11-24T06:32:21.604032+0000","last_unstale":"2023-11-24T06:32:22.601778+0000","last_undegraded":"2023-11-24T06:32:22.601778+0000","last_fullsized":"2023-11-24T06:32:22.601778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:44.973032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.625091+0000","last_change":"2023-11-24T06:32:22.618801+0000","last_active":"2023-11-24T06:32:22.625091+0000","last_peered":"2023-11-24T06:32:22.625091+0000","last_clean":"2023-11-24T06:32:22.625091+0000","last_became_active":"2023-11-24T06:32:22.617801+0000","last_became_peered":"2023-11-24T06:32:22.617801+0000","last_unstale":"2023-11-24T06:32:22.625091+0000","last_undegraded":"2023-11-24T06:32:22.625091+0000","last_fullsized":"2023-11-24T06:32:22.625091+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:02.976397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.597149+0000","last_change":"2023-11-24T06:32:21.594914+0000","last_active":"2023-11-24T06:32:22.597149+0000","last_peered":"2023-11-24T06:32:22.597149+0000","last_clean":"2023-11-24T06:32:22.597149+0000","last_became_active":"2023-11-24T06:32:21.594271+0000","last_became_peered":"2023-11-24T06:32:21.594271+0000","last_unstale":"2023-11-24T06:32:22.597149+0000","last_undegraded":"2023-11-24T06:32:22.597149+0000","last_fullsized":"2023-11-24T06:32:22.597149+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:33.324066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.619183+0000","last_change":"2023-11-24T06:32:22.613161+0000","last_active":"2023-11-24T06:32:22.619183+0000","last_peered":"2023-11-24T06:32:22.619183+0000","last_clean":"2023-11-24T06:32:22.619183+0000","last_became_active":"2023-11-24T06:32:22.612854+0000","last_became_peered":"2023-11-24T06:32:22.612854+0000","last_unstale":"2023-11-24T06:32:22.619183+0000","last_undegraded":"2023-11-24T06:32:22.619183+0000","last_fullsized":"2023-11-24T06:32:22.619183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:21.444004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.603541+0000","last_change":"2023-11-24T06:32:21.593591+0000","last_active":"2023-11-24T06:32:22.603541+0000","last_peered":"2023-11-24T06:32:22.603541+0000","last_clean":"2023-11-24T06:32:22.603541+0000","last_became_active":"2023-11-24T06:32:21.593264+0000","last_became_peered":"2023-11-24T06:32:21.593264+0000","last_unstale":"2023-11-24T06:32:22.603541+0000","last_undegraded":"2023-11-24T06:32:22.603541+0000","last_fullsized":"2023-11-24T06:32:22.603541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:20.649413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624516+0000","last_change":"2023-11-24T06:32:22.613718+0000","last_active":"2023-11-24T06:32:22.624516+0000","last_peered":"2023-11-24T06:32:22.624516+0000","last_clean":"2023-11-24T06:32:22.624516+0000","last_became_active":"2023-11-24T06:32:22.613401+0000","last_became_peered":"2023-11-24T06:32:22.613401+0000","last_unstale":"2023-11-24T06:32:22.624516+0000","last_undegraded":"2023-11-24T06:32:22.624516+0000","last_fullsized":"2023-11-24T06:32:22.624516+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:43:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.638924+0000","last_change":"2023-11-24T06:32:21.605993+0000","last_active":"2023-11-24T06:32:22.638924+0000","last_peered":"2023-11-24T06:32:22.638924+0000","last_clean":"2023-11-24T06:32:22.638924+0000","last_became_active":"2023-11-24T06:32:21.605707+0000","last_became_peered":"2023-11-24T06:32:21.605707+0000","last_unstale":"2023-11-24T06:32:22.638924+0000","last_undegraded":"2023-11-24T06:32:22.638924+0000","last_fullsized":"2023-11-24T06:32:22.638924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:13:21.672586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626296+0000","last_change":"2023-11-24T06:32:22.619009+0000","last_active":"2023-11-24T06:32:22.626296+0000","last_peered":"2023-11-24T06:32:22.626296+0000","last_clean":"2023-11-24T06:32:22.626296+0000","last_became_active":"2023-11-24T06:32:22.618693+0000","last_became_peered":"2023-11-24T06:32:22.618693+0000","last_unstale":"2023-11-24T06:32:22.626296+0000","last_undegraded":"2023-11-24T06:32:22.626296+0000","last_fullsized":"2023-11-24T06:32:22.626296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:43.292138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.598346+0000","last_change":"2023-11-24T06:32:21.593277+0000","last_active":"2023-11-24T06:32:22.598346+0000","last_peered":"2023-11-24T06:32:22.598346+0000","last_clean":"2023-11-24T06:32:22.598346+0000","last_became_active":"2023-11-24T06:32:21.592976+0000","last_became_peered":"2023-11-24T06:32:21.592976+0000","last_unstale":"2023-11-24T06:32:22.598346+0000","last_undegraded":"2023-11-24T06:32:22.598346+0000","last_fullsized":"2023-11-24T06:32:22.598346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:06.404766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626611+0000","last_change":"2023-11-24T06:32:22.618309+0000","last_active":"2023-11-24T06:32:22.626611+0000","last_peered":"2023-11-24T06:32:22.626611+0000","last_clean":"2023-11-24T06:32:22.626611+0000","last_became_active":"2023-11-24T06:32:22.616733+0000","last_became_peered":"2023-11-24T06:32:22.616733+0000","last_unstale":"2023-11-24T06:32:22.626611+0000","last_undegraded":"2023-11-24T06:32:22.626611+0000","last_fullsized":"2023-11-24T06:32:22.626611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:46:44.828074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.598355+0000","last_change":"2023-11-24T06:32:21.597210+0000","last_active":"2023-11-24T06:32:22.598355+0000","last_peered":"2023-11-24T06:32:22.598355+0000","last_clean":"2023-11-24T06:32:22.598355+0000","last_became_active":"2023-11-24T06:32:21.596929+0000","last_became_peered":"2023-11-24T06:32:21.596929+0000","last_unstale":"2023-11-24T06:32:22.598355+0000","last_undegraded":"2023-11-24T06:32:22.598355+0000","last_fullsized":"2023-11-24T06:32:22.598355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:16:42.874871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.626197+0000","last_change":"2023-11-24T06:32:22.614007+0000","last_active":"2023-11-24T06:32:22.626197+0000","last_peered":"2023-11-24T06:32:22.626197+0000","last_clean":"2023-11-24T06:32:22.626197+0000","last_became_active":"2023-11-24T06:32:22.613719+0000","last_became_peered":"2023-11-24T06:32:22.613719+0000","last_unstale":"2023-11-24T06:32:22.626197+0000","last_undegraded":"2023-11-24T06:32:22.626197+0000","last_fullsized":"2023-11-24T06:32:22.626197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.343143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.603646+0000","last_change":"2023-11-24T06:32:21.594654+0000","last_active":"2023-11-24T06:32:22.603646+0000","last_peered":"2023-11-24T06:32:22.603646+0000","last_clean":"2023-11-24T06:32:22.603646+0000","last_became_active":"2023-11-24T06:32:21.594436+0000","last_became_peered":"2023-11-24T06:32:21.594436+0000","last_unstale":"2023-11-24T06:32:22.603646+0000","last_undegraded":"2023-11-24T06:32:22.603646+0000","last_fullsized":"2023-11-24T06:32:22.603646+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:59:16.379006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.627494+0000","last_change":"2023-11-24T06:32:22.618903+0000","last_active":"2023-11-24T06:32:22.627494+0000","last_peered":"2023-11-24T06:32:22.627494+0000","last_clean":"2023-11-24T06:32:22.627494+0000","last_became_active":"2023-11-24T06:32:22.618632+0000","last_became_peered":"2023-11-24T06:32:22.618632+0000","last_unstale":"2023-11-24T06:32:22.627494+0000","last_undegraded":"2023-11-24T06:32:22.627494+0000","last_fullsized":"2023-11-24T06:32:22.627494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:30.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595979+0000","last_change":"2023-11-24T06:32:21.593103+0000","last_active":"2023-11-24T06:32:22.595979+0000","last_peered":"2023-11-24T06:32:22.595979+0000","last_clean":"2023-11-24T06:32:22.595979+0000","last_became_active":"2023-11-24T06:32:21.592769+0000","last_became_peered":"2023-11-24T06:32:21.592769+0000","last_unstale":"2023-11-24T06:32:22.595979+0000","last_undegraded":"2023-11-24T06:32:22.595979+0000","last_fullsized":"2023-11-24T06:32:22.595979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:26.000589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.617004+0000","last_change":"2023-11-24T06:32:22.610398+0000","last_active":"2023-11-24T06:32:22.617004+0000","last_peered":"2023-11-24T06:32:22.617004+0000","last_clean":"2023-11-24T06:32:22.617004+0000","last_became_active":"2023-11-24T06:32:22.610064+0000","last_became_peered":"2023-11-24T06:32:22.610064+0000","last_unstale":"2023-11-24T06:32:22.617004+0000","last_undegraded":"2023-11-24T06:32:22.617004+0000","last_fullsized":"2023-11-24T06:32:22.617004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:03.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.595385+0000","last_change":"2023-11-24T06:32:21.609986+0000","last_active":"2023-11-24T06:32:22.595385+0000","last_peered":"2023-11-24T06:32:22.595385+0000","last_clean":"2023-11-24T06:32:22.595385+0000","last_became_active":"2023-11-24T06:32:21.609755+0000","last_became_peered":"2023-11-24T06:32:21.609755+0000","last_unstale":"2023-11-24T06:32:22.595385+0000","last_undegraded":"2023-11-24T06:32:22.595385+0000","last_fullsized":"2023-11-24T06:32:22.595385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:58.917321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624064+0000","last_change":"2023-11-24T06:32:22.619665+0000","last_active":"2023-11-24T06:32:22.624064+0000","last_peered":"2023-11-24T06:32:22.624064+0000","last_clean":"2023-11-24T06:32:22.624064+0000","last_became_active":"2023-11-24T06:32:22.618313+0000","last_became_peered":"2023-11-24T06:32:22.618313+0000","last_unstale":"2023-11-24T06:32:22.624064+0000","last_undegraded":"2023-11-24T06:32:22.624064+0000","last_fullsized":"2023-11-24T06:32:22.624064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:46.850581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.596366+0000","last_change":"2023-11-24T06:32:21.601020+0000","last_active":"2023-11-24T06:32:22.596366+0000","last_peered":"2023-11-24T06:32:22.596366+0000","last_clean":"2023-11-24T06:32:22.596366+0000","last_became_active":"2023-11-24T06:32:21.600660+0000","last_became_peered":"2023-11-24T06:32:21.600660+0000","last_unstale":"2023-11-24T06:32:22.596366+0000","last_undegraded":"2023-11-24T06:32:22.596366+0000","last_fullsized":"2023-11-24T06:32:22.596366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:08.150273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.624870+0000","last_change":"2023-11-24T06:32:22.617977+0000","last_active":"2023-11-24T06:32:22.624870+0000","last_peered":"2023-11-24T06:32:22.624870+0000","last_clean":"2023-11-24T06:32:22.624870+0000","last_became_active":"2023-11-24T06:32:22.617698+0000","last_became_peered":"2023-11-24T06:32:22.617698+0000","last_unstale":"2023-11-24T06:32:22.624870+0000","last_undegraded":"2023-11-24T06:32:22.624870+0000","last_fullsized":"2023-11-24T06:32:22.624870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:17.244728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.610669+0000","last_change":"2023-11-24T06:32:21.601447+0000","last_active":"2023-11-24T06:32:22.610669+0000","last_peered":"2023-11-24T06:32:22.610669+0000","last_clean":"2023-11-24T06:32:22.610669+0000","last_became_active":"2023-11-24T06:32:21.600786+0000","last_became_peered":"2023-11-24T06:32:21.600786+0000","last_unstale":"2023-11-24T06:32:22.610669+0000","last_undegraded":"2023-11-24T06:32:22.610669+0000","last_fullsized":"2023-11-24T06:32:22.610669+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:48:46.197556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.616634+0000","last_change":"2023-11-24T06:32:22.610420+0000","last_active":"2023-11-24T06:32:22.616634+0000","last_peered":"2023-11-24T06:32:22.616634+0000","last_clean":"2023-11-24T06:32:22.616634+0000","last_became_active":"2023-11-24T06:32:22.610136+0000","last_became_peered":"2023-11-24T06:32:22.610136+0000","last_unstale":"2023-11-24T06:32:22.616634+0000","last_undegraded":"2023-11-24T06:32:22.616634+0000","last_fullsized":"2023-11-24T06:32:22.616634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:21.572711+0000","last_clean_scrub_stamp":"2023-11-24T06:32:21.572711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:16.407250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-24T06:32:22.637708+0000","last_change":"2023-11-24T06:32:21.602165+0000","last_active":"2023-11-24T06:32:22.637708+0000","last_peered":"2023-11-24T06:32:22.637708+0000","last_clean":"2023-11-24T06:32:22.637708+0000","last_became_active":"2023-11-24T06:32:21.601861+0000","last_became_peered":"2023-11-24T06:32:21.601861+0000","last_unstale":"2023-11-24T06:32:22.637708+0000","last_undegraded":"2023-11-24T06:32:22.637708+0000","last_fullsized":"2023-11-24T06:32:22.637708+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:20.566246+0000","last_clean_scrub_stamp":"2023-11-24T06:32:20.566246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:16.385574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-24T06:32:21.589797+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:32:21.589797+0000","last_peered":"2023-11-24T06:32:21.589797+0000","last_clean":"2023-11-24T06:32:21.589797+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:32:21.589797+0000","last_undegraded":"2023-11-24T06:32:21.589797+0000","last_fullsized":"2023-11-24T06:32:21.589797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":956140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76700000000000002,"5min":1.619,"15min":1.619},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.417,"15min":1.417},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90900000000000003,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98899999999999999,"5min":1.7,"15min":1.7},"last":0.628}]},{"osd":2,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0049999999999999,"5min":1.96,"15min":1.96},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96599999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.505}]},{"osd":3,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95699999999999996,"5min":1.55,"15min":1.55},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":0.996,"15min":0.996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.47299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92600000000000005,"5min":1,"15min":1},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:31:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94299999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":365248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89100000000000001,"5min":2.637,"15min":2.637},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0720000000000001,"5min":1.619,"15min":1.619},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93000000000000005,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.745}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97499999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.497}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0980000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.119,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.036,"15min":1.036},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":868352,"data_stored":365246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":1.278,"15min":1.278},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":1.919,"15min":1.919},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91000000000000003,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95899999999999996,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.04,"5min":1.998,"15min":1.998},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84899999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97399999999999998,"5min":1.462,"15min":1.462},"last":0.76000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.37,"15min":0.37},"max":{"1min":0.86099999999999999,"5min":1.165,"15min":1.165},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88500000000000001,"5min":1.022,"15min":1.022},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95199999999999996,"5min":1.202,"15min":1.202},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86099999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.248,"15min":1.248},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.079,"15min":1.079},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.149,"15min":1.149},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.62,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63100000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64900000000000002,"5min":1.095,"15min":1.095},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.753},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97099999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.497},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0109999999999999,"5min":1.264,"15min":1.264},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91600000000000004,"5min":1.286,"15min":1.286},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:31:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.409,"15min":1.409},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51500000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98699999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.56699999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.501}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0609999999999999,"5min":1.075,"15min":1.075},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.65700000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3400000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97799999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.27,"15min":1.27},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.3759999999999999,"5min":1.389,"15min":1.389},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1220000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.101,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.64300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3049999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.82299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":367384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.02,"15min":1.02},"last":0.629},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.754},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93899999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.032,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.749}]},{"osd":7,"last update":"Fri Nov 24 06:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98099999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1454080,"data_stored":954555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.48699999999999999,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.75900000000000001,"5min":1.393,"15min":1.393},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81899999999999995,"5min":1.319,"15min":1.319},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.879,"5min":1.589,"15min":1.589},"last":0.75}]},{"osd":4,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.014,"5min":1.206,"15min":1.206},"last":1.462},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95899999999999996,"5min":1.778,"15min":1.778},"last":1.2849999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79600000000000004,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92700000000000005,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92900000000000005,"5min":1.496,"15min":1.496},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82199999999999995,"15min":0.83699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95299999999999996,"5min":1.454,"15min":1.454},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.514}]},{"osd":7,"last update":"Fri Nov 24 06:31:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.278,"15min":1.278},"last":1.3320000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93400000000000005,"5min":1.829,"15min":1.829},"last":1.446}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:32:27.062 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:32:27.063 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:32:27.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4acafe640 1 Processor -- start 2023-11-24T06:32:27.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4acafe640 1 -- start start 2023-11-24T06:32:27.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4acafe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4a80725f0 0x7fe4a806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4acafe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a806cb70 con 0x7fe4a80ca000 2023-11-24T06:32:27.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4acafe640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a806ce10 con 0x7fe4a80cba80 2023-11-24T06:32:27.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4acafe640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80ca770 con 0x7fe4a80725f0 2023-11-24T06:32:27.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe4a80ca000 0x7fe4a8164670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:36526/0 (socket says 172.21.15.143:36526) 2023-11-24T06:32:27.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 -- 172.21.15.143:0/2010556720 learned_addr learned my addr 172.21.15.143:0/2010556720 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:27.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a659c640 1 --2- 172.21.15.143:0/2010556720 >> v2:172.21.15.146:3300/0 conn(0x7fe4a80725f0 0x7fe4a806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902328843 0 0) 0x7fe4a806cb70 con 0x7fe4a80ca000 2023-11-24T06:32:27.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe494005740 con 0x7fe4a80ca000 2023-11-24T06:32:27.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992083758 0 0) 0x7fe4a806ce10 con 0x7fe4a80cba80 2023-11-24T06:32:27.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a806cb70 con 0x7fe4a80cba80 2023-11-24T06:32:27.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057511917 0 0) 0x7fe494005740 con 0x7fe4a80ca000 2023-11-24T06:32:27.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 >> v2:172.21.15.146:3300/0 conn(0x7fe4a80725f0 msgr2=0x7fe4a806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:27.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 --2- 172.21.15.143:0/2010556720 >> v2:172.21.15.146:3300/0 conn(0x7fe4a80725f0 0x7fe4a806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 >> v1:172.21.15.146:6789/0 conn(0x7fe4a80cba80 legacy=0x7fe4a80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a806d0f0 con 0x7fe4a80ca000 2023-11-24T06:32:27.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fe4a0001a00 con 0x7fe4a80ca000 2023-11-24T06:32:27.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 >> v1:172.21.15.143:6789/0 conn(0x7fe4a80ca000 legacy=0x7fe4a8164670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe494005d70 0x7fe494006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940069e0 0x7fe494006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940073a0 0x7fe49400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80ca770 con 0x7fe4940073a0 2023-11-24T06:32:27.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49400e1c0 con 0x7fe4940069e0 2023-11-24T06:32:27.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49400e380 con 0x7fe494005d70 2023-11-24T06:32:27.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940073a0 0x7fe49400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a659c640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe494005d70 0x7fe494006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe49dd9b640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940069e0 0x7fe494006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 -- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe494005d70 msgr2=0x7fe494006170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:27.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe494005d70 0x7fe494006170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 -- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940069e0 msgr2=0x7fe494006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:27.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940069e0 0x7fe494006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.241+0000 7fe4a6d9d640 1 -- 172.21.15.143:0/2010556720 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494005740 con 0x7fe4940073a0 2023-11-24T06:32:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4a6d9d640 1 -- 172.21.15.143:0/2010556720 reap_dead start 2023-11-24T06:32:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4a6d9d640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940073a0 0x7fe49400dba0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000a710 tx=0x7fe4a001d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b443f3bbe1606e71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:27.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00ad630 con 0x7fe4940073a0 2023-11-24T06:32:27.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a00a8070 con 0x7fe4940073a0 2023-11-24T06:32:27.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4a5d9b640 1 -- 172.21.15.143:0/2010556720 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00ada10 con 0x7fe4940073a0 2023-11-24T06:32:27.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 -- 172.21.15.143:0/2010556720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940073a0 msgr2=0x7fe49400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940073a0 0x7fe49400dba0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000a710 tx=0x7fe4a001d200 comp rx=0 tx=0).stop 2023-11-24T06:32:27.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 -- 172.21.15.143:0/2010556720 shutdown_connections 2023-11-24T06:32:27.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 --2- 172.21.15.143:0/2010556720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940073a0 0x7fe49400dba0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 -- 172.21.15.143:0/2010556720 >> 172.21.15.143:0/2010556720 conn(0x7fe4a80b0bf0 msgr2=0x7fe4a80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 -- 172.21.15.143:0/2010556720 shutdown_connections 2023-11-24T06:32:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.245+0000 7fe4acafe640 1 -- 172.21.15.143:0/2010556720 wait complete. 2023-11-24T06:32:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 Processor -- start 2023-11-24T06:32:27.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 -- start start 2023-11-24T06:32:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940073a0 0x7fe4a8157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 0x7fe4a81e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a815a300 0x7fe4a815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8157c70 con 0x7fe4a80b4520 2023-11-24T06:32:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a815cfb0 con 0x7fe4940073a0 2023-11-24T06:32:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a815acc0 con 0x7fe4a815a300 2023-11-24T06:32:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 0x7fe4a81e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 0x7fe4a81e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38426/0 (socket says 172.21.15.143:38426) 2023-11-24T06:32:27.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 -- 172.21.15.143:0/4118340964 learned_addr learned my addr 172.21.15.143:0/4118340964 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4a659c640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940073a0 0x7fe4a8157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4a6d9d640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a815a300 0x7fe4a815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 -- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a815a300 msgr2=0x7fe4a815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a815a300 0x7fe4a815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 -- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940073a0 msgr2=0x7fe4a8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940073a0 0x7fe4a8157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 -- 172.21.15.143:0/4118340964 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a81e3170 con 0x7fe4a80b4520 2023-11-24T06:32:27.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4a659c640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940073a0 0x7fe4a8157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:27.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49dd9b640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 0x7fe4a81e5120 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe49800f770 tx=0x7fe49800fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:27.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498005110 con 0x7fe4a80b4520 2023-11-24T06:32:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498005270 con 0x7fe4a80b4520 2023-11-24T06:32:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a81e3410 con 0x7fe4a80b4520 2023-11-24T06:32:27.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498007030 con 0x7fe4a80b4520 2023-11-24T06:32:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.249+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a81e39d0 con 0x7fe4a80b4520 2023-11-24T06:32:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.253+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a81e3bf0 con 0x7fe4a80b4520 2023-11-24T06:32:27.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.253+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fe4980073a0 con 0x7fe4a80b4520 2023-11-24T06:32:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.253+0000 7fe49f7fe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066890 0x7fe488068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.253+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe4980841f0 con 0x7fe4a80b4520 2023-11-24T06:32:27.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.253+0000 7fe4a659c640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066890 0x7fe488068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.253+0000 7fe4a659c640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066890 0x7fe488068d50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe4a81e81b0 tx=0x7fe490008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:27.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.257+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe498051070 con 0x7fe4a80b4520 2023-11-24T06:32:27.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.457+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe4a809d250 con 0x7fe4a80b4520 2023-11-24T06:32:27.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe49f7fe640 1 -- 172.21.15.143:0/4118340964 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe498054690 con 0x7fe4a80b4520 2023-11-24T06:32:27.467 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-11-24T06:32:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:32:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: caps mds = "allow" 2023-11-24T06:32:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: caps mon = "allow r" 2023-11-24T06:32:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:32:27.469 INFO:teuthology.orchestra.run.smithi143.stderr:updated caps for client.0 2023-11-24T06:32:27.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066890 msgr2=0x7fe488068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066890 0x7fe488068d50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe4a81e81b0 tx=0x7fe490008040 comp rx=0 tx=0).stop 2023-11-24T06:32:27.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 msgr2=0x7fe4a81e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 0x7fe4a81e5120 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe49800f770 tx=0x7fe49800fc30 comp rx=0 tx=0).stop 2023-11-24T06:32:27.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 shutdown_connections 2023-11-24T06:32:27.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe488066890 0x7fe488068d50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a815a300 0x7fe4a815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4a80b4520 0x7fe4a81e5120 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 --2- 172.21.15.143:0/4118340964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4940073a0 0x7fe4a8157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 >> 172.21.15.143:0/4118340964 conn(0x7fe4a80b0bf0 msgr2=0x7fe4a81594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:27.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 shutdown_connections 2023-11-24T06:32:27.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.461+0000 7fe4acafe640 1 -- 172.21.15.143:0/4118340964 wait complete. 2023-11-24T06:32:27.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:27.573 INFO:tasks.ceph.mds.c.smithi143.stderr:2023-11-24T06:32:27.565+0000 7fe5570e6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:32:27.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 Processor -- start 2023-11-24T06:32:27.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 -- start start 2023-11-24T06:32:27.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4614143a90 0x7f461415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f461415a6b0 0x7f461406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461415b100 con 0x7f461415ab60 2023-11-24T06:32:27.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461415b3e0 con 0x7f4614143a90 2023-11-24T06:32:27.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461b593640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461415ddb0 con 0x7f461415a6b0 2023-11-24T06:32:27.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4614143a90 0x7f461415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4614143a90 0x7f461415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40790/0 (socket says 172.21.15.143:40790) 2023-11-24T06:32:27.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 -- 172.21.15.143:0/2666367612 learned_addr learned my addr 172.21.15.143:0/2666367612 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:27.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f4619d90640 1 --2- 172.21.15.143:0/2666367612 >> v2:172.21.15.146:3300/0 conn(0x7f461415a6b0 0x7f461406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 -- 172.21.15.143:0/2666367612 >> v2:172.21.15.146:3300/0 conn(0x7f461415a6b0 msgr2=0x7f461406d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:27.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 --2- 172.21.15.143:0/2666367612 >> v2:172.21.15.146:3300/0 conn(0x7f461415a6b0 0x7f461406d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 -- 172.21.15.143:0/2666367612 >> v1:172.21.15.146:6789/0 conn(0x7f461415ab60 legacy=0x7f46140702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:27.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f461a591640 1 -- 172.21.15.143:0/2666367612 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461415e090 con 0x7f4614143a90 2023-11-24T06:32:27.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.621+0000 7f4619d90640 1 --2- 172.21.15.143:0/2666367612 >> v2:172.21.15.146:3300/0 conn(0x7f461415a6b0 0x7f461406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:27.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461a591640 1 --2- 172.21.15.143:0/2666367612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4614143a90 0x7f461415e5b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f46140aea10 tx=0x7f461001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d2ce8fa6a6ddc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:27.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461958f640 1 -- 172.21.15.143:0/2666367612 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100ab600 con 0x7f4614143a90 2023-11-24T06:32:27.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461958f640 1 -- 172.21.15.143:0/2666367612 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100a7050 con 0x7f4614143a90 2023-11-24T06:32:27.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461958f640 1 -- 172.21.15.143:0/2666367612 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100ab980 con 0x7f4614143a90 2023-11-24T06:32:27.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 -- 172.21.15.143:0/2666367612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4614143a90 msgr2=0x7f461415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 --2- 172.21.15.143:0/2666367612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4614143a90 0x7f461415e5b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f46140aea10 tx=0x7f461001c430 comp rx=0 tx=0).stop 2023-11-24T06:32:27.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 -- 172.21.15.143:0/2666367612 shutdown_connections 2023-11-24T06:32:27.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 --2- 172.21.15.143:0/2666367612 >> v2:172.21.15.146:3300/0 conn(0x7f461415a6b0 0x7f461406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 --2- 172.21.15.143:0/2666367612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4614143a90 0x7f461415e5b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 -- 172.21.15.143:0/2666367612 >> 172.21.15.143:0/2666367612 conn(0x7f46140cb840 msgr2=0x7f46140cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:27.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 -- 172.21.15.143:0/2666367612 shutdown_connections 2023-11-24T06:32:27.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.625+0000 7f461b593640 1 -- 172.21.15.143:0/2666367612 wait complete. 2023-11-24T06:32:27.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 Processor -- start 2023-11-24T06:32:27.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 -- start start 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4614143a90 0x7f461413dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 0x7f46140ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f461415ab60 0x7f46140a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140ab060 con 0x7f461415a6b0 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140adb20 con 0x7f4614143a90 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4614143120 con 0x7f461415ab60 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 0x7f46140ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 0x7f46140ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40792/0 (socket says 172.21.15.143:40792) 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 -- 172.21.15.143:0/523992033 learned_addr learned my addr 172.21.15.143:0/523992033 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461ad92640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f461415ab60 0x7f46140a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461a591640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4614143a90 0x7f461413dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 -- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f461415ab60 msgr2=0x7f46140a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f461415ab60 0x7f46140a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 -- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4614143a90 msgr2=0x7f461413dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4614143a90 0x7f461413dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 -- 172.21.15.143:0/523992033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100094d0 con 0x7f461415a6b0 2023-11-24T06:32:27.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f4619d90640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 0x7f46140ad5e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f460400c7f0 tx=0x7f460400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:27.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460400cea0 con 0x7f461415a6b0 2023-11-24T06:32:27.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4604007a30 con 0x7f461415a6b0 2023-11-24T06:32:27.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4614142b60 con 0x7f461415a6b0 2023-11-24T06:32:27.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604007de0 con 0x7f461415a6b0 2023-11-24T06:32:27.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.629+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46140ad0c0 con 0x7f461415a6b0 2023-11-24T06:32:27.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.633+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461404e850 con 0x7f461415a6b0 2023-11-24T06:32:27.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.633+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f46040113f0 con 0x7f461415a6b0 2023-11-24T06:32:27.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.633+0000 7f460affd640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f8066860 0x7f45f8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:27.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.633+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4604084770 con 0x7f461415a6b0 2023-11-24T06:32:27.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.633+0000 7f461a591640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f8066860 0x7f45f8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:27.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.633+0000 7f461a591640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f8066860 0x7f45f8068d20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f46140cea50 tx=0x7f4610009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:27.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.637+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46040515b0 con 0x7f461415a6b0 2023-11-24T06:32:27.823 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.817+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46140a86f0 con 0x7f461415a6b0 2023-11-24T06:32:27.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.817+0000 7f460affd640 1 -- 172.21.15.143:0/523992033 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f4604054bd0 con 0x7f461415a6b0 2023-11-24T06:32:27.824 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:27.825 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:32:21.961215+0000","modified":"2023-11-24T06:32:24.993795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6567":{"gid":6567,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/492061256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":492061256},{"type":"v1","addr":"172.21.15.143:6837","nonce":492061256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:32:27.825 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 44 2023-11-24T06:32:27.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f8066860 msgr2=0x7f45f8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f8066860 0x7f45f8068d20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f46140cea50 tx=0x7f4610009040 comp rx=0 tx=0).stop 2023-11-24T06:32:27.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 msgr2=0x7f46140ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:27.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 0x7f46140ad5e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f460400c7f0 tx=0x7f460400ccb0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.827 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 shutdown_connections 2023-11-24T06:32:27.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f45f8066860 0x7f45f8068d20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f461415ab60 0x7f46140a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f461415a6b0 0x7f46140ad5e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 --2- 172.21.15.143:0/523992033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4614143a90 0x7f461413dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:27.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 >> 172.21.15.143:0/523992033 conn(0x7f46140cb840 msgr2=0x7f46140aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:27.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 shutdown_connections 2023-11-24T06:32:27.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:27.821+0000 7f461b593640 1 -- 172.21.15.143:0/523992033 wait complete. 2023-11-24T06:32:28.247 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:32:21.961215+0000', 'modified': '2023-11-24T06:32:24.993795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6567}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6567': {'gid': 6567, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/492061256', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6836', 'nonce': 492061256}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 492061256}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:32:28.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:32:28.248 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T06:32:28.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07c032640 1 Processor -- start 2023-11-24T06:32:28.387 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07c032640 1 -- start start 2023-11-24T06:32:28.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07c032640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc07416c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.392 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07c032640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0740ccbd0 con 0x7fc0740ce070 2023-11-24T06:32:28.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07c032640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07406dac0 con 0x7fc0740cab60 2023-11-24T06:32:28.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07c032640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07406dda0 con 0x7fc07416a5b0 2023-11-24T06:32:28.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc0795cd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc0740ce070 0x7fc07406cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49874/0 (socket says 172.21.15.143:49874) 2023-11-24T06:32:28.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc0795cd640 1 -- 172.21.15.143:0/1451532993 learned_addr learned my addr 172.21.15.143:0/1451532993 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:28.393 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.381+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc07416c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561978925 0 0) 0x7fc0740ccbd0 con 0x7fc0740ce070 2023-11-24T06:32:28.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc060003530 con 0x7fc0740ce070 2023-11-24T06:32:28.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048669285 0 0) 0x7fc07406dac0 con 0x7fc0740cab60 2023-11-24T06:32:28.394 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0740ccbd0 con 0x7fc0740cab60 2023-11-24T06:32:28.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958629026 0 0) 0x7fc060003530 con 0x7fc0740ce070 2023-11-24T06:32:28.395 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 msgr2=0x7fc07416c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc07416c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 >> v1:172.21.15.146:6789/0 conn(0x7fc0740cab60 legacy=0x7fc0740caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07406e080 con 0x7fc0740ce070 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fc064001680 con 0x7fc0740ce070 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc07416c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 >> v1:172.21.15.143:6789/0 conn(0x7fc0740ce070 legacy=0x7fc07406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc060003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc060004080 0x7fc0600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc060004d10 0x7fc060005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07406dda0 con 0x7fc060004080 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06000ba40 con 0x7fc060004d10 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06000bc00 con 0x7fc07416a5b0 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc0795cd640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc060004080 0x7fc0600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc060004d10 0x7fc060005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc079dce640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc060003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc0795cd640 1 -- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 msgr2=0x7fc060003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc0795cd640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc07416a5b0 0x7fc060003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc0795cd640 1 -- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc060004d10 msgr2=0x7fc060005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc0795cd640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc060004d10 0x7fc060005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.385+0000 7fc0795cd640 1 -- 172.21.15.143:0/1451532993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009a70 con 0x7fc060004080 2023-11-24T06:32:28.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc0795cd640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc060004080 0x7fc0600047d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc06400c160 tx=0x7fc06401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79dcd5333af0c0a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640058e0 con 0x7fc060004080 2023-11-24T06:32:28.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064005a60 con 0x7fc060004080 2023-11-24T06:32:28.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc078dcc640 1 -- 172.21.15.143:0/1451532993 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064005e10 con 0x7fc060004080 2023-11-24T06:32:28.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- 172.21.15.143:0/1451532993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc060004080 msgr2=0x7fc0600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 --2- 172.21.15.143:0/1451532993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc060004080 0x7fc0600047d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc06400c160 tx=0x7fc06401cba0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07a5cf640 1 -- 172.21.15.143:0/1451532993 reap_dead start 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- 172.21.15.143:0/1451532993 shutdown_connections 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- 172.21.15.143:0/1451532993 >> 172.21.15.143:0/1451532993 conn(0x7fc0740b0bf0 msgr2=0x7fc0740b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- 172.21.15.143:0/1451532993 shutdown_connections 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- 172.21.15.143:0/1451532993 wait complete. 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 Processor -- start 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- start start 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060004080 0x7fc07415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc07415c2b0 0x7fc0740b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 0x7fc07409c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07409c6c0 con 0x7fc07409bd00 2023-11-24T06:32:28.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740b4c00 con 0x7fc07415c2b0 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.389+0000 7fc07c032640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07415c730 con 0x7fc060004080 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 0x7fc07409c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 0x7fc07409c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40818/0 (socket says 172.21.15.143:40818) 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3308901583 learned_addr learned my addr 172.21.15.143:0/3308901583 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc079dce640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060004080 0x7fc07415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc0795cd640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc07415c2b0 0x7fc0740b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060004080 msgr2=0x7fc07415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060004080 0x7fc07415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc07415c2b0 msgr2=0x7fc0740b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc07415c2b0 0x7fc0740b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3308901583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07415c970 con 0x7fc07409bd00 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc079dce640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060004080 0x7fc07415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc0795cd640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc07415c2b0 0x7fc0740b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 0x7fc07409c180 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc0740cef70 tx=0x7fc06c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc06a7fc640 1 -- 172.21.15.143:0/3308901583 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00e040 con 0x7fc07409bd00 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc06a7fc640 1 -- 172.21.15.143:0/3308901583 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00f040 con 0x7fc07409bd00 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc06a7fc640 1 -- 172.21.15.143:0/3308901583 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c015670 con 0x7fc07409bd00 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07409a490 con 0x7fc07409bd00 2023-11-24T06:32:28.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07409aa50 con 0x7fc07409bd00 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.393+0000 7fc06a7fc640 1 -- 172.21.15.143:0/3308901583 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fc06c0157d0 con 0x7fc07409bd00 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc06a7fc640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc058066860 0x7fc058068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc06a7fc640 1 -- 172.21.15.143:0/3308901583 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc06c0851d0 con 0x7fc07409bd00 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc058066860 0x7fc058068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 Processor -- start 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- start start 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc058066860 0x7fc058068d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc070005630 tx=0x7fc070006ff0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 0x55f467a8b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8b5b0 0x55f467a40de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a41700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4678ab130 con 0x55f467a8ac90 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4678989a0 con 0x55f467a41320 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f467895ed0 con 0x55f467a8b5b0 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 0x55f467a8b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 0x55f467a8b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40826/0 (socket says 172.21.15.143:40826) 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 -- 172.21.15.143:0/589044005 learned_addr learned my addr 172.21.15.143:0/589044005 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a41700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc0795cd640 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8b5b0 0x55f467a40de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 -- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8b5b0 msgr2=0x55f467a40de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8b5b0 0x55f467a40de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 -- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 msgr2=0x55f467a41700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a41700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 -- 172.21.15.143:0/589044005 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f467589890 con 0x55f467a8ac90 2023-11-24T06:32:28.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc0795cd640 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8b5b0 0x55f467a40de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:28.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc079dce640 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 0x55f467a8b070 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc070016610 tx=0x7fc070015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b23106609be904 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc0577fe640 1 -- 172.21.15.143:0/589044005 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700154a0 con 0x55f467a8ac90 2023-11-24T06:32:28.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc0577fe640 1 -- 172.21.15.143:0/589044005 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070015600 con 0x55f467a8ac90 2023-11-24T06:32:28.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc0577fe640 1 -- 172.21.15.143:0/589044005 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070015970 con 0x55f467a8ac90 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- 172.21.15.143:0/589044005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 msgr2=0x55f467a8b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 0x55f467a8b070 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc070016610 tx=0x7fc070015000 comp rx=0 tx=0).stop 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- 172.21.15.143:0/589044005 shutdown_connections 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a41700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8b5b0 0x55f467a40de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 --2- 172.21.15.143:0/589044005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8ac90 0x55f467a8b070 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- 172.21.15.143:0/589044005 >> 172.21.15.143:0/589044005 conn(0x55f467a3d2d0 msgr2=0x55f467a3f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.397+0000 7fc07f392000 1 -- 172.21.15.143:0/589044005 shutdown_connections 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- 172.21.15.143:0/589044005 wait complete. 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- start start 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 Processor -- start 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a45d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a46280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 0x55f467a59910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4678917c0 con 0x55f467a8b5b0 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f467849bf0 con 0x55f467a41320 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f46784fa90 con 0x55f467a8ac90 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 10 client.0 _ll_register_callbacks cb 0x55f467a2c3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 0x55f467a59910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 0x55f467a59910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40838/0 (socket says 172.21.15.143:40838) 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3450154219 learned_addr learned my addr 172.21.15.143:0/3450154219 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc0795cd640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a46280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc079dce640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a45d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 msgr2=0x55f467a46280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a46280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 msgr2=0x55f467a45d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a45d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 -- 172.21.15.143:0/3450154219 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0740ccbd0 con 0x55f467a8b5b0 2023-11-24T06:32:28.419 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc0795cd640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a46280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 0x55f467a59910 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc06c007130 tx=0x7fc06c055d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaa43b5d5df1835 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc054ff9640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc054ff9640 1 -- 172.21.15.143:0/3450154219 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c055140 con 0x55f467a8b5b0 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc054ff9640 1 -- 172.21.15.143:0/3450154219 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc06c0552a0 con 0x55f467a8b5b0 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f467853470 con 0x55f467a8b5b0 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc054ff9640 1 -- 172.21.15.143:0/3450154219 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc06c05dac0 con 0x55f467a8b5b0 2023-11-24T06:32:28.420 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 10 client.6699 fetch_fsmap learned FSMap version 44 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55f467852190 con 0x55f467a8b5b0 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc054ff9640 1 -- 172.21.15.143:0/3450154219 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f467853470 con 0x55f467a8b5b0 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc054ff9640 1 -- 172.21.15.143:0/3450154219 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc06c005d20 con 0x55f467a8b5b0 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 10 client.6699 fetch_fsmap finished waiting for FSMap version 44 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 10 client.6699 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 20 client.6699 populate_metadata read hostname 'smithi143' 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a5a320 0x55f467a9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 4 client.6699 mds_command: new command op to 6567 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 --> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f467856b50 con 0x55f467a5a320 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.401+0000 7fc079dce640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a5a320 0x55f467a9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc079dce640 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a5a320 0x55f467a9cf50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995c5de618c23f56 server_cookie=a0268328804254ac in_seq=0 out_seq=0 2023-11-24T06:32:28.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc054ff9640 10 client.6699 ms_handle_connect on v2:172.21.15.143:6836/492061256 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc054ff9640 1 -- 172.21.15.143:0/3450154219 <== mds.0 v2:172.21.15.143:6836/492061256 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f467856b50 con 0x55f467a5a320 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc054ff9640 10 client.6699 handle_command_reply: tid=0 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 client.6699 shutdown 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 msgr2=0x55f467a59910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 0x55f467a59910 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc06c007130 tx=0x7fc06c055d80 comp rx=0 tx=0).stop 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 shutdown_connections 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a8b5b0 0x55f467a59910 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a46280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a5a320 0x55f467a9cf50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 --2- 172.21.15.143:0/3450154219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a41320 0x55f467a45d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc054ff9640 0 client.6699 ms_handle_reset on v2:172.21.15.143:6836/492061256 2023-11-24T06:32:28.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 >> 172.21.15.143:0/3450154219 conn(0x55f467a3d2d0 msgr2=0x55f467a3f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 shutdown_connections 2023-11-24T06:32:28.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 1 -- 172.21.15.143:0/3450154219 wait complete. 2023-11-24T06:32:28.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.405+0000 7fc07f392000 20 client.6699 trim_cache size 0 max 16384 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 Processor -- start 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- start start 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a3d2d0 0x55f467a88b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a89070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46754a940 con 0x55f467a41320 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f467a46fb0 con 0x55f467a3d2d0 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f46786be30 con 0x55f467a8ac90 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a89070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a89070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40846/0 (socket says 172.21.15.143:40846) 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 -- 172.21.15.143:0/4253759187 learned_addr learned my addr 172.21.15.143:0/4253759187 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc079dce640 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a3d2d0 0x55f467a88b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 -- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 msgr2=0x55f467a6d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a6d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 -- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a3d2d0 msgr2=0x55f467a88b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a3d2d0 0x55f467a88b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 -- 172.21.15.143:0/4253759187 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f467838490 con 0x55f467a41320 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc0795cd640 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a89070 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0640ab040 tx=0x7fc064001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4096371f89d6e87 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc057fff640 1 -- 172.21.15.143:0/4253759187 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640b3040 con 0x55f467a41320 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc057fff640 1 -- 172.21.15.143:0/4253759187 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064005bd0 con 0x55f467a41320 2023-11-24T06:32:28.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc057fff640 1 -- 172.21.15.143:0/4253759187 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640a58a0 con 0x55f467a41320 2023-11-24T06:32:28.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- 172.21.15.143:0/4253759187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 msgr2=0x55f467a89070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a89070 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0640ab040 tx=0x7fc064001a00 comp rx=0 tx=0).stop 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- 172.21.15.143:0/4253759187 shutdown_connections 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a8ac90 0x55f467a6d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a89070 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 --2- 172.21.15.143:0/4253759187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a3d2d0 0x55f467a88b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- 172.21.15.143:0/4253759187 >> 172.21.15.143:0/4253759187 conn(0x55f467a45ef0 msgr2=0x55f467a3f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- 172.21.15.143:0/4253759187 shutdown_connections 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.421+0000 7fc07f392000 1 -- 172.21.15.143:0/4253759187 wait complete. 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- start start 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 Processor -- start 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a3d2d0 0x55f467a6d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a6dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a8ac90 0x55f467a9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f467850380 con 0x55f467a41320 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46784ee10 con 0x55f467a8ac90 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f467892070 con 0x55f467a3d2d0 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 10 client.0 _ll_register_callbacks cb 0x55f4678dfc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a6dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a6dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40856/0 (socket says 172.21.15.143:40856) 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 -- 172.21.15.143:0/4221853496 learned_addr learned my addr 172.21.15.143:0/4221853496 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc079dce640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a3d2d0 0x55f467a6d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07a5cf640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a8ac90 0x55f467a9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 -- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a3d2d0 msgr2=0x55f467a6d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a3d2d0 0x55f467a6d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 -- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a8ac90 msgr2=0x55f467a9cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a8ac90 0x55f467a9cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 -- 172.21.15.143:0/4221853496 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c009a70 con 0x55f467a41320 2023-11-24T06:32:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc0795cd640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a6dd20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc064001ec0 tx=0x7fc064019940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bf983a1c49637b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc054ff9640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:32:28.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc054ff9640 1 -- 172.21.15.143:0/4221853496 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064005e40 con 0x55f467a41320 2023-11-24T06:32:28.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc054ff9640 1 -- 172.21.15.143:0/4221853496 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc0640a58a0 con 0x55f467a41320 2023-11-24T06:32:28.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f467890110 con 0x55f467a41320 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc054ff9640 1 -- 172.21.15.143:0/4221853496 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0640a5a60 con 0x55f467a41320 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 10 client.6705 fetch_fsmap learned FSMap version 44 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55f467589cc0 con 0x55f467a41320 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc054ff9640 1 -- 172.21.15.143:0/4221853496 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f467890110 con 0x55f467a41320 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc054ff9640 1 -- 172.21.15.143:0/4221853496 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc0640c0020 con 0x55f467a41320 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 10 client.6705 fetch_fsmap finished waiting for FSMap version 44 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 10 client.6705 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 20 client.6705 populate_metadata read hostname 'smithi143' 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a8b5b0 0x55f467af3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 4 client.6705 mds_command: new command op to 6567 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:32:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.425+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 --> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4678bf9a0 con 0x55f467a8b5b0 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc079dce640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a8b5b0 0x55f467af3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc054ff9640 10 client.6705 ms_handle_connect on v2:172.21.15.143:6836/492061256 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc079dce640 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a8b5b0 0x55f467af3e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696147ca3ddcd2ba server_cookie=e99486d285f0722 in_seq=0 out_seq=0 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc054ff9640 1 -- 172.21.15.143:0/4221853496 <== mds.0 v2:172.21.15.143:6836/492061256 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f4678bf9a0 con 0x55f467a8b5b0 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc054ff9640 10 client.6705 handle_command_reply: tid=0 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 client.6705 shutdown 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 msgr2=0x55f467a6dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a6dd20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc064001ec0 tx=0x7fc064019940 comp rx=0 tx=0).stop 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 shutdown_connections 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:6836/492061256,v1:172.21.15.143:6837/492061256] conn(0x55f467a8b5b0 0x55f467af3e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f467a8ac90 0x55f467a9cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f467a41320 0x55f467a6dd20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 --2- 172.21.15.143:0/4221853496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f467a3d2d0 0x55f467a6d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc054ff9640 0 client.6705 ms_handle_reset on v2:172.21.15.143:6836/492061256 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 >> 172.21.15.143:0/4221853496 conn(0x55f467a45ef0 msgr2=0x55f467a3ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 shutdown_connections 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 1 -- 172.21.15.143:0/4221853496 wait complete. 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07f392000 20 client.6705 trim_cache size 0 max 16384 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "039ed6d4-b5c2-4e8e-a15f-05a601a78248", 2023-11-24T06:32:28.440 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 6567, 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 5.8221182059999999, 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 44, 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 72, 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 72, 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 11.727231449 2023-11-24T06:32:28.441 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:32:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc058066860 msgr2=0x7fc058068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc058066860 0x7fc058068d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc070005630 tx=0x7fc070006ff0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 msgr2=0x7fc07409c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 0x7fc07409c180 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc0740cef70 tx=0x7fc06c00f580 comp rx=0 tx=0).stop 2023-11-24T06:32:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 shutdown_connections 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc058066860 0x7fc058068d20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc07409bd00 0x7fc07409c180 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc07415c2b0 0x7fc0740b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 --2- 172.21.15.143:0/3308901583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060004080 0x7fc07415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 >> 172.21.15.143:0/3308901583 conn(0x7fc0740b0bf0 msgr2=0x7fc0740ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 shutdown_connections 2023-11-24T06:32:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.429+0000 7fc07c032640 1 -- 172.21.15.143:0/3308901583 wait complete. 2023-11-24T06:32:28.453 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:32:28.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ed0d01640 1 Processor -- start 2023-11-24T06:32:28.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ed0d01640 1 -- start start 2023-11-24T06:32:28.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ed0d01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ecc0d3020 0x7f9ecc0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ed0d01640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc06c0e0 con 0x7f9ecc0ce8b0 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ed0d01640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0d39f0 con 0x7f9ecc15d570 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ed0d01640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0d1cc0 con 0x7f9ecc0d3020 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ec1d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ecc0d3020 0x7f9ecc0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ecad9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9ecc0ce8b0 0x7f9ecc0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49886/0 (socket says 172.21.15.143:49886) 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ecad9d640 1 -- 172.21.15.143:0/3559127701 learned_addr learned my addr 172.21.15.143:0/3559127701 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:28.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ec1d9b640 1 -- 172.21.15.143:0/3559127701 >> v1:172.21.15.146:6789/0 conn(0x7f9ecc15d570 legacy=0x7f9ecc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ec1d9b640 1 -- 172.21.15.143:0/3559127701 >> v1:172.21.15.143:6789/0 conn(0x7f9ecc0ce8b0 legacy=0x7f9ecc0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ec1d9b640 1 -- 172.21.15.143:0/3559127701 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0d1fa0 con 0x7f9ecc0d3020 2023-11-24T06:32:28.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.585+0000 7f9ec9d9b640 1 -- 172.21.15.143:0/3559127701 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916723030 0 0) 0x7f9ecc06c0e0 con 0x7f9ecc0ce8b0 2023-11-24T06:32:28.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ec1d9b640 1 --2- 172.21.15.143:0/3559127701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc0d3020 0x7f9ecc0d34b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009d90 tx=0x7f9eb401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40add3c2a59d06aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ec9d9b640 1 -- 172.21.15.143:0/3559127701 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40a59e0 con 0x7f9ecc0d3020 2023-11-24T06:32:28.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ec9d9b640 1 -- 172.21.15.143:0/3559127701 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40a5b40 con 0x7f9ecc0d3020 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ec9d9b640 1 -- 172.21.15.143:0/3559127701 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40ad440 con 0x7f9ecc0d3020 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 -- 172.21.15.143:0/3559127701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc0d3020 msgr2=0x7f9ecc0d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/3559127701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc0d3020 0x7f9ecc0d34b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009d90 tx=0x7f9eb401c920 comp rx=0 tx=0).stop 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 -- 172.21.15.143:0/3559127701 shutdown_connections 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/3559127701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc0d3020 0x7f9ecc0d34b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 -- 172.21.15.143:0/3559127701 >> 172.21.15.143:0/3559127701 conn(0x7f9ecc08ceb0 msgr2=0x7f9ecc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 -- 172.21.15.143:0/3559127701 shutdown_connections 2023-11-24T06:32:28.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.589+0000 7f9ed0d01640 1 -- 172.21.15.143:0/3559127701 wait complete. 2023-11-24T06:32:28.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 Processor -- start 2023-11-24T06:32:28.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 -- start start 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0ce8b0 0x7f9ecc1fb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ecc0d3020 0x7f9ecc0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 0x7f9ecc0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1fdbf0 con 0x7f9ecc15d570 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1fded0 con 0x7f9ecc0ce8b0 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1fe1b0 con 0x7f9ecc0d3020 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 0x7f9ecc0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 0x7f9ecc0c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40866/0 (socket says 172.21.15.143:40866) 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 -- 172.21.15.143:0/4205064247 learned_addr learned my addr 172.21.15.143:0/4205064247 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9eca59c640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0ce8b0 0x7f9ecc1fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ec1d9b640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ecc0d3020 0x7f9ecc0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 -- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ecc0d3020 msgr2=0x7f9ecc0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ecc0d3020 0x7f9ecc0c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 -- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0ce8b0 msgr2=0x7f9ecc1fb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0ce8b0 0x7f9ecc1fb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 -- 172.21.15.143:0/4205064247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009a70 con 0x7f9ecc15d570 2023-11-24T06:32:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ecad9d640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 0x7f9ecc0c9640 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c450 tx=0x7f9ec400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40074e0 con 0x7f9ecc15d570 2023-11-24T06:32:28.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4007660 con 0x7f9ecc15d570 2023-11-24T06:32:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc1fe490 con 0x7f9ecc15d570 2023-11-24T06:32:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4004a30 con 0x7f9ecc15d570 2023-11-24T06:32:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.593+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc0cc140 con 0x7f9ecc15d570 2023-11-24T06:32:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.597+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc067520 con 0x7f9ecc15d570 2023-11-24T06:32:28.603 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.597+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f9ec4004b90 con 0x7f9ecc15d570 2023-11-24T06:32:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.597+0000 7f9ec37fe640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9eac066860 0x7f9eac068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.597+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9ec40840a0 con 0x7f9ecc15d570 2023-11-24T06:32:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.597+0000 7f9eca59c640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9eac066860 0x7f9eac068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:28.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.597+0000 7f9eca59c640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9eac066860 0x7f9eac068d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc007fd0 tx=0x7f9ebc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:28.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.601+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ec40b5280 con 0x7f9ecc15d570 2023-11-24T06:32:28.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.785+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ecc0ca290 con 0x7f9ecc15d570 2023-11-24T06:32:28.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.785+0000 7f9ec37fe640 1 -- 172.21.15.143:0/4205064247 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9ec4051130 con 0x7f9ecc15d570 2023-11-24T06:32:28.792 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:32:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9eac066860 msgr2=0x7f9eac068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9eac066860 0x7f9eac068d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc007fd0 tx=0x7f9ebc009040 comp rx=0 tx=0).stop 2023-11-24T06:32:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 msgr2=0x7f9ecc0c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 0x7f9ecc0c9640 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c450 tx=0x7f9ec400c910 comp rx=0 tx=0).stop 2023-11-24T06:32:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 shutdown_connections 2023-11-24T06:32:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9eac066860 0x7f9eac068d20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc15d570 0x7f9ecc0c9640 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ecc0d3020 0x7f9ecc0c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 --2- 172.21.15.143:0/4205064247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0ce8b0 0x7f9ecc1fb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 >> 172.21.15.143:0/4205064247 conn(0x7f9ecc08ceb0 msgr2=0x7f9ecc0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:28.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 shutdown_connections 2023-11-24T06:32:28.796 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:28.789+0000 7f9ed0d01640 1 -- 172.21.15.143:0/4205064247 wait complete. 2023-11-24T06:32:28.814 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:32:28.814 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:32:28.814 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:32:28.814 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:32:28.815 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:32:28.815 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:32:28.815 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:32:28.815 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:32:28.816 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:32:28.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:28.816 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:32:28.826 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:32:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:32:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:32:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42214sec preferred_lft 42214sec 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:32:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:32:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:28.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:28.831 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:32:28.891 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:32:28.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:28.893 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:32:28.952 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:32:28.953 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:32:28.953 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:32:28.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:28.953 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:32:28.953 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:32:28.953 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:32:28.953 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:32:28.953 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:32:28.953 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:32:29.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.044 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:32:29.053 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:32:29.054 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:32:29.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:32:29.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.054 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-11-24T06:32:29.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:32:29.121 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:32:29.173 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:32:29.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:32:29.173 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:32:29.224 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:32:29.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.224 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:32:29.314 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:32:29.314 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:32:29.327 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:32:29.327 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:32:29.327 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:32:29.327 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:32:29.327 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:32:29.331 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:32:29.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.332 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:32:29.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.353 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:32:29.423 INFO:teuthology.orchestra.run.smithi143.stdout:client6301 2023-11-24T06:32:29.423 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:29.423 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:29.477 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:32:29.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.653+0000 7fefc6ead640 1 Processor -- start 2023-11-24T06:32:29.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.653+0000 7fefc6ead640 1 -- start start 2023-11-24T06:32:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc6ead640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fefc015d500 0x7fefc00ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc6ead640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fefc00cfc10 0x7fefc00d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc6ead640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc00d0580 con 0x7fefc00d3e80 2023-11-24T06:32:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc6ead640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc00d21c0 con 0x7fefc00cfc10 2023-11-24T06:32:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc6ead640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc00cdcd0 con 0x7fefc015d500 2023-11-24T06:32:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc66ac640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fefc00cfc10 0x7fefc00d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:29.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc56aa640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fefc00d3e80 0x7fefc00d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49890/0 (socket says 172.21.15.143:49890) 2023-11-24T06:32:29.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc56aa640 1 -- 172.21.15.143:0/3754167711 learned_addr learned my addr 172.21.15.143:0/3754167711 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:29.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc5eab640 1 --2- 172.21.15.143:0/3754167711 >> v2:172.21.15.146:3300/0 conn(0x7fefc015d500 0x7fefc00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc66ac640 1 -- 172.21.15.143:0/3754167711 >> v2:172.21.15.146:3300/0 conn(0x7fefc015d500 msgr2=0x7fefc00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc66ac640 1 --2- 172.21.15.143:0/3754167711 >> v2:172.21.15.146:3300/0 conn(0x7fefc015d500 0x7fefc00ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc66ac640 1 -- 172.21.15.143:0/3754167711 >> v1:172.21.15.143:6789/0 conn(0x7fefc00d3e80 legacy=0x7fefc00d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.657+0000 7fefc66ac640 1 -- 172.21.15.143:0/3754167711 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00d1ef0 con 0x7fefc00cfc10 2023-11-24T06:32:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc66ac640 1 --2- 172.21.15.143:0/3754167711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00cfc10 0x7fefc00d0040 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fefc008bb30 tx=0x7fefb801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0dac7a5136e850 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc4ea9640 1 -- 172.21.15.143:0/3754167711 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80a59a0 con 0x7fefc00cfc10 2023-11-24T06:32:29.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc4ea9640 1 -- 172.21.15.143:0/3754167711 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb80a5b00 con 0x7fefc00cfc10 2023-11-24T06:32:29.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc4ea9640 1 -- 172.21.15.143:0/3754167711 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80a5e90 con 0x7fefc00cfc10 2023-11-24T06:32:29.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- 172.21.15.143:0/3754167711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00cfc10 msgr2=0x7fefc00d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:29.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 --2- 172.21.15.143:0/3754167711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00cfc10 0x7fefc00d0040 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fefc008bb30 tx=0x7fefb801c8e0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- 172.21.15.143:0/3754167711 shutdown_connections 2023-11-24T06:32:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 --2- 172.21.15.143:0/3754167711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00cfc10 0x7fefc00d0040 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 --2- 172.21.15.143:0/3754167711 >> v2:172.21.15.146:3300/0 conn(0x7fefc015d500 0x7fefc00ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- 172.21.15.143:0/3754167711 >> 172.21.15.143:0/3754167711 conn(0x7fefc009c540 msgr2=0x7fefc00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- 172.21.15.143:0/3754167711 shutdown_connections 2023-11-24T06:32:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- 172.21.15.143:0/3754167711 wait complete. 2023-11-24T06:32:29.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 Processor -- start 2023-11-24T06:32:29.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- start start 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefc00cfc10 0x7fefc01f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 0x7fefc014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fefc015d500 0x7fefc014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc01f7160 con 0x7fefc00d3e80 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc014c1a0 con 0x7fefc00cfc10 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.661+0000 7fefc6ead640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc015e240 con 0x7fefc015d500 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 0x7fefc014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 0x7fefc014bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40886/0 (socket says 172.21.15.143:40886) 2023-11-24T06:32:29.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 -- 172.21.15.143:0/1143936295 learned_addr learned my addr 172.21.15.143:0/1143936295 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc5eab640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefc00cfc10 0x7fefc01f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc66ac640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fefc015d500 0x7fefc014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 -- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fefc015d500 msgr2=0x7fefc014ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fefc015d500 0x7fefc014ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 -- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefc00cfc10 msgr2=0x7fefc01f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefc00cfc10 0x7fefc01f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 -- 172.21.15.143:0/1143936295 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009a70 con 0x7fefc00d3e80 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc66ac640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fefc015d500 0x7fefc014ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc56aa640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 0x7fefc014bc60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fefb000c530 tx=0x7fefb000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0005cf0 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb0005e50 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc014b2e0 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0007270 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc01f9ce0 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc004e850 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.665+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fefb00073d0 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.669+0000 7fefb67fc640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fefa4066860 0x7fefa4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.669+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fefb0083a50 con 0x7fefc00d3e80 2023-11-24T06:32:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.669+0000 7fefc5eab640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fefa4066860 0x7fefa4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:29.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.669+0000 7fefc5eab640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fefa4066860 0x7fefa4068d20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fefc014c800 tx=0x7fefbc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:29.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.673+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefb0050980 con 0x7fefc00d3e80 2023-11-24T06:32:29.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fefc0168100 con 0x7fefc00d3e80 2023-11-24T06:32:29.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefb67fc640 1 -- 172.21.15.143:0/1143936295 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7fefb0017020 con 0x7fefc00d3e80 2023-11-24T06:32:29.858 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:32:29.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fefa4066860 msgr2=0x7fefa4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:29.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fefa4066860 0x7fefa4068d20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fefc014c800 tx=0x7fefbc009190 comp rx=0 tx=0).stop 2023-11-24T06:32:29.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 msgr2=0x7fefc014bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 0x7fefc014bc60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fefb000c530 tx=0x7fefb000c9f0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 shutdown_connections 2023-11-24T06:32:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fefa4066860 0x7fefa4068d20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fefc015d500 0x7fefc014ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc00d3e80 0x7fefc014bc60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 --2- 172.21.15.143:0/1143936295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefc00cfc10 0x7fefc01f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 >> 172.21.15.143:0/1143936295 conn(0x7fefc009c540 msgr2=0x7fefc00c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 shutdown_connections 2023-11-24T06:32:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:29.853+0000 7fefc6ead640 1 -- 172.21.15.143:0/1143936295 wait complete. 2023-11-24T06:32:29.879 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:32:29.879 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:32:29.880 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:32:29.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.881 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:32:29.891 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:29.892 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42245sec preferred_lft 42245sec 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:32:29.894 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.895 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:32:29.895 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:32:29.895 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:32:29.895 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:32:29.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.896 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:32:29.958 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:32:29.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:29.963 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:32:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:32:30.019 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:32:30.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:30.019 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:32:30.019 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:32:30.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:32:30.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:32:30.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:32:30.019 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:32:30.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:30.116 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:32:30.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:32:30.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:32:30.126 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:32:30.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:30.126 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-11-24T06:32:30.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:32:30.191 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:32:30.246 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:32:30.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:32:30.246 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:32:30.298 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:32:30.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:30.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:32:30.393 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:32:30.393 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:32:30.406 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:32:30.406 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:32:30.406 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:32:30.407 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 1@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:32:30.407 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:32:30.410 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:32:30.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:30.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:32:30.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:30.431 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:32:30.492 INFO:teuthology.orchestra.run.smithi146.stdout:client6726 2023-11-24T06:32:30.492 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:30.492 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:30.546 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:32:30.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7d1c1640 1 Processor -- start 2023-11-24T06:32:30.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7d1c1640 1 -- start start 2023-11-24T06:32:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7d1c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0c780710d0 0x7f0c7809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7d1c1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7806d8b0 con 0x7f0c78144030 2023-11-24T06:32:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7d1c1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7806cca0 con 0x7f0c7806c650 2023-11-24T06:32:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7d1c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c78145020 con 0x7f0c780710d0 2023-11-24T06:32:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c76d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0c78144030 0x7f0c7806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49904/0 (socket says 172.21.15.143:49904) 2023-11-24T06:32:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c76d9d640 1 -- 172.21.15.143:0/2300329284 learned_addr learned my addr 172.21.15.143:0/2300329284 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7759e640 1 --2- 172.21.15.143:0/2300329284 >> v2:172.21.15.143:3300/0 conn(0x7f0c780710d0 0x7f0c7809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c75d9b640 1 -- 172.21.15.143:0/2300329284 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210582373 0 0) 0x7f0c7806d8b0 con 0x7f0c78144030 2023-11-24T06:32:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c75d9b640 1 -- 172.21.15.143:0/2300329284 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c60003530 con 0x7f0c78144030 2023-11-24T06:32:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7759e640 1 -- 172.21.15.143:0/2300329284 >> v1:172.21.15.146:6789/0 conn(0x7f0c7806c650 legacy=0x7f0c780709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7759e640 1 -- 172.21.15.143:0/2300329284 >> v1:172.21.15.143:6789/0 conn(0x7f0c78144030 legacy=0x7f0c7806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:30.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.689+0000 7f0c7759e640 1 -- 172.21.15.143:0/2300329284 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7806cf80 con 0x7f0c780710d0 2023-11-24T06:32:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7759e640 1 --2- 172.21.15.143:0/2300329284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c780710d0 0x7f0c7809cc20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009d90 tx=0x7f0c7001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bbae667a803fc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c75d9b640 1 -- 172.21.15.143:0/2300329284 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700a5900 con 0x7f0c780710d0 2023-11-24T06:32:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c75d9b640 1 -- 172.21.15.143:0/2300329284 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c700a5a60 con 0x7f0c780710d0 2023-11-24T06:32:30.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c75d9b640 1 -- 172.21.15.143:0/2300329284 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700a5dd0 con 0x7f0c780710d0 2023-11-24T06:32:30.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/2300329284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c780710d0 msgr2=0x7f0c7809cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:30.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/2300329284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c780710d0 0x7f0c7809cc20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009d90 tx=0x7f0c7001c950 comp rx=0 tx=0).stop 2023-11-24T06:32:30.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/2300329284 shutdown_connections 2023-11-24T06:32:30.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/2300329284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c780710d0 0x7f0c7809cc20 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:30.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/2300329284 >> 172.21.15.143:0/2300329284 conn(0x7f0c780b0bf0 msgr2=0x7f0c780b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:30.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/2300329284 shutdown_connections 2023-11-24T06:32:30.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.693+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/2300329284 wait complete. 2023-11-24T06:32:30.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 Processor -- start 2023-11-24T06:32:30.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- start start 2023-11-24T06:32:30.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c7806c650 0x7f0c78140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:30.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c780710d0 0x7f0c78159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:30.705 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 0x7f0c780b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:30.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815b4e0 con 0x7f0c78144030 2023-11-24T06:32:30.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815a0d0 con 0x7f0c780710d0 2023-11-24T06:32:30.706 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780b2570 con 0x7f0c7806c650 2023-11-24T06:32:30.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 0x7f0c780b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:30.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 0x7f0c780b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40916/0 (socket says 172.21.15.143:40916) 2023-11-24T06:32:30.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 -- 172.21.15.143:0/3226063411 learned_addr learned my addr 172.21.15.143:0/3226063411 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:30.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c76d9d640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c7806c650 0x7f0c78140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7659c640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c780710d0 0x7f0c78159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 -- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c7806c650 msgr2=0x7f0c78140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c7806c650 0x7f0c78140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 -- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c780710d0 msgr2=0x7f0c78159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c780710d0 0x7f0c78159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 -- 172.21.15.143:0/3226063411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70009a70 con 0x7f0c78144030 2023-11-24T06:32:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7759e640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 0x7f0c780b3a10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0c70019560 tx=0x7f0c700196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700a5900 con 0x7f0c78144030 2023-11-24T06:32:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c70003ba0 con 0x7f0c78144030 2023-11-24T06:32:30.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7815ac40 con 0x7f0c78144030 2023-11-24T06:32:30.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700ad650 con 0x7f0c78144030 2023-11-24T06:32:30.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7815b200 con 0x7f0c78144030 2023-11-24T06:32:30.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.697+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780b26b0 con 0x7f0c78144030 2023-11-24T06:32:30.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.701+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f0c700b4070 con 0x7f0c78144030 2023-11-24T06:32:30.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.701+0000 7f0c5f7fe640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c64066860 0x7f0c64068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:30.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.701+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0c7011e6b0 con 0x7f0c78144030 2023-11-24T06:32:30.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.701+0000 7f0c76d9d640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c64066860 0x7f0c64068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:30.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.701+0000 7f0c76d9d640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c64066860 0x7f0c64068d20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0c680011f0 tx=0x7f0c68007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:30.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.705+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c780b26b0 con 0x7f0c78144030 2023-11-24T06:32:30.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:30.885+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c780b26b0 con 0x7f0c78144030 2023-11-24T06:32:31.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c5f7fe640 1 -- 172.21.15.143:0/3226063411 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0c780b26b0 con 0x7f0c78144030 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c64066860 msgr2=0x7f0c64068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c64066860 0x7f0c64068d20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0c680011f0 tx=0x7f0c68007d40 comp rx=0 tx=0).stop 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 msgr2=0x7f0c780b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 0x7f0c780b3a10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0c70019560 tx=0x7f0c700196f0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 shutdown_connections 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0c64066860 0x7f0c64068d20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c78144030 0x7f0c780b3a10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c780710d0 0x7f0c78159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 --2- 172.21.15.143:0/3226063411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c7806c650 0x7f0c78140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 >> 172.21.15.143:0/3226063411 conn(0x7f0c780b0bf0 msgr2=0x7f0c78072340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 shutdown_connections 2023-11-24T06:32:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.657+0000 7f0c7d1c1640 1 -- 172.21.15.143:0/3226063411 wait complete. 2023-11-24T06:32:31.688 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:32:31.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa520832640 1 Processor -- start 2023-11-24T06:32:31.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa520832640 1 -- start start 2023-11-24T06:32:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa520832640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cc0a0 0x7fa51c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa520832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c0c99f0 con 0x7fa51c15d600 2023-11-24T06:32:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa520832640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c161120 con 0x7fa51c161c00 2023-11-24T06:32:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa520832640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c162080 con 0x7fa51c0cc0a0 2023-11-24T06:32:31.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa51a59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa51c15d600 0x7fa51c15e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49918/0 (socket says 172.21.15.143:49918) 2023-11-24T06:32:31.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa51a59c640 1 -- 172.21.15.143:0/3853047422 learned_addr learned my addr 172.21.15.143:0/3853047422 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:31.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa51ad9d640 1 --2- 172.21.15.143:0/3853047422 >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cc0a0 0x7fa51c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668014586 0 0) 0x7fa51c0c99f0 con 0x7fa51c15d600 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.825+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa508003530 con 0x7fa51c15d600 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704903109 0 0) 0x7fa508003530 con 0x7fa51c15d600 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cc0a0 msgr2=0x7fa51c0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 --2- 172.21.15.143:0/3853047422 >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cc0a0 0x7fa51c0abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 >> v1:172.21.15.146:6789/0 conn(0x7fa51c161c00 legacy=0x7fa51c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c161400 con 0x7fa51c15d600 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fa50c001680 con 0x7fa51c15d600 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 >> v1:172.21.15.143:6789/0 conn(0x7fa51c15d600 legacy=0x7fa51c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa508003980 0x7fa508003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa508004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa508005190 0x7fa50800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c000 con 0x7fa5080047d0 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c170 con 0x7fa508003980 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c330 con 0x7fa508005190 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa508004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa51a59c640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa508003980 0x7fa508003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa51ad9d640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa508005190 0x7fa50800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 -- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa508005190 msgr2=0x7fa50800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:31.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa508005190 0x7fa50800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 -- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa508003980 msgr2=0x7fa508003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:31.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa508003980 0x7fa508003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 -- 172.21.15.143:0/3853047422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508003530 con 0x7fa5080047d0 2023-11-24T06:32:31.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa51ad9d640 1 -- 172.21.15.143:0/3853047422 reap_dead start 2023-11-24T06:32:31.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.829+0000 7fa513fff640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa508004c50 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa504001780 tx=0x7fa50401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae11c5ef696f8579 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:31.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040052d0 con 0x7fa5080047d0 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5040a7050 con 0x7fa5080047d0 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa519d9b640 1 -- 172.21.15.143:0/3853047422 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504003600 con 0x7fa5080047d0 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- 172.21.15.143:0/3853047422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 msgr2=0x7fa508004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa508004c50 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa504001780 tx=0x7fa50401c400 comp rx=0 tx=0).stop 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- 172.21.15.143:0/3853047422 shutdown_connections 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 --2- 172.21.15.143:0/3853047422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa508004c50 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- 172.21.15.143:0/3853047422 >> 172.21.15.143:0/3853047422 conn(0x7fa51c0b0bf0 msgr2=0x7fa51c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- 172.21.15.143:0/3853047422 shutdown_connections 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- 172.21.15.143:0/3853047422 wait complete. 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 Processor -- start 2023-11-24T06:32:31.840 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- start start 2023-11-24T06:32:31.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa51c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa51c156720 0x7fa51c09aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0c60d0 0x7fa51c15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0cea10 con 0x7fa5080047d0 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0ce290 con 0x7fa51c0c60d0 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.833+0000 7fa520832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c156ba0 con 0x7fa51c156720 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa51c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa51c0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40928/0 (socket says 172.21.15.143:40928) 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 -- 172.21.15.143:0/1416630054 learned_addr learned my addr 172.21.15.143:0/1416630054 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa513fff640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa51c156720 0x7fa51c09aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51ad9d640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0c60d0 0x7fa51c15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 -- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa51c156720 msgr2=0x7fa51c09aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa51c156720 0x7fa51c09aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 -- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0c60d0 msgr2=0x7fa51c15f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0c60d0 0x7fa51c15f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 -- 172.21.15.143:0/1416630054 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0cd1b0 con 0x7fa5080047d0 2023-11-24T06:32:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa51a59c640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa51c0ccb40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa50c012490 tx=0x7fa50c012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c014750 con 0x7fa5080047d0 2023-11-24T06:32:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c0148b0 con 0x7fa5080047d0 2023-11-24T06:32:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0cd490 con 0x7fa5080047d0 2023-11-24T06:32:31.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c014c40 con 0x7fa5080047d0 2023-11-24T06:32:31.845 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c0cda50 con 0x7fa5080047d0 2023-11-24T06:32:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c09d250 con 0x7fa5080047d0 2023-11-24T06:32:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fa50c0153e0 con 0x7fa5080047d0 2023-11-24T06:32:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.837+0000 7fa512ffd640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa4fc066890 0x7fa4fc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.841+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa50c086c00 con 0x7fa5080047d0 2023-11-24T06:32:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.841+0000 7fa513fff640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa4fc066890 0x7fa4fc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.841+0000 7fa513fff640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa4fc066890 0x7fa4fc068d50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa504001750 tx=0x7fa5040011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:31.845+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa50c053cd0 con 0x7fa5080047d0 2023-11-24T06:32:32.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.013+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa51c0c9650 con 0x7fa4fc066890 2023-11-24T06:32:32.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.013+0000 7fa512ffd640 1 -- 172.21.15.143:0/1416630054 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa504005330 con 0x7fa4fc066890 2023-11-24T06:32:32.020 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:32:32.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:32.021 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "cephfs" 2023-11-24T06:32:32.021 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:32.021 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:32:32.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa4fc066890 msgr2=0x7fa4fc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa4fc066890 0x7fa4fc068d50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa504001750 tx=0x7fa5040011a0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 msgr2=0x7fa51c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa51c0ccb40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa50c012490 tx=0x7fa50c012950 comp rx=0 tx=0).stop 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 shutdown_connections 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa4fc066890 0x7fa4fc068d50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0c60d0 0x7fa51c15f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa51c156720 0x7fa51c09aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 --2- 172.21.15.143:0/1416630054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5080047d0 0x7fa51c0ccb40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 >> 172.21.15.143:0/1416630054 conn(0x7fa51c0b0bf0 msgr2=0x7fa51c15da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 shutdown_connections 2023-11-24T06:32:32.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.017+0000 7fa520832640 1 -- 172.21.15.143:0/1416630054 wait complete. 2023-11-24T06:32:32.042 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:32:32.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.177+0000 7f459651d640 1 Processor -- start 2023-11-24T06:32:32.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.177+0000 7f459651d640 1 -- start start 2023-11-24T06:32:32.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.177+0000 7f459651d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f459015ec60 0x7f45900cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f459651d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45900cc6b0 0x7f45900b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f459651d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4590070f00 con 0x7f459015a290 2023-11-24T06:32:32.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f459651d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4590071170 con 0x7f45900cc6b0 2023-11-24T06:32:32.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f459651d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cb690 con 0x7f459015ec60 2023-11-24T06:32:32.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45900cc6b0 0x7f45900b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f458f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f459015ec60 0x7f45900cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45900cc6b0 0x7f45900b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:39622/0 (socket says 172.21.15.143:39622) 2023-11-24T06:32:32.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 -- 172.21.15.143:0/2470898732 learned_addr learned my addr 172.21.15.143:0/2470898732 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:32.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 -- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f459015ec60 msgr2=0x7f45900cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:32.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 --2- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f459015ec60 0x7f45900cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 -- 172.21.15.143:0/2470898732 >> v1:172.21.15.146:6789/0 conn(0x7f459015a290 legacy=0x7f45900707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 -- 172.21.15.143:0/2470898732 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900cb970 con 0x7f45900cc6b0 2023-11-24T06:32:32.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f458effd640 1 -- 172.21.15.143:0/2470898732 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531474475 0 0) 0x7f4590070f00 con 0x7f459015a290 2023-11-24T06:32:32.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.181+0000 7f4594aba640 1 --2- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45900cc6b0 0x7f45900b1f80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4588009e50 tx=0x7f458801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6db11391d23516f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458effd640 1 -- 172.21.15.143:0/2470898732 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880a5720 con 0x7f45900cc6b0 2023-11-24T06:32:32.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458effd640 1 -- 172.21.15.143:0/2470898732 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45880a5880 con 0x7f45900cc6b0 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458effd640 1 -- 172.21.15.143:0/2470898732 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880a5c10 con 0x7f45900cc6b0 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45900cc6b0 msgr2=0x7f45900b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 --2- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45900cc6b0 0x7f45900b1f80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4588009e50 tx=0x7f458801c950 comp rx=0 tx=0).stop 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- 172.21.15.143:0/2470898732 shutdown_connections 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 --2- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45900cc6b0 0x7f45900b1f80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 --2- 172.21.15.143:0/2470898732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f459015ec60 0x7f45900cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- 172.21.15.143:0/2470898732 >> 172.21.15.143:0/2470898732 conn(0x7f45900b0c80 msgr2=0x7f45900b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- 172.21.15.143:0/2470898732 shutdown_connections 2023-11-24T06:32:32.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- 172.21.15.143:0/2470898732 wait complete. 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 Processor -- start 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- start start 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900cc6b0 0x7f459013dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 0x7f459013b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459015ec60 0x7f459015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590158a60 con 0x7f459015a290 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459015d810 con 0x7f459015ec60 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f459651d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45901580c0 con 0x7f45900cc6b0 2023-11-24T06:32:32.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 0x7f459013b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 0x7f459013b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40930/0 (socket says 172.21.15.143:40930) 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458f7fe640 1 -- 172.21.15.143:0/2609024705 learned_addr learned my addr 172.21.15.143:0/2609024705 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f458ffff640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900cc6b0 0x7f459013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.185+0000 7f4594aba640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459015ec60 0x7f459015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458f7fe640 1 -- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900cc6b0 msgr2=0x7f459013dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458f7fe640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900cc6b0 0x7f459013dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458f7fe640 1 -- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459015ec60 msgr2=0x7f459015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458f7fe640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459015ec60 0x7f459015d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458f7fe640 1 -- 172.21.15.143:0/2609024705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588009b30 con 0x7f459015a290 2023-11-24T06:32:32.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458f7fe640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 0x7f459013b290 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f458400e840 tx=0x7f458400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584009510 con 0x7f459015a290 2023-11-24T06:32:32.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458400ee90 con 0x7f459015a290 2023-11-24T06:32:32.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45901583a0 con 0x7f459015a290 2023-11-24T06:32:32.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400cb80 con 0x7f459015a290 2023-11-24T06:32:32.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4590157d70 con 0x7f459015a290 2023-11-24T06:32:32.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459004e8c0 con 0x7f459015a290 2023-11-24T06:32:32.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.189+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f458400cce0 con 0x7f459015a290 2023-11-24T06:32:32.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.193+0000 7f458cff9640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f457c066860 0x7f457c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.193+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4584084d80 con 0x7f459015a290 2023-11-24T06:32:32.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.193+0000 7f458ffff640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f457c066860 0x7f457c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.193+0000 7f458ffff640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f457c066860 0x7f457c068d20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4580000f70 tx=0x7f4580009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.193+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4584051d80 con 0x7f459015a290 2023-11-24T06:32:32.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4590165120 con 0x7f459015a290 2023-11-24T06:32:32.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f458cff9640 1 -- 172.21.15.143:0/2609024705 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45840170c0 con 0x7f459015a290 2023-11-24T06:32:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f457c066860 msgr2=0x7f457c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f457c066860 0x7f457c068d20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4580000f70 tx=0x7f4580009040 comp rx=0 tx=0).stop 2023-11-24T06:32:32.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 msgr2=0x7f459013b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 0x7f459013b290 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f458400e840 tx=0x7f458400ec40 comp rx=0 tx=0).stop 2023-11-24T06:32:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 shutdown_connections 2023-11-24T06:32:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f457c066860 0x7f457c068d20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459015ec60 0x7f459015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f459015a290 0x7f459013b290 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 --2- 172.21.15.143:0/2609024705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900cc6b0 0x7f459013dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 >> 172.21.15.143:0/2609024705 conn(0x7f45900b0c80 msgr2=0x7f45900b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:32.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 shutdown_connections 2023-11-24T06:32:32.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.345+0000 7f459651d640 1 -- 172.21.15.143:0/2609024705 wait complete. 2023-11-24T06:32:32.371 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp6346 2023-11-24T06:32:32.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.505+0000 7f9a82d57640 1 Processor -- start 2023-11-24T06:32:32.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.505+0000 7f9a82d57640 1 -- start start 2023-11-24T06:32:32.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.505+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a7c06ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a82d57640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c06c6b0 con 0x7f9a7c0cc0b0 2023-11-24T06:32:32.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a82d57640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c070d40 con 0x7f9a7c0721e0 2023-11-24T06:32:32.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a82d57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c070780 con 0x7f9a7c15b240 2023-11-24T06:32:32.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9a7c0cc0b0 0x7f9a7c15ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49922/0 (socket says 172.21.15.143:49922) 2023-11-24T06:32:32.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 -- 172.21.15.143:0/3306320236 learned_addr learned my addr 172.21.15.143:0/3306320236 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a80af3640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a7c06ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375692871 0 0) 0x7f9a7c06c6b0 con 0x7f9a7c0cc0b0 2023-11-24T06:32:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a64003530 con 0x7f9a7c0cc0b0 2023-11-24T06:32:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055411781 0 0) 0x7f9a64003530 con 0x7f9a7c0cc0b0 2023-11-24T06:32:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 msgr2=0x7f9a7c06ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a7c06ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 >> v1:172.21.15.146:6789/0 conn(0x7f9a7c0721e0 legacy=0x7f9a7c0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c070a60 con 0x7f9a7c0cc0b0 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f9a74001a00 con 0x7f9a7c0cc0b0 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 >> v1:172.21.15.143:6789/0 conn(0x7f9a7c0cc0b0 legacy=0x7f9a7c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a640039b0 0x7f9a64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a64004d10 0x7f9a64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c070780 con 0x7f9a64004d10 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6400ba40 con 0x7f9a640039b0 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6400bc00 con 0x7f9a7c15b240 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a64004d10 0x7f9a64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a73fff640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a80af3640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a640039b0 0x7f9a64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 -- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 msgr2=0x7f9a640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 -- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a640039b0 msgr2=0x7f9a64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a640039b0 0x7f9a64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a812f4640 1 -- 172.21.15.143:0/3306320236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64003530 con 0x7f9a64004d10 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a73fff640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c15b240 0x7f9a640047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.509+0000 7f9a80af3640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a640039b0 0x7f9a64003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:32.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a812f4640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a64004d10 0x7f9a64005190 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0ca8e0 tx=0x7f9a7401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0fdace058f02b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740072d0 con 0x7f9a64004d10 2023-11-24T06:32:32.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a740a8070 con 0x7f9a64004d10 2023-11-24T06:32:32.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a737fe640 1 -- 172.21.15.143:0/3306320236 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740076b0 con 0x7f9a64004d10 2023-11-24T06:32:32.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 -- 172.21.15.143:0/3306320236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a64004d10 msgr2=0x7f9a64005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 --2- 172.21.15.143:0/3306320236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a64004d10 0x7f9a64005190 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0ca8e0 tx=0x7f9a7401d2a0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a812f4640 1 -- 172.21.15.143:0/3306320236 reap_dead start 2023-11-24T06:32:32.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 -- 172.21.15.143:0/3306320236 shutdown_connections 2023-11-24T06:32:32.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 -- 172.21.15.143:0/3306320236 >> 172.21.15.143:0/3306320236 conn(0x7f9a7c0b0d50 msgr2=0x7f9a7c0b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:32.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 -- 172.21.15.143:0/3306320236 shutdown_connections 2023-11-24T06:32:32.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 -- 172.21.15.143:0/3306320236 wait complete. 2023-11-24T06:32:32.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 Processor -- start 2023-11-24T06:32:32.524 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.513+0000 7f9a82d57640 1 -- start start 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c1515b0 0x7f9a7c09c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 0x7f9a7c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c0b4550 0x7f9a7c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b4050 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c09afd0 con 0x7f9a7c0b4550 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b2e90 con 0x7f9a7c1515b0 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 0x7f9a7c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 0x7f9a7c0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40938/0 (socket says 172.21.15.143:40938) 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 -- 172.21.15.143:0/2009877911 learned_addr learned my addr 172.21.15.143:0/2009877911 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a80af3640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c1515b0 0x7f9a7c09c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a812f4640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c0b4550 0x7f9a7c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 -- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c1515b0 msgr2=0x7f9a7c09c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c1515b0 0x7f9a7c09c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 -- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c0b4550 msgr2=0x7f9a7c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c0b4550 0x7f9a7c0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 -- 172.21.15.143:0/2009877911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c09bdf0 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a73fff640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 0x7f9a7c0b2950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00e580 tx=0x7f9a6c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0052e0 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c005440 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c0b4f10 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c003840 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c09b4c0 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c09bf80 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.517+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f9a6c0039a0 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.521+0000 7f9a717fa640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a68066890 0x7f9a68068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.521+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9a6c084150 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.521+0000 7f9a80af3640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a68066890 0x7f9a68068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.521+0000 7f9a80af3640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a68066890 0x7f9a68068d50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0ace80 tx=0x7f9a78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.525+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a6c051020 con 0x7f9a7c0b24d0 2023-11-24T06:32:32.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.693+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp6346", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a7c06e2d0 con 0x7f9a68066890 2023-11-24T06:32:32.706 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:32.701+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:32.706 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:32.701+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:32.707 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:32.701+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:32.707 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:32.701+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:32.707 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:32.701+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:32.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a717fa640 1 -- 172.21.15.143:0/2009877911 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9a78013960 con 0x7f9a68066890 2023-11-24T06:32:32.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a68066890 msgr2=0x7f9a68068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a68066890 0x7f9a68068d50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0ace80 tx=0x7f9a78008040 comp rx=0 tx=0).stop 2023-11-24T06:32:32.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 msgr2=0x7f9a7c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 0x7f9a7c0b2950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00e580 tx=0x7f9a6c00ea40 comp rx=0 tx=0).stop 2023-11-24T06:32:32.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 shutdown_connections 2023-11-24T06:32:32.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9a68066890 0x7f9a68068d50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c0b4550 0x7f9a7c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7c0b24d0 0x7f9a7c0b2950 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 --2- 172.21.15.143:0/2009877911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a7c1515b0 0x7f9a7c09c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 >> 172.21.15.143:0/2009877911 conn(0x7f9a7c0b0d50 msgr2=0x7f9a7c0ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:32.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 shutdown_connections 2023-11-24T06:32:32.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.717+0000 7f9a82d57640 1 -- 172.21.15.143:0/2009877911 wait complete. 2023-11-24T06:32:32.742 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol2549 --group_name subvol_grp6346 2023-11-24T06:32:32.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 Processor -- start 2023-11-24T06:32:32.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 -- start start 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44000709c0 0x7f4400070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440006d8b0 con 0x7f440009cc20 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4400145020 con 0x7f44000709c0 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4408616640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440009d0a0 con 0x7f4400144030 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4405bb1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f440009cc20 0x7f440006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49934/0 (socket says 172.21.15.143:49934) 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4405bb1640 1 -- 172.21.15.143:0/3276455892 learned_addr learned my addr 172.21.15.143:0/3276455892 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4406bb3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44000709c0 0x7f4400070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f44063b2640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f44053b0640 1 -- 172.21.15.143:0/3276455892 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542099355 0 0) 0x7f440006d8b0 con 0x7f440009cc20 2023-11-24T06:32:32.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f44053b0640 1 -- 172.21.15.143:0/3276455892 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ec003530 con 0x7f440009cc20 2023-11-24T06:32:32.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4406bb3640 1 -- 172.21.15.143:0/3276455892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 msgr2=0x7f440006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:32.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4406bb3640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4406bb3640 1 -- 172.21.15.143:0/3276455892 >> v1:172.21.15.143:6789/0 conn(0x7f440009cc20 legacy=0x7f440006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f4406bb3640 1 -- 172.21.15.143:0/3276455892 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400071390 con 0x7f44000709c0 2023-11-24T06:32:32.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.881+0000 7f44063b2640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:32.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4406bb3640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44000709c0 0x7f4400070e50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009d90 tx=0x7f43f801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525a76bb18e95e20 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f44053b0640 1 -- 172.21.15.143:0/3276455892 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80a59e0 con 0x7f44000709c0 2023-11-24T06:32:32.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f44053b0640 1 -- 172.21.15.143:0/3276455892 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f80a5b40 con 0x7f44000709c0 2023-11-24T06:32:32.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f44053b0640 1 -- 172.21.15.143:0/3276455892 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80ad440 con 0x7f44000709c0 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 -- 172.21.15.143:0/3276455892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44000709c0 msgr2=0x7f4400070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44000709c0 0x7f4400070e50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009d90 tx=0x7f43f801c920 comp rx=0 tx=0).stop 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 -- 172.21.15.143:0/3276455892 shutdown_connections 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44000709c0 0x7f4400070e50 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 --2- 172.21.15.143:0/3276455892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 -- 172.21.15.143:0/3276455892 >> 172.21.15.143:0/3276455892 conn(0x7f44000b0bf0 msgr2=0x7f44000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 -- 172.21.15.143:0/3276455892 shutdown_connections 2023-11-24T06:32:32.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.885+0000 7f4408616640 1 -- 172.21.15.143:0/3276455892 wait complete. 2023-11-24T06:32:32.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 Processor -- start 2023-11-24T06:32:32.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- start start 2023-11-24T06:32:32.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44000709c0 0x7f44000b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 0x7f440012ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440009aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000b4080 con 0x7f440009cc20 2023-11-24T06:32:32.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000b3bf0 con 0x7f44000709c0 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440012f0f0 con 0x7f4400144030 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 0x7f440012ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 0x7f440012ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40968/0 (socket says 172.21.15.143:40968) 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 -- 172.21.15.143:0/1429491878 learned_addr learned my addr 172.21.15.143:0/1429491878 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4406bb3640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440009aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f44063b2640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44000709c0 0x7f44000b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 -- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 msgr2=0x7f440009aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440009aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 -- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44000709c0 msgr2=0x7f44000b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44000709c0 0x7f44000b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 -- 172.21.15.143:0/1429491878 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc009420 con 0x7f440009cc20 2023-11-24T06:32:32.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4405bb1640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 0x7f440012ebb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c450 tx=0x7f43f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0005cf0 con 0x7f440009cc20 2023-11-24T06:32:32.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0005e50 con 0x7f440009cc20 2023-11-24T06:32:32.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f8009a70 con 0x7f440009cc20 2023-11-24T06:32:32.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0007290 con 0x7f440009cc20 2023-11-24T06:32:32.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44000b32c0 con 0x7f440009cc20 2023-11-24T06:32:32.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.889+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4400067520 con 0x7f440009cc20 2023-11-24T06:32:32.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.893+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f43f00073f0 con 0x7f440009cc20 2023-11-24T06:32:32.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.893+0000 7f43f6ffd640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43e4066890 0x7f43e4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:32.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.893+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f43f0083a40 con 0x7f440009cc20 2023-11-24T06:32:32.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.893+0000 7f44063b2640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43e4066890 0x7f43e4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:32.899 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.893+0000 7f44063b2640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43e4066890 0x7f43e4068d50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4400155520 tx=0x7f43fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:32.903 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:32.897+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43f0050970 con 0x7f440009cc20 2023-11-24T06:32:33.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.069+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol2549", "group_name": "subvol_grp6346", "target": ["mon-mgr", ""]}) v1 -- 0x7f440006e450 con 0x7f43e4066890 2023-11-24T06:32:33.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.089+0000 7f43f6ffd640 1 -- 172.21.15.143:0/1429491878 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f43fc0098c0 con 0x7f43e4066890 2023-11-24T06:32:33.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43e4066890 msgr2=0x7f43e4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43e4066890 0x7f43e4068d50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4400155520 tx=0x7f43fc009190 comp rx=0 tx=0).stop 2023-11-24T06:32:33.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 msgr2=0x7f440012ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 0x7f440012ebb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c450 tx=0x7f43f000c910 comp rx=0 tx=0).stop 2023-11-24T06:32:33.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 shutdown_connections 2023-11-24T06:32:33.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f43e4066890 0x7f43e4068d50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4400144030 0x7f440009aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f440009cc20 0x7f440012ebb0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 --2- 172.21.15.143:0/1429491878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44000709c0 0x7f44000b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 >> 172.21.15.143:0/1429491878 conn(0x7f44000b0bf0 msgr2=0x7f44000b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:33.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 shutdown_connections 2023-11-24T06:32:33.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.093+0000 7f4408616640 1 -- 172.21.15.143:0/1429491878 wait complete. 2023-11-24T06:32:33.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:33.117 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp6346/.snap/ancestral_snap_1) 2023-11-24T06:32:33.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:33.148 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%i ./volumes/subvol_grp6346) 2023-11-24T06:32:33.201 INFO:teuthology.orchestra.run.smithi143.stdout:1099511627777 2023-11-24T06:32:33.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:33.202 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls ./volumes/subvol_grp6346/subvol2549/.snap/_ancestral_snap_1_1099511627777) 2023-11-24T06:32:33.257 INFO:teuthology.orchestra.run.smithi143.stdout:e33c6d5c-930d-4e19-946c-7481379ee951 2023-11-24T06:32:33.258 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol2549 _ancestral_snap_1_1099511627777 subvol_grp6346 2023-11-24T06:32:33.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.437+0000 7fda08606640 1 Processor -- start 2023-11-24T06:32:33.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.437+0000 7fda08606640 1 -- start start 2023-11-24T06:32:33.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda08606640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fda000cc0a0 0x7fda000abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda08606640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000c99f0 con 0x7fda00161c00 2023-11-24T06:32:33.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda08606640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda00161120 con 0x7fda0015d600 2023-11-24T06:32:33.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda08606640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda00162080 con 0x7fda000cc0a0 2023-11-24T06:32:33.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda05ba1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fda00161c00 0x7fda000cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49944/0 (socket says 172.21.15.143:49944) 2023-11-24T06:32:33.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda05ba1640 1 -- 172.21.15.143:0/3253692749 learned_addr learned my addr 172.21.15.143:0/3253692749 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:33.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda06ba3640 1 --2- 172.21.15.143:0/3253692749 >> v2:172.21.15.143:3300/0 conn(0x7fda000cc0a0 0x7fda000abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda053a0640 1 -- 172.21.15.143:0/3253692749 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090442388 0 0) 0x7fda000c99f0 con 0x7fda00161c00 2023-11-24T06:32:33.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda06ba3640 1 -- 172.21.15.143:0/3253692749 >> v1:172.21.15.146:6789/0 conn(0x7fda0015d600 legacy=0x7fda0015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda06ba3640 1 -- 172.21.15.143:0/3253692749 >> v1:172.21.15.143:6789/0 conn(0x7fda00161c00 legacy=0x7fda000cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.441+0000 7fda06ba3640 1 -- 172.21.15.143:0/3253692749 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00161400 con 0x7fda000cc0a0 2023-11-24T06:32:33.449 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda06ba3640 1 --2- 172.21.15.143:0/3253692749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda000cc0a0 0x7fda000abed0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009d90 tx=0x7fd9f801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c18ec29e0f52e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:33.449 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda053a0640 1 -- 172.21.15.143:0/3253692749 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80a5940 con 0x7fda000cc0a0 2023-11-24T06:32:33.449 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda053a0640 1 -- 172.21.15.143:0/3253692749 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80a5aa0 con 0x7fda000cc0a0 2023-11-24T06:32:33.449 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda053a0640 1 -- 172.21.15.143:0/3253692749 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80a5e30 con 0x7fda000cc0a0 2023-11-24T06:32:33.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- 172.21.15.143:0/3253692749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda000cc0a0 msgr2=0x7fda000abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 --2- 172.21.15.143:0/3253692749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda000cc0a0 0x7fda000abed0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009d90 tx=0x7fd9f801c950 comp rx=0 tx=0).stop 2023-11-24T06:32:33.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- 172.21.15.143:0/3253692749 shutdown_connections 2023-11-24T06:32:33.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 --2- 172.21.15.143:0/3253692749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda000cc0a0 0x7fda000abed0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- 172.21.15.143:0/3253692749 >> 172.21.15.143:0/3253692749 conn(0x7fda000b0bf0 msgr2=0x7fda000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:33.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- 172.21.15.143:0/3253692749 shutdown_connections 2023-11-24T06:32:33.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- 172.21.15.143:0/3253692749 wait complete. 2023-11-24T06:32:33.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 Processor -- start 2023-11-24T06:32:33.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- start start 2023-11-24T06:32:33.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda000cc0a0 0x7fda0009b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda0015d600 0x7fda00152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda00161c00 0x7fda00152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda001525b0 con 0x7fda00161c00 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00154010 con 0x7fda0015d600 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.445+0000 7fda08606640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda001533e0 con 0x7fda000cc0a0 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda00161c00 0x7fda00152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda00161c00 0x7fda00152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40994/0 (socket says 172.21.15.143:40994) 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 -- 172.21.15.143:0/3527351680 learned_addr learned my addr 172.21.15.143:0/3527351680 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:33.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda063a2640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda000cc0a0 0x7fda0009b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda05ba1640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda0015d600 0x7fda00152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 -- 172.21.15.143:0/3527351680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda000cc0a0 msgr2=0x7fda0009b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda000cc0a0 0x7fda0009b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 -- 172.21.15.143:0/3527351680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda0015d600 msgr2=0x7fda00152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda0015d600 0x7fda00152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 -- 172.21.15.143:0/3527351680 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009a70 con 0x7fda00161c00 2023-11-24T06:32:33.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda06ba3640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda00161c00 0x7fda00152ea0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8019560 tx=0x7fd9f80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:33.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80ade80 con 0x7fda00161c00 2023-11-24T06:32:33.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80039a0 con 0x7fda00161c00 2023-11-24T06:32:33.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8003d50 con 0x7fda00161c00 2023-11-24T06:32:33.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda08606640 1 -- 172.21.15.143:0/3527351680 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda00153660 con 0x7fda00161c00 2023-11-24T06:32:33.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda08606640 1 -- 172.21.15.143:0/3527351680 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda00153c20 con 0x7fda00161c00 2023-11-24T06:32:33.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fda08606640 1 -- 172.21.15.143:0/3527351680 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda00153e10 con 0x7fda00161c00 2023-11-24T06:32:33.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.449+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7fd9f8004030 con 0x7fda00161c00 2023-11-24T06:32:33.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.453+0000 7fd9f6ffd640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd9e4066860 0x7fd9e4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.453+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd9f811f8b0 con 0x7fda00161c00 2023-11-24T06:32:33.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.453+0000 7fda063a2640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd9e4066860 0x7fd9e4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.453+0000 7fda063a2640 1 --2- 172.21.15.143:0/3527351680 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd9e4066860 0x7fd9e4068d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fda001583a0 tx=0x7fd9fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:33.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.457+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9f80ec9a0 con 0x7fda00161c00 2023-11-24T06:32:33.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.629+0000 7fda08606640 1 -- 172.21.15.143:0/3527351680 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol2549", "snap_name": "_ancestral_snap_1_1099511627777", "group_name": "subvol_grp6346", "target": ["mon-mgr", ""]}) v1 -- 0x7fda0016b430 con 0x7fd9e4066860 2023-11-24T06:32:33.642 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:33.637+0000 7f509801b640 -1 mgr.server reply reply (22) Invalid argument snapshot name '_ancestral_snap_1_1099511627777' is invalid 2023-11-24T06:32:33.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.637+0000 7fd9f6ffd640 1 -- 172.21.15.143:0/3527351680 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: -22 snapshot name '_ancestral_snap_1_1099511627777' is invalid) v1 ==== 66+0+0 (secure 0 0 0) 0x7fd9fc0050d0 con 0x7fd9e4066860 2023-11-24T06:32:33.642 INFO:teuthology.orchestra.run.smithi143.stderr:Error EINVAL: snapshot name '_ancestral_snap_1_1099511627777' is invalid 2023-11-24T06:32:33.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-11-24T06:32:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:33.651 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/subvol_grp6346/.snap/ancestral_snap_1) 2023-11-24T06:32:33.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol2549 --group_name subvol_grp6346 2023-11-24T06:32:33.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 Processor -- start 2023-11-24T06:32:33.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 -- start start 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d4015d780 0x7f8d400d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 0x7f8d400afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400cdd80 con 0x7f8d400b21c0 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d400ceb80 con 0x7f8d4015d780 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d44c17640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400cdfb0 con 0x7f8d400d1ed0 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 0x7f8d400afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 0x7f8d400afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:52178/0 (socket says 172.21.15.143:52178) 2023-11-24T06:32:33.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 -- 172.21.15.143:0/2031870495 learned_addr learned my addr 172.21.15.143:0/2031870495 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3f7fe640 1 --2- 172.21.15.143:0/2031870495 >> v2:172.21.15.146:3300/0 conn(0x7f8d4015d780 0x7f8d400d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 -- 172.21.15.143:0/2031870495 >> v2:172.21.15.146:3300/0 conn(0x7f8d4015d780 msgr2=0x7f8d400d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 --2- 172.21.15.143:0/2031870495 >> v2:172.21.15.146:3300/0 conn(0x7f8d4015d780 0x7f8d400d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3e7fc640 1 -- 172.21.15.143:0/2031870495 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024875722 0 0) 0x7f8d400cdd80 con 0x7f8d400b21c0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 -- 172.21.15.143:0/2031870495 >> v1:172.21.15.146:6789/0 conn(0x7f8d400b21c0 legacy=0x7f8d400d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.861+0000 7f8d3ffff640 1 -- 172.21.15.143:0/2031870495 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400ce250 con 0x7f8d400d1ed0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d3ffff640 1 --2- 172.21.15.143:0/2031870495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 0x7f8d400afe10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009e50 tx=0x7f8d3801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838c4d84d23b8847 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d3e7fc640 1 -- 172.21.15.143:0/2031870495 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380a58a0 con 0x7f8d400d1ed0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d3e7fc640 1 -- 172.21.15.143:0/2031870495 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d380a5a00 con 0x7f8d400d1ed0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d3e7fc640 1 -- 172.21.15.143:0/2031870495 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380a5d90 con 0x7f8d400d1ed0 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 -- 172.21.15.143:0/2031870495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 msgr2=0x7f8d400afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 --2- 172.21.15.143:0/2031870495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 0x7f8d400afe10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009e50 tx=0x7f8d3801c9e0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 -- 172.21.15.143:0/2031870495 shutdown_connections 2023-11-24T06:32:33.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 --2- 172.21.15.143:0/2031870495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400d1ed0 0x7f8d400afe10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 --2- 172.21.15.143:0/2031870495 >> v2:172.21.15.146:3300/0 conn(0x7f8d4015d780 0x7f8d400d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 -- 172.21.15.143:0/2031870495 >> 172.21.15.143:0/2031870495 conn(0x7f8d4009c520 msgr2=0x7f8d400d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:33.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 -- 172.21.15.143:0/2031870495 shutdown_connections 2023-11-24T06:32:33.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.865+0000 7f8d44c17640 1 -- 172.21.15.143:0/2031870495 wait complete. 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 Processor -- start 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 -- start start 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400b21c0 0x7f8d40158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d400d1ed0 0x7f8d400b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 0x7f8d400c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40158e90 con 0x7f8d4015d780 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40158c60 con 0x7f8d400d1ed0 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d44c17640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400b7f80 con 0x7f8d400b21c0 2023-11-24T06:32:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 0x7f8d400c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 0x7f8d400c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40996/0 (socket says 172.21.15.143:40996) 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 -- 172.21.15.143:0/1024357066 learned_addr learned my addr 172.21.15.143:0/1024357066 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3f7fe640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400b21c0 0x7f8d40158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3effd640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d400d1ed0 0x7f8d400b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 -- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400b21c0 msgr2=0x7f8d40158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400b21c0 0x7f8d40158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 -- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d400d1ed0 msgr2=0x7f8d400b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d400d1ed0 0x7f8d400b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 -- 172.21.15.143:0/1024357066 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009b30 con 0x7f8d4015d780 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d3ffff640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 0x7f8d400c8950 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8d380af040 tx=0x7f8d38019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.869+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380bd070 con 0x7f8d4015d780 2023-11-24T06:32:33.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d380b8470 con 0x7f8d4015d780 2023-11-24T06:32:33.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380b87e0 con 0x7f8d4015d780 2023-11-24T06:32:33.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d44c17640 1 -- 172.21.15.143:0/1024357066 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d400b8260 con 0x7f8d4015d780 2023-11-24T06:32:33.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d44c17640 1 -- 172.21.15.143:0/1024357066 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4006b430 con 0x7f8d4015d780 2023-11-24T06:32:33.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4006b620 con 0x7f8d4015d780 2023-11-24T06:32:33.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f8d380b8940 con 0x7f8d4015d780 2023-11-24T06:32:33.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d27fff640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d2c066860 0x7f8d2c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:33.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8d3811f380 con 0x7f8d4015d780 2023-11-24T06:32:33.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d3f7fe640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d2c066860 0x7f8d2c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:33.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.873+0000 7f8d3f7fe640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d2c066860 0x7f8d2c068d20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009b60 tx=0x7f8d30009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:33.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:33.877+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d380ec2b0 con 0x7f8d4015d780 2023-11-24T06:32:34.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.049+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol2549", "group_name": "subvol_grp6346", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d400b0b60 con 0x7f8d2c066860 2023-11-24T06:32:34.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.061+0000 7f8d27fff640 1 -- 172.21.15.143:0/1024357066 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8d30011ac0 con 0x7f8d2c066860 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d2c066860 msgr2=0x7f8d2c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d2c066860 0x7f8d2c068d20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009b60 tx=0x7f8d30009190 comp rx=0 tx=0).stop 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 msgr2=0x7f8d400c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 0x7f8d400c8950 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8d380af040 tx=0x7f8d38019780 comp rx=0 tx=0).stop 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 shutdown_connections 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8d2c066860 0x7f8d2c068d20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d4015d780 0x7f8d400c8950 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d400d1ed0 0x7f8d400b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 --2- 172.21.15.143:0/1024357066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d400b21c0 0x7f8d40158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 >> 172.21.15.143:0/1024357066 conn(0x7f8d4009c520 msgr2=0x7f8d4015e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:34.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 shutdown_connections 2023-11-24T06:32:34.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.065+0000 7f8d25ffb640 1 -- 172.21.15.143:0/1024357066 wait complete. 2023-11-24T06:32:34.075 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.069+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.075 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.069+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.075 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.069+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.075 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.069+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.075 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.069+0000 7f509a820640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.091 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.085+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.091 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.085+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.091 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.085+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.091 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.085+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.091 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:32:34.085+0000 7f509a01f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:32:34.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:34.097 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T06:32:34.113 INFO:teuthology.orchestra.run.smithi143.stdout:2 2023-11-24T06:32:34.114 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp6346 2023-11-24T06:32:34.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4d93f640 1 Processor -- start 2023-11-24T06:32:34.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4d93f640 1 -- start start 2023-11-24T06:32:34.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4d93f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e4815d500 0x7f6e4806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4d93f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480d1400 con 0x7f6e4806bf80 2023-11-24T06:32:34.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4d93f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480b7d80 con 0x7f6e480b8f90 2023-11-24T06:32:34.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4d93f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4806c410 con 0x7f6e4815d500 2023-11-24T06:32:34.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4c93d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e4815d500 0x7f6e4806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4c93d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e4815d500 0x7f6e4806ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41022/0 (socket says 172.21.15.143:41022) 2023-11-24T06:32:34.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.297+0000 7f6e4c93d640 1 -- 172.21.15.143:0/1053982775 learned_addr learned my addr 172.21.15.143:0/1053982775 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:34.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4c93d640 1 -- 172.21.15.143:0/1053982775 >> v1:172.21.15.146:6789/0 conn(0x7f6e480b8f90 legacy=0x7f6e480d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:34.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4c93d640 1 -- 172.21.15.143:0/1053982775 >> v1:172.21.15.143:6789/0 conn(0x7f6e4806bf80 legacy=0x7f6e480b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4c93d640 1 -- 172.21.15.143:0/1053982775 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480b8060 con 0x7f6e4815d500 2023-11-24T06:32:34.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4c93d640 1 --2- 172.21.15.143:0/1053982775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e4815d500 0x7f6e4806ba40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009870 tx=0x7f6e4401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1340f59bce9eeea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:34.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e3f7fe640 1 -- 172.21.15.143:0/1053982775 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440a89f0 con 0x7f6e4815d500 2023-11-24T06:32:34.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e3f7fe640 1 -- 172.21.15.143:0/1053982775 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440a8b50 con 0x7f6e4815d500 2023-11-24T06:32:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e3f7fe640 1 -- 172.21.15.143:0/1053982775 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440b0440 con 0x7f6e4815d500 2023-11-24T06:32:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1053982775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e4815d500 msgr2=0x7f6e4806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1053982775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e4815d500 0x7f6e4806ba40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009870 tx=0x7f6e4401ecf0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1053982775 shutdown_connections 2023-11-24T06:32:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1053982775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e4815d500 0x7f6e4806ba40 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1053982775 >> 172.21.15.143:0/1053982775 conn(0x7f6e480613d0 msgr2=0x7f6e480617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:34.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1053982775 shutdown_connections 2023-11-24T06:32:34.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.301+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1053982775 wait complete. 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 Processor -- start 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 -- start start 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4806bf80 0x7f6e481f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 0x7f6e481554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4815d500 0x7f6e4815c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48156a20 con 0x7f6e480b8f90 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e481f3100 con 0x7f6e4806bf80 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d93f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48155da0 con 0x7f6e4815d500 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 0x7f6e481554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 0x7f6e481554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41024/0 (socket says 172.21.15.143:41024) 2023-11-24T06:32:34.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 -- 172.21.15.143:0/1047820532 learned_addr learned my addr 172.21.15.143:0/1047820532 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4c93d640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4806bf80 0x7f6e481f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d13e640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4815d500 0x7f6e4815c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 -- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4815d500 msgr2=0x7f6e4815c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4815d500 0x7f6e4815c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 -- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4806bf80 msgr2=0x7f6e481f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4806bf80 0x7f6e481f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 -- 172.21.15.143:0/1047820532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440094d0 con 0x7f6e480b8f90 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e4d13e640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4815d500 0x7f6e4815c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3ffff640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 0x7f6e481554a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c450 tx=0x7f6e3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38012830 con 0x7f6e480b8f90 2023-11-24T06:32:34.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e380129b0 con 0x7f6e480b8f90 2023-11-24T06:32:34.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.305+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38012d60 con 0x7f6e480b8f90 2023-11-24T06:32:34.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e48156080 con 0x7f6e480b8f90 2023-11-24T06:32:34.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e48156640 con 0x7f6e480b8f90 2023-11-24T06:32:34.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e48067a40 con 0x7f6e480b8f90 2023-11-24T06:32:34.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 10) v1 ==== 86209+0+0 (secure 0 0 0) 0x7f6e3801c460 con 0x7f6e480b8f90 2023-11-24T06:32:34.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e3d7fa640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e34066860 0x7f6e34068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6e380843b0 con 0x7f6e480b8f90 2023-11-24T06:32:34.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e4c93d640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e34066860 0x7f6e34068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.309+0000 7f6e4c93d640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e34066860 0x7f6e34068d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e440b2000 tx=0x7f6e44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:34.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.313+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e38051280 con 0x7f6e480b8f90 2023-11-24T06:32:34.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.485+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp6346", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e480b8620 con 0x7f6e34066860 2023-11-24T06:32:34.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.489+0000 7f6e3d7fa640 1 -- 172.21.15.143:0/1047820532 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6e440b05c0 con 0x7f6e34066860 2023-11-24T06:32:34.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.489+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e34066860 msgr2=0x7f6e34068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.489+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e34066860 0x7f6e34068d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e440b2000 tx=0x7f6e44009040 comp rx=0 tx=0).stop 2023-11-24T06:32:34.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.489+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 msgr2=0x7f6e481554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.489+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 0x7f6e481554a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c450 tx=0x7f6e3800c910 comp rx=0 tx=0).stop 2023-11-24T06:32:34.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 shutdown_connections 2023-11-24T06:32:34.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6e34066860 0x7f6e34068d20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4815d500 0x7f6e4815c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e480b8f90 0x7f6e481554a0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 --2- 172.21.15.143:0/1047820532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4806bf80 0x7f6e481f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 >> 172.21.15.143:0/1047820532 conn(0x7f6e480613d0 msgr2=0x7f6e4815b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:34.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 shutdown_connections 2023-11-24T06:32:34.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.493+0000 7f6e4d93f640 1 -- 172.21.15.143:0/1047820532 wait complete. 2023-11-24T06:32:34.516 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:32:34.517 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:34.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:34.613 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:32:34.613 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:34.613 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:34.622 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:34.623 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:34.673 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:34.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e74fe640 1 Processor -- start 2023-11-24T06:32:34.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e74fe640 1 -- start start 2023-11-24T06:32:34.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e74fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe9e015d570 0x7fe9e006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e74fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00d1cc0 con 0x7fe9e00d3020 2023-11-24T06:32:34.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e74fe640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00d1fa0 con 0x7fe9e00ce8b0 2023-11-24T06:32:34.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e74fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e00ce0b0 con 0x7fe9e015d570 2023-11-24T06:32:34.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e529a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe9e015d570 0x7fe9e006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e4a99640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe9e00d3020 0x7fe9e00d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49970/0 (socket says 172.21.15.143:49970) 2023-11-24T06:32:34.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e4a99640 1 -- 172.21.15.143:0/3741289452 learned_addr learned my addr 172.21.15.143:0/3741289452 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:34.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e529a640 1 -- 172.21.15.143:0/3741289452 >> v1:172.21.15.146:6789/0 conn(0x7fe9e00ce8b0 legacy=0x7fe9e00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:34.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e529a640 1 -- 172.21.15.143:0/3741289452 >> v1:172.21.15.143:6789/0 conn(0x7fe9e00d3020 legacy=0x7fe9e00d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.853+0000 7fe9e529a640 1 -- 172.21.15.143:0/3741289452 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00ce390 con 0x7fe9e015d570 2023-11-24T06:32:34.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e529a640 1 --2- 172.21.15.143:0/3741289452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015d570 0x7fe9e006b9d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0097c0 tx=0x7fe9dc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cf715fecfd5745 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:34.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9d7fff640 1 -- 172.21.15.143:0/3741289452 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc004230 con 0x7fe9e015d570 2023-11-24T06:32:34.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9d7fff640 1 -- 172.21.15.143:0/3741289452 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0a7050 con 0x7fe9e015d570 2023-11-24T06:32:34.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9d7fff640 1 -- 172.21.15.143:0/3741289452 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc003620 con 0x7fe9e015d570 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3741289452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015d570 msgr2=0x7fe9e006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3741289452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015d570 0x7fe9e006b9d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0097c0 tx=0x7fe9dc01c440 comp rx=0 tx=0).stop 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3741289452 shutdown_connections 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3741289452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015d570 0x7fe9e006b9d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3741289452 >> 172.21.15.143:0/3741289452 conn(0x7fe9e008ceb0 msgr2=0x7fe9e009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3741289452 shutdown_connections 2023-11-24T06:32:34.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.857+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3741289452 wait complete. 2023-11-24T06:32:34.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 Processor -- start 2023-11-24T06:32:34.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- start start 2023-11-24T06:32:34.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e00ce8b0 0x7fe9e0159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 0x7fe9e015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e015d570 0x7fe9e0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00c5fe0 con 0x7fe9e00d3020 2023-11-24T06:32:34.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0153a30 con 0x7fe9e00ce8b0 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015c960 con 0x7fe9e015d570 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 0x7fe9e015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 0x7fe9e015c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41046/0 (socket says 172.21.15.143:41046) 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 -- 172.21.15.143:0/3203360036 learned_addr learned my addr 172.21.15.143:0/3203360036 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e529a640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e00ce8b0 0x7fe9e0159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e5a9b640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e015d570 0x7fe9e0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 -- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e015d570 msgr2=0x7fe9e0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e015d570 0x7fe9e0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 -- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e00ce8b0 msgr2=0x7fe9e0159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e00ce8b0 0x7fe9e0159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 -- 172.21.15.143:0/3203360036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009420 con 0x7fe9e00d3020 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e4a99640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 0x7fe9e015c000 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c4d0 tx=0x7fe9d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:34.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0005cf0 con 0x7fe9e00d3020 2023-11-24T06:32:34.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d0005e50 con 0x7fe9e00d3020 2023-11-24T06:32:34.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0007270 con 0x7fe9e00d3020 2023-11-24T06:32:34.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e00c6230 con 0x7fe9e00d3020 2023-11-24T06:32:34.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00c7150 con 0x7fe9e00d3020 2023-11-24T06:32:34.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.861+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e0153ba0 con 0x7fe9e00d3020 2023-11-24T06:32:34.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.865+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fe9d00073d0 con 0x7fe9e00d3020 2023-11-24T06:32:34.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.865+0000 7fe9d5ffb640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe9c4066a10 0x7fe9c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:34.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.865+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe9d0083ce0 con 0x7fe9e00d3020 2023-11-24T06:32:34.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.865+0000 7fe9e529a640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe9c4066a10 0x7fe9c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:34.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.865+0000 7fe9e529a640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe9c4066a10 0x7fe9c4068ed0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0ad000 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:34.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:34.869+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9d00509d0 con 0x7fe9e00d3020 2023-11-24T06:32:35.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9e00c66e0 con 0x7fe9e00d3020 2023-11-24T06:32:35.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9d5ffb640 1 -- 172.21.15.143:0/3203360036 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16659 (secure 0 0 0) 0x7fe9d0017020 con 0x7fe9e00d3020 2023-11-24T06:32:35.029 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:35.029 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":72,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:23.588756+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe9c4066a10 msgr2=0x7fe9c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe9c4066a10 0x7fe9c4068ed0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0ad000 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2023-11-24T06:32:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 msgr2=0x7fe9e015c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 0x7fe9e015c000 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c4d0 tx=0x7fe9d000c990 comp rx=0 tx=0).stop 2023-11-24T06:32:35.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 shutdown_connections 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe9c4066a10 0x7fe9c4068ed0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e015d570 0x7fe9e0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e00d3020 0x7fe9e015c000 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 --2- 172.21.15.143:0/3203360036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e00ce8b0 0x7fe9e0159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 >> 172.21.15.143:0/3203360036 conn(0x7fe9e008ceb0 msgr2=0x7fe9e006c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 shutdown_connections 2023-11-24T06:32:35.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.021+0000 7fe9e74fe640 1 -- 172.21.15.143:0/3203360036 wait complete. 2023-11-24T06:32:35.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:32:19.668658+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:32:20.965372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:35.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:35.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 Processor -- start 2023-11-24T06:32:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 -- start start 2023-11-24T06:32:35.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa1200ae4a0 0x7fa12015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1200ce420 0x7fa12006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200b3510 con 0x7fa1200cd850 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200b37f0 con 0x7fa1200ae4a0 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa128594640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200b3ad0 con 0x7fa1200ce420 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa1200ae4a0 0x7fa12015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa1200ae4a0 0x7fa12015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41060/0 (socket says 172.21.15.143:41060) 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 -- 172.21.15.143:0/3524066924 learned_addr learned my addr 172.21.15.143:0/3524066924 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa125b2f640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa1200cd850 0x7fa1200cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49984/0 (socket says 172.21.15.143:49984) 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126b31640 1 --2- 172.21.15.143:0/3524066924 >> v2:172.21.15.146:3300/0 conn(0x7fa1200ce420 0x7fa12006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 -- 172.21.15.143:0/3524066924 >> v2:172.21.15.146:3300/0 conn(0x7fa1200ce420 msgr2=0x7fa12006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 --2- 172.21.15.143:0/3524066924 >> v2:172.21.15.146:3300/0 conn(0x7fa1200ce420 0x7fa12006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 -- 172.21.15.143:0/3524066924 >> v1:172.21.15.143:6789/0 conn(0x7fa1200cd850 legacy=0x7fa1200cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126330640 1 -- 172.21.15.143:0/3524066924 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200b3db0 con 0x7fa1200ae4a0 2023-11-24T06:32:35.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.197+0000 7fa126b31640 1 --2- 172.21.15.143:0/3524066924 >> v2:172.21.15.146:3300/0 conn(0x7fa1200ce420 0x7fa12006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa126330640 1 --2- 172.21.15.143:0/3524066924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200ae4a0 0x7fa12015ba00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa1200b45b0 tx=0x7fa11c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7b76076719bc74 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa12532e640 1 -- 172.21.15.143:0/3524066924 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0aa650 con 0x7fa1200ae4a0 2023-11-24T06:32:35.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa12532e640 1 -- 172.21.15.143:0/3524066924 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c0aa7b0 con 0x7fa1200ae4a0 2023-11-24T06:32:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa12532e640 1 -- 172.21.15.143:0/3524066924 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0aab40 con 0x7fa1200ae4a0 2023-11-24T06:32:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 -- 172.21.15.143:0/3524066924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200ae4a0 msgr2=0x7fa12015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 --2- 172.21.15.143:0/3524066924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200ae4a0 0x7fa12015ba00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa1200b45b0 tx=0x7fa11c01c4d0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 -- 172.21.15.143:0/3524066924 shutdown_connections 2023-11-24T06:32:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 --2- 172.21.15.143:0/3524066924 >> v2:172.21.15.146:3300/0 conn(0x7fa1200ce420 0x7fa12006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 --2- 172.21.15.143:0/3524066924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200ae4a0 0x7fa12015ba00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 -- 172.21.15.143:0/3524066924 >> 172.21.15.143:0/3524066924 conn(0x7fa1200b0c80 msgr2=0x7fa1200b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 -- 172.21.15.143:0/3524066924 shutdown_connections 2023-11-24T06:32:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.201+0000 7fa128594640 1 -- 172.21.15.143:0/3524066924 wait complete. 2023-11-24T06:32:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 Processor -- start 2023-11-24T06:32:35.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 -- start start 2023-11-24T06:32:35.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1200ae4a0 0x7fa120141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 0x7fa120070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1200ce420 0x7fa1201f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12014eb60 con 0x7fa1200cd850 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120071530 con 0x7fa1200ce420 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa120072350 con 0x7fa1200ae4a0 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 0x7fa120070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 0x7fa120070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41068/0 (socket says 172.21.15.143:41068) 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 -- 172.21.15.143:0/502986050 learned_addr learned my addr 172.21.15.143:0/502986050 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:35.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa126b31640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1200ce420 0x7fa1201f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa126330640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1200ae4a0 0x7fa120141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 -- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1200ae4a0 msgr2=0x7fa120141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1200ae4a0 0x7fa120141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 -- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1200ce420 msgr2=0x7fa1201f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1200ce420 0x7fa1201f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 -- 172.21.15.143:0/502986050 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c0094d0 con 0x7fa1200cd850 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa125b2f640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 0x7fa120070ff0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c400 tx=0x7fa11000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100074e0 con 0x7fa1200cd850 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110007640 con 0x7fa1200cd850 2023-11-24T06:32:35.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110004a30 con 0x7fa1200cd850 2023-11-24T06:32:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa120071740 con 0x7fa1200cd850 2023-11-24T06:32:35.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.205+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa120071d00 con 0x7fa1200cd850 2023-11-24T06:32:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.209+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12006e1e0 con 0x7fa1200cd850 2023-11-24T06:32:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.209+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fa110004b90 con 0x7fa1200cd850 2023-11-24T06:32:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.209+0000 7fa116ffd640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa104066a10 0x7fa104068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.209+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa110084210 con 0x7fa1200cd850 2023-11-24T06:32:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.209+0000 7fa126330640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa104066a10 0x7fa104068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.217 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.209+0000 7fa126330640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa104066a10 0x7fa104068ed0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ae000 tx=0x7fa11c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.213+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa110050e00 con 0x7fa1200cd850 2023-11-24T06:32:35.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa12004e8c0 con 0x7fa1200cd850 2023-11-24T06:32:35.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa116ffd640 1 -- 172.21.15.143:0/502986050 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa110054420 con 0x7fa1200cd850 2023-11-24T06:32:35.371 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:35.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa104066a10 msgr2=0x7fa104068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa104066a10 0x7fa104068ed0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ae000 tx=0x7fa11c0a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:35.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 msgr2=0x7fa120070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 0x7fa120070ff0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c400 tx=0x7fa11000c8c0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 shutdown_connections 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa104066a10 0x7fa104068ed0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1200ce420 0x7fa1201f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1200cd850 0x7fa120070ff0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 --2- 172.21.15.143:0/502986050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1200ae4a0 0x7fa120141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 >> 172.21.15.143:0/502986050 conn(0x7fa1200b0c80 msgr2=0x7fa12014ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 shutdown_connections 2023-11-24T06:32:35.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.365+0000 7fa128594640 1 -- 172.21.15.143:0/502986050 wait complete. 2023-11-24T06:32:35.391 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:32:35.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.525+0000 7fd54a817640 1 Processor -- start 2023-11-24T06:32:35.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.525+0000 7fd54a817640 1 -- start start 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd54a817640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd54415ec60 0x7fd5440cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd54a817640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5440cc6b0 0x7fd5440b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd54a817640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd544070f00 con 0x7fd54415a290 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd54a817640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544071170 con 0x7fd54415ec60 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd54a817640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440cb690 con 0x7fd5440cc6b0 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd5437fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd54415ec60 0x7fd5440cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd543fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd54415a290 0x7fd5440707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49998/0 (socket says 172.21.15.143:49998) 2023-11-24T06:32:35.534 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd543fff640 1 -- 172.21.15.143:0/1602124799 learned_addr learned my addr 172.21.15.143:0/1602124799 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:35.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd548db4640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5440cc6b0 0x7fd5440b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd5437fe640 1 -- 172.21.15.143:0/1602124799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5440cc6b0 msgr2=0x7fd5440b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:35.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd5437fe640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5440cc6b0 0x7fd5440b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd5437fe640 1 -- 172.21.15.143:0/1602124799 >> v1:172.21.15.143:6789/0 conn(0x7fd54415a290 legacy=0x7fd5440707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd5437fe640 1 -- 172.21.15.143:0/1602124799 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440cb970 con 0x7fd54415ec60 2023-11-24T06:32:35.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd542ffd640 1 -- 172.21.15.143:0/1602124799 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060812759 0 0) 0x7fd544070f00 con 0x7fd54415a290 2023-11-24T06:32:35.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.529+0000 7fd548db4640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5440cc6b0 0x7fd5440b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:35.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd5437fe640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd54415ec60 0x7fd5440cc170 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097c0 tx=0x7fd53801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7189e4e161fd4a64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd542ffd640 1 -- 172.21.15.143:0/1602124799 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380ab600 con 0x7fd54415ec60 2023-11-24T06:32:35.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd542ffd640 1 -- 172.21.15.143:0/1602124799 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380a7050 con 0x7fd54415ec60 2023-11-24T06:32:35.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd542ffd640 1 -- 172.21.15.143:0/1602124799 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380ab980 con 0x7fd54415ec60 2023-11-24T06:32:35.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 -- 172.21.15.143:0/1602124799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd54415ec60 msgr2=0x7fd5440cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd54415ec60 0x7fd5440cc170 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097c0 tx=0x7fd53801c3c0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 -- 172.21.15.143:0/1602124799 shutdown_connections 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5440cc6b0 0x7fd5440b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 --2- 172.21.15.143:0/1602124799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd54415ec60 0x7fd5440cc170 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 -- 172.21.15.143:0/1602124799 >> 172.21.15.143:0/1602124799 conn(0x7fd5440b0c80 msgr2=0x7fd5440b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 -- 172.21.15.143:0/1602124799 shutdown_connections 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 -- 172.21.15.143:0/1602124799 wait complete. 2023-11-24T06:32:35.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 Processor -- start 2023-11-24T06:32:35.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.533+0000 7fd54a817640 1 -- start start 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 0x7fd54414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54415a290 0x7fd5440ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd54415ec60 0x7fd5441636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441597d0 con 0x7fd5440cc6b0 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544158f30 con 0x7fd54415a290 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd544159210 con 0x7fd54415ec60 2023-11-24T06:32:35.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 0x7fd54414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 0x7fd54414b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41080/0 (socket says 172.21.15.143:41080) 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 -- 172.21.15.143:0/3056698664 learned_addr learned my addr 172.21.15.143:0/3056698664 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd5437fe640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54415a290 0x7fd5440ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd548db4640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd54415ec60 0x7fd5441636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 -- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd54415ec60 msgr2=0x7fd5441636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd54415ec60 0x7fd5441636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 -- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54415a290 msgr2=0x7fd5440ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54415a290 0x7fd5440ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 -- 172.21.15.143:0/3056698664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538009420 con 0x7fd5440cc6b0 2023-11-24T06:32:35.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd548db4640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd54415ec60 0x7fd5441636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:35.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd543fff640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 0x7fd54414b2a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd5340011f0 tx=0x7fd53400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5340074e0 con 0x7fd5440cc6b0 2023-11-24T06:32:35.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534007640 con 0x7fd5440cc6b0 2023-11-24T06:32:35.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5441594f0 con 0x7fd5440cc6b0 2023-11-24T06:32:35.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534004a10 con 0x7fd5440cc6b0 2023-11-24T06:32:35.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5440adfb0 con 0x7fd5440cc6b0 2023-11-24T06:32:35.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54404e8c0 con 0x7fd5440cc6b0 2023-11-24T06:32:35.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.537+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fd534004b70 con 0x7fd5440cc6b0 2023-11-24T06:32:35.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.541+0000 7fd540ff9640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd530066a10 0x7fd530068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.541+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd534083d60 con 0x7fd5440cc6b0 2023-11-24T06:32:35.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.541+0000 7fd5437fe640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd530066a10 0x7fd530068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.541+0000 7fd5437fe640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd530066a10 0x7fd530068ed0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd5380ad000 tx=0x7fd538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.545+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd534050a90 con 0x7fd5440cc6b0 2023-11-24T06:32:35.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.693+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd54415df00 con 0x7fd5440cc6b0 2023-11-24T06:32:35.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.693+0000 7fd540ff9640 1 -- 172.21.15.143:0/3056698664 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5340180a0 con 0x7fd5440cc6b0 2023-11-24T06:32:35.700 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd530066a10 msgr2=0x7fd530068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd530066a10 0x7fd530068ed0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd5380ad000 tx=0x7fd538008040 comp rx=0 tx=0).stop 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 msgr2=0x7fd54414b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 0x7fd54414b2a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd5340011f0 tx=0x7fd53400c9b0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 shutdown_connections 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd530066a10 0x7fd530068ed0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd54415ec60 0x7fd5441636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54415a290 0x7fd5440ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 --2- 172.21.15.143:0/3056698664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5440cc6b0 0x7fd54414b2a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 >> 172.21.15.143:0/3056698664 conn(0x7fd5440b0c80 msgr2=0x7fd5440b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:35.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 shutdown_connections 2023-11-24T06:32:35.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.697+0000 7fd54a817640 1 -- 172.21.15.143:0/3056698664 wait complete. 2023-11-24T06:32:35.721 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:32:35.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 Processor -- start 2023-11-24T06:32:35.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 -- start start 2023-11-24T06:32:35.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500ae4a0 0x7fb75015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb7500cd850 0x7fb7500cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.863 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7500ce250 0x7fb75015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7500ce6e0 con 0x7fb7500cd850 2023-11-24T06:32:35.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7500b3510 con 0x7fb7500ce250 2023-11-24T06:32:35.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb75658d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b37f0 con 0x7fb7500ae4a0 2023-11-24T06:32:35.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb7500cd850 0x7fb7500cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb7500cd850 0x7fb7500cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41096/0 (socket says 172.21.15.143:41096) 2023-11-24T06:32:35.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 -- 172.21.15.143:0/1178303613 learned_addr learned my addr 172.21.15.143:0/1178303613 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:35.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74ffff640 1 --2- 172.21.15.143:0/1178303613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500ae4a0 0x7fb75015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb754b2a640 1 --2- 172.21.15.143:0/1178303613 >> v2:172.21.15.146:3300/0 conn(0x7fb7500ce250 0x7fb75015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 -- 172.21.15.143:0/1178303613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500ae4a0 msgr2=0x7fb75015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 --2- 172.21.15.143:0/1178303613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500ae4a0 0x7fb75015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 -- 172.21.15.143:0/1178303613 >> v2:172.21.15.146:3300/0 conn(0x7fb7500ce250 msgr2=0x7fb75015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 --2- 172.21.15.143:0/1178303613 >> v2:172.21.15.146:3300/0 conn(0x7fb7500ce250 0x7fb75015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.857+0000 7fb74f7fe640 1 -- 172.21.15.143:0/1178303613 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500b3ad0 con 0x7fb7500cd850 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb74f7fe640 1 --2- 172.21.15.143:0/1178303613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500cd850 0x7fb7500cdd10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb7500cc570 tx=0x7fb74401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115c98f1e7085f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb74effd640 1 -- 172.21.15.143:0/1178303613 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ab600 con 0x7fb7500cd850 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb74effd640 1 -- 172.21.15.143:0/1178303613 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440a7050 con 0x7fb7500cd850 2023-11-24T06:32:35.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb74effd640 1 -- 172.21.15.143:0/1178303613 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ab980 con 0x7fb7500cd850 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 -- 172.21.15.143:0/1178303613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500cd850 msgr2=0x7fb7500cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 --2- 172.21.15.143:0/1178303613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500cd850 0x7fb7500cdd10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb7500cc570 tx=0x7fb74401c210 comp rx=0 tx=0).stop 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 -- 172.21.15.143:0/1178303613 shutdown_connections 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 --2- 172.21.15.143:0/1178303613 >> v2:172.21.15.146:3300/0 conn(0x7fb7500ce250 0x7fb75015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 --2- 172.21.15.143:0/1178303613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500cd850 0x7fb7500cdd10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 --2- 172.21.15.143:0/1178303613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500ae4a0 0x7fb75015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 -- 172.21.15.143:0/1178303613 >> 172.21.15.143:0/1178303613 conn(0x7fb7500b0c80 msgr2=0x7fb7500b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:35.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 -- 172.21.15.143:0/1178303613 shutdown_connections 2023-11-24T06:32:35.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 -- 172.21.15.143:0/1178303613 wait complete. 2023-11-24T06:32:35.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.861+0000 7fb75658d640 1 Processor -- start 2023-11-24T06:32:35.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- start start 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 0x7fb75014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500cd850 0x7fb7500abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7500ce250 0x7fb7500ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75014f930 con 0x7fb7500ae4a0 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500ad750 con 0x7fb7500ce250 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75014fdc0 con 0x7fb7500cd850 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 0x7fb75014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 0x7fb75014f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41112/0 (socket says 172.21.15.143:41112) 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 -- 172.21.15.143:0/3362878299 learned_addr learned my addr 172.21.15.143:0/3362878299 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74f7fe640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500cd850 0x7fb7500abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb754b2a640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7500ce250 0x7fb7500ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 -- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500cd850 msgr2=0x7fb7500abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500cd850 0x7fb7500abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 -- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7500ce250 msgr2=0x7fb7500ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:35.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7500ce250 0x7fb7500ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:35.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 -- 172.21.15.143:0/3362878299 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440094d0 con 0x7fb7500ae4a0 2023-11-24T06:32:35.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74ffff640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 0x7fb75014f3f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb74000e8e0 tx=0x7fb74000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000ca00 con 0x7fb7500ae4a0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74000cb60 con 0x7fb7500ae4a0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7500acb40 con 0x7fb7500ae4a0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740013470 con 0x7fb7500ae4a0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7500ad100 con 0x7fb7500ae4a0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.865+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75006c5c0 con 0x7fb7500ae4a0 2023-11-24T06:32:35.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.869+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb7400135d0 con 0x7fb7500ae4a0 2023-11-24T06:32:35.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.869+0000 7fb74cff9640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb73c066a40 0x7fb73c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:35.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.869+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb740084a20 con 0x7fb7500ae4a0 2023-11-24T06:32:35.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.869+0000 7fb74f7fe640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb73c066a40 0x7fb73c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:35.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.869+0000 7fb74f7fe640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb73c066a40 0x7fb73c068f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ad000 tx=0x7fb744008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:35.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:35.873+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb740051710 con 0x7fb7500ae4a0 2023-11-24T06:32:36.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.021+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb75004e8c0 con 0x7fb7500ae4a0 2023-11-24T06:32:36.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.021+0000 7fb74cff9640 1 -- 172.21.15.143:0/3362878299 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7400170a0 con 0x7fb7500ae4a0 2023-11-24T06:32:36.027 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:32:36.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb73c066a40 msgr2=0x7fb73c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb73c066a40 0x7fb73c068f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ad000 tx=0x7fb744008040 comp rx=0 tx=0).stop 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 msgr2=0x7fb75014f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 0x7fb75014f3f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb74000e8e0 tx=0x7fb74000eda0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 shutdown_connections 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb73c066a40 0x7fb73c068f00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7500ce250 0x7fb7500ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7500cd850 0x7fb7500abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 --2- 172.21.15.143:0/3362878299 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7500ae4a0 0x7fb75014f3f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 >> 172.21.15.143:0/3362878299 conn(0x7fb7500b0c80 msgr2=0x7fb7500af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 shutdown_connections 2023-11-24T06:32:36.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.025+0000 7fb75658d640 1 -- 172.21.15.143:0/3362878299 wait complete. 2023-11-24T06:32:36.048 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:32:36.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.181+0000 7ff630a46640 1 Processor -- start 2023-11-24T06:32:36.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.181+0000 7ff630a46640 1 -- start start 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff630a46640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff62c15a4d0 0x7ff62c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff630a46640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff62c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff630a46640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c06e0d0 con 0x7ff62c0cad20 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff630a46640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c15a8b0 con 0x7ff62c15a4d0 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff630a46640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0c9c30 con 0x7ff62c06d740 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff623fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff62c0cad20 0x7ff62c15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50004/0 (socket says 172.21.15.143:50004) 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff623fff640 1 -- 172.21.15.143:0/3399867160 learned_addr learned my addr 172.21.15.143:0/3399867160 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 --2- 172.21.15.143:0/3399867160 >> v2:172.21.15.146:3300/0 conn(0x7ff62c15a4d0 0x7ff62c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62ad9d640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff62c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086552425 0 0) 0x7ff614001120 con 0x7ff62c0cad20 2023-11-24T06:32:36.191 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff618003530 con 0x7ff62c0cad20 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1562612236 0 0) 0x7ff618003530 con 0x7ff62c0cad20 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 msgr2=0x7ff62c06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff62c06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 >> v2:172.21.15.146:3300/0 conn(0x7ff62c15a4d0 msgr2=0x7ff62c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 --2- 172.21.15.143:0/3399867160 >> v2:172.21.15.146:3300/0 conn(0x7ff62c15a4d0 0x7ff62c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0c9f60 con 0x7ff62c0cad20 2023-11-24T06:32:36.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7ff614001810 con 0x7ff62c0cad20 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 >> v1:172.21.15.143:6789/0 conn(0x7ff62c0cad20 legacy=0x7ff62c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff618003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6180047d0 0x7ff618004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff618005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c15a8b0 con 0x7ff618003980 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0c9c30 con 0x7ff6180047d0 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61800dbf0 con 0x7ff62c06d740 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff618003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff623fff640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6180047d0 0x7ff618004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62ad9d640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff618005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 -- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 msgr2=0x7ff618005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:36.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff618005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 -- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6180047d0 msgr2=0x7ff618004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:36.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6180047d0 0x7ff618004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62a59c640 1 -- 172.21.15.143:0/3399867160 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618003530 con 0x7ff618003980 2023-11-24T06:32:36.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.185+0000 7ff62ad9d640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c06d740 0x7ff618005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:36.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff62a59c640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff618003da0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009b10 tx=0x7ff61c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc852ddaa5209ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:36.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0a6470 con 0x7ff618003980 2023-11-24T06:32:36.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c0a65d0 con 0x7ff618003980 2023-11-24T06:32:36.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff629d9b640 1 -- 172.21.15.143:0/3399867160 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0a6980 con 0x7ff618003980 2023-11-24T06:32:36.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff630a46640 1 -- 172.21.15.143:0/3399867160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 msgr2=0x7ff618003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.195 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff630a46640 1 --2- 172.21.15.143:0/3399867160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff618003da0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009b10 tx=0x7ff61c01ca60 comp rx=0 tx=0).stop 2023-11-24T06:32:36.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff62ad9d640 1 -- 172.21.15.143:0/3399867160 reap_dead start 2023-11-24T06:32:36.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff630a46640 1 -- 172.21.15.143:0/3399867160 shutdown_connections 2023-11-24T06:32:36.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff630a46640 1 -- 172.21.15.143:0/3399867160 >> 172.21.15.143:0/3399867160 conn(0x7ff62c0b0bf0 msgr2=0x7ff62c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:36.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff630a46640 1 -- 172.21.15.143:0/3399867160 shutdown_connections 2023-11-24T06:32:36.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.189+0000 7ff630a46640 1 -- 172.21.15.143:0/3399867160 wait complete. 2023-11-24T06:32:36.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 Processor -- start 2023-11-24T06:32:36.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- start start 2023-11-24T06:32:36.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff62c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c157c40 0x7ff62c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff62c1580c0 0x7ff62c0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c15ab90 con 0x7ff618003980 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0b26f0 con 0x7ff62c1580c0 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0b2940 con 0x7ff62c157c40 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff62c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff62c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41120/0 (socket says 172.21.15.143:41120) 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 -- 172.21.15.143:0/1208765566 learned_addr learned my addr 172.21.15.143:0/1208765566 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff623fff640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c157c40 0x7ff62c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62ad9d640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff62c1580c0 0x7ff62c0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 -- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c157c40 msgr2=0x7ff62c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c157c40 0x7ff62c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 -- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff62c1580c0 msgr2=0x7ff62c0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff62c1580c0 0x7ff62c0b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 -- 172.21.15.143:0/1208765566 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0b2c20 con 0x7ff618003980 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62ad9d640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff62c1580c0 0x7ff62c0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:36.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff62a59c640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff62c15d5c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff61c01c890 tx=0x7ff618005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:36.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0a6dc0 con 0x7ff618003980 2023-11-24T06:32:36.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c0bc450 con 0x7ff618003980 2023-11-24T06:32:36.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0bc7e0 con 0x7ff618003980 2023-11-24T06:32:36.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c0b2f00 con 0x7ff618003980 2023-11-24T06:32:36.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c0b34c0 con 0x7ff618003980 2023-11-24T06:32:36.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.193+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c09d250 con 0x7ff618003980 2023-11-24T06:32:36.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.197+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7ff61c0bc940 con 0x7ff618003980 2023-11-24T06:32:36.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.197+0000 7ff622ffd640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff60c066a10 0x7ff60c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.197+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff61c11ea10 con 0x7ff618003980 2023-11-24T06:32:36.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.197+0000 7ff623fff640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff60c066a10 0x7ff60c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.197+0000 7ff623fff640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff60c066a10 0x7ff60c068ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0ae350 tx=0x7ff614007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:36.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.201+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff61c0eb460 con 0x7ff618003980 2023-11-24T06:32:36.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.365+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff62c15ab90 con 0x7ff618003980 2023-11-24T06:32:36.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.365+0000 7ff622ffd640 1 -- 172.21.15.143:0/1208765566 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff61c0eea80 con 0x7ff618003980 2023-11-24T06:32:36.372 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:32:36.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff60c066a10 msgr2=0x7ff60c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff60c066a10 0x7ff60c068ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0ae350 tx=0x7ff614007980 comp rx=0 tx=0).stop 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 msgr2=0x7ff62c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff62c15d5c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff61c01c890 tx=0x7ff618005800 comp rx=0 tx=0).stop 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 shutdown_connections 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff60c066a10 0x7ff60c068ed0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff62c1580c0 0x7ff62c0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff62c157c40 0x7ff62c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 --2- 172.21.15.143:0/1208765566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff618003980 0x7ff62c15d5c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 >> 172.21.15.143:0/1208765566 conn(0x7ff62c0b0bf0 msgr2=0x7ff62c0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:36.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 shutdown_connections 2023-11-24T06:32:36.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.369+0000 7ff630a46640 1 -- 172.21.15.143:0/1208765566 wait complete. 2023-11-24T06:32:36.394 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:32:36.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:36.395 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:32:36.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:32:36.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:36.423 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:32:36.478 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:36.478 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:36.488 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:36.488 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:36.538 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:36.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 Processor -- start 2023-11-24T06:32:36.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 -- start start 2023-11-24T06:32:36.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab406acc0 0x7f8ab4144f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ab40b30a0 0x7f8ab4145460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab40b1b70 con 0x7f8ab40b0a00 2023-11-24T06:32:36.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab40b15b0 con 0x7f8ab40b30a0 2023-11-24T06:32:36.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8abbfa1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40b1890 con 0x7f8ab406acc0 2023-11-24T06:32:36.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8ab9d3d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8ab40b0a00 0x7f8ab406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50012/0 (socket says 172.21.15.143:50012) 2023-11-24T06:32:36.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8ab9d3d640 1 -- 172.21.15.143:0/4093210231 learned_addr learned my addr 172.21.15.143:0/4093210231 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8aba53e640 1 --2- 172.21.15.143:0/4093210231 >> v2:172.21.15.146:3300/0 conn(0x7f8ab40b30a0 0x7f8ab4145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8ab953c640 1 --2- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab406acc0 0x7f8ab4144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8ab8d3b640 1 -- 172.21.15.143:0/4093210231 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241147868 0 0) 0x7f8ab40b1b70 con 0x7f8ab40b0a00 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8ab8d3b640 1 -- 172.21.15.143:0/4093210231 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0003530 con 0x7f8ab40b0a00 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8aba53e640 1 -- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab406acc0 msgr2=0x7f8ab4144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8aba53e640 1 --2- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab406acc0 0x7f8ab4144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8aba53e640 1 -- 172.21.15.143:0/4093210231 >> v1:172.21.15.143:6789/0 conn(0x7f8ab40b0a00 legacy=0x7f8ab406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.673+0000 7f8aba53e640 1 -- 172.21.15.143:0/4093210231 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40b4ca0 con 0x7f8ab40b30a0 2023-11-24T06:32:36.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8aba53e640 1 --2- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab40b30a0 0x7f8ab4145460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009d90 tx=0x7f8aac01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc78b6a4e092ed4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:36.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8ab8d3b640 1 -- 172.21.15.143:0/4093210231 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0a59b0 con 0x7f8ab40b30a0 2023-11-24T06:32:36.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8ab8d3b640 1 -- 172.21.15.143:0/4093210231 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac0a5b10 con 0x7f8ab40b30a0 2023-11-24T06:32:36.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8ab8d3b640 1 -- 172.21.15.143:0/4093210231 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0a5ea0 con 0x7f8ab40b30a0 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 -- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab40b30a0 msgr2=0x7f8ab4145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab40b30a0 0x7f8ab4145460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009d90 tx=0x7f8aac01c950 comp rx=0 tx=0).stop 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 -- 172.21.15.143:0/4093210231 shutdown_connections 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab40b30a0 0x7f8ab4145460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/4093210231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab406acc0 0x7f8ab4144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 -- 172.21.15.143:0/4093210231 >> 172.21.15.143:0/4093210231 conn(0x7f8ab40b55c0 msgr2=0x7f8ab40b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 -- 172.21.15.143:0/4093210231 shutdown_connections 2023-11-24T06:32:36.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.677+0000 7f8abbfa1640 1 -- 172.21.15.143:0/4093210231 wait complete. 2023-11-24T06:32:36.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 Processor -- start 2023-11-24T06:32:36.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 -- start start 2023-11-24T06:32:36.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab406acc0 0x7f8ab4163200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 0x7f8ab406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab40b30a0 0x7f8ab406df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab409d5f0 con 0x7f8ab40b0a00 2023-11-24T06:32:36.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab409cd50 con 0x7f8ab406acc0 2023-11-24T06:32:36.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8abbfa1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab409d030 con 0x7f8ab40b30a0 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 0x7f8ab406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 0x7f8ab406d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41128/0 (socket says 172.21.15.143:41128) 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 -- 172.21.15.143:0/2972847725 learned_addr learned my addr 172.21.15.143:0/2972847725 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8aba53e640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab40b30a0 0x7f8ab406df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab9d3d640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab406acc0 0x7f8ab4163200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 -- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab40b30a0 msgr2=0x7f8ab406df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab40b30a0 0x7f8ab406df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 -- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab406acc0 msgr2=0x7f8ab4163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab406acc0 0x7f8ab4163200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 -- 172.21.15.143:0/2972847725 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac009a70 con 0x7f8ab40b0a00 2023-11-24T06:32:36.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.681+0000 7f8ab953c640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 0x7f8ab406d9f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400e870 tx=0x7f8aa400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:36.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4009510 con 0x7f8ab40b0a00 2023-11-24T06:32:36.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa400eec0 con 0x7f8ab40b0a00 2023-11-24T06:32:36.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab409d310 con 0x7f8ab40b0a00 2023-11-24T06:32:36.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa400cb40 con 0x7f8ab40b0a00 2023-11-24T06:32:36.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4163740 con 0x7f8ab40b0a00 2023-11-24T06:32:36.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab4067520 con 0x7f8ab40b0a00 2023-11-24T06:32:36.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f8aa400cca0 con 0x7f8ab40b0a00 2023-11-24T06:32:36.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8aaa7fc640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8a98066a10 0x7f8a98068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:36.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8aa40849d0 con 0x7f8ab40b0a00 2023-11-24T06:32:36.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.685+0000 7f8ab9d3d640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8a98066a10 0x7f8a98068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:36.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.689+0000 7f8ab9d3d640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8a98066a10 0x7f8a98068ed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00011f0 tx=0x7f8ab0007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:36.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.689+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8aa4051630 con 0x7f8ab40b0a00 2023-11-24T06:32:36.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.841+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ab40b0150 con 0x7f8ab40b0a00 2023-11-24T06:32:36.850 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8aaa7fc640 1 -- 172.21.15.143:0/2972847725 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16659 (secure 0 0 0) 0x7f8aa4017090 con 0x7f8ab40b0a00 2023-11-24T06:32:36.850 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:36.850 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":72,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:23.588756+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:36.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8a98066a10 msgr2=0x7f8a98068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8a98066a10 0x7f8a98068ed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00011f0 tx=0x7f8ab0007d40 comp rx=0 tx=0).stop 2023-11-24T06:32:36.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 msgr2=0x7f8ab406d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:36.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 0x7f8ab406d9f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400e870 tx=0x7f8aa400ec70 comp rx=0 tx=0).stop 2023-11-24T06:32:36.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 shutdown_connections 2023-11-24T06:32:36.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8a98066a10 0x7f8a98068ed0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ab40b30a0 0x7f8ab406df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab40b0a00 0x7f8ab406d9f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 --2- 172.21.15.143:0/2972847725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ab406acc0 0x7f8ab4163200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:36.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 >> 172.21.15.143:0/2972847725 conn(0x7f8ab40b55c0 msgr2=0x7f8ab4165ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:36.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 shutdown_connections 2023-11-24T06:32:36.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:36.845+0000 7f8abbfa1640 1 -- 172.21.15.143:0/2972847725 wait complete. 2023-11-24T06:32:36.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:32:19.668658+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:32:20.965372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:36.873 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:37.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f14918e3640 1 Processor -- start 2023-11-24T06:32:37.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f14918e3640 1 -- start start 2023-11-24T06:32:37.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f14918e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 0x7f148c164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f14918e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c15a050 con 0x7f148c0ccef0 2023-11-24T06:32:37.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f14918e3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c06e150 con 0x7f148c0ce2e0 2023-11-24T06:32:37.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f14918e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0722e0 con 0x7f148c0b1f80 2023-11-24T06:32:37.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148affd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f148c0ccef0 0x7f148c06d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50016/0 (socket says 172.21.15.143:50016) 2023-11-24T06:32:37.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148affd640 1 -- 172.21.15.143:0/4071343313 learned_addr learned my addr 172.21.15.143:0/4071343313 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981653451 0 0) 0x7f148c15a050 con 0x7f148c0ccef0 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 0x7f148c164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003530 con 0x7f148c0ccef0 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3300942258 0 0) 0x7f1474003530 con 0x7f148c0ccef0 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 msgr2=0x7f148c164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 0x7f148c164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 >> v1:172.21.15.146:6789/0 conn(0x7f148c0ce2e0 legacy=0x7f148c06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c072860 con 0x7f148c0ccef0 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f147c001680 con 0x7f148c0ccef0 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 >> v1:172.21.15.143:6789/0 conn(0x7f148c0ccef0 legacy=0x7f148c06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 0x7f14740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474003f30 0x7f14740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1474004d10 0x7f1474005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0722e0 con 0x7f1474004d10 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147400ba70 con 0x7f1474003f30 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147400bc30 con 0x7f148c0b1f80 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1474004d10 0x7f1474005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148affd640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 0x7f14740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148a7fc640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474003f30 0x7f14740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 -- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 msgr2=0x7f14740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:37.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b1f80 0x7f14740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 -- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474003f30 msgr2=0x7f14740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:37.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474003f30 0x7f14740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.009+0000 7f148b7fe640 1 -- 172.21.15.143:0/4071343313 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474003530 con 0x7f1474004d10 2023-11-24T06:32:37.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f148b7fe640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1474004d10 0x7f1474005190 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1484009fc0 tx=0x7f148401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736dfa32a4d572b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840a5c70 con 0x7f1474004d10 2023-11-24T06:32:37.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400f040 con 0x7f1474004d10 2023-11-24T06:32:37.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f1489ffb640 1 -- 172.21.15.143:0/4071343313 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ad440 con 0x7f1474004d10 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f14918e3640 1 -- 172.21.15.143:0/4071343313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1474004d10 msgr2=0x7f1474005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f14918e3640 1 --2- 172.21.15.143:0/4071343313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1474004d10 0x7f1474005190 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1484009fc0 tx=0x7f148401cc60 comp rx=0 tx=0).stop 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f148b7fe640 1 -- 172.21.15.143:0/4071343313 reap_dead start 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f14918e3640 1 -- 172.21.15.143:0/4071343313 shutdown_connections 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f14918e3640 1 -- 172.21.15.143:0/4071343313 >> 172.21.15.143:0/4071343313 conn(0x7f148c0b0c80 msgr2=0x7f148c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f14918e3640 1 -- 172.21.15.143:0/4071343313 shutdown_connections 2023-11-24T06:32:37.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.013+0000 7f14918e3640 1 -- 172.21.15.143:0/4071343313 wait complete. 2023-11-24T06:32:37.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 Processor -- start 2023-11-24T06:32:37.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 -- start start 2023-11-24T06:32:37.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c1f2ea0 0x7f148c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 0x7f148c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c15cca0 0x7f148c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0b3180 con 0x7f148c0b2d00 2023-11-24T06:32:37.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c152b10 con 0x7f148c15cca0 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c15d120 con 0x7f148c1f2ea0 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 0x7f148c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 0x7f148c15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41146/0 (socket says 172.21.15.143:41146) 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 -- 172.21.15.143:0/2689351936 learned_addr learned my addr 172.21.15.143:0/2689351936 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148b7fe640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c15cca0 0x7f148c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148affd640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c1f2ea0 0x7f148c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 -- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c1f2ea0 msgr2=0x7f148c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c1f2ea0 0x7f148c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 -- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c15cca0 msgr2=0x7f148c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c15cca0 0x7f148c0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 -- 172.21.15.143:0/2689351936 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c151f00 con 0x7f148c0b2d00 2023-11-24T06:32:37.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148b7fe640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c15cca0 0x7f148c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148affd640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c1f2ea0 0x7f148c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f148a7fc640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 0x7f148c15c760 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f148000f7f0 tx=0x7f148000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800050d0 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480005230 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c1521e0 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000d730 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.017+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1527a0 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.021+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c04e8c0 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.021+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f148000d890 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.021+0000 7f1473fff640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1478066a00 0x7f1478068ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.021+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f14800848d0 con 0x7f148c0b2d00 2023-11-24T06:32:37.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.021+0000 7f148affd640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1478066a00 0x7f1478068ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.021+0000 7f148affd640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1478066a00 0x7f1478068ec0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f147c007d50 tx=0x7f147c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.025+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14800514c0 con 0x7f148c0b2d00 2023-11-24T06:32:37.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.177+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f148c152960 con 0x7f148c0b2d00 2023-11-24T06:32:37.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.177+0000 7f1473fff640 1 -- 172.21.15.143:0/2689351936 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1480054ae0 con 0x7f148c0b2d00 2023-11-24T06:32:37.184 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1478066a00 msgr2=0x7f1478068ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1478066a00 0x7f1478068ec0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f147c007d50 tx=0x7f147c009040 comp rx=0 tx=0).stop 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 msgr2=0x7f148c15c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 0x7f148c15c760 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f148000f7f0 tx=0x7f148000fcb0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 shutdown_connections 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1478066a00 0x7f1478068ec0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c15cca0 0x7f148c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148c0b2d00 0x7f148c15c760 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 --2- 172.21.15.143:0/2689351936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c1f2ea0 0x7f148c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 >> 172.21.15.143:0/2689351936 conn(0x7f148c0b0c80 msgr2=0x7f148c0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:37.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 shutdown_connections 2023-11-24T06:32:37.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.181+0000 7f14918e3640 1 -- 172.21.15.143:0/2689351936 wait complete. 2023-11-24T06:32:37.205 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:32:37.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 Processor -- start 2023-11-24T06:32:37.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 -- start start 2023-11-24T06:32:37.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f281c0ce420 0x7f281c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0cd850 0x7f281c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c0b3510 con 0x7f281c0ae4a0 2023-11-24T06:32:37.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0b37f0 con 0x7f281c0ce420 2023-11-24T06:32:37.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f2821c91640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0b3ad0 con 0x7f281c0cd850 2023-11-24T06:32:37.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281affd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f281c0ce420 0x7f281c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281b7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f281c0ae4a0 0x7f281c0cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50028/0 (socket says 172.21.15.143:50028) 2023-11-24T06:32:37.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281b7fe640 1 -- 172.21.15.143:0/1367074265 learned_addr learned my addr 172.21.15.143:0/1367074265 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:37.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281bfff640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0cd850 0x7f281c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281affd640 1 -- 172.21.15.143:0/1367074265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0cd850 msgr2=0x7f281c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:37.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281affd640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0cd850 0x7f281c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281affd640 1 -- 172.21.15.143:0/1367074265 >> v1:172.21.15.143:6789/0 conn(0x7f281c0ae4a0 legacy=0x7f281c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.341+0000 7f281a7fc640 1 -- 172.21.15.143:0/1367074265 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032261660 0 0) 0x7f281c0b3510 con 0x7f281c0ae4a0 2023-11-24T06:32:37.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f281affd640 1 -- 172.21.15.143:0/1367074265 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0b3db0 con 0x7f281c0ce420 2023-11-24T06:32:37.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f281bfff640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0cd850 0x7f281c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:37.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f281affd640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0ce420 0x7f281c15ba00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f28100097c0 tx=0x7f281001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc172958d93c40 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f281a7fc640 1 -- 172.21.15.143:0/1367074265 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100ab670 con 0x7f281c0ce420 2023-11-24T06:32:37.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f281a7fc640 1 -- 172.21.15.143:0/1367074265 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28100ab7d0 con 0x7f281c0ce420 2023-11-24T06:32:37.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f281a7fc640 1 -- 172.21.15.143:0/1367074265 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100abb60 con 0x7f281c0ce420 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 -- 172.21.15.143:0/1367074265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0ce420 msgr2=0x7f281c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0ce420 0x7f281c15ba00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f28100097c0 tx=0x7f281001c450 comp rx=0 tx=0).stop 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 -- 172.21.15.143:0/1367074265 shutdown_connections 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0cd850 0x7f281c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 --2- 172.21.15.143:0/1367074265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0ce420 0x7f281c15ba00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 -- 172.21.15.143:0/1367074265 >> 172.21.15.143:0/1367074265 conn(0x7f281c0b0c80 msgr2=0x7f281c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:37.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 -- 172.21.15.143:0/1367074265 shutdown_connections 2023-11-24T06:32:37.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.345+0000 7f2821c91640 1 -- 172.21.15.143:0/1367074265 wait complete. 2023-11-24T06:32:37.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 Processor -- start 2023-11-24T06:32:37.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 -- start start 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281c0ae4a0 0x7f281c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 0x7f281c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0ce420 0x7f281c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c155970 con 0x7f281c0cd850 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c153c70 con 0x7f281c0ae4a0 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f2821c91640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c153f50 con 0x7f281c0ce420 2023-11-24T06:32:37.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 0x7f281c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 0x7f281c154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41174/0 (socket says 172.21.15.143:41174) 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 -- 172.21.15.143:0/3536892799 learned_addr learned my addr 172.21.15.143:0/3536892799 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281b7fe640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281c0ae4a0 0x7f281c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281bfff640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0ce420 0x7f281c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 -- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0ce420 msgr2=0x7f281c151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0ce420 0x7f281c151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 -- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281c0ae4a0 msgr2=0x7f281c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281c0ae4a0 0x7f281c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 -- 172.21.15.143:0/3536892799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810009420 con 0x7f281c0cd850 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.349+0000 7f281affd640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 0x7f281c154a30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f281001ab00 tx=0x7f28100191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100abe90 con 0x7f281c0cd850 2023-11-24T06:32:37.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28100bf450 con 0x7f281c0cd850 2023-11-24T06:32:37.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100bf820 con 0x7f281c0cd850 2023-11-24T06:32:37.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c154230 con 0x7f281c0cd850 2023-11-24T06:32:37.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c151fa0 con 0x7f281c0cd850 2023-11-24T06:32:37.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c155ae0 con 0x7f281c0cd850 2023-11-24T06:32:37.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f28100b43f0 con 0x7f281c0cd850 2023-11-24T06:32:37.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2803fff640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2808066a40 0x7f2808068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f281011f130 con 0x7f281c0cd850 2023-11-24T06:32:37.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.353+0000 7f281b7fe640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2808066a40 0x7f2808068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.357+0000 7f281b7fe640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2808066a40 0x7f2808068f00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f280c007fd0 tx=0x7f280c007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.357+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f281c155ae0 con 0x7f281c0cd850 2023-11-24T06:32:37.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.509+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f281c155ab0 con 0x7f281c0cd850 2023-11-24T06:32:37.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.509+0000 7f2803fff640 1 -- 172.21.15.143:0/3536892799 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28100ebbf0 con 0x7f281c0cd850 2023-11-24T06:32:37.515 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:32:37.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.509+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2808066a40 msgr2=0x7f2808068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.509+0000 7f2821c91640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2808066a40 0x7f2808068f00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f280c007fd0 tx=0x7f280c007d60 comp rx=0 tx=0).stop 2023-11-24T06:32:37.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.509+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 msgr2=0x7f281c154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.509+0000 7f2821c91640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 0x7f281c154a30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f281001ab00 tx=0x7f28100191f0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 shutdown_connections 2023-11-24T06:32:37.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2808066a40 0x7f2808068f00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f281c0ce420 0x7f281c151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f281c0cd850 0x7f281c154a30 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 --2- 172.21.15.143:0/3536892799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281c0ae4a0 0x7f281c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 >> 172.21.15.143:0/3536892799 conn(0x7f281c0b0c80 msgr2=0x7f281c15caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:37.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 shutdown_connections 2023-11-24T06:32:37.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.513+0000 7f2821c91640 1 -- 172.21.15.143:0/3536892799 wait complete. 2023-11-24T06:32:37.537 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:32:37.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.673+0000 7f31f05c1640 1 Processor -- start 2023-11-24T06:32:37.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.673+0000 7f31f05c1640 1 -- start start 2023-11-24T06:32:37.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.673+0000 7f31f05c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f31e80ccef0 0x7f31e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.673+0000 7f31f05c1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31e80b1f80 0x7f31e806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31f05c1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e815a050 con 0x7f31e806ddb0 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31f05c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e806e1c0 con 0x7f31e80ccef0 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31f05c1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80722e0 con 0x7f31e80b1f80 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f31e80ccef0 0x7f31e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f31e80ccef0 0x7f31e806d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58498/0 (socket says 172.21.15.143:58498) 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 -- 172.21.15.143:0/205557067 learned_addr learned my addr 172.21.15.143:0/205557067 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31edb5c640 1 --2- 172.21.15.143:0/205557067 >> v2:172.21.15.146:3300/0 conn(0x7f31e80b1f80 0x7f31e806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 -- 172.21.15.143:0/205557067 >> v2:172.21.15.146:3300/0 conn(0x7f31e80b1f80 msgr2=0x7f31e806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 --2- 172.21.15.143:0/205557067 >> v2:172.21.15.146:3300/0 conn(0x7f31e80b1f80 0x7f31e806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 -- 172.21.15.143:0/205557067 >> v1:172.21.15.146:6789/0 conn(0x7f31e806ddb0 legacy=0x7f31e80cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:37.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 -- 172.21.15.143:0/205557067 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8072860 con 0x7f31e80ccef0 2023-11-24T06:32:37.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ee35d640 1 --2- 172.21.15.143:0/205557067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e80ccef0 0x7f31e806d330 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f31e80b18a0 tx=0x7f31e401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1fb19d6510b251 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ed35b640 1 -- 172.21.15.143:0/205557067 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40ab600 con 0x7f31e80ccef0 2023-11-24T06:32:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ed35b640 1 -- 172.21.15.143:0/205557067 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40a7050 con 0x7f31e80ccef0 2023-11-24T06:32:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.677+0000 7f31ed35b640 1 -- 172.21.15.143:0/205557067 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40ab980 con 0x7f31e80ccef0 2023-11-24T06:32:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- 172.21.15.143:0/205557067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e80ccef0 msgr2=0x7f31e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 --2- 172.21.15.143:0/205557067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e80ccef0 0x7f31e806d330 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f31e80b18a0 tx=0x7f31e401c490 comp rx=0 tx=0).stop 2023-11-24T06:32:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- 172.21.15.143:0/205557067 shutdown_connections 2023-11-24T06:32:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 --2- 172.21.15.143:0/205557067 >> v2:172.21.15.146:3300/0 conn(0x7f31e80b1f80 0x7f31e806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 --2- 172.21.15.143:0/205557067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e80ccef0 0x7f31e806d330 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- 172.21.15.143:0/205557067 >> 172.21.15.143:0/205557067 conn(0x7f31e80b0c80 msgr2=0x7f31e80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- 172.21.15.143:0/205557067 shutdown_connections 2023-11-24T06:32:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- 172.21.15.143:0/205557067 wait complete. 2023-11-24T06:32:37.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 Processor -- start 2023-11-24T06:32:37.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- start start 2023-11-24T06:32:37.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 0x7f31e8145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e80b1f80 0x7f31e8151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e80ccef0 0x7f31e814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81508a0 con 0x7f31e806ddb0 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8150b60 con 0x7f31e80ccef0 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31f05c1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8150e40 con 0x7f31e80b1f80 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31ee35d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 0x7f31e8145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31ee35d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 0x7f31e8145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58504/0 (socket says 172.21.15.143:58504) 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31ee35d640 1 -- 172.21.15.143:0/2757256942 learned_addr learned my addr 172.21.15.143:0/2757256942 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31eeb5e640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e80ccef0 0x7f31e814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.681+0000 7f31edb5c640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e80b1f80 0x7f31e8151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31ee35d640 1 -- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e80b1f80 msgr2=0x7f31e8151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31ee35d640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e80b1f80 0x7f31e8151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31ee35d640 1 -- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e80ccef0 msgr2=0x7f31e814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31ee35d640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e80ccef0 0x7f31e814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31ee35d640 1 -- 172.21.15.143:0/2757256942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40094d0 con 0x7f31e806ddb0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31ee35d640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 0x7f31e8145570 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f31e40ae040 tx=0x7f31e401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40b6620 con 0x7f31e806ddb0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40abe90 con 0x7f31e806ddb0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e8151120 con 0x7f31e806ddb0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40b69e0 con 0x7f31e806ddb0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e8151e60 con 0x7f31e806ddb0 2023-11-24T06:32:37.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e804e8c0 con 0x7f31e806ddb0 2023-11-24T06:32:37.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f31e40b2040 con 0x7f31e806ddb0 2023-11-24T06:32:37.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31deffd640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f31cc066a10 0x7f31cc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:37.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f31e411eb30 con 0x7f31e806ddb0 2023-11-24T06:32:37.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.685+0000 7f31edb5c640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f31cc066a10 0x7f31cc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:37.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.689+0000 7f31edb5c640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f31cc066a10 0x7f31cc068ed0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f31e814fe00 tx=0x7f31d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:37.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.689+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31e40eb680 con 0x7f31e806ddb0 2023-11-24T06:32:37.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.845+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31e806e900 con 0x7f31e806ddb0 2023-11-24T06:32:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31deffd640 1 -- 172.21.15.143:0/2757256942 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31e40b00a0 con 0x7f31e806ddb0 2023-11-24T06:32:37.854 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:32:37.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f31cc066a10 msgr2=0x7f31cc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f31cc066a10 0x7f31cc068ed0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f31e814fe00 tx=0x7f31d8008040 comp rx=0 tx=0).stop 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 msgr2=0x7f31e8145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 0x7f31e8145570 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f31e40ae040 tx=0x7f31e401acd0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 shutdown_connections 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f31cc066a10 0x7f31cc068ed0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e80ccef0 0x7f31e814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e80b1f80 0x7f31e8151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 --2- 172.21.15.143:0/2757256942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31e806ddb0 0x7f31e8145570 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 >> 172.21.15.143:0/2757256942 conn(0x7f31e80b0c80 msgr2=0x7f31e80ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 shutdown_connections 2023-11-24T06:32:37.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:37.849+0000 7f31f05c1640 1 -- 172.21.15.143:0/2757256942 wait complete. 2023-11-24T06:32:37.874 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:32:38.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.009+0000 7f151b59e640 1 Processor -- start 2023-11-24T06:32:38.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.009+0000 7f151b59e640 1 -- start start 2023-11-24T06:32:38.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.009+0000 7f151b59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 0x7f151c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.009+0000 7f151b59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c0d1960 con 0x7f151c06b6c0 2023-11-24T06:32:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.009+0000 7f151b59e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c15dc30 con 0x7f151c154830 2023-11-24T06:32:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.009+0000 7f151b59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c15df10 con 0x7f151c0d0fc0 2023-11-24T06:32:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f151c06b6c0 0x7f151c06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:60962/0 (socket says 172.21.15.143:60962) 2023-11-24T06:32:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 -- 172.21.15.143:0/3927292779 learned_addr learned my addr 172.21.15.143:0/3927292779 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:38.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1513fff640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 0x7f151c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489818638 0 0) 0x7f151c0d1960 con 0x7f151c06b6c0 2023-11-24T06:32:38.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1508003530 con 0x7f151c06b6c0 2023-11-24T06:32:38.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134954428 0 0) 0x7f1508003530 con 0x7f151c06b6c0 2023-11-24T06:32:38.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 msgr2=0x7f151c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:38.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 0x7f151c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 >> v1:172.21.15.146:6789/0 conn(0x7f151c154830 legacy=0x7f151c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c15e1f0 con 0x7f151c06b6c0 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f1514001a00 con 0x7f151c06b6c0 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 >> v1:172.21.15.143:6789/0 conn(0x7f151c06b6c0 legacy=0x7f151c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 0x7f15080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1508003ef0 0x7f15080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f1508005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c15df10 con 0x7f1508004d10 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150800baa0 con 0x7f1508003ef0 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150800bc60 con 0x7f151c0d0fc0 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f1508005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151a59c640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 0x7f15080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1513fff640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1508003ef0 0x7f15080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 -- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 msgr2=0x7f15080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c0d0fc0 0x7f15080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 -- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1508003ef0 msgr2=0x7f15080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1508003ef0 0x7f15080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f151ad9d640 1 -- 172.21.15.143:0/3927292779 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508003530 con 0x7f1508004d10 2023-11-24T06:32:38.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.013+0000 7f1513fff640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1508003ef0 0x7f15080047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151ad9d640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f1508005190 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f151400a830 tx=0x7f151401d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a0d98671d27f64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140ad630 con 0x7f1508004d10 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15140a8070 con 0x7f1508004d10 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f1519d9b640 1 -- 172.21.15.143:0/3927292779 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140ada30 con 0x7f1508004d10 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 -- 172.21.15.143:0/3927292779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 msgr2=0x7f1508005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 --2- 172.21.15.143:0/3927292779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f1508005190 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f151400a830 tx=0x7f151401d310 comp rx=0 tx=0).stop 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151ad9d640 1 -- 172.21.15.143:0/3927292779 reap_dead start 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 -- 172.21.15.143:0/3927292779 shutdown_connections 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 -- 172.21.15.143:0/3927292779 >> 172.21.15.143:0/3927292779 conn(0x7f151c060fd0 msgr2=0x7f151c0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:38.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 -- 172.21.15.143:0/3927292779 shutdown_connections 2023-11-24T06:32:38.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 -- 172.21.15.143:0/3927292779 wait complete. 2023-11-24T06:32:38.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 Processor -- start 2023-11-24T06:32:38.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.017+0000 7f151b59e640 1 -- start start 2023-11-24T06:32:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f151c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151c0cd3c0 0x7f151c1601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c1606e0 0x7f151c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c160b60 con 0x7f1508004d10 2023-11-24T06:32:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c0cc100 con 0x7f151c0cd3c0 2023-11-24T06:32:38.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c0cc350 con 0x7f151c1606e0 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f151c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f151c1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58522/0 (socket says 172.21.15.143:58522) 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 -- 172.21.15.143:0/3308922846 learned_addr learned my addr 172.21.15.143:0/3308922846 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f1513fff640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151c0cd3c0 0x7f151c1601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151ad9d640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c1606e0 0x7f151c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 -- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c1606e0 msgr2=0x7f151c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c1606e0 0x7f151c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 -- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151c0cd3c0 msgr2=0x7f151c1601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151c0cd3c0 0x7f151c1601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 -- 172.21.15.143:0/3308922846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c0cc630 con 0x7f1508004d10 2023-11-24T06:32:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151a59c640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f151c1539f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f150c00f780 tx=0x7f150c00fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00fe90 con 0x7f1508004d10 2023-11-24T06:32:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c0052e0 con 0x7f1508004d10 2023-11-24T06:32:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c0cc910 con 0x7f1508004d10 2023-11-24T06:32:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00d970 con 0x7f1508004d10 2023-11-24T06:32:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c0cced0 con 0x7f1508004d10 2023-11-24T06:32:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c04e850 con 0x7f1508004d10 2023-11-24T06:32:38.030 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.021+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f150c00dad0 con 0x7f1508004d10 2023-11-24T06:32:38.031 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.025+0000 7f1512ffd640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14fc066a10 0x7f14fc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.025+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f150c084a30 con 0x7f1508004d10 2023-11-24T06:32:38.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.025+0000 7f1513fff640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14fc066a10 0x7f14fc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.025+0000 7f1513fff640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14fc066a10 0x7f14fc068ed0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f151c15d730 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.033 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.029+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f150c0515a0 con 0x7f1508004d10 2023-11-24T06:32:38.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f151c164260 con 0x7f1508004d10 2023-11-24T06:32:38.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f1512ffd640 1 -- 172.21.15.143:0/3308922846 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f150c054bc0 con 0x7f1508004d10 2023-11-24T06:32:38.195 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:32:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14fc066a10 msgr2=0x7f14fc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14fc066a10 0x7f14fc068ed0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f151c15d730 tx=0x7f1504008040 comp rx=0 tx=0).stop 2023-11-24T06:32:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 msgr2=0x7f151c1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f151c1539f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f150c00f780 tx=0x7f150c00fc40 comp rx=0 tx=0).stop 2023-11-24T06:32:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 shutdown_connections 2023-11-24T06:32:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f14fc066a10 0x7f14fc068ed0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f151c1606e0 0x7f151c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151c0cd3c0 0x7f151c1601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 --2- 172.21.15.143:0/3308922846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1508004d10 0x7f151c1539f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 >> 172.21.15.143:0/3308922846 conn(0x7f151c060fd0 msgr2=0x7f151c163910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 shutdown_connections 2023-11-24T06:32:38.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.189+0000 7f151b59e640 1 -- 172.21.15.143:0/3308922846 wait complete. 2023-11-24T06:32:38.216 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:32:38.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:38.217 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:32:38.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:32:38.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:32:38.257 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:32:38.310 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:38.311 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:38.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:32:38.320 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:38.320 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:38.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:32:38.366 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:38.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:32:38.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:32:38.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.497+0000 7fc7e7459640 1 Processor -- start 2023-11-24T06:32:38.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.497+0000 7fc7e7459640 1 -- start start 2023-11-24T06:32:38.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e7459640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc7e00ce750 0x7fc7e00cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e7459640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e7459640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00d04f0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e7459640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e015d980 con 0x7fc7e00ce750 2023-11-24T06:32:38.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e7459640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00ced10 con 0x7fc7e00d00a0 2023-11-24T06:32:38.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e5c56640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc7e00ce750 0x7fc7e00cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e6457640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc7e015d5a0 0x7fc7e00d39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:60976/0 (socket says 172.21.15.143:60976) 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e6457640 1 -- 172.21.15.143:0/3690755167 learned_addr learned my addr 172.21.15.143:0/3690755167 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e6c58640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e5c56640 1 -- 172.21.15.143:0/3690755167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 msgr2=0x7fc7e00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e5c56640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e5c56640 1 -- 172.21.15.143:0/3690755167 >> v1:172.21.15.143:6789/0 conn(0x7fc7e015d5a0 legacy=0x7fc7e00d39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e5c56640 1 -- 172.21.15.143:0/3690755167 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00ceff0 con 0x7fc7e00ce750 2023-11-24T06:32:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e6c58640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:38.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.501+0000 7fc7e5455640 1 -- 172.21.15.143:0/3690755167 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700811205 0 0) 0x7fc7dc001120 con 0x7fc7e015d5a0 2023-11-24T06:32:38.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e5c56640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e00ce750 0x7fc7e00cfb60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00097c0 tx=0x7fc7d001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549fb73d30f0cdae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e5455640 1 -- 172.21.15.143:0/3690755167 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00a8970 con 0x7fc7e00ce750 2023-11-24T06:32:38.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e5455640 1 -- 172.21.15.143:0/3690755167 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d00a8ad0 con 0x7fc7e00ce750 2023-11-24T06:32:38.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e5455640 1 -- 172.21.15.143:0/3690755167 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00a8e60 con 0x7fc7e00ce750 2023-11-24T06:32:38.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 -- 172.21.15.143:0/3690755167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e00ce750 msgr2=0x7fc7e00cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e00ce750 0x7fc7e00cfb60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00097c0 tx=0x7fc7d001ec70 comp rx=0 tx=0).stop 2023-11-24T06:32:38.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 -- 172.21.15.143:0/3690755167 shutdown_connections 2023-11-24T06:32:38.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3690755167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e00ce750 0x7fc7e00cfb60 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 -- 172.21.15.143:0/3690755167 >> 172.21.15.143:0/3690755167 conn(0x7fc7e009c510 msgr2=0x7fc7e00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:38.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 -- 172.21.15.143:0/3690755167 shutdown_connections 2023-11-24T06:32:38.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 -- 172.21.15.143:0/3690755167 wait complete. 2023-11-24T06:32:38.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 Processor -- start 2023-11-24T06:32:38.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.505+0000 7fc7e7459640 1 -- start start 2023-11-24T06:32:38.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7e00ce750 0x7fc7e01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 0x7fc7e00b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0160a00 con 0x7fc7e015d5a0 2023-11-24T06:32:38.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c6e40 con 0x7fc7e00ce750 2023-11-24T06:32:38.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0154ee0 con 0x7fc7e00d00a0 2023-11-24T06:32:38.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 0x7fc7e00b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 0x7fc7e00b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58538/0 (socket says 172.21.15.143:58538) 2023-11-24T06:32:38.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 -- 172.21.15.143:0/3945362758 learned_addr learned my addr 172.21.15.143:0/3945362758 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:38.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e5c56640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6457640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7e00ce750 0x7fc7e01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 -- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 msgr2=0x7fc7e00b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 -- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7e00ce750 msgr2=0x7fc7e01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7e00ce750 0x7fc7e01549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 -- 172.21.15.143:0/3945362758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009420 con 0x7fc7e015d5a0 2023-11-24T06:32:38.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e6c58640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 0x7fc7e00b1be0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009fa0 tx=0x7fc7d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8003ba0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d800f040 con 0x7fc7e015d5a0 2023-11-24T06:32:38.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e0160440 con 0x7fc7e015d5a0 2023-11-24T06:32:38.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8004030 con 0x7fc7e015d5a0 2023-11-24T06:32:38.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00c70e0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e00c6ca0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.509+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fc7d8004190 con 0x7fc7e015d5a0 2023-11-24T06:32:38.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.513+0000 7fc7d6ffd640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7c4066a10 0x7fc7c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.513+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fc7d8084d20 con 0x7fc7e015d5a0 2023-11-24T06:32:38.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.513+0000 7fc7e6457640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7c4066a10 0x7fc7c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.521 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.513+0000 7fc7e6457640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7c4066a10 0x7fc7c4068ed0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc007fd0 tx=0x7fc7dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.522 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.517+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7e00c6ca0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.701+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7e00c6ca0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.701+0000 7fc7d6ffd640 1 -- 172.21.15.143:0/3945362758 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fc7e00c6ca0 con 0x7fc7e015d5a0 2023-11-24T06:32:38.708 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:38.709 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:32:21.961215+0000","modified":"2023-11-24T06:32:24.993795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6567":{"gid":6567,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/492061256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":492061256},{"type":"v1","addr":"172.21.15.143:6837","nonce":492061256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:32:38.709 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 45 2023-11-24T06:32:38.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7c4066a10 msgr2=0x7fc7c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7c4066a10 0x7fc7c4068ed0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc007fd0 tx=0x7fc7dc009040 comp rx=0 tx=0).stop 2023-11-24T06:32:38.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 msgr2=0x7fc7e00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 0x7fc7e00b1be0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009fa0 tx=0x7fc7d800d560 comp rx=0 tx=0).stop 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 shutdown_connections 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc7c4066a10 0x7fc7c4068ed0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e015d5a0 0x7fc7e00b1be0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7e00d00a0 0x7fc7e00b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 --2- 172.21.15.143:0/3945362758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7e00ce750 0x7fc7e01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 >> 172.21.15.143:0/3945362758 conn(0x7fc7e009c510 msgr2=0x7fc7e00afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 shutdown_connections 2023-11-24T06:32:38.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.705+0000 7fc7e7459640 1 -- 172.21.15.143:0/3945362758 wait complete. 2023-11-24T06:32:38.730 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:38.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.861+0000 7f7d626bb640 1 Processor -- start 2023-11-24T06:32:38.869 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.861+0000 7f7d626bb640 1 -- start start 2023-11-24T06:32:38.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d626bb640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d5c144030 0x7f7d5c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d626bb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c0709c0 0x7f7d5c070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d626bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c06d8b0 con 0x7f7d5c09cc20 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d626bb640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c145020 con 0x7f7d5c144030 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d626bb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c09d0a0 con 0x7f7d5c0709c0 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5b7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7d5c09cc20 0x7f7d5c06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:60984/0 (socket says 172.21.15.143:60984) 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5b7fe640 1 -- 172.21.15.143:0/114552821 learned_addr learned my addr 172.21.15.143:0/114552821 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5bfff640 1 --2- 172.21.15.143:0/114552821 >> v2:172.21.15.146:3300/0 conn(0x7f7d5c144030 0x7f7d5c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d60c58640 1 --2- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c0709c0 0x7f7d5c070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5affd640 1 -- 172.21.15.143:0/114552821 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338688388 0 0) 0x7f7d5c06d8b0 con 0x7f7d5c09cc20 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5affd640 1 -- 172.21.15.143:0/114552821 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d44003530 con 0x7f7d5c09cc20 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5bfff640 1 -- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c0709c0 msgr2=0x7f7d5c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5bfff640 1 --2- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c0709c0 0x7f7d5c070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5bfff640 1 -- 172.21.15.143:0/114552821 >> v1:172.21.15.143:6789/0 conn(0x7f7d5c09cc20 legacy=0x7f7d5c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.865+0000 7f7d5bfff640 1 -- 172.21.15.143:0/114552821 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c071390 con 0x7f7d5c144030 2023-11-24T06:32:38.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d5bfff640 1 --2- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c06c650 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0097c0 tx=0x7f7d4c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2fa00f72ac5712c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d5affd640 1 -- 172.21.15.143:0/114552821 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0ab650 con 0x7f7d5c144030 2023-11-24T06:32:38.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d5affd640 1 -- 172.21.15.143:0/114552821 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0ab7b0 con 0x7f7d5c144030 2023-11-24T06:32:38.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d5affd640 1 -- 172.21.15.143:0/114552821 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0abb40 con 0x7f7d5c144030 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 -- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 msgr2=0x7f7d5c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 --2- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c06c650 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0097c0 tx=0x7f7d4c01c450 comp rx=0 tx=0).stop 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 -- 172.21.15.143:0/114552821 shutdown_connections 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 --2- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c0709c0 0x7f7d5c070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 --2- 172.21.15.143:0/114552821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c06c650 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 -- 172.21.15.143:0/114552821 >> 172.21.15.143:0/114552821 conn(0x7f7d5c0b0bf0 msgr2=0x7f7d5c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 -- 172.21.15.143:0/114552821 shutdown_connections 2023-11-24T06:32:38.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 -- 172.21.15.143:0/114552821 wait complete. 2023-11-24T06:32:38.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 Processor -- start 2023-11-24T06:32:38.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.869+0000 7f7d626bb640 1 -- start start 2023-11-24T06:32:38.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 0x7f7d5c136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c09cc20 0x7f7d5c1391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c153890 con 0x7f7d5c0709c0 2023-11-24T06:32:38.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c153b70 con 0x7f7d5c144030 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c153e50 con 0x7f7d5c09cc20 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 0x7f7d5c136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 0x7f7d5c136590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58540/0 (socket says 172.21.15.143:58540) 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 -- 172.21.15.143:0/1425932897 learned_addr learned my addr 172.21.15.143:0/1425932897 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5b7fe640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c09cc20 0x7f7d5c1391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d60c58640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 -- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c09cc20 msgr2=0x7f7d5c1391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c09cc20 0x7f7d5c1391d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 -- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 msgr2=0x7f7d5c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 -- 172.21.15.143:0/1425932897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c009420 con 0x7f7d5c0709c0 2023-11-24T06:32:38.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d5bfff640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 0x7f7d5c136590 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0ad040 tx=0x7f7d4c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0bf610 con 0x7f7d5c0709c0 2023-11-24T06:32:38.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0bf790 con 0x7f7d5c0709c0 2023-11-24T06:32:38.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c154130 con 0x7f7d5c0709c0 2023-11-24T06:32:38.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0bfb40 con 0x7f7d5c0709c0 2023-11-24T06:32:38.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c136ad0 con 0x7f7d5c0709c0 2023-11-24T06:32:38.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c067520 con 0x7f7d5c0709c0 2023-11-24T06:32:38.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.873+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f7d4c0b5400 con 0x7f7d5c0709c0 2023-11-24T06:32:38.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.877+0000 7f7d58ff9640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d48066a10 0x7f7d48068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:38.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.877+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f7d4c11f5c0 con 0x7f7d5c0709c0 2023-11-24T06:32:38.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.877+0000 7f7d5b7fe640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d48066a10 0x7f7d48068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:38.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.877+0000 7f7d5b7fe640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d48066a10 0x7f7d48068ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c06ca70 tx=0x7f7d50007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:38.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:38.881+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d4c0ec230 con 0x7f7d5c0709c0 2023-11-24T06:32:39.034 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.029+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d5c0caed0 con 0x7f7d5c0709c0 2023-11-24T06:32:39.035 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.029+0000 7f7d58ff9640 1 -- 172.21.15.143:0/1425932897 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f7d4c0ef850 con 0x7f7d5c0709c0 2023-11-24T06:32:39.036 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:39.036 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":73,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:37.695531+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":73,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d48066a10 msgr2=0x7f7d48068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d48066a10 0x7f7d48068ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c06ca70 tx=0x7f7d50007d40 comp rx=0 tx=0).stop 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 msgr2=0x7f7d5c136590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 0x7f7d5c136590 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0ad040 tx=0x7f7d4c01ac90 comp rx=0 tx=0).stop 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 shutdown_connections 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7d48066a10 0x7f7d48068ed0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c144030 0x7f7d5c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.038 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d5c09cc20 0x7f7d5c1391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 --2- 172.21.15.143:0/1425932897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d5c0709c0 0x7f7d5c136590 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 >> 172.21.15.143:0/1425932897 conn(0x7f7d5c0b0bf0 msgr2=0x7f7d5c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:39.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 shutdown_connections 2023-11-24T06:32:39.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.033+0000 7f7d626bb640 1 -- 172.21.15.143:0/1425932897 wait complete. 2023-11-24T06:32:39.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:32:19.668658+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:32:20.965372+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 73, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:39.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:39.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 Processor -- start 2023-11-24T06:32:39.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 -- start start 2023-11-24T06:32:39.198 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff7180cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff7180cb850 0x7ff7180ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7180ce590 con 0x7ff718140590 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff718161280 con 0x7ff7180cb850 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff71d4fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff718161560 con 0x7ff71806bdd0 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff716ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff718140590 0x7ff71806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:60996/0 (socket says 172.21.15.143:60996) 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff716ffd640 1 -- 172.21.15.143:0/1965821004 learned_addr learned my addr 172.21.15.143:0/1965821004 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:39.199 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff7177fe640 1 --2- 172.21.15.143:0/1965821004 >> v2:172.21.15.143:3300/0 conn(0x7ff7180cb850 0x7ff7180ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff7167fc640 1 --2- 172.21.15.143:0/1965821004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff7180cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff715ffb640 1 -- 172.21.15.143:0/1965821004 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942837959 0 0) 0x7ff7180ce590 con 0x7ff718140590 2023-11-24T06:32:39.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff7177fe640 1 -- 172.21.15.143:0/1965821004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 msgr2=0x7ff7180cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:39.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff7177fe640 1 --2- 172.21.15.143:0/1965821004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff7180cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff7177fe640 1 -- 172.21.15.143:0/1965821004 >> v1:172.21.15.143:6789/0 conn(0x7ff718140590 legacy=0x7ff71806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.193+0000 7ff7177fe640 1 -- 172.21.15.143:0/1965821004 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718161840 con 0x7ff7180cb850 2023-11-24T06:32:39.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff7177fe640 1 --2- 172.21.15.143:0/1965821004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff7180ce050 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff710009d90 tx=0x7ff71001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d858f33e8e32b9f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff715ffb640 1 -- 172.21.15.143:0/1965821004 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100a5980 con 0x7ff7180cb850 2023-11-24T06:32:39.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff715ffb640 1 -- 172.21.15.143:0/1965821004 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7100a5ae0 con 0x7ff7180cb850 2023-11-24T06:32:39.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff715ffb640 1 -- 172.21.15.143:0/1965821004 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100a5e70 con 0x7ff7180cb850 2023-11-24T06:32:39.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 -- 172.21.15.143:0/1965821004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 msgr2=0x7ff7180ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/1965821004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff7180ce050 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff710009d90 tx=0x7ff71001c8c0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 -- 172.21.15.143:0/1965821004 shutdown_connections 2023-11-24T06:32:39.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/1965821004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff7180ce050 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/1965821004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff7180cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 -- 172.21.15.143:0/1965821004 >> 172.21.15.143:0/1965821004 conn(0x7ff7180b2e50 msgr2=0x7ff7180b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:39.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 -- 172.21.15.143:0/1965821004 shutdown_connections 2023-11-24T06:32:39.204 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 -- 172.21.15.143:0/1965821004 wait complete. 2023-11-24T06:32:39.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.197+0000 7ff71d4fe640 1 Processor -- start 2023-11-24T06:32:39.205 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- start start 2023-11-24T06:32:39.206 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff718155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff71814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff718140590 0x7ff71813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71814ecb0 con 0x7ff7180cb850 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff718140010 con 0x7ff718140590 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181562d0 con 0x7ff71806bdd0 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff71814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff71814e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58552/0 (socket says 172.21.15.143:58552) 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 -- 172.21.15.143:0/3183348991 learned_addr learned my addr 172.21.15.143:0/3183348991 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff716ffd640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff718155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7177fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff718140590 0x7ff71813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 -- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 msgr2=0x7ff718155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff718155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 -- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff718140590 msgr2=0x7ff71813fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff718140590 0x7ff71813fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 -- 172.21.15.143:0/3183348991 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710009a70 con 0x7ff7180cb850 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff716ffd640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff718155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7177fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff718140590 0x7ff71813fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:39.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff7167fc640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff71814e770 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00d7d0 tx=0x7ff70c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c018070 con 0x7ff7180cb850 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c004020 con 0x7ff7180cb850 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0041d0 con 0x7ff7180cb850 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7180c6160 con 0x7ff7180cb850 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7180c6720 con 0x7ff7180cb850 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.201+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71804e8c0 con 0x7ff7180cb850 2023-11-24T06:32:39.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.205+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7ff70c004330 con 0x7ff7180cb850 2023-11-24T06:32:39.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.205+0000 7ff6ff7fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff704066a10 0x7ff704068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.205+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7ff70c084740 con 0x7ff7180cb850 2023-11-24T06:32:39.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.205+0000 7ff716ffd640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff704066a10 0x7ff704068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.205+0000 7ff716ffd640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff704066a10 0x7ff704068ed0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff708000f70 tx=0x7ff708007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.209+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff70c051390 con 0x7ff7180cb850 2023-11-24T06:32:39.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.357+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff71806c8f0 con 0x7ff7180cb850 2023-11-24T06:32:39.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.357+0000 7ff6ff7fe640 1 -- 172.21.15.143:0/3183348991 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff70c0549b0 con 0x7ff7180cb850 2023-11-24T06:32:39.365 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff704066a10 msgr2=0x7ff704068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff704066a10 0x7ff704068ed0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff708000f70 tx=0x7ff708007cb0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 msgr2=0x7ff71814e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff71814e770 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00d7d0 tx=0x7ff70c00dc90 comp rx=0 tx=0).stop 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 shutdown_connections 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff704066a10 0x7ff704068ed0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff718140590 0x7ff71813fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7180cb850 0x7ff71814e770 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 --2- 172.21.15.143:0/3183348991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff71806bdd0 0x7ff718155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 >> 172.21.15.143:0/3183348991 conn(0x7ff7180b2e50 msgr2=0x7ff7180cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:39.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 shutdown_connections 2023-11-24T06:32:39.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.361+0000 7ff71d4fe640 1 -- 172.21.15.143:0/3183348991 wait complete. 2023-11-24T06:32:39.385 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:32:39.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5887a79640 1 Processor -- start 2023-11-24T06:32:39.526 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5887a79640 1 -- start start 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5887a79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58800b1f80 0x7f58800b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5887a79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880070f00 con 0x7f588015a290 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5887a79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880071170 con 0x7f588015ec60 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5887a79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800cb690 con 0x7f58800b1f80 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5885815640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f588015a290 0x7f58800707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32776/0 (socket says 172.21.15.143:32776) 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5885815640 1 -- 172.21.15.143:0/1903402443 learned_addr learned my addr 172.21.15.143:0/1903402443 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:39.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5886016640 1 --2- 172.21.15.143:0/1903402443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58800b1f80 0x7f58800b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866335837 0 0) 0x7f5880070f00 con 0x7f588015a290 2023-11-24T06:32:39.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c003530 con 0x7f588015a290 2023-11-24T06:32:39.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901408159 0 0) 0x7f5880071170 con 0x7f588015ec60 2023-11-24T06:32:39.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5880070f00 con 0x7f588015ec60 2023-11-24T06:32:39.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906409548 0 0) 0x7f586c003530 con 0x7f588015a290 2023-11-24T06:32:39.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5886016640 1 -- 172.21.15.143:0/1903402443 >> v1:172.21.15.146:6789/0 conn(0x7f588015ec60 legacy=0x7f58800cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5886016640 1 -- 172.21.15.143:0/1903402443 >> v1:172.21.15.143:6789/0 conn(0x7f588015a290 legacy=0x7f58800707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.521+0000 7f5886016640 1 -- 172.21.15.143:0/1903402443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800cb970 con 0x7f58800b1f80 2023-11-24T06:32:39.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5886016640 1 --2- 172.21.15.143:0/1903402443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58800b1f80 0x7f58800b23f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5878009dc0 tx=0x7f587801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6531cca9bc21958a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0016a0 con 0x7f58800b1f80 2023-11-24T06:32:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780a5550 con 0x7f58800b1f80 2023-11-24T06:32:39.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5884813640 1 -- 172.21.15.143:0/1903402443 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780a58e0 con 0x7f58800b1f80 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 -- 172.21.15.143:0/1903402443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58800b1f80 msgr2=0x7f58800b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 --2- 172.21.15.143:0/1903402443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58800b1f80 0x7f58800b23f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5878009dc0 tx=0x7f587801c800 comp rx=0 tx=0).stop 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 -- 172.21.15.143:0/1903402443 shutdown_connections 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 --2- 172.21.15.143:0/1903402443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58800b1f80 0x7f58800b23f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 -- 172.21.15.143:0/1903402443 >> 172.21.15.143:0/1903402443 conn(0x7f58800b0c80 msgr2=0x7f58800b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 -- 172.21.15.143:0/1903402443 shutdown_connections 2023-11-24T06:32:39.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.525+0000 7f5887a79640 1 -- 172.21.15.143:0/1903402443 wait complete. 2023-11-24T06:32:39.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 Processor -- start 2023-11-24T06:32:39.533 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- start start 2023-11-24T06:32:39.535 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58800b1f80 0x7f5880158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f588015a290 0x7f5880098920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 0x7f5880147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588015b640 con 0x7f588015ec60 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880154090 con 0x7f58800b1f80 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5880154930 con 0x7f588015a290 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 0x7f5880147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 0x7f5880147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58554/0 (socket says 172.21.15.143:58554) 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 -- 172.21.15.143:0/2964052030 learned_addr learned my addr 172.21.15.143:0/2964052030 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5885815640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58800b1f80 0x7f5880158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5885014640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f588015a290 0x7f5880098920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 -- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f588015a290 msgr2=0x7f5880098920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.536 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f588015a290 0x7f5880098920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 -- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58800b1f80 msgr2=0x7f5880158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58800b1f80 0x7f5880158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 -- 172.21.15.143:0/2964052030 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009a70 con 0x7f588015ec60 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5885014640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f588015a290 0x7f5880098920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5886016640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 0x7f5880147290 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f58780b0040 tx=0x7f58780195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878003ba0 con 0x7f588015ec60 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878003d20 con 0x7f588015ec60 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878004270 con 0x7f588015ec60 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880098e60 con 0x7f588015ec60 2023-11-24T06:32:39.537 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58801542e0 con 0x7f588015ec60 2023-11-24T06:32:39.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.529+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004e8c0 con 0x7f588015ec60 2023-11-24T06:32:39.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.533+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f58780b4050 con 0x7f588015ec60 2023-11-24T06:32:39.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.533+0000 7f58767fc640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5864066a40 0x7f5864068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.533+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f587811f340 con 0x7f588015ec60 2023-11-24T06:32:39.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.533+0000 7f5885815640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5864066a40 0x7f5864068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.533+0000 7f5885815640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5864066a40 0x7f5864068f00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f587c001550 tx=0x7f587c001620 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.537+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58780ec060 con 0x7f588015ec60 2023-11-24T06:32:39.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.685+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5880067870 con 0x7f588015ec60 2023-11-24T06:32:39.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.685+0000 7f58767fc640 1 -- 172.21.15.143:0/2964052030 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5878009450 con 0x7f588015ec60 2023-11-24T06:32:39.693 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:32:39.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5864066a40 msgr2=0x7f5864068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5864066a40 0x7f5864068f00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f587c001550 tx=0x7f587c001620 comp rx=0 tx=0).stop 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 msgr2=0x7f5880147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 0x7f5880147290 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f58780b0040 tx=0x7f58780195a0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 shutdown_connections 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5864066a40 0x7f5864068f00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f588015ec60 0x7f5880147290 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f588015a290 0x7f5880098920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 --2- 172.21.15.143:0/2964052030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58800b1f80 0x7f5880158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 >> 172.21.15.143:0/2964052030 conn(0x7f58800b0c80 msgr2=0x7f5880070650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 shutdown_connections 2023-11-24T06:32:39.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.689+0000 7f5887a79640 1 -- 172.21.15.143:0/2964052030 wait complete. 2023-11-24T06:32:39.714 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:32:39.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 Processor -- start 2023-11-24T06:32:39.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 -- start start 2023-11-24T06:32:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f544815a290 0x7f54480707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f544815ec60 0x7f54480cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54480cc6b0 0x7f54480b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5448071170 con 0x7f544815ec60 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480cb690 con 0x7f544815a290 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544e9aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480cb970 con 0x7f54480cc6b0 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f544815ec60 0x7f54480cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f544815ec60 0x7f54480cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58564/0 (socket says 172.21.15.143:58564) 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 -- 172.21.15.143:0/622410417 learned_addr learned my addr 172.21.15.143:0/622410417 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f5447fff640 1 --2- 172.21.15.143:0/622410417 >> v2:172.21.15.146:3300/0 conn(0x7f544815a290 0x7f54480707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f544cf47640 1 --2- 172.21.15.143:0/622410417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54480cc6b0 0x7f54480b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 -- 172.21.15.143:0/622410417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54480cc6b0 msgr2=0x7f54480b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 --2- 172.21.15.143:0/622410417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54480cc6b0 0x7f54480b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 -- 172.21.15.143:0/622410417 >> v2:172.21.15.146:3300/0 conn(0x7f544815a290 msgr2=0x7f54480707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:39.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 --2- 172.21.15.143:0/622410417 >> v2:172.21.15.146:3300/0 conn(0x7f544815a290 0x7f54480707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f54477fe640 1 -- 172.21.15.143:0/622410417 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480cbc50 con 0x7f544815ec60 2023-11-24T06:32:39.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.849+0000 7f5447fff640 1 --2- 172.21.15.143:0/622410417 >> v2:172.21.15.146:3300/0 conn(0x7f544815a290 0x7f54480707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:39.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f54477fe640 1 --2- 172.21.15.143:0/622410417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f54480cc170 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f544806c0d0 tx=0x7f543c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c75d20ba4a3e90 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f5446ffd640 1 -- 172.21.15.143:0/622410417 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0ab600 con 0x7f544815ec60 2023-11-24T06:32:39.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f5446ffd640 1 -- 172.21.15.143:0/622410417 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c0a7050 con 0x7f544815ec60 2023-11-24T06:32:39.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f5446ffd640 1 -- 172.21.15.143:0/622410417 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0ab980 con 0x7f544815ec60 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 -- 172.21.15.143:0/622410417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 msgr2=0x7f54480cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 --2- 172.21.15.143:0/622410417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f54480cc170 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f544806c0d0 tx=0x7f543c01c470 comp rx=0 tx=0).stop 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 -- 172.21.15.143:0/622410417 shutdown_connections 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 --2- 172.21.15.143:0/622410417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54480cc6b0 0x7f54480b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 --2- 172.21.15.143:0/622410417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f54480cc170 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 --2- 172.21.15.143:0/622410417 >> v2:172.21.15.146:3300/0 conn(0x7f544815a290 0x7f54480707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 -- 172.21.15.143:0/622410417 >> 172.21.15.143:0/622410417 conn(0x7f54480b0c80 msgr2=0x7f54480b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 -- 172.21.15.143:0/622410417 shutdown_connections 2023-11-24T06:32:39.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.853+0000 7f544e9aa640 1 -- 172.21.15.143:0/622410417 wait complete. 2023-11-24T06:32:39.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 Processor -- start 2023-11-24T06:32:39.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 -- start start 2023-11-24T06:32:39.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54480cc6b0 0x7f544815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544815a290 0x7f54481442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f5448152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54481447e0 con 0x7f544815ec60 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448150de0 con 0x7f54480cc6b0 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54481510c0 con 0x7f544815a290 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f5448152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f5448152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58572/0 (socket says 172.21.15.143:58572) 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 -- 172.21.15.143:0/206921810 learned_addr learned my addr 172.21.15.143:0/206921810 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f5447fff640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54480cc6b0 0x7f544815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f54477fe640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544815a290 0x7f54481442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 -- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544815a290 msgr2=0x7f54481442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544815a290 0x7f54481442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 -- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54480cc6b0 msgr2=0x7f544815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54480cc6b0 0x7f544815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 -- 172.21.15.143:0/206921810 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0094d0 con 0x7f544815ec60 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544cf47640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f5448152920 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5440007e60 tx=0x7f544000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440014620 con 0x7f544815ec60 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000ee90 con 0x7f544815ec60 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5448070f40 con 0x7f544815ec60 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400149e0 con 0x7f544815ec60 2023-11-24T06:32:39.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.857+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5448151680 con 0x7f544815ec60 2023-11-24T06:32:39.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.861+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544804e8c0 con 0x7f544815ec60 2023-11-24T06:32:39.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.861+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f5440014b40 con 0x7f544815ec60 2023-11-24T06:32:39.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.861+0000 7f5444ff9640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5434066a10 0x7f5434068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:39.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.861+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f54400852d0 con 0x7f544815ec60 2023-11-24T06:32:39.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.861+0000 7f5447fff640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5434066a10 0x7f5434068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:39.868 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.861+0000 7f5447fff640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5434066a10 0x7f5434068ed0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f543800c900 tx=0x7f5438008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:39.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:39.865+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5440051e40 con 0x7f544815ec60 2023-11-24T06:32:40.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.013+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54480b1310 con 0x7f544815ec60 2023-11-24T06:32:40.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.013+0000 7f5444ff9640 1 -- 172.21.15.143:0/206921810 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5440055460 con 0x7f544815ec60 2023-11-24T06:32:40.020 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:32:40.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5434066a10 msgr2=0x7f5434068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5434066a10 0x7f5434068ed0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f543800c900 tx=0x7f5438008040 comp rx=0 tx=0).stop 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 msgr2=0x7f5448152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f5448152920 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5440007e60 tx=0x7f544000e4b0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 shutdown_connections 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5434066a10 0x7f5434068ed0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f544815ec60 0x7f5448152920 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544815a290 0x7f54481442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 --2- 172.21.15.143:0/206921810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54480cc6b0 0x7f544815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 >> 172.21.15.143:0/206921810 conn(0x7f54480b0c80 msgr2=0x7f5448073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 shutdown_connections 2023-11-24T06:32:40.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.017+0000 7f544e9aa640 1 -- 172.21.15.143:0/206921810 wait complete. 2023-11-24T06:32:40.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:40.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.173+0000 7f5b3611c640 1 Processor -- start 2023-11-24T06:32:40.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.173+0000 7f5b3611c640 1 -- start start 2023-11-24T06:32:40.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b3611c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b3015a320 0x7f5b300b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b3611c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5b300b36c0 0x7f5b30070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b3611c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3015a700 con 0x7f5b30070bd0 2023-11-24T06:32:40.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b3611c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b300b2430 con 0x7f5b3015a320 2023-11-24T06:32:40.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b3611c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b300b2620 con 0x7f5b300b36c0 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b3015a320 0x7f5b300b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5b30070bd0 0x7f5b30071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32786/0 (socket says 172.21.15.143:32786) 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2ffff640 1 -- 172.21.15.143:0/2711384843 learned_addr learned my addr 172.21.15.143:0/2711384843 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2effd640 1 --2- 172.21.15.143:0/2711384843 >> v2:172.21.15.146:3300/0 conn(0x7f5b300b36c0 0x7f5b30070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2f7fe640 1 -- 172.21.15.143:0/2711384843 >> v2:172.21.15.146:3300/0 conn(0x7f5b300b36c0 msgr2=0x7f5b30070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2f7fe640 1 --2- 172.21.15.143:0/2711384843 >> v2:172.21.15.146:3300/0 conn(0x7f5b300b36c0 0x7f5b30070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2f7fe640 1 -- 172.21.15.143:0/2711384843 >> v1:172.21.15.143:6789/0 conn(0x7f5b30070bd0 legacy=0x7f5b30071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2f7fe640 1 -- 172.21.15.143:0/2711384843 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300b2900 con 0x7f5b3015a320 2023-11-24T06:32:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.177+0000 7f5b2e7fc640 1 -- 172.21.15.143:0/2711384843 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950556906 0 0) 0x7f5b3015a700 con 0x7f5b30070bd0 2023-11-24T06:32:40.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b2f7fe640 1 --2- 172.21.15.143:0/2711384843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3015a320 0x7f5b300b1ef0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006c180 tx=0x7f5b2001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa4dc99a28d123a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b2e7fc640 1 -- 172.21.15.143:0/2711384843 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200a7070 con 0x7f5b3015a320 2023-11-24T06:32:40.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b2e7fc640 1 -- 172.21.15.143:0/2711384843 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b200ab430 con 0x7f5b3015a320 2023-11-24T06:32:40.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b2e7fc640 1 -- 172.21.15.143:0/2711384843 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200ab7c0 con 0x7f5b3015a320 2023-11-24T06:32:40.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 -- 172.21.15.143:0/2711384843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3015a320 msgr2=0x7f5b300b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 --2- 172.21.15.143:0/2711384843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3015a320 0x7f5b300b1ef0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006c180 tx=0x7f5b2001c430 comp rx=0 tx=0).stop 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 -- 172.21.15.143:0/2711384843 shutdown_connections 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 --2- 172.21.15.143:0/2711384843 >> v2:172.21.15.146:3300/0 conn(0x7f5b300b36c0 0x7f5b30070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 --2- 172.21.15.143:0/2711384843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3015a320 0x7f5b300b1ef0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 -- 172.21.15.143:0/2711384843 >> 172.21.15.143:0/2711384843 conn(0x7f5b300b0bf0 msgr2=0x7f5b300b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 -- 172.21.15.143:0/2711384843 shutdown_connections 2023-11-24T06:32:40.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 -- 172.21.15.143:0/2711384843 wait complete. 2023-11-24T06:32:40.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 Processor -- start 2023-11-24T06:32:40.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.181+0000 7f5b3611c640 1 -- start start 2023-11-24T06:32:40.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b30070bd0 0x7f5b3009c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 0x7f5b3015fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b3015a320 0x7f5b301603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30151610 con 0x7f5b300b36c0 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3009a890 con 0x7f5b30070bd0 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300999e0 con 0x7f5b3015a320 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 0x7f5b3015fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 0x7f5b3015fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58592/0 (socket says 172.21.15.143:58592) 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 -- 172.21.15.143:0/3340764619 learned_addr learned my addr 172.21.15.143:0/3340764619 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2f7fe640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b30070bd0 0x7f5b3009c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 -- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b3015a320 msgr2=0x7f5b301603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b3015a320 0x7f5b301603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 -- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b30070bd0 msgr2=0x7f5b3009c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b30070bd0 0x7f5b3009c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 -- 172.21.15.143:0/3340764619 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20009420 con 0x7f5b300b36c0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b2effd640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 0x7f5b3015fea0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400d800 tx=0x7f5b2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400b6c0 con 0x7f5b300b36c0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400b860 con 0x7f5b300b36c0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b30099c80 con 0x7f5b300b36c0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400bc10 con 0x7f5b300b36c0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3009a240 con 0x7f5b300b36c0 2023-11-24T06:32:40.194 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3009aa40 con 0x7f5b300b36c0 2023-11-24T06:32:40.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.185+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f5b2401e460 con 0x7f5b300b36c0 2023-11-24T06:32:40.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.189+0000 7f5b17fff640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b1c066a10 0x7f5b1c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.189+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f5b24084ec0 con 0x7f5b300b36c0 2023-11-24T06:32:40.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.189+0000 7f5b2f7fe640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b1c066a10 0x7f5b1c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.196 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.189+0000 7f5b2f7fe640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b1c066a10 0x7f5b1c068ed0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5b200af000 tx=0x7f5b200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.197 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.193+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b3009aa40 con 0x7f5b300b36c0 2023-11-24T06:32:40.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.373+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b3009aa00 con 0x7f5b300b36c0 2023-11-24T06:32:40.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.373+0000 7f5b17fff640 1 -- 172.21.15.143:0/3340764619 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f5b24051b70 con 0x7f5b300b36c0 2023-11-24T06:32:40.379 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:40.380 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:32:21.961215+0000","modified":"2023-11-24T06:32:24.993795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6567":{"gid":6567,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/492061256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":492061256},{"type":"v1","addr":"172.21.15.143:6837","nonce":492061256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:32:40.380 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 45 2023-11-24T06:32:40.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b1c066a10 msgr2=0x7f5b1c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b1c066a10 0x7f5b1c068ed0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5b200af000 tx=0x7f5b200a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 msgr2=0x7f5b3015fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 0x7f5b3015fea0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400d800 tx=0x7f5b2400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 shutdown_connections 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5b1c066a10 0x7f5b1c068ed0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b3015a320 0x7f5b301603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b300b36c0 0x7f5b3015fea0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 --2- 172.21.15.143:0/3340764619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b30070bd0 0x7f5b3009c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 >> 172.21.15.143:0/3340764619 conn(0x7f5b300b0bf0 msgr2=0x7f5b30071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 shutdown_connections 2023-11-24T06:32:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.377+0000 7f5b3611c640 1 -- 172.21.15.143:0/3340764619 wait complete. 2023-11-24T06:32:40.401 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.533+0000 7fafd1301640 1 Processor -- start 2023-11-24T06:32:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.533+0000 7fafd1301640 1 -- start start 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafd1301640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafd1301640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fafcc0709c0 0x7fafcc070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafd1301640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc06d8b0 con 0x7fafcc09cc20 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafd1301640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc145020 con 0x7fafcc0709c0 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafd1301640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc09d0a0 con 0x7fafcc144030 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fafcc0709c0 0x7fafcc070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fafcc0709c0 0x7fafcc070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58600/0 (socket says 172.21.15.143:58600) 2023-11-24T06:32:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 -- 172.21.15.143:0/2729452516 learned_addr learned my addr 172.21.15.143:0/2729452516 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcaffd640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 -- 172.21.15.143:0/2729452516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 msgr2=0x7fafcc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 -- 172.21.15.143:0/2729452516 >> v1:172.21.15.146:6789/0 conn(0x7fafcc09cc20 legacy=0x7fafcc06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcb7fe640 1 -- 172.21.15.143:0/2729452516 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc071390 con 0x7fafcc0709c0 2023-11-24T06:32:40.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.537+0000 7fafcaffd640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafcb7fe640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc070e50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009870 tx=0x7fafc401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa261f09d0eb2b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafca7fc640 1 -- 172.21.15.143:0/2729452516 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40aa5f0 con 0x7fafcc0709c0 2023-11-24T06:32:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafca7fc640 1 -- 172.21.15.143:0/2729452516 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40aa750 con 0x7fafcc0709c0 2023-11-24T06:32:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafca7fc640 1 -- 172.21.15.143:0/2729452516 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40aaae0 con 0x7fafcc0709c0 2023-11-24T06:32:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 -- 172.21.15.143:0/2729452516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 msgr2=0x7fafcc070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc070e50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009870 tx=0x7fafc401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 -- 172.21.15.143:0/2729452516 shutdown_connections 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc070e50 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 --2- 172.21.15.143:0/2729452516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 -- 172.21.15.143:0/2729452516 >> 172.21.15.143:0/2729452516 conn(0x7fafcc0b0bf0 msgr2=0x7fafcc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 -- 172.21.15.143:0/2729452516 shutdown_connections 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 -- 172.21.15.143:0/2729452516 wait complete. 2023-11-24T06:32:40.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 Processor -- start 2023-11-24T06:32:40.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.541+0000 7fafd1301640 1 -- start start 2023-11-24T06:32:40.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc1f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafcc09cc20 0x7fafcc1f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1fa000 con 0x7fafcc0709c0 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc141a00 con 0x7fafcc09cc20 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc141ce0 con 0x7fafcc144030 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc1f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc1f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58616/0 (socket says 172.21.15.143:58616) 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 -- 172.21.15.143:0/455633468 learned_addr learned my addr 172.21.15.143:0/455633468 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcb7fe640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafc27fc640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafcc09cc20 0x7fafcc1f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 -- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 msgr2=0x7fafcc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 -- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafcc09cc20 msgr2=0x7fafcc1f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafcc09cc20 0x7fafcc1f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 -- 172.21.15.143:0/455633468 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40094d0 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafcaffd640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc1f5bc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00ce00 tx=0x7fafbc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00f890 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00f9f0 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00fdc0 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc141fc0 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc1f8d70 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc067520 con 0x7fafcc0709c0 2023-11-24T06:32:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.545+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fafbc00b040 con 0x7fafcc0709c0 2023-11-24T06:32:40.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.549+0000 7fafc3fff640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafac066a10 0x7fafac068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.549+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fafbc0852d0 con 0x7fafcc0709c0 2023-11-24T06:32:40.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.549+0000 7fafc27fc640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafac066a10 0x7fafac068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.549+0000 7fafc27fc640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafac066a10 0x7fafac068ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fafcc15b910 tx=0x7fafb4007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.553+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafbc051de0 con 0x7fafcc0709c0 2023-11-24T06:32:40.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.700+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafcc0cf930 con 0x7fafcc0709c0 2023-11-24T06:32:40.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafc3fff640 1 -- 172.21.15.143:0/455633468 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fafbc055400 con 0x7fafcc0709c0 2023-11-24T06:32:40.713 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:40.714 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":73,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:37.695531+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":73,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:40.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafac066a10 msgr2=0x7fafac068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafac066a10 0x7fafac068ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fafcc15b910 tx=0x7fafb4007e40 comp rx=0 tx=0).stop 2023-11-24T06:32:40.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 msgr2=0x7fafcc1f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc1f5bc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00ce00 tx=0x7fafbc00a650 comp rx=0 tx=0).stop 2023-11-24T06:32:40.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 shutdown_connections 2023-11-24T06:32:40.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fafac066a10 0x7fafac068ed0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafcc144030 0x7fafcc0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.718 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafcc09cc20 0x7fafcc1f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 --2- 172.21.15.143:0/455633468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fafcc0709c0 0x7fafcc1f5bc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 >> 172.21.15.143:0/455633468 conn(0x7fafcc0b0bf0 msgr2=0x7fafcc0af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:40.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 shutdown_connections 2023-11-24T06:32:40.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.704+0000 7fafd1301640 1 -- 172.21.15.143:0/455633468 wait complete. 2023-11-24T06:32:40.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:32:40.733 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:40.870 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 Processor -- start 2023-11-24T06:32:40.871 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 -- start start 2023-11-24T06:32:40.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab9015d570 0x7fab9006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab900ce8b0 0x7fab900ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.872 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900d1cc0 con 0x7fab900d3020 2023-11-24T06:32:40.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900d1fa0 con 0x7fab9015d570 2023-11-24T06:32:40.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab96279640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900ce0b0 con 0x7fab900ce8b0 2023-11-24T06:32:40.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab9015d570 0x7fab9006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab9015d570 0x7fab9006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58628/0 (socket says 172.21.15.143:58628) 2023-11-24T06:32:40.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 -- 172.21.15.143:0/2656215698 learned_addr learned my addr 172.21.15.143:0/2656215698 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:40.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab94816640 1 --2- 172.21.15.143:0/2656215698 >> v2:172.21.15.146:3300/0 conn(0x7fab900ce8b0 0x7fab900ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 -- 172.21.15.143:0/2656215698 >> v2:172.21.15.146:3300/0 conn(0x7fab900ce8b0 msgr2=0x7fab900ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:40.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 --2- 172.21.15.143:0/2656215698 >> v2:172.21.15.146:3300/0 conn(0x7fab900ce8b0 0x7fab900ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 -- 172.21.15.143:0/2656215698 >> v1:172.21.15.146:6789/0 conn(0x7fab900d3020 legacy=0x7fab900d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:40.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.864+0000 7fab8ffff640 1 -- 172.21.15.143:0/2656215698 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900ce390 con 0x7fab9015d570 2023-11-24T06:32:40.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab8ffff640 1 --2- 172.21.15.143:0/2656215698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab9006b9d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fab900c6e60 tx=0x7fab8001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66d49d42862e3d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab8effd640 1 -- 172.21.15.143:0/2656215698 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800aa610 con 0x7fab9015d570 2023-11-24T06:32:40.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab8effd640 1 -- 172.21.15.143:0/2656215698 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab800a6040 con 0x7fab9015d570 2023-11-24T06:32:40.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab8effd640 1 -- 172.21.15.143:0/2656215698 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800aa990 con 0x7fab9015d570 2023-11-24T06:32:40.876 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 -- 172.21.15.143:0/2656215698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 msgr2=0x7fab9006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 --2- 172.21.15.143:0/2656215698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab9006b9d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fab900c6e60 tx=0x7fab8001c490 comp rx=0 tx=0).stop 2023-11-24T06:32:40.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 -- 172.21.15.143:0/2656215698 shutdown_connections 2023-11-24T06:32:40.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 --2- 172.21.15.143:0/2656215698 >> v2:172.21.15.146:3300/0 conn(0x7fab900ce8b0 0x7fab900ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 --2- 172.21.15.143:0/2656215698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab9006b9d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 -- 172.21.15.143:0/2656215698 >> 172.21.15.143:0/2656215698 conn(0x7fab9008ceb0 msgr2=0x7fab9009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:40.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 -- 172.21.15.143:0/2656215698 shutdown_connections 2023-11-24T06:32:40.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.868+0000 7fab96279640 1 -- 172.21.15.143:0/2656215698 wait complete. 2023-11-24T06:32:40.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 Processor -- start 2023-11-24T06:32:40.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 -- start start 2023-11-24T06:32:40.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab900ce8b0 0x7fab900b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab900d3020 0x7fab900b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab900c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90155360 con 0x7fab9015d570 2023-11-24T06:32:40.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b6ad0 con 0x7fab900d3020 2023-11-24T06:32:40.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b6d70 con 0x7fab900ce8b0 2023-11-24T06:32:40.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab900c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab900c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58636/0 (socket says 172.21.15.143:58636) 2023-11-24T06:32:40.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 -- 172.21.15.143:0/3759689505 learned_addr learned my addr 172.21.15.143:0/3759689505 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:40.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab8ffff640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab900ce8b0 0x7fab900b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab8f7fe640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab900d3020 0x7fab900b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 -- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab900ce8b0 msgr2=0x7fab900b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab900ce8b0 0x7fab900b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 -- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab900d3020 msgr2=0x7fab900b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:40.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab900d3020 0x7fab900b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:40.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 -- 172.21.15.143:0/3759689505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800094d0 con 0x7fab9015d570 2023-11-24T06:32:40.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab8f7fe640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab900d3020 0x7fab900b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:40.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab94816640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab900c7310 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fab88007d90 tx=0x7fab8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88014420 con 0x7fab9015d570 2023-11-24T06:32:40.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab880145a0 con 0x7fab9015d570 2023-11-24T06:32:40.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab900b7050 con 0x7fab9015d570 2023-11-24T06:32:40.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88014950 con 0x7fab9015d570 2023-11-24T06:32:40.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.872+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab900b8d50 con 0x7fab9015d570 2023-11-24T06:32:40.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.876+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90067520 con 0x7fab9015d570 2023-11-24T06:32:40.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.876+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fab88014ab0 con 0x7fab9015d570 2023-11-24T06:32:40.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.876+0000 7fab8cff9640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fab7c066a10 0x7fab7c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:40.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.876+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fab88085230 con 0x7fab9015d570 2023-11-24T06:32:40.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.876+0000 7fab8ffff640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fab7c066a10 0x7fab7c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:40.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.876+0000 7fab8ffff640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fab7c066a10 0x7fab7c068ed0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fab800ae000 tx=0x7fab800b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:40.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:40.880+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab88051da0 con 0x7fab9015d570 2023-11-24T06:32:41.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.060+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab900ca290 con 0x7fab9015d570 2023-11-24T06:32:41.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.060+0000 7fab8cff9640 1 -- 172.21.15.143:0/3759689505 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fab880553c0 con 0x7fab9015d570 2023-11-24T06:32:41.067 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:41.067 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:32:21.961215+0000","modified":"2023-11-24T06:32:24.993795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6567":{"gid":6567,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/492061256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":492061256},{"type":"v1","addr":"172.21.15.143:6837","nonce":492061256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:32:41.067 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 45 2023-11-24T06:32:41.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.060+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fab7c066a10 msgr2=0x7fab7c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.060+0000 7fab96279640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fab7c066a10 0x7fab7c068ed0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fab800ae000 tx=0x7fab800b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:41.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.060+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 msgr2=0x7fab900c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.060+0000 7fab96279640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab900c7310 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fab88007d90 tx=0x7fab8800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 shutdown_connections 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fab7c066a10 0x7fab7c068ed0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab9015d570 0x7fab900c7310 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab900d3020 0x7fab900b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 --2- 172.21.15.143:0/3759689505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab900ce8b0 0x7fab900b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 >> 172.21.15.143:0/3759689505 conn(0x7fab9008ceb0 msgr2=0x7fab901571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 shutdown_connections 2023-11-24T06:32:41.070 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.064+0000 7fab96279640 1 -- 172.21.15.143:0/3759689505 wait complete. 2023-11-24T06:32:41.088 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:41.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 Processor -- start 2023-11-24T06:32:41.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 -- start start 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f39f806c650 0x7f39f809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f80709c0 0x7f39f8070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f806d8b0 con 0x7f39f8144030 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f8145020 con 0x7f39f806c650 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39ffb0f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f8071390 con 0x7f39f80709c0 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f39f806c650 0x7f39f809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.228 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f39f806c650 0x7f39f809cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58644/0 (socket says 172.21.15.143:58644) 2023-11-24T06:32:41.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 -- 172.21.15.143:0/423700931 learned_addr learned my addr 172.21.15.143:0/423700931 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:41.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fe0ac640 1 --2- 172.21.15.143:0/423700931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f80709c0 0x7f39f8070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 -- 172.21.15.143:0/423700931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f80709c0 msgr2=0x7f39f8070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:41.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 --2- 172.21.15.143:0/423700931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f80709c0 0x7f39f8070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 -- 172.21.15.143:0/423700931 >> v1:172.21.15.146:6789/0 conn(0x7f39f8144030 legacy=0x7f39f806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.220+0000 7f39fd0aa640 1 -- 172.21.15.143:0/423700931 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f806cca0 con 0x7f39f806c650 2023-11-24T06:32:41.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39fd0aa640 1 --2- 172.21.15.143:0/423700931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f806c650 0x7f39f809cc20 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009870 tx=0x7f39e801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac2c27585e5137 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39fc8a9640 1 -- 172.21.15.143:0/423700931 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80a7070 con 0x7f39f806c650 2023-11-24T06:32:41.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39fc8a9640 1 -- 172.21.15.143:0/423700931 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e80ab430 con 0x7f39f806c650 2023-11-24T06:32:41.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39fc8a9640 1 -- 172.21.15.143:0/423700931 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80ab7c0 con 0x7f39f806c650 2023-11-24T06:32:41.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 -- 172.21.15.143:0/423700931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f806c650 msgr2=0x7f39f809cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/423700931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f806c650 0x7f39f809cc20 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009870 tx=0x7f39e801c540 comp rx=0 tx=0).stop 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 -- 172.21.15.143:0/423700931 shutdown_connections 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/423700931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f80709c0 0x7f39f8070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/423700931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f806c650 0x7f39f809cc20 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 -- 172.21.15.143:0/423700931 >> 172.21.15.143:0/423700931 conn(0x7f39f80b0bf0 msgr2=0x7f39f80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 -- 172.21.15.143:0/423700931 shutdown_connections 2023-11-24T06:32:41.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.224+0000 7f39ffb0f640 1 -- 172.21.15.143:0/423700931 wait complete. 2023-11-24T06:32:41.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 Processor -- start 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 -- start start 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f806c650 0x7f39f8138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 0x7f39f8139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f8144030 0x7f39f81399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81f4b50 con 0x7f39f80709c0 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81f4df0 con 0x7f39f806c650 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81f50d0 con 0x7f39f8144030 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 0x7f39f8139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 0x7f39f8139470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58658/0 (socket says 172.21.15.143:58658) 2023-11-24T06:32:41.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 -- 172.21.15.143:0/1416740828 learned_addr learned my addr 172.21.15.143:0/1416740828 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:41.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fe0ac640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f8144030 0x7f39f81399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd8ab640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f806c650 0x7f39f8138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 -- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f8144030 msgr2=0x7f39f81399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f8144030 0x7f39f81399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 -- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f806c650 msgr2=0x7f39f8138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f806c650 0x7f39f8138b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 -- 172.21.15.143:0/1416740828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80094d0 con 0x7f39f80709c0 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd8ab640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f806c650 0x7f39f8138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39fd0aa640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 0x7f39f8139470 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f39e801a170 tx=0x7f39e80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80ba070 con 0x7f39f80709c0 2023-11-24T06:32:41.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e80b4420 con 0x7f39f80709c0 2023-11-24T06:32:41.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80b47d0 con 0x7f39f80709c0 2023-11-24T06:32:41.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.228+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f81f53b0 con 0x7f39f80709c0 2023-11-24T06:32:41.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f8158ff0 con 0x7f39f80709c0 2023-11-24T06:32:41.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f8067520 con 0x7f39f80709c0 2023-11-24T06:32:41.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f39e80b4930 con 0x7f39f80709c0 2023-11-24T06:32:41.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39ee7fc640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f39dc066a40 0x7f39dc068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f39e811e370 con 0x7f39f80709c0 2023-11-24T06:32:41.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39fd8ab640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f39dc066a40 0x7f39dc068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.232+0000 7f39fd8ab640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f39dc066a40 0x7f39dc068f00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f39f806db20 tx=0x7f39f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.236+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39e80eae60 con 0x7f39f80709c0 2023-11-24T06:32:41.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.416+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39f81f5540 con 0x7f39f80709c0 2023-11-24T06:32:41.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.416+0000 7f39ee7fc640 1 -- 172.21.15.143:0/1416740828 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f39e80ee480 con 0x7f39f80709c0 2023-11-24T06:32:41.425 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:41.426 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:32:21.961215+0000","modified":"2023-11-24T06:32:24.993795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6567":{"gid":6567,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/492061256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":492061256},{"type":"v1","addr":"172.21.15.143:6837","nonce":492061256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 45 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f39dc066a40 msgr2=0x7f39dc068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f39dc066a40 0x7f39dc068f00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f39f806db20 tx=0x7f39f4009040 comp rx=0 tx=0).stop 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 msgr2=0x7f39f8139470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 0x7f39f8139470 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f39e801a170 tx=0x7f39e80192e0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 shutdown_connections 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f39dc066a40 0x7f39dc068f00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39f8144030 0x7f39f81399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39f80709c0 0x7f39f8139470 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 --2- 172.21.15.143:0/1416740828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f806c650 0x7f39f8138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 >> 172.21.15.143:0/1416740828 conn(0x7f39f80b0bf0 msgr2=0x7f39f80723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:41.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 shutdown_connections 2023-11-24T06:32:41.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.420+0000 7f39ffb0f640 1 -- 172.21.15.143:0/1416740828 wait complete. 2023-11-24T06:32:41.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:41.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 Processor -- start 2023-11-24T06:32:41.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 -- start start 2023-11-24T06:32:41.583 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba2c144030 0x7fba2c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba2c0709c0 0x7fba2c070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c06d8b0 con 0x7fba2c09cc20 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c145020 con 0x7fba2c144030 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba33f01640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c09d0a0 con 0x7fba2c0709c0 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba2c144030 0x7fba2c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba2c144030 0x7fba2c06c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58670/0 (socket says 172.21.15.143:58670) 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 -- 172.21.15.143:0/2946723557 learned_addr learned my addr 172.21.15.143:0/2946723557 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:41.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba3249e640 1 --2- 172.21.15.143:0/2946723557 >> v2:172.21.15.146:3300/0 conn(0x7fba2c0709c0 0x7fba2c070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 -- 172.21.15.143:0/2946723557 >> v2:172.21.15.146:3300/0 conn(0x7fba2c0709c0 msgr2=0x7fba2c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:41.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 --2- 172.21.15.143:0/2946723557 >> v2:172.21.15.146:3300/0 conn(0x7fba2c0709c0 0x7fba2c070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 -- 172.21.15.143:0/2946723557 >> v1:172.21.15.146:6789/0 conn(0x7fba2c09cc20 legacy=0x7fba2c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.576+0000 7fba31c9d640 1 -- 172.21.15.143:0/2946723557 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c071370 con 0x7fba2c144030 2023-11-24T06:32:41.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba31c9d640 1 --2- 172.21.15.143:0/2946723557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c144030 0x7fba2c06c650 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fba2c145220 tx=0x7fba2801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e8013865b3aba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba30c9b640 1 -- 172.21.15.143:0/2946723557 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280aa430 con 0x7fba2c144030 2023-11-24T06:32:41.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba30c9b640 1 -- 172.21.15.143:0/2946723557 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba280aa590 con 0x7fba2c144030 2023-11-24T06:32:41.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba30c9b640 1 -- 172.21.15.143:0/2946723557 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280aa920 con 0x7fba2c144030 2023-11-24T06:32:41.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 -- 172.21.15.143:0/2946723557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c144030 msgr2=0x7fba2c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 --2- 172.21.15.143:0/2946723557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c144030 0x7fba2c06c650 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fba2c145220 tx=0x7fba2801c4d0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 -- 172.21.15.143:0/2946723557 shutdown_connections 2023-11-24T06:32:41.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 --2- 172.21.15.143:0/2946723557 >> v2:172.21.15.146:3300/0 conn(0x7fba2c0709c0 0x7fba2c070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 --2- 172.21.15.143:0/2946723557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c144030 0x7fba2c06c650 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 -- 172.21.15.143:0/2946723557 >> 172.21.15.143:0/2946723557 conn(0x7fba2c0b0bf0 msgr2=0x7fba2c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:41.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 -- 172.21.15.143:0/2946723557 shutdown_connections 2023-11-24T06:32:41.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.580+0000 7fba33f01640 1 -- 172.21.15.143:0/2946723557 wait complete. 2023-11-24T06:32:41.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 Processor -- start 2023-11-24T06:32:41.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 -- start start 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0709c0 0x7fba2c0af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 0x7fba2c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c144030 0x7fba2c138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c157850 con 0x7fba2c09cc20 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0afbf0 con 0x7fba2c0709c0 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1537d0 con 0x7fba2c144030 2023-11-24T06:32:41.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 0x7fba2c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 0x7fba2c155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58672/0 (socket says 172.21.15.143:58672) 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 -- 172.21.15.143:0/275317817 learned_addr learned my addr 172.21.15.143:0/275317817 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba31c9d640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0709c0 0x7fba2c0af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3249e640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c144030 0x7fba2c138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 -- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c144030 msgr2=0x7fba2c138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c144030 0x7fba2c138200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 -- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0709c0 msgr2=0x7fba2c0af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0709c0 0x7fba2c0af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 -- 172.21.15.143:0/275317817 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280094d0 con 0x7fba2c09cc20 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba3149c640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 0x7fba2c155510 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c500 tx=0x7fba1c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c005220 con 0x7fba2c09cc20 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c005380 con 0x7fba2c09cc20 2023-11-24T06:32:41.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c007270 con 0x7fba2c09cc20 2023-11-24T06:32:41.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c153ab0 con 0x7fba2c09cc20 2023-11-24T06:32:41.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.584+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c138740 con 0x7fba2c09cc20 2023-11-24T06:32:41.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.588+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c067520 con 0x7fba2c09cc20 2023-11-24T06:32:41.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.588+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fba1c0073d0 con 0x7fba2c09cc20 2023-11-24T06:32:41.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.588+0000 7fba227fc640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fba10066a10 0x7fba10068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.588+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fba1c084140 con 0x7fba2c09cc20 2023-11-24T06:32:41.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.588+0000 7fba31c9d640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fba10066a10 0x7fba10068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.588+0000 7fba31c9d640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fba10066a10 0x7fba10068ed0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba280ae000 tx=0x7fba280b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.592+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba1c0b5280 con 0x7fba2c09cc20 2023-11-24T06:32:41.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.748+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2c0b1dd0 con 0x7fba2c09cc20 2023-11-24T06:32:41.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba227fc640 1 -- 172.21.15.143:0/275317817 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fba1c050d70 con 0x7fba2c09cc20 2023-11-24T06:32:41.758 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:41.758 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":73,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:37.695531+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:19.668658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:20.965372+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":73,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fba10066a10 msgr2=0x7fba10068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fba10066a10 0x7fba10068ed0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba280ae000 tx=0x7fba280b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 msgr2=0x7fba2c155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 0x7fba2c155510 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c500 tx=0x7fba1c00c9c0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 shutdown_connections 2023-11-24T06:32:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fba10066a10 0x7fba10068ed0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c144030 0x7fba2c138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba2c09cc20 0x7fba2c155510 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 --2- 172.21.15.143:0/275317817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0709c0 0x7fba2c0af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 >> 172.21.15.143:0/275317817 conn(0x7fba2c0b0bf0 msgr2=0x7fba2c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:41.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 shutdown_connections 2023-11-24T06:32:41.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.752+0000 7fba33f01640 1 -- 172.21.15.143:0/275317817 wait complete. 2023-11-24T06:32:41.779 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:32:41.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 Processor -- start 2023-11-24T06:32:41.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 -- start start 2023-11-24T06:32:41.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80b8ed0 0x7f18a80d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18a80cdf80 0x7f18a80ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80b6a30 con 0x7f18a81608f0 2023-11-24T06:32:41.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a8160cd0 con 0x7f18a80cdf80 2023-11-24T06:32:41.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18acc82640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b9310 con 0x7f18a80b8ed0 2023-11-24T06:32:41.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a6ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80b8ed0 0x7f18a80d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a7fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18a80cdf80 0x7f18a80ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.920 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a77fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f18a81608f0 0x7f18a80b6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:42764/0 (socket says 172.21.15.143:42764) 2023-11-24T06:32:41.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a77fe640 1 -- 172.21.15.143:0/2455129361 learned_addr learned my addr 172.21.15.143:0/2455129361 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:41.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a7fff640 1 -- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80b8ed0 msgr2=0x7f18a80d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:41.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a7fff640 1 --2- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80b8ed0 0x7f18a80d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a7fff640 1 -- 172.21.15.143:0/2455129361 >> v1:172.21.15.146:6789/0 conn(0x7f18a81608f0 legacy=0x7f18a80b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.912+0000 7f18a7fff640 1 -- 172.21.15.143:0/2455129361 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80ce950 con 0x7f18a80cdf80 2023-11-24T06:32:41.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18a7fff640 1 --2- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a80cdf80 0x7f18a80ce410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009d90 tx=0x7f18a001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a153749059712f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18a67fc640 1 -- 172.21.15.143:0/2455129361 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a00a59e0 con 0x7f18a80cdf80 2023-11-24T06:32:41.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18a67fc640 1 -- 172.21.15.143:0/2455129361 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00a5b40 con 0x7f18a80cdf80 2023-11-24T06:32:41.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18a67fc640 1 -- 172.21.15.143:0/2455129361 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a00ad440 con 0x7f18a80cdf80 2023-11-24T06:32:41.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 -- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a80cdf80 msgr2=0x7f18a80ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 --2- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a80cdf80 0x7f18a80ce410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009d90 tx=0x7f18a001c920 comp rx=0 tx=0).stop 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 -- 172.21.15.143:0/2455129361 shutdown_connections 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 --2- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a80cdf80 0x7f18a80ce410 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 --2- 172.21.15.143:0/2455129361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80b8ed0 0x7f18a80d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 -- 172.21.15.143:0/2455129361 >> 172.21.15.143:0/2455129361 conn(0x7f18a80613d0 msgr2=0x7f18a80617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 -- 172.21.15.143:0/2455129361 shutdown_connections 2023-11-24T06:32:41.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.916+0000 7f18acc82640 1 -- 172.21.15.143:0/2455129361 wait complete. 2023-11-24T06:32:41.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 Processor -- start 2023-11-24T06:32:41.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 -- start start 2023-11-24T06:32:41.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 0x7f18a814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80cdf80 0x7f18a8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a81608f0 0x7f18a814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b78f0 con 0x7f18a80b8ed0 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a814f520 con 0x7f18a81608f0 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a814fdc0 con 0x7f18a80cdf80 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 0x7f18a814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 0x7f18a814a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58682/0 (socket says 172.21.15.143:58682) 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 -- 172.21.15.143:0/3253032307 learned_addr learned my addr 172.21.15.143:0/3253032307 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a7fff640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a81608f0 0x7f18a814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a6ffd640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80cdf80 0x7f18a8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 -- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80cdf80 msgr2=0x7f18a8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80cdf80 0x7f18a8158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 -- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a81608f0 msgr2=0x7f18a814adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a81608f0 0x7f18a814adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 -- 172.21.15.143:0/3253032307 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0009a70 con 0x7f18a80b8ed0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18a77fe640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 0x7f18a814a7a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f189800c530 tx=0x7f189800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898005cf0 con 0x7f18a80b8ed0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898005e50 con 0x7f18a80b8ed0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898007270 con 0x7f18a80b8ed0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a814cd00 con 0x7f18a80b8ed0 2023-11-24T06:32:41.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.920+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a80b2950 con 0x7f18a80b8ed0 2023-11-24T06:32:41.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.924+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a804e850 con 0x7f18a80b8ed0 2023-11-24T06:32:41.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.924+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f18980073d0 con 0x7f18a80b8ed0 2023-11-24T06:32:41.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.924+0000 7f188ffff640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1894066a10 0x7f1894068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:41.931 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.924+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f1898083bf0 con 0x7f18a80b8ed0 2023-11-24T06:32:41.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.924+0000 7f18a6ffd640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1894066a10 0x7f1894068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:41.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.924+0000 7f18a6ffd640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1894066a10 0x7f1894068ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f18a80b2590 tx=0x7f189c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:41.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:41.928+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1898050810 con 0x7f18a80b8ed0 2023-11-24T06:32:42.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.108+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f18a80b6a30 con 0x7f18a80b8ed0 2023-11-24T06:32:42.117 INFO:tasks.ceph.mon.a.smithi143.stderr:2023-11-24T06:32:42.108+0000 7f12a8d9d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:32:42.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.112+0000 7f188ffff640 1 -- 172.21.15.143:0/3253032307 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7f18a80b6a30 con 0x7f18a80b8ed0 2023-11-24T06:32:42.119 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1894066a10 msgr2=0x7f1894068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1894066a10 0x7f1894068ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f18a80b2590 tx=0x7f189c009190 comp rx=0 tx=0).stop 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 msgr2=0x7f18a814a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 0x7f18a814a7a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f189800c530 tx=0x7f189800c9f0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 shutdown_connections 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1894066a10 0x7f1894068ed0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a81608f0 0x7f18a814adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18a80cdf80 0x7f18a8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 --2- 172.21.15.143:0/3253032307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18a80b8ed0 0x7f18a814a7a0 secure :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f189800c530 tx=0x7f189800c9f0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 >> 172.21.15.143:0/3253032307 conn(0x7f18a80613d0 msgr2=0x7f18a80d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:42.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 shutdown_connections 2023-11-24T06:32:42.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.116+0000 7f18acc82640 1 -- 172.21.15.143:0/3253032307 wait complete. 2023-11-24T06:32:42.145 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:32:42.187 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:32:42.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.280+0000 7f062c0e3640 1 Processor -- start 2023-11-24T06:32:42.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.280+0000 7f062c0e3640 1 -- start start 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062c0e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415ec60 0x7f06240cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062c0e3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06240cc6b0 0x7f06240b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062c0e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0624070f00 con 0x7f062415a290 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062c0e3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0624071170 con 0x7f06240cc6b0 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062c0e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06240cb690 con 0x7f062415ec60 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f0629e7f640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f062415a290 0x7f06240707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32808/0 (socket says 172.21.15.143:32808) 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f0629e7f640 1 -- 172.21.15.143:0/1917423963 learned_addr learned my addr 172.21.15.143:0/1917423963 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062967e640 1 --2- 172.21.15.143:0/1917423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415ec60 0x7f06240cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:42.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062a680640 1 --2- 172.21.15.143:0/1917423963 >> v2:172.21.15.146:3300/0 conn(0x7f06240cc6b0 0x7f06240b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:42.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f0628e7d640 1 -- 172.21.15.143:0/1917423963 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157496512 0 0) 0x7f0624070f00 con 0x7f062415a290 2023-11-24T06:32:42.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f0628e7d640 1 -- 172.21.15.143:0/1917423963 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0610003530 con 0x7f062415a290 2023-11-24T06:32:42.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062967e640 1 -- 172.21.15.143:0/1917423963 >> v2:172.21.15.146:3300/0 conn(0x7f06240cc6b0 msgr2=0x7f06240b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:42.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062967e640 1 --2- 172.21.15.143:0/1917423963 >> v2:172.21.15.146:3300/0 conn(0x7f06240cc6b0 0x7f06240b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062967e640 1 -- 172.21.15.143:0/1917423963 >> v1:172.21.15.143:6789/0 conn(0x7f062415a290 legacy=0x7f06240707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:42.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062967e640 1 -- 172.21.15.143:0/1917423963 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240cb970 con 0x7f062415ec60 2023-11-24T06:32:42.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.284+0000 7f062a680640 1 --2- 172.21.15.143:0/1917423963 >> v2:172.21.15.146:3300/0 conn(0x7f06240cc6b0 0x7f06240b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:42.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062967e640 1 --2- 172.21.15.143:0/1917423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415ec60 0x7f06240cc170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06140097c0 tx=0x7f061401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de301964d6f9e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:42.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f0628e7d640 1 -- 172.21.15.143:0/1917423963 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140ab600 con 0x7f062415ec60 2023-11-24T06:32:42.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f0628e7d640 1 -- 172.21.15.143:0/1917423963 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140a7050 con 0x7f062415ec60 2023-11-24T06:32:42.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f0628e7d640 1 -- 172.21.15.143:0/1917423963 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140ab980 con 0x7f062415ec60 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 -- 172.21.15.143:0/1917423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415ec60 msgr2=0x7f06240cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1917423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415ec60 0x7f06240cc170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06140097c0 tx=0x7f061401c3c0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 -- 172.21.15.143:0/1917423963 shutdown_connections 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1917423963 >> v2:172.21.15.146:3300/0 conn(0x7f06240cc6b0 0x7f06240b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1917423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415ec60 0x7f06240cc170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 -- 172.21.15.143:0/1917423963 >> 172.21.15.143:0/1917423963 conn(0x7f06240b0c80 msgr2=0x7f06240b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 -- 172.21.15.143:0/1917423963 shutdown_connections 2023-11-24T06:32:42.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 -- 172.21.15.143:0/1917423963 wait complete. 2023-11-24T06:32:42.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 Processor -- start 2023-11-24T06:32:42.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.288+0000 7f062c0e3640 1 -- start start 2023-11-24T06:32:42.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06240cc6b0 0x7f0624149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:42.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415a290 0x7f06240b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:42.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 0x7f0624166f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624150fa0 con 0x7f062415ec60 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624151280 con 0x7f06240cc6b0 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0624151560 con 0x7f062415a290 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 0x7f0624166f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 0x7f0624166f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58698/0 (socket says 172.21.15.143:58698) 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 -- 172.21.15.143:0/1746893209 learned_addr learned my addr 172.21.15.143:0/1746893209 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062967e640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415a290 0x7f06240b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f0629e7f640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06240cc6b0 0x7f0624149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 -- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415a290 msgr2=0x7f06240b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415a290 0x7f06240b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 -- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06240cc6b0 msgr2=0x7f0624149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06240cc6b0 0x7f0624149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 -- 172.21.15.143:0/1746893209 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009a70 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f0629e7f640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06240cc6b0 0x7f0624149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062a680640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 0x7f0624166f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f061c00efc0 tx=0x7f061c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c009d70 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00f040 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0039a0 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0614009420 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0624149c80 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0624151720 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.292+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f061c0144a0 con 0x7f062415ec60 2023-11-24T06:32:42.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.296+0000 7f061a7fc640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0608066a10 0x7f0608068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:42.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.296+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5851+0+0 (secure 0 0 0) 0x7f061c085700 con 0x7f062415ec60 2023-11-24T06:32:42.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.296+0000 7f0629e7f640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0608066a10 0x7f0608068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:42.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.296+0000 7f0629e7f640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0608066a10 0x7f0608068ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f06200011f0 tx=0x7f0620009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:42.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.300+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f061c0520e0 con 0x7f062415ec60 2023-11-24T06:32:42.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:42.492+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0624152ce0 con 0x7f062415ec60 2023-11-24T06:32:43.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.116+0000 7f061a7fc640 1 -- 172.21.15.143:0/1746893209 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0624152ce0 con 0x7f062415ec60 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0608066a10 msgr2=0x7f0608068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0608066a10 0x7f0608068ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f06200011f0 tx=0x7f0620009040 comp rx=0 tx=0).stop 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 msgr2=0x7f0624166f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 0x7f0624166f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f061c00efc0 tx=0x7f061c009f90 comp rx=0 tx=0).stop 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 shutdown_connections 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0608066a10 0x7f0608068ed0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f062415ec60 0x7f0624166f70 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f062415a290 0x7f06240b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 --2- 172.21.15.143:0/1746893209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06240cc6b0 0x7f0624149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 >> 172.21.15.143:0/1746893209 conn(0x7f06240b0c80 msgr2=0x7f0624154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:43.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 shutdown_connections 2023-11-24T06:32:43.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.120+0000 7f062c0e3640 1 -- 172.21.15.143:0/1746893209 wait complete. 2023-11-24T06:32:43.149 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:32:43.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 Processor -- start 2023-11-24T06:32:43.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 -- start start 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89c015d570 0x7f89c006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c00d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c00d39d0 con 0x7f89c00d14b0 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c00d05b0 con 0x7f89c015d570 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89c4a32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00d0890 con 0x7f89c00d3020 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89c015d570 0x7f89c006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:43.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89c015d570 0x7f89c006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58708/0 (socket says 172.21.15.143:58708) 2023-11-24T06:32:43.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 -- 172.21.15.143:0/732658243 learned_addr learned my addr 172.21.15.143:0/732658243 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:43.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89bed9d640 1 --2- 172.21.15.143:0/732658243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c00d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:43.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 -- 172.21.15.143:0/732658243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 msgr2=0x7f89c00d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:43.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 --2- 172.21.15.143:0/732658243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c00d3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 -- 172.21.15.143:0/732658243 >> v1:172.21.15.146:6789/0 conn(0x7f89c00d14b0 legacy=0x7f89c00cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:43.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.332+0000 7f89be59c640 1 -- 172.21.15.143:0/732658243 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00d0b70 con 0x7f89c015d570 2023-11-24T06:32:43.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89be59c640 1 --2- 172.21.15.143:0/732658243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c006bba0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009870 tx=0x7f89b001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaa5c302a6cefa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89bdd9b640 1 -- 172.21.15.143:0/732658243 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00ac640 con 0x7f89c015d570 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89bdd9b640 1 -- 172.21.15.143:0/732658243 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b00ac7a0 con 0x7f89c015d570 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89bdd9b640 1 -- 172.21.15.143:0/732658243 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00acb30 con 0x7f89c015d570 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 -- 172.21.15.143:0/732658243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 msgr2=0x7f89c006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 --2- 172.21.15.143:0/732658243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c006bba0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009870 tx=0x7f89b001c420 comp rx=0 tx=0).stop 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 -- 172.21.15.143:0/732658243 shutdown_connections 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 --2- 172.21.15.143:0/732658243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c00d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 --2- 172.21.15.143:0/732658243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c006bba0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 -- 172.21.15.143:0/732658243 >> 172.21.15.143:0/732658243 conn(0x7f89c008ceb0 msgr2=0x7f89c009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:43.344 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 -- 172.21.15.143:0/732658243 shutdown_connections 2023-11-24T06:32:43.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.336+0000 7f89c4a32640 1 -- 172.21.15.143:0/732658243 wait complete. 2023-11-24T06:32:43.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 Processor -- start 2023-11-24T06:32:43.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 -- start start 2023-11-24T06:32:43.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c00d14b0 0x7f89c00c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c00b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00c9e40 con 0x7f89c015d570 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c015a550 con 0x7f89c00d14b0 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c015ab10 con 0x7f89c00d3020 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c00b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c00b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58714/0 (socket says 172.21.15.143:58714) 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 -- 172.21.15.143:0/2683605744 learned_addr learned my addr 172.21.15.143:0/2683605744 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:43.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89b5d9b640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:43.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89be59c640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c00d14b0 0x7f89c00c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:43.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 -- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 msgr2=0x7f89c015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:43.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 -- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c00d14b0 msgr2=0x7f89c00c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:43.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c00d14b0 0x7f89c00c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:43.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 -- 172.21.15.143:0/2683605744 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00094d0 con 0x7f89c015d570 2023-11-24T06:32:43.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89be59c640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c00d14b0 0x7f89c00c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:43.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89bed9d640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c00b4110 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009dd0 tx=0x7f89b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:43.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8014480 con 0x7f89c015d570 2023-11-24T06:32:43.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b800f040 con 0x7f89c015d570 2023-11-24T06:32:43.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c01558c0 con 0x7f89c015d570 2023-11-24T06:32:43.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8014840 con 0x7f89c015d570 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.340+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c00c7360 con 0x7f89c015d570 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.344+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c015a8c0 con 0x7f89c015d570 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.344+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f89b80149a0 con 0x7f89c015d570 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.344+0000 7f89b77fe640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89a0066a10 0x7f89a0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.344+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5851+0+0 (secure 0 0 0) 0x7f89b8085750 con 0x7f89c015d570 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.344+0000 7f89be59c640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89a0066a10 0x7f89a0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:43.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.344+0000 7f89be59c640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89a0066a10 0x7f89a0068ed0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f89b00ae000 tx=0x7f89b00a6070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:43.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.348+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89b80522f0 con 0x7f89c015d570 2023-11-24T06:32:43.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:43.500+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89c0067520 con 0x7f89c015d570 2023-11-24T06:32:44.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89b77fe640 1 -- 172.21.15.143:0/2683605744 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f89b8055910 con 0x7f89c015d570 2023-11-24T06:32:44.126 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:32:44.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89a0066a10 msgr2=0x7f89a0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:44.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89a0066a10 0x7f89a0068ed0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f89b00ae000 tx=0x7f89b00a6070 comp rx=0 tx=0).stop 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 msgr2=0x7f89c00b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c00b4110 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009dd0 tx=0x7f89b800c490 comp rx=0 tx=0).stop 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 shutdown_connections 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f89a0066a10 0x7f89a0068ed0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89c015d570 0x7f89c00b4110 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89c00d3020 0x7f89c015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 --2- 172.21.15.143:0/2683605744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c00d14b0 0x7f89c00c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 >> 172.21.15.143:0/2683605744 conn(0x7f89c008ceb0 msgr2=0x7f89c0159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:44.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.120+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 shutdown_connections 2023-11-24T06:32:44.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.124+0000 7f89c4a32640 1 -- 172.21.15.143:0/2683605744 wait complete. 2023-11-24T06:32:44.154 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:32:44.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.288+0000 7f9acfabb640 1 Processor -- start 2023-11-24T06:32:44.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.288+0000 7f9acfabb640 1 -- start start 2023-11-24T06:32:44.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acfabb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ac8144030 0x7f9ac806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:44.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acfabb640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ac809cc20 0x7f9ac806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:44.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acfabb640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac806d8b0 con 0x7f9ac806e280 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acfabb640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac8145020 con 0x7f9ac8144030 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acfabb640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac809d0a0 con 0x7f9ac809cc20 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ac8144030 0x7f9ac806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ac8144030 0x7f9ac806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58722/0 (socket says 172.21.15.143:58722) 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 -- 172.21.15.143:0/3626004681 learned_addr learned my addr 172.21.15.143:0/3626004681 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd056640 1 --2- 172.21.15.143:0/3626004681 >> v2:172.21.15.146:3300/0 conn(0x7f9ac809cc20 0x7f9ac806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 -- 172.21.15.143:0/3626004681 >> v2:172.21.15.146:3300/0 conn(0x7f9ac809cc20 msgr2=0x7f9ac806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 --2- 172.21.15.143:0/3626004681 >> v2:172.21.15.146:3300/0 conn(0x7f9ac809cc20 0x7f9ac806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 -- 172.21.15.143:0/3626004681 >> v1:172.21.15.146:6789/0 conn(0x7f9ac806e280 legacy=0x7f9ac80709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:44.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.292+0000 7f9acd857640 1 -- 172.21.15.143:0/3626004681 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac806cca0 con 0x7f9ac8144030 2023-11-24T06:32:44.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acd857640 1 --2- 172.21.15.143:0/3626004681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8144030 0x7f9ac806c650 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80700a0 tx=0x7f9ac401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bc59aa0856515a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:44.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acc855640 1 -- 172.21.15.143:0/3626004681 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40aa5f0 con 0x7f9ac8144030 2023-11-24T06:32:44.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acc855640 1 -- 172.21.15.143:0/3626004681 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac40aa750 con 0x7f9ac8144030 2023-11-24T06:32:44.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acc855640 1 -- 172.21.15.143:0/3626004681 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40aaae0 con 0x7f9ac8144030 2023-11-24T06:32:44.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 -- 172.21.15.143:0/3626004681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8144030 msgr2=0x7f9ac806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 --2- 172.21.15.143:0/3626004681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8144030 0x7f9ac806c650 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80700a0 tx=0x7f9ac401c490 comp rx=0 tx=0).stop 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 -- 172.21.15.143:0/3626004681 shutdown_connections 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 --2- 172.21.15.143:0/3626004681 >> v2:172.21.15.146:3300/0 conn(0x7f9ac809cc20 0x7f9ac806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 --2- 172.21.15.143:0/3626004681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8144030 0x7f9ac806c650 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 -- 172.21.15.143:0/3626004681 >> 172.21.15.143:0/3626004681 conn(0x7f9ac80b0bf0 msgr2=0x7f9ac80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 -- 172.21.15.143:0/3626004681 shutdown_connections 2023-11-24T06:32:44.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 -- 172.21.15.143:0/3626004681 wait complete. 2023-11-24T06:32:44.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 Processor -- start 2023-11-24T06:32:44.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.296+0000 7f9acfabb640 1 -- start start 2023-11-24T06:32:44.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 0x7f9ac815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:44.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac809cc20 0x7f9ac80b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:44.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac8144030 0x7f9ac80b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:44.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81328d0 con 0x7f9ac806e280 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac809a720 con 0x7f9ac8144030 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8099b10 con 0x7f9ac809cc20 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 0x7f9ac815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 0x7f9ac815ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58730/0 (socket says 172.21.15.143:58730) 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 -- 172.21.15.143:0/4200574943 learned_addr learned my addr 172.21.15.143:0/4200574943 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd056640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac809cc20 0x7f9ac80b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9ace058640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac8144030 0x7f9ac80b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 -- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac809cc20 msgr2=0x7f9ac80b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac809cc20 0x7f9ac80b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 -- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac8144030 msgr2=0x7f9ac80b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:44.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac8144030 0x7f9ac80b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:44.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 -- 172.21.15.143:0/4200574943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40094d0 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acd857640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 0x7f9ac815ac80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40ac040 tx=0x7f9ac401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40aa5f0 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac40b3820 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8099df0 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40b3bd0 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac809a3b0 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac8067520 con 0x7f9ac806e280 2023-11-24T06:32:44.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.300+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f9ac40b3d30 con 0x7f9ac806e280 2023-11-24T06:32:44.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.304+0000 7f9abe7fc640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aac066a10 0x7f9aac068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:44.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.304+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5413+0+0 (secure 0 0 0) 0x7f9ac40a7070 con 0x7f9ac806e280 2023-11-24T06:32:44.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.304+0000 7f9acd056640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aac066a10 0x7f9aac068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:44.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.304+0000 7f9acd056640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aac066a10 0x7f9aac068ed0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8165d70 tx=0x7f9ab8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:44.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.308+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ac40ebc20 con 0x7f9ac806e280 2023-11-24T06:32:44.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:44.456+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ac815b240 con 0x7f9ac806e280 2023-11-24T06:32:45.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9abe7fc640 1 -- 172.21.15.143:0/4200574943 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9ac40c30d0 con 0x7f9ac806e280 2023-11-24T06:32:45.052 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2023-11-24T06:32:45.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aac066a10 msgr2=0x7f9aac068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aac066a10 0x7f9aac068ed0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8165d70 tx=0x7f9ab8008040 comp rx=0 tx=0).stop 2023-11-24T06:32:45.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 msgr2=0x7f9ac815ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 0x7f9ac815ac80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40ac040 tx=0x7f9ac401acd0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 shutdown_connections 2023-11-24T06:32:45.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aac066a10 0x7f9aac068ed0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac8144030 0x7f9ac80b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac809cc20 0x7f9ac80b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 --2- 172.21.15.143:0/4200574943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac806e280 0x7f9ac815ac80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.056 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 >> 172.21.15.143:0/4200574943 conn(0x7f9ac80b0bf0 msgr2=0x7f9ac813c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:45.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.048+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 shutdown_connections 2023-11-24T06:32:45.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.052+0000 7f9acfabb640 1 -- 172.21.15.143:0/4200574943 wait complete. 2023-11-24T06:32:45.090 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:32:45.229 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 Processor -- start 2023-11-24T06:32:45.230 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 -- start start 2023-11-24T06:32:45.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6f80ae4a0 0x7fc6f815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 0x7fc6f80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80b3510 con 0x7fc6f80ce250 2023-11-24T06:32:45.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80ce6e0 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6ff09c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b37f0 con 0x7fc6f80cd850 2023-11-24T06:32:45.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 0x7fc6f80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6fce38640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6f80ae4a0 0x7fc6f815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 0x7fc6f80cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:37758/0 (socket says 172.21.15.143:37758) 2023-11-24T06:32:45.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 -- 172.21.15.143:0/1389654730 learned_addr learned my addr 172.21.15.143:0/1389654730 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:45.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 -- 172.21.15.143:0/1389654730 >> v2:172.21.15.146:3300/0 conn(0x7fc6f80ae4a0 msgr2=0x7fc6f815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:45.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 --2- 172.21.15.143:0/1389654730 >> v2:172.21.15.146:3300/0 conn(0x7fc6f80ae4a0 0x7fc6f815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 -- 172.21.15.143:0/1389654730 >> v1:172.21.15.146:6789/0 conn(0x7fc6f80ce250 legacy=0x7fc6f815eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.224+0000 7fc6f7fff640 1 -- 172.21.15.143:0/1389654730 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80b3ad0 con 0x7fc6f80cd850 2023-11-24T06:32:45.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6f7fff640 1 --2- 172.21.15.143:0/1389654730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 0x7fc6f80cdd10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009870 tx=0x7fc6e401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8904556bd2f90ba9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:45.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6f77fe640 1 -- 172.21.15.143:0/1389654730 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e40aa670 con 0x7fc6f80cd850 2023-11-24T06:32:45.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6f77fe640 1 -- 172.21.15.143:0/1389654730 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e40aa7d0 con 0x7fc6f80cd850 2023-11-24T06:32:45.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6f77fe640 1 -- 172.21.15.143:0/1389654730 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e40aab60 con 0x7fc6f80cd850 2023-11-24T06:32:45.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 -- 172.21.15.143:0/1389654730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 msgr2=0x7fc6f80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/1389654730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 0x7fc6f80cdd10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009870 tx=0x7fc6e401c510 comp rx=0 tx=0).stop 2023-11-24T06:32:45.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 -- 172.21.15.143:0/1389654730 shutdown_connections 2023-11-24T06:32:45.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/1389654730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80cd850 0x7fc6f80cdd10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/1389654730 >> v2:172.21.15.146:3300/0 conn(0x7fc6f80ae4a0 0x7fc6f815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 -- 172.21.15.143:0/1389654730 >> 172.21.15.143:0/1389654730 conn(0x7fc6f80b0c80 msgr2=0x7fc6f80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:45.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 -- 172.21.15.143:0/1389654730 shutdown_connections 2023-11-24T06:32:45.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.228+0000 7fc6ff09c640 1 -- 172.21.15.143:0/1389654730 wait complete. 2023-11-24T06:32:45.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 Processor -- start 2023-11-24T06:32:45.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 -- start start 2023-11-24T06:32:45.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 0x7fc6f81f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6f80cd850 0x7fc6f809c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80ce250 0x7fc6f8151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8154430 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f81f6a90 con 0x7fc6f80cd850 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f81537b0 con 0x7fc6f80ce250 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 0x7fc6f81f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 0x7fc6f81f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58744/0 (socket says 172.21.15.143:58744) 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 -- 172.21.15.143:0/3731953138 learned_addr learned my addr 172.21.15.143:0/3731953138 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6f7fff640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6f80cd850 0x7fc6f809c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fd639640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80ce250 0x7fc6f8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 -- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80ce250 msgr2=0x7fc6f8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80ce250 0x7fc6f8151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 -- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6f80cd850 msgr2=0x7fc6f809c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6f80cd850 0x7fc6f809c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 -- 172.21.15.143:0/3731953138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e40094d0 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6fce38640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 0x7fc6f81f6550 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00e930 tx=0x7fc6ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:45.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec009690 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec00ca00 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f8153a90 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00cd70 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.232+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f8154050 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.236+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f804e8c0 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.236+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fc6ec013470 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.236+0000 7fc6f57fa640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc6dc066a10 0x7fc6dc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.236+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7fc6ec084870 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.236+0000 7fc6f7fff640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc6dc066a10 0x7fc6dc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.236+0000 7fc6f7fff640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc6dc066a10 0x7fc6dc068ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40ae000 tx=0x7fc6e40b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:45.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.240+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6ec0518c0 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.392+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc6f80cfc50 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.396+0000 7fc6f57fa640 1 -- 172.21.15.143:0/3731953138 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6ec054ee0 con 0x7fc6f80ae4a0 2023-11-24T06:32:45.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc6dc066a10 msgr2=0x7fc6dc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc6dc066a10 0x7fc6dc068ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40ae000 tx=0x7fc6e40b5040 comp rx=0 tx=0).stop 2023-11-24T06:32:45.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 msgr2=0x7fc6f81f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 0x7fc6f81f6550 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00e930 tx=0x7fc6ec00edf0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 shutdown_connections 2023-11-24T06:32:45.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc6dc066a10 0x7fc6dc068ed0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6f80ce250 0x7fc6f8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6f80cd850 0x7fc6f809c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 --2- 172.21.15.143:0/3731953138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6f80ae4a0 0x7fc6f81f6550 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 >> 172.21.15.143:0/3731953138 conn(0x7fc6f80b0c80 msgr2=0x7fc6f80cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:45.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 shutdown_connections 2023-11-24T06:32:45.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.400+0000 7fc6ff09c640 1 -- 172.21.15.143:0/3731953138 wait complete. 2023-11-24T06:32:45.426 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_info' 2023-11-24T06:32:45.566 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0fa1772640 1 Processor -- start 2023-11-24T06:32:45.566 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0fa1772640 1 -- start start 2023-11-24T06:32:45.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0fa1772640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0f9c15d570 0x7f0f9c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0fa1772640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0d1cc0 con 0x7f0f9c0d3020 2023-11-24T06:32:45.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0fa1772640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0d1fa0 con 0x7f0f9c0ce8b0 2023-11-24T06:32:45.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0fa1772640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0ce0b0 con 0x7f0f9c15d570 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9b7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0f9c0ce8b0 0x7f0f9c0ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:42788/0 (socket says 172.21.15.143:42788) 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9b7fe640 1 -- 172.21.15.143:0/2426595611 learned_addr learned my addr 172.21.15.143:0/2426595611 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9affd640 1 --2- 172.21.15.143:0/2426595611 >> v2:172.21.15.143:3300/0 conn(0x7f0f9c15d570 0x7f0f9c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9affd640 1 -- 172.21.15.143:0/2426595611 >> v1:172.21.15.146:6789/0 conn(0x7f0f9c0ce8b0 legacy=0x7f0f9c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9a7fc640 1 -- 172.21.15.143:0/2426595611 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269753466 0 0) 0x7f0f9c0d1fa0 con 0x7f0f9c0ce8b0 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9affd640 1 -- 172.21.15.143:0/2426595611 >> v1:172.21.15.143:6789/0 conn(0x7f0f9c0d3020 legacy=0x7f0f9c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.560+0000 7f0f9affd640 1 -- 172.21.15.143:0/2426595611 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0ce390 con 0x7f0f9c15d570 2023-11-24T06:32:45.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0f9affd640 1 --2- 172.21.15.143:0/2426595611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c06b9d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097c0 tx=0x7f0f8c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf12d95f40ec2e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:45.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0f9a7fc640 1 -- 172.21.15.143:0/2426595611 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0a8050 con 0x7f0f9c15d570 2023-11-24T06:32:45.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0f9a7fc640 1 -- 172.21.15.143:0/2426595611 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0ac5f0 con 0x7f0f9c15d570 2023-11-24T06:32:45.571 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0f9a7fc640 1 -- 172.21.15.143:0/2426595611 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0ac980 con 0x7f0f9c15d570 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 -- 172.21.15.143:0/2426595611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 msgr2=0x7f0f9c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 --2- 172.21.15.143:0/2426595611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c06b9d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097c0 tx=0x7f0f8c01c480 comp rx=0 tx=0).stop 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 -- 172.21.15.143:0/2426595611 shutdown_connections 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 --2- 172.21.15.143:0/2426595611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c06b9d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 -- 172.21.15.143:0/2426595611 >> 172.21.15.143:0/2426595611 conn(0x7f0f9c08ceb0 msgr2=0x7f0f9c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 -- 172.21.15.143:0/2426595611 shutdown_connections 2023-11-24T06:32:45.572 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.564+0000 7f0fa1772640 1 -- 172.21.15.143:0/2426595611 wait complete. 2023-11-24T06:32:45.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 Processor -- start 2023-11-24T06:32:45.573 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- start start 2023-11-24T06:32:45.575 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c0ce8b0 0x7f0f9c149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f9c0d3020 0x7f0f9c14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c15e480 con 0x7f0f9c15d570 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c7aa0 con 0x7f0f9c0ce8b0 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c15e1a0 con 0x7f0f9c0d3020 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c0c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58754/0 (socket says 172.21.15.143:58754) 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 -- 172.21.15.143:0/1983051586 learned_addr learned my addr 172.21.15.143:0/1983051586 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f927fc640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f9c0d3020 0x7f0f9c14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9affd640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c0ce8b0 0x7f0f9c149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.576 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 -- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f9c0d3020 msgr2=0x7f0f9c14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f9c0d3020 0x7f0f9c14f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 -- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c0ce8b0 msgr2=0x7f0f9c149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c0ce8b0 0x7f0f9c149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 -- 172.21.15.143:0/1983051586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c009420 con 0x7f0f9c15d570 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9affd640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c0ce8b0 0x7f0f9c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f9b7fe640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c0c4860 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c7c0 tx=0x7f0f9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400a5e0 con 0x7f0f9c15d570 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9400a760 con 0x7f0f9c15d570 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400ab10 con 0x7f0f9c15d570 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0c7450 con 0x7f0f9c15d570 2023-11-24T06:32:45.577 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c152670 con 0x7f0f9c15d570 2023-11-24T06:32:45.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.568+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c067520 con 0x7f0f9c15d570 2023-11-24T06:32:45.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.572+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f0f9400ac70 con 0x7f0f9c15d570 2023-11-24T06:32:45.578 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.572+0000 7f0f93fff640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f7c066a10 0x7f0f7c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:45.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.572+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7f0f94083a30 con 0x7f0f9c15d570 2023-11-24T06:32:45.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.572+0000 7f0f9affd640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f7c066a10 0x7f0f7c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:45.579 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.572+0000 7f0f9affd640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f7c066a10 0x7f0f7c068ed0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0ae000 tx=0x7f0f8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:45.582 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.576+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f94050950 con 0x7f0f9c15d570 2023-11-24T06:32:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:45.780+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_info"]} v 0) v1 -- 0x7f0f9c0c7be0 con 0x7f0f9c15d570 2023-11-24T06:32:46.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.128+0000 7f0f93fff640 1 -- 172.21.15.143:0/1983051586 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_info"]}]=0 v204) v1 ==== 166+0+0 (secure 0 0 0) 0x7f0f94018020 con 0x7f0f9c15d570 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f7c066a10 msgr2=0x7f0f7c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f7c066a10 0x7f0f7c068ed0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0ae000 tx=0x7f0f8c008040 comp rx=0 tx=0).stop 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 msgr2=0x7f0f9c0c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c0c4860 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c7c0 tx=0x7f0f9400cc80 comp rx=0 tx=0).stop 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 shutdown_connections 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0f7c066a10 0x7f0f7c068ed0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c15d570 0x7f0f9c0c4860 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f9c0d3020 0x7f0f9c14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 --2- 172.21.15.143:0/1983051586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c0ce8b0 0x7f0f9c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 >> 172.21.15.143:0/1983051586 conn(0x7f0f9c08ceb0 msgr2=0x7f0f9c1554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:46.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 shutdown_connections 2023-11-24T06:32:46.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.132+0000 7f0fa1772640 1 -- 172.21.15.143:0/1983051586 wait complete. 2023-11-24T06:32:46.160 INFO:tasks.cephfs_test_runner:tests the scenario where 'fs subvolume snapshot info' command ... ok 2023-11-24T06:32:46.160 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:32:46.160 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:46.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.292+0000 7f41f1a32640 1 Processor -- start 2023-11-24T06:32:46.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.292+0000 7f41f1a32640 1 -- start start 2023-11-24T06:32:46.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.292+0000 7f41f1a32640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41ec0b36c0 0x7f41ec0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.292+0000 7f41f1a32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec070da0 0x7f41ec15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41f1a32640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec15a700 con 0x7f41ec15a320 2023-11-24T06:32:46.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41f1a32640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0b2430 con 0x7f41ec0b36c0 2023-11-24T06:32:46.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41f1a32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec0b2620 con 0x7f41ec070da0 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41ec0b36c0 0x7f41ec0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41ec0b36c0 0x7f41ec0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:39208/0 (socket says 172.21.15.143:39208) 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41eaffd640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f41ec15a320 0x7f41ec070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:42798/0 (socket says 172.21.15.143:42798) 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 -- 172.21.15.143:0/1070130874 learned_addr learned my addr 172.21.15.143:0/1070130874 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41eb7fe640 1 --2- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec070da0 0x7f41ec15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 -- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec070da0 msgr2=0x7f41ec15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:46.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 --2- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec070da0 0x7f41ec15ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 -- 172.21.15.143:0/1070130874 >> v1:172.21.15.146:6789/0 conn(0x7f41ec15a320 legacy=0x7f41ec070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 -- 172.21.15.143:0/1070130874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec0b2900 con 0x7f41ec0b36c0 2023-11-24T06:32:46.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41ea7fc640 1 -- 172.21.15.143:0/1070130874 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929320043 0 0) 0x7f41ec15a700 con 0x7f41ec15a320 2023-11-24T06:32:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.296+0000 7f41e3fff640 1 --2- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec0b36c0 0x7f41ec0b1ef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4825d1be35442b86 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41ea7fc640 1 -- 172.21.15.143:0/1070130874 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40ab620 con 0x7f41ec0b36c0 2023-11-24T06:32:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41ea7fc640 1 -- 172.21.15.143:0/1070130874 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d40ab780 con 0x7f41ec0b36c0 2023-11-24T06:32:46.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41ea7fc640 1 -- 172.21.15.143:0/1070130874 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40abb10 con 0x7f41ec0b36c0 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec0b36c0 msgr2=0x7f41ec0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 --2- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec0b36c0 0x7f41ec0b1ef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d401c510 comp rx=0 tx=0).stop 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- 172.21.15.143:0/1070130874 shutdown_connections 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 --2- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec070da0 0x7f41ec15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 --2- 172.21.15.143:0/1070130874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec0b36c0 0x7f41ec0b1ef0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- 172.21.15.143:0/1070130874 >> 172.21.15.143:0/1070130874 conn(0x7f41ec0b0bf0 msgr2=0x7f41ec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- 172.21.15.143:0/1070130874 shutdown_connections 2023-11-24T06:32:46.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- 172.21.15.143:0/1070130874 wait complete. 2023-11-24T06:32:46.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 Processor -- start 2023-11-24T06:32:46.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- start start 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec070da0 0x7f41ec14cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec0b36c0 0x7f41ec15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 0x7f41ec14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec14d500 con 0x7f41ec15a320 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec15c3d0 con 0x7f41ec070da0 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.300+0000 7f41f1a32640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec15c6b0 con 0x7f41ec0b36c0 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 0x7f41ec14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 0x7f41ec14f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58770/0 (socket says 172.21.15.143:58770) 2023-11-24T06:32:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 -- 172.21.15.143:0/608960401 learned_addr learned my addr 172.21.15.143:0/608960401 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41e3fff640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec0b36c0 0x7f41ec15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.310 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eaffd640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec070da0 0x7f41ec14cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 -- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec0b36c0 msgr2=0x7f41ec15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec0b36c0 0x7f41ec15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 -- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec070da0 msgr2=0x7f41ec14cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec070da0 0x7f41ec14cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 -- 172.21.15.143:0/608960401 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40094d0 con 0x7f41ec15a320 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41eb7fe640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 0x7f41ec14f640 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f41e400efc0 tx=0x7f41e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4014480 con 0x7f41ec15a320 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400f040 con 0x7f41ec15a320 2023-11-24T06:32:46.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4014820 con 0x7f41ec15a320 2023-11-24T06:32:46.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec15c990 con 0x7f41ec15a320 2023-11-24T06:32:46.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec15cf50 con 0x7f41ec15a320 2023-11-24T06:32:46.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec15d170 con 0x7f41ec15a320 2023-11-24T06:32:46.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f41e4014980 con 0x7f41ec15a320 2023-11-24T06:32:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.304+0000 7f41e8ff9640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f41cc066a10 0x7f41cc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.308+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7f41e40851b0 con 0x7f41ec15a320 2023-11-24T06:32:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.308+0000 7f41eaffd640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f41cc066a10 0x7f41cc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.308+0000 7f41eaffd640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f41cc066a10 0x7f41cc068ed0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f41dc000f70 tx=0x7f41dc007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.308+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41e4051fe0 con 0x7f41ec15a320 2023-11-24T06:32:46.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.460+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41ec067520 con 0x7f41ec15a320 2023-11-24T06:32:46.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.460+0000 7f41e8ff9640 1 -- 172.21.15.143:0/608960401 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+13122 (secure 0 0 0) 0x7f41e4055600 con 0x7f41ec15a320 2023-11-24T06:32:46.468 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:46.469 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":76,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:45.049292+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/492061256":"2023-11-25T06:32:42.115670+0000","172.21.15.143:6836/492061256":"2023-11-25T06:32:42.115670+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:46.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f41cc066a10 msgr2=0x7f41cc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f41cc066a10 0x7f41cc068ed0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f41dc000f70 tx=0x7f41dc007df0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 msgr2=0x7f41ec14f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 0x7f41ec14f640 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f41e400efc0 tx=0x7f41e400c490 comp rx=0 tx=0).stop 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 shutdown_connections 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f41cc066a10 0x7f41cc068ed0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41ec15a320 0x7f41ec14f640 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41ec0b36c0 0x7f41ec15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 --2- 172.21.15.143:0/608960401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41ec070da0 0x7f41ec14cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 >> 172.21.15.143:0/608960401 conn(0x7f41ec0b0bf0 msgr2=0x7f41ec163310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 shutdown_connections 2023-11-24T06:32:46.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.464+0000 7f41f1a32640 1 -- 172.21.15.143:0/608960401 wait complete. 2023-11-24T06:32:46.489 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:46.490 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:46.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 Processor -- start 2023-11-24T06:32:46.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 -- start start 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ad900 0x7f4bbc15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bbc0adce0 0x7f4bbc070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0b23a0 con 0x7f4bbc0ac850 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc15e490 con 0x7f4bbc0adce0 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc4046640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc15e770 con 0x7f4bbc0ad900 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.624+0000 7f4bc15e1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bbc0adce0 0x7f4bbc070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bbc0adce0 0x7f4bbc070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58774/0 (socket says 172.21.15.143:58774) 2023-11-24T06:32:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 -- 172.21.15.143:0/3716011137 learned_addr learned my addr 172.21.15.143:0/3716011137 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 -- 172.21.15.143:0/3716011137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ad900 msgr2=0x7f4bbc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc1de2640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ad900 0x7f4bbc15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ad900 0x7f4bbc15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 -- 172.21.15.143:0/3716011137 >> v1:172.21.15.143:6789/0 conn(0x7f4bbc0ac850 legacy=0x7f4bbc1611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 -- 172.21.15.143:0/3716011137 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc15ea50 con 0x7f4bbc0adce0 2023-11-24T06:32:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc1de2640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ad900 0x7f4bbc15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:46.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc15e1640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0adce0 0x7f4bbc070a70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009870 tx=0x7f4bac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8247f1eaf999801c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc0de0640 1 -- 172.21.15.143:0/3716011137 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0a95f0 con 0x7f4bbc0adce0 2023-11-24T06:32:46.636 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc0de0640 1 -- 172.21.15.143:0/3716011137 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0a9750 con 0x7f4bbc0adce0 2023-11-24T06:32:46.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.628+0000 7f4bc0de0640 1 -- 172.21.15.143:0/3716011137 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0a9ae0 con 0x7f4bbc0adce0 2023-11-24T06:32:46.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- 172.21.15.143:0/3716011137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0adce0 msgr2=0x7f4bbc070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0adce0 0x7f4bbc070a70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009870 tx=0x7f4bac01c510 comp rx=0 tx=0).stop 2023-11-24T06:32:46.637 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- 172.21.15.143:0/3716011137 shutdown_connections 2023-11-24T06:32:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0adce0 0x7f4bbc070a70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 --2- 172.21.15.143:0/3716011137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ad900 0x7f4bbc15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- 172.21.15.143:0/3716011137 >> 172.21.15.143:0/3716011137 conn(0x7f4bbc0cf410 msgr2=0x7f4bbc0cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- 172.21.15.143:0/3716011137 shutdown_connections 2023-11-24T06:32:46.638 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- 172.21.15.143:0/3716011137 wait complete. 2023-11-24T06:32:46.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 Processor -- start 2023-11-24T06:32:46.639 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- start start 2023-11-24T06:32:46.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ac850 0x7f4bbc15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.640 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 0x7f4bbc14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bbc0adce0 0x7f4bbc0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc14d230 con 0x7f4bbc0ad900 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc06e8d0 con 0x7f4bbc0adce0 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc4046640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc14d440 con 0x7f4bbc0ac850 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 0x7f4bbc14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 0x7f4bbc14c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58776/0 (socket says 172.21.15.143:58776) 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 -- 172.21.15.143:0/400292666 learned_addr learned my addr 172.21.15.143:0/400292666 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 -- 172.21.15.143:0/400292666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ac850 msgr2=0x7f4bbc15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ac850 0x7f4bbc15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 -- 172.21.15.143:0/400292666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bbc0adce0 msgr2=0x7f4bbc0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.641 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bbc0adce0 0x7f4bbc0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.632+0000 7f4bc15e1640 1 -- 172.21.15.143:0/400292666 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0094d0 con 0x7f4bbc0ad900 2023-11-24T06:32:46.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bc15e1640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 0x7f4bbc14c080 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01abc0 tx=0x7f4bac0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b1800 con 0x7f4bbc0ad900 2023-11-24T06:32:46.642 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0b1960 con 0x7f4bbc0ad900 2023-11-24T06:32:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc14d720 con 0x7f4bbc0ad900 2023-11-24T06:32:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b1d10 con 0x7f4bbc0ad900 2023-11-24T06:32:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc06e4f0 con 0x7f4bbc0ad900 2023-11-24T06:32:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc14d940 con 0x7f4bbc0ad900 2023-11-24T06:32:46.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f4bac0bb440 con 0x7f4bbc0ad900 2023-11-24T06:32:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bb27fc640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ba0066a40 0x7f4ba0068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7f4bac11ecf0 con 0x7f4bbc0ad900 2023-11-24T06:32:46.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.636+0000 7f4bc1de2640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ba0066a40 0x7f4ba0068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.640+0000 7f4bc1de2640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ba0066a40 0x7f4ba0068f00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800a8d0 tx=0x7f4bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.640+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4bac0ebab0 con 0x7f4bbc0ad900 2023-11-24T06:32:46.797 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bbc1616d0 con 0x7f4bbc0ad900 2023-11-24T06:32:46.798 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bb27fc640 1 -- 172.21.15.143:0/400292666 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bac0ef0d0 con 0x7f4bbc0ad900 2023-11-24T06:32:46.798 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:46.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ba0066a40 msgr2=0x7f4ba0068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.800 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ba0066a40 0x7f4ba0068f00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800a8d0 tx=0x7f4bb8008040 comp rx=0 tx=0).stop 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 msgr2=0x7f4bbc14c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 0x7f4bbc14c080 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01abc0 tx=0x7f4bac0192b0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 shutdown_connections 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4ba0066a40 0x7f4ba0068f00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bbc0adce0 0x7f4bbc0afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bbc0ad900 0x7f4bbc14c080 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 --2- 172.21.15.143:0/400292666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bbc0ac850 0x7f4bbc15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 >> 172.21.15.143:0/400292666 conn(0x7f4bbc0cf410 msgr2=0x7f4bbc160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:46.801 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 shutdown_connections 2023-11-24T06:32:46.802 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.792+0000 7f4bc4046640 1 -- 172.21.15.143:0/400292666 wait complete. 2023-11-24T06:32:46.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_ls' 2023-11-24T06:32:46.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.948+0000 7f18dde91640 1 Processor -- start 2023-11-24T06:32:46.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18dde91640 1 -- start start 2023-11-24T06:32:46.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18dde91640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18d815a320 0x7f18d80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18dde91640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 0x7f18d8070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18dde91640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d815a700 con 0x7f18d8070bd0 2023-11-24T06:32:46.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18dde91640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80b2430 con 0x7f18d815a320 2023-11-24T06:32:46.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18dde91640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80b2620 con 0x7f18d80b36c0 2023-11-24T06:32:46.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d6ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 0x7f18d8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18d815a320 0x7f18d80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18d815a320 0x7f18d80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:39236/0 (socket says 172.21.15.143:39236) 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d6ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 0x7f18d8070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:37800/0 (socket says 172.21.15.143:37800) 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 -- 172.21.15.143:0/3223416802 learned_addr learned my addr 172.21.15.143:0/3223416802 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 -- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 msgr2=0x7f18d8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 --2- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 0x7f18d8070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 -- 172.21.15.143:0/3223416802 >> v1:172.21.15.146:6789/0 conn(0x7f18d8070bd0 legacy=0x7f18d80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d77fe640 1 -- 172.21.15.143:0/3223416802 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80b2900 con 0x7f18d815a320 2023-11-24T06:32:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.952+0000 7f18d6ffd640 1 --2- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 0x7f18d8070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:46.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18d77fe640 1 --2- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d815a320 0x7f18d80b1ef0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009870 tx=0x7f18c801e750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169d68bf961a9eb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18d67fc640 1 -- 172.21.15.143:0/3223416802 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80a7710 con 0x7f18d815a320 2023-11-24T06:32:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18d67fc640 1 -- 172.21.15.143:0/3223416802 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c80a7870 con 0x7f18d815a320 2023-11-24T06:32:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18d67fc640 1 -- 172.21.15.143:0/3223416802 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80a7c00 con 0x7f18d815a320 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 -- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d815a320 msgr2=0x7f18d80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 --2- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d815a320 0x7f18d80b1ef0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009870 tx=0x7f18c801e750 comp rx=0 tx=0).stop 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 -- 172.21.15.143:0/3223416802 shutdown_connections 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 --2- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d80b36c0 0x7f18d8070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 --2- 172.21.15.143:0/3223416802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d815a320 0x7f18d80b1ef0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 -- 172.21.15.143:0/3223416802 >> 172.21.15.143:0/3223416802 conn(0x7f18d80b0bf0 msgr2=0x7f18d80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 -- 172.21.15.143:0/3223416802 shutdown_connections 2023-11-24T06:32:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.956+0000 7f18dde91640 1 -- 172.21.15.143:0/3223416802 wait complete. 2023-11-24T06:32:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 Processor -- start 2023-11-24T06:32:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- start start 2023-11-24T06:32:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d8070bd0 0x7f18d80cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 0x7f18d80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d815a320 0x7f18d8159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cd250 con 0x7f18d80b36c0 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cd530 con 0x7f18d8070bd0 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cd810 con 0x7f18d815a320 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 0x7f18d80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 0x7f18d80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58790/0 (socket says 172.21.15.143:58790) 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 -- 172.21.15.143:0/4246171445 learned_addr learned my addr 172.21.15.143:0/4246171445 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d77fe640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d8070bd0 0x7f18d80cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d7fff640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d815a320 0x7f18d8159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 -- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d815a320 msgr2=0x7f18d8159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d815a320 0x7f18d8159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 -- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d8070bd0 msgr2=0x7f18d80cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d8070bd0 0x7f18d80cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:46.968 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 -- 172.21.15.143:0/4246171445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009420 con 0x7f18d80b36c0 2023-11-24T06:32:46.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18d6ffd640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 0x7f18d80ce2f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e9d0 tx=0x7f18cc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00ca60 con 0x7f18d80b36c0 2023-11-24T06:32:46.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00cbc0 con 0x7f18d80b36c0 2023-11-24T06:32:46.969 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c80094d0 con 0x7f18d80b36c0 2023-11-24T06:32:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc013470 con 0x7f18d80b36c0 2023-11-24T06:32:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d80cddd0 con 0x7f18d80b36c0 2023-11-24T06:32:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.960+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8067520 con 0x7f18d80b36c0 2023-11-24T06:32:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.964+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f18cc0135d0 con 0x7f18d80b36c0 2023-11-24T06:32:46.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.964+0000 7f18bffff640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18c4066a10 0x7f18c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.964+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7f18cc084530 con 0x7f18d80b36c0 2023-11-24T06:32:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.964+0000 7f18d77fe640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18c4066a10 0x7f18c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:46.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.964+0000 7f18d77fe640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18c4066a10 0x7f18c4068ed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f18c80b1000 tx=0x7f18c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:46.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:46.968+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18cc051480 con 0x7f18d80b36c0 2023-11-24T06:32:47.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:47.176+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_ls"]} v 0) v1 -- 0x7f18d80af8d0 con 0x7f18d80b36c0 2023-11-24T06:32:48.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.136+0000 7f18bffff640 1 -- 172.21.15.143:0/4246171445 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_ls"]}]=0 v206) v1 ==== 167+0+0 (secure 0 0 0) 0x7f18cc054aa0 con 0x7f18d80b36c0 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18c4066a10 msgr2=0x7f18c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18c4066a10 0x7f18c4068ed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f18c80b1000 tx=0x7f18c8008040 comp rx=0 tx=0).stop 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 msgr2=0x7f18d80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 0x7f18d80ce2f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e9d0 tx=0x7f18cc00ee90 comp rx=0 tx=0).stop 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 shutdown_connections 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18c4066a10 0x7f18c4068ed0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18d815a320 0x7f18d8159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18d80b36c0 0x7f18d80ce2f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 --2- 172.21.15.143:0/4246171445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18d8070bd0 0x7f18d80cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 >> 172.21.15.143:0/4246171445 conn(0x7f18d80b0bf0 msgr2=0x7f18d80afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 shutdown_connections 2023-11-24T06:32:48.150 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.140+0000 7f18dde91640 1 -- 172.21.15.143:0/4246171445 wait complete. 2023-11-24T06:32:48.172 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:32:48.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 Processor -- start 2023-11-24T06:32:48.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 -- start start 2023-11-24T06:32:48.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f17240d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17240d37e0 0x7f17240b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f17240b1630 0x7f17240b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172406b980 con 0x7f17240b1630 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240d3c60 con 0x7f17240d37e0 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f172a046640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240b0090 con 0x7f172415d7f0 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f17240b1630 0x7f17240b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f17240b1630 0x7f17240b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50094/0 (socket says 172.21.15.143:50094) 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 -- 172.21.15.143:0/2803257855 learned_addr learned my addr 172.21.15.143:0/2803257855 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:48.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f171bfff640 1 --2- 172.21.15.143:0/2803257855 >> v2:172.21.15.146:3300/0 conn(0x7f17240d37e0 0x7f17240b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f17237fe640 1 --2- 172.21.15.143:0/2803257855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f17240d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 -- 172.21.15.143:0/2803257855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 msgr2=0x7f17240d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:48.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 --2- 172.21.15.143:0/2803257855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f17240d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 -- 172.21.15.143:0/2803257855 >> v2:172.21.15.146:3300/0 conn(0x7f17240d37e0 msgr2=0x7f17240b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:48.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 --2- 172.21.15.143:0/2803257855 >> v2:172.21.15.146:3300/0 conn(0x7f17240d37e0 0x7f17240b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.312+0000 7f1723fff640 1 -- 172.21.15.143:0/2803257855 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240b0330 con 0x7f17240b1630 2023-11-24T06:32:48.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f1723fff640 1 --2- 172.21.15.143:0/2803257855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f17240b1ac0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f17240b5ff0 tx=0x7f171c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eba497cb5759ce6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:48.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f1722ffd640 1 -- 172.21.15.143:0/2803257855 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5650 con 0x7f17240b1630 2023-11-24T06:32:48.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f1722ffd640 1 -- 172.21.15.143:0/2803257855 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0a57b0 con 0x7f17240b1630 2023-11-24T06:32:48.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f1722ffd640 1 -- 172.21.15.143:0/2803257855 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5b40 con 0x7f17240b1630 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 -- 172.21.15.143:0/2803257855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 msgr2=0x7f17240b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 --2- 172.21.15.143:0/2803257855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f17240b1ac0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f17240b5ff0 tx=0x7f171c01c9d0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 -- 172.21.15.143:0/2803257855 shutdown_connections 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 --2- 172.21.15.143:0/2803257855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f17240b1ac0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 --2- 172.21.15.143:0/2803257855 >> v2:172.21.15.146:3300/0 conn(0x7f17240d37e0 0x7f17240b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 --2- 172.21.15.143:0/2803257855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f17240d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 -- 172.21.15.143:0/2803257855 >> 172.21.15.143:0/2803257855 conn(0x7f172409c790 msgr2=0x7f172408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:48.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 -- 172.21.15.143:0/2803257855 shutdown_connections 2023-11-24T06:32:48.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.316+0000 7f172a046640 1 -- 172.21.15.143:0/2803257855 wait complete. 2023-11-24T06:32:48.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 Processor -- start 2023-11-24T06:32:48.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 -- start start 2023-11-24T06:32:48.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f172414c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17240d37e0 0x7f172414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f172414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172414cdd0 con 0x7f17240b1630 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17240b3b50 con 0x7f17240d37e0 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1724150eb0 con 0x7f172415d7f0 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f172414c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f172414c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50098/0 (socket says 172.21.15.143:50098) 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 -- 172.21.15.143:0/835270009 learned_addr learned my addr 172.21.15.143:0/835270009 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f1723fff640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f172414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f171bfff640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17240d37e0 0x7f172414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 -- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 msgr2=0x7f172414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f172414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 -- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17240d37e0 msgr2=0x7f172414f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17240d37e0 0x7f172414f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 -- 172.21.15.143:0/835270009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c009b30 con 0x7f17240b1630 2023-11-24T06:32:48.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f171bfff640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17240d37e0 0x7f172414f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:48.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f17237fe640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f172414c1e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f171400d620 tx=0x7f171400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:48.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400b620 con 0x7f17240b1630 2023-11-24T06:32:48.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171400b780 con 0x7f17240b1630 2023-11-24T06:32:48.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400bb10 con 0x7f17240b1630 2023-11-24T06:32:48.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724150330 con 0x7f17240b1630 2023-11-24T06:32:48.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.320+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241508f0 con 0x7f17240b1630 2023-11-24T06:32:48.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.324+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172404e8c0 con 0x7f17240b1630 2023-11-24T06:32:48.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.324+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f171400bc70 con 0x7f17240b1630 2023-11-24T06:32:48.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.324+0000 7f1720ff9640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1704066a10 0x7f1704068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.324+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7f17140849f0 con 0x7f17240b1630 2023-11-24T06:32:48.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.324+0000 7f171bfff640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1704066a10 0x7f1704068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.324+0000 7f171bfff640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1704066a10 0x7f1704068ed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f17240d05b0 tx=0x7f170c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:48.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.328+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17140518c0 con 0x7f17240b1630 2023-11-24T06:32:48.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.476+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f17240cb3f0 con 0x7f17240b1630 2023-11-24T06:32:48.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.480+0000 7f1720ff9640 1 -- 172.21.15.143:0/835270009 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1714054ee0 con 0x7f17240b1630 2023-11-24T06:32:48.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1704066a10 msgr2=0x7f1704068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1704066a10 0x7f1704068ed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f17240d05b0 tx=0x7f170c008040 comp rx=0 tx=0).stop 2023-11-24T06:32:48.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 msgr2=0x7f172414c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f172414c1e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f171400d620 tx=0x7f171400dae0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 shutdown_connections 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1704066a10 0x7f1704068ed0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f172415d7f0 0x7f172414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17240d37e0 0x7f172414f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 --2- 172.21.15.143:0/835270009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17240b1630 0x7f172414c1e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 >> 172.21.15.143:0/835270009 conn(0x7f172409c790 msgr2=0x7f17240cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 shutdown_connections 2023-11-24T06:32:48.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.484+0000 7f172a046640 1 -- 172.21.15.143:0/835270009 wait complete. 2023-11-24T06:32:48.509 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:32:48.510 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:48.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:32:48.628 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:32:48.628 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:48.628 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:48.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:32:48.637 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:48.638 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:48.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:32:48.647 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:32:48.647 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:48.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:32:48.693 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:32:48.694 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:32:48.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:32:48.703 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:32:48.704 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:32:48.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.864+0000 7f1d2fcbb640 1 Processor -- start 2023-11-24T06:32:48.873 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2fcbb640 1 -- start start 2023-11-24T06:32:48.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2fcbb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d280ce8b0 0x7f1d280ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2fcbb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2806c0e0 con 0x7f1d280d3020 2023-11-24T06:32:48.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2fcbb640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280d1cc0 con 0x7f1d2815d570 2023-11-24T06:32:48.874 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2fcbb640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280d1fa0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2e258640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d280ce8b0 0x7f1d280ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2e258640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d280ce8b0 0x7f1d280ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50108/0 (socket says 172.21.15.143:50108) 2023-11-24T06:32:48.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2e258640 1 -- 172.21.15.143:0/2917574174 learned_addr learned my addr 172.21.15.143:0/2917574174 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:48.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2e258640 1 -- 172.21.15.143:0/2917574174 >> v1:172.21.15.146:6789/0 conn(0x7f1d2815d570 legacy=0x7f1d2806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:48.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2e258640 1 -- 172.21.15.143:0/2917574174 >> v1:172.21.15.143:6789/0 conn(0x7f1d280d3020 legacy=0x7f1d280d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.875 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.868+0000 7f1d2e258640 1 -- 172.21.15.143:0/2917574174 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280ce0b0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.877 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2e258640 1 --2- 172.21.15.143:0/2917574174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d280ced60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009e50 tx=0x7f1d2001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e91ab8520e1a892 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:48.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2ca55640 1 -- 172.21.15.143:0/2917574174 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200a58a0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2ca55640 1 -- 172.21.15.143:0/2917574174 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d200a5a00 con 0x7f1d280ce8b0 2023-11-24T06:32:48.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2ca55640 1 -- 172.21.15.143:0/2917574174 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200a5d90 con 0x7f1d280ce8b0 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/2917574174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 msgr2=0x7f1d280ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/2917574174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d280ced60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009e50 tx=0x7f1d2001c9e0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/2917574174 shutdown_connections 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/2917574174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d280ced60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/2917574174 >> 172.21.15.143:0/2917574174 conn(0x7f1d2808ceb0 msgr2=0x7f1d2809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/2917574174 shutdown_connections 2023-11-24T06:32:48.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/2917574174 wait complete. 2023-11-24T06:32:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 Processor -- start 2023-11-24T06:32:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.872+0000 7f1d2fcbb640 1 -- start start 2023-11-24T06:32:48.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d2815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d280d3020 0x7f1d281f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d2815d570 0x7f1d281f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d281f98b0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2815a1c0 con 0x7f1d2815d570 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2815a4a0 con 0x7f1d280d3020 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d2815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d2815c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50122/0 (socket says 172.21.15.143:50122) 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 -- 172.21.15.143:0/4075281552 learned_addr learned my addr 172.21.15.143:0/4075281552 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2e258640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d2815d570 0x7f1d281f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2d256640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d280d3020 0x7f1d281f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 -- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d280d3020 msgr2=0x7f1d281f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d280d3020 0x7f1d281f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 -- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d2815d570 msgr2=0x7f1d281f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d2815d570 0x7f1d281f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 -- 172.21.15.143:0/4075281552 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009b30 con 0x7f1d280ce8b0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2d256640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d280d3020 0x7f1d281f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2da57640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d2815c2c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c3c0 tx=0x7f1d2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d240052d0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24005430 con 0x7f1d280ce8b0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2815a780 con 0x7f1d280ce8b0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24003840 con 0x7f1d280ce8b0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2815af80 con 0x7f1d280ce8b0 2023-11-24T06:32:48.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2815aca0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.876+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f1d240039a0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.880+0000 7f1d1e7fc640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d0c066a10 0x7f1d0c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.880+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4999+0+0 (secure 0 0 0) 0x7f1d24083ae0 con 0x7f1d280ce8b0 2023-11-24T06:32:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.880+0000 7f1d2d256640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d0c066a10 0x7f1d0c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.880+0000 7f1d2d256640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d0c066a10 0x7f1d0c068ed0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d28072210 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:48.884+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d2815aca0 con 0x7f1d280ce8b0 2023-11-24T06:32:49.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.060+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d2815aca0 con 0x7f1d280ce8b0 2023-11-24T06:32:49.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.060+0000 7f1d1e7fc640 1 -- 172.21.15.143:0/4075281552 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f1d2815aca0 con 0x7f1d280ce8b0 2023-11-24T06:32:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:49.070 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6160,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/65969584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":65969584},{"type":"v1","addr":"172.21.15.143:6835","nonce":65969584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3601284457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3601284457},{"type":"v1","addr":"172.21.15.146:6834","nonce":3601284457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6169,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1429533766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1429533766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1429533766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/1668616635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1668616635},{"type":"v1","addr":"172.21.15.143:6837","nonce":1668616635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[]} 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 47 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d0c066a10 msgr2=0x7f1d0c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d0c066a10 0x7f1d0c068ed0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d28072210 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 msgr2=0x7f1d2815c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d2815c2c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c3c0 tx=0x7f1d2400c880 comp rx=0 tx=0).stop 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 shutdown_connections 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1d0c066a10 0x7f1d0c068ed0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d2815d570 0x7f1d281f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:49.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d280d3020 0x7f1d281f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 --2- 172.21.15.143:0/4075281552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d280ce8b0 0x7f1d2815c2c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 >> 172.21.15.143:0/4075281552 conn(0x7f1d2808ceb0 msgr2=0x7f1d280b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 shutdown_connections 2023-11-24T06:32:49.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:49.064+0000 7f1d2fcbb640 1 -- 172.21.15.143:0/4075281552 wait complete. 2023-11-24T06:32:49.090 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:32:49.091 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:32:49.091 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:32:49.091 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:49.091 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:32:49.091 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:32:49.091 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:32:49.091 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:49.092 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:32:49.092 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:32:49.092 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:32:49.092 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:49.092 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:32:49.092 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:32:49.092 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:32:49.093 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:32:49.109 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:32:49.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:32:49.111 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:32:49.112 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:32:49.114 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:32:49.114 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:32:49.152 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:32:49.153 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:49.155 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:32:49.155 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:49.159 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:32:49.159 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:49.243 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2023-11-24T06:32:49.245 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-11-24T06:32:49.246 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-11-24T06:32:52.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-24T06:32:55.114 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:32:55.114 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:32:55.118 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:32:55.119 DEBUG:teuthology.parallel:result is None 2023-11-24T06:32:55.119 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:32:55.212 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:32:55.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.264+0000 7fa283468640 1 Processor -- start 2023-11-24T06:32:55.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.264+0000 7fa283468640 1 -- start start 2023-11-24T06:32:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa283468640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 0x7fa27c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa283468640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa27c15b600 0x7fa27c06d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa283468640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c0abed0 con 0x7fa27c0c9650 2023-11-24T06:32:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa283468640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c072710 con 0x7fa27c15b600 2023-11-24T06:32:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa283468640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c072370 con 0x7fa27c15b220 2023-11-24T06:32:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa281a05640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa27c0c9650 0x7fa27c15efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38566/0 (socket says 172.21.15.143:38566) 2023-11-24T06:32:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa281a05640 1 -- 172.21.15.143:0/64500293 learned_addr learned my addr 172.21.15.143:0/64500293 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:55.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 --2- 172.21.15.143:0/64500293 >> v2:172.21.15.146:3300/0 conn(0x7fa27c15b600 0x7fa27c06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa281204640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 0x7fa27c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220524096 0 0) 0x7fa27c0abed0 con 0x7fa27c0c9650 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa268003530 con 0x7fa27c0c9650 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202163839 0 0) 0x7fa268003530 con 0x7fa27c0c9650 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 msgr2=0x7fa27c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 0x7fa27c0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 >> v2:172.21.15.146:3300/0 conn(0x7fa27c15b600 msgr2=0x7fa27c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 --2- 172.21.15.143:0/64500293 >> v2:172.21.15.146:3300/0 conn(0x7fa27c15b600 0x7fa27c06d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c06d580 con 0x7fa27c0c9650 2023-11-24T06:32:55.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fa274001a00 con 0x7fa27c0c9650 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 >> v1:172.21.15.143:6789/0 conn(0x7fa27c0c9650 legacy=0x7fa27c15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 0x7fa268003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa268003f00 0x7fa2680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268004d10 0x7fa268005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c072710 con 0x7fa268003f00 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c072370 con 0x7fa268004d10 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26800b990 con 0x7fa27c15b220 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa268003f00 0x7fa2680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa281204640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 0x7fa268003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa281a05640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268004d10 0x7fa268005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 -- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 msgr2=0x7fa268003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:55.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c15b220 0x7fa268003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:55.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 -- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268004d10 msgr2=0x7fa268005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:55.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268004d10 0x7fa268005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:55.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.268+0000 7fa280a03640 1 -- 172.21.15.143:0/64500293 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268003530 con 0x7fa268003f00 2023-11-24T06:32:55.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa280a03640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa268003f00 0x7fa2680047d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009ae0 tx=0x7fa26c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb2ddf9694d3176 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:55.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0a5570 con 0x7fa268003f00 2023-11-24T06:32:55.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c0a56d0 con 0x7fa268003f00 2023-11-24T06:32:55.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa273fff640 1 -- 172.21.15.143:0/64500293 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0a5a80 con 0x7fa268003f00 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 -- 172.21.15.143:0/64500293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa268003f00 msgr2=0x7fa2680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 --2- 172.21.15.143:0/64500293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa268003f00 0x7fa2680047d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009ae0 tx=0x7fa26c01ca30 comp rx=0 tx=0).stop 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa281a05640 1 -- 172.21.15.143:0/64500293 reap_dead start 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 -- 172.21.15.143:0/64500293 shutdown_connections 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 -- 172.21.15.143:0/64500293 >> 172.21.15.143:0/64500293 conn(0x7fa27c0b0bf0 msgr2=0x7fa27c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 -- 172.21.15.143:0/64500293 shutdown_connections 2023-11-24T06:32:55.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 -- 172.21.15.143:0/64500293 wait complete. 2023-11-24T06:32:55.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.272+0000 7fa283468640 1 Processor -- start 2023-11-24T06:32:55.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- start start 2023-11-24T06:32:55.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268003f00 0x7fa27c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c14baa0 0x7fa27c146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 0x7fa27c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c157ad0 con 0x7fa27c146640 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0b2e60 con 0x7fa268003f00 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0b30b0 con 0x7fa27c14baa0 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 0x7fa27c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 0x7fa27c0b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50168/0 (socket says 172.21.15.143:50168) 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 -- 172.21.15.143:0/253157890 learned_addr learned my addr 172.21.15.143:0/253157890 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281204640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268003f00 0x7fa27c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa280a03640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c14baa0 0x7fa27c146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 -- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c14baa0 msgr2=0x7fa27c146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c14baa0 0x7fa27c146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 -- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268003f00 msgr2=0x7fa27c157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268003f00 0x7fa27c157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 -- 172.21.15.143:0/253157890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0b3390 con 0x7fa27c146640 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281204640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268003f00 0x7fa27c157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa280a03640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c14baa0 0x7fa27c146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa281a05640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 0x7fa27c0b3e70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa274002240 tx=0x7fa274011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400f8c0 con 0x7fa27c146640 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27400fa20 con 0x7fa27c146640 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c0b3670 con 0x7fa27c146640 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400fdd0 con 0x7fa27c146640 2023-11-24T06:32:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c14bf00 con 0x7fa27c146640 2023-11-24T06:32:55.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.276+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c0b3b90 con 0x7fa27c146640 2023-11-24T06:32:55.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.280+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fa27401f460 con 0x7fa27c146640 2023-11-24T06:32:55.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.280+0000 7fa271ffb640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa260066a10 0x7fa260068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:55.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.280+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fa274087640 con 0x7fa27c146640 2023-11-24T06:32:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.280+0000 7fa281204640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa260066a10 0x7fa260068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.280+0000 7fa281204640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa260066a10 0x7fa260068ed0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa278009b00 tx=0x7fa278008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:55.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.284+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa27c0b3b90 con 0x7fa27c146640 2023-11-24T06:32:55.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:55.448+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa27c0b3b90 con 0x7fa27c146640 2023-11-24T06:32:57.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.052+0000 7fa271ffb640 1 -- 172.21.15.143:0/253157890 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa27c0b3b90 con 0x7fa27c146640 2023-11-24T06:32:57.061 INFO:teuthology.orchestra.run.smithi143.stderr: removed all blocklist entries 2023-11-24T06:32:57.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa260066a10 msgr2=0x7fa260068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa260066a10 0x7fa260068ed0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa278009b00 tx=0x7fa278008040 comp rx=0 tx=0).stop 2023-11-24T06:32:57.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 msgr2=0x7fa27c0b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 0x7fa27c0b3e70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa274002240 tx=0x7fa274011c20 comp rx=0 tx=0).stop 2023-11-24T06:32:57.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 shutdown_connections 2023-11-24T06:32:57.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa260066a10 0x7fa260068ed0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27c146640 0x7fa27c0b3e70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa27c14baa0 0x7fa27c146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 --2- 172.21.15.143:0/253157890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268003f00 0x7fa27c157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 >> 172.21.15.143:0/253157890 conn(0x7fa27c0b0bf0 msgr2=0x7fa27c15d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:57.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 shutdown_connections 2023-11-24T06:32:57.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.056+0000 7fa283468640 1 -- 172.21.15.143:0/253157890 wait complete. 2023-11-24T06:32:57.089 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:32:57.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4de13df640 1 Processor -- start 2023-11-24T06:32:57.231 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4de13df640 1 -- start start 2023-11-24T06:32:57.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4de13df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4ddc0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4de13df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0d14d0 con 0x7f4ddc160aa0 2023-11-24T06:32:57.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4de13df640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc161540 con 0x7f4ddc0d0700 2023-11-24T06:32:57.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4de13df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0d0b90 con 0x7f4ddc160f60 2023-11-24T06:32:57.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4ddaffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4ddc160aa0 0x7f4ddc0b8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38572/0 (socket says 172.21.15.143:38572) 2023-11-24T06:32:57.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4ddaffd640 1 -- 172.21.15.143:0/3592647959 learned_addr learned my addr 172.21.15.143:0/3592647959 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:57.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.224+0000 7f4dda7fc640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4ddc0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.234 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982249047 0 0) 0x7f4ddc0d14d0 con 0x7f4ddc160aa0 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc4003530 con 0x7f4ddc160aa0 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374857362 0 0) 0x7f4ddc161540 con 0x7f4ddc0d0700 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ddc0d14d0 con 0x7f4ddc0d0700 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862367280 0 0) 0x7f4dc4003530 con 0x7f4ddc160aa0 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 msgr2=0x7f4ddc0d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4ddc0d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 >> v1:172.21.15.146:6789/0 conn(0x7f4ddc0d0700 legacy=0x7f4ddc0d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc161820 con 0x7f4ddc160aa0 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f4dcc001680 con 0x7f4ddc160aa0 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 >> v1:172.21.15.143:6789/0 conn(0x7f4ddc160aa0 legacy=0x7f4ddc0b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc4003b40 0x7f4dc4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4dc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0d0b90 con 0x7f4dc4003b40 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc400ba90 con 0x7f4dc4004d10 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc400bc50 con 0x7f4ddc160f60 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc4003b40 0x7f4dc4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dda7fc640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4dc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddb7fe640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddaffd640 1 -- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 msgr2=0x7f4dc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4dc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddaffd640 1 -- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dc4004d10 msgr2=0x7f4dc4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:57.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddaffd640 1 -- 172.21.15.143:0/3592647959 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4003530 con 0x7f4dc4003b40 2023-11-24T06:32:57.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4dda7fc640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ddc160f60 0x7f4dc40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:57.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.228+0000 7f4ddb7fe640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:57.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc4003b40 0x7f4dc4003f40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c160 tx=0x7f4dcc01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97392e0c791a1bc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0058e0 con 0x7f4dc4003b40 2023-11-24T06:32:57.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc005a60 con 0x7f4dc4003b40 2023-11-24T06:32:57.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4dd9ffb640 1 -- 172.21.15.143:0/3592647959 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc005e10 con 0x7f4dc4003b40 2023-11-24T06:32:57.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 -- 172.21.15.143:0/3592647959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc4003b40 msgr2=0x7f4dc4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.238 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 --2- 172.21.15.143:0/3592647959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc4003b40 0x7f4dc4003f40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c160 tx=0x7f4dcc01cb90 comp rx=0 tx=0).stop 2023-11-24T06:32:57.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4ddb7fe640 1 -- 172.21.15.143:0/3592647959 reap_dead start 2023-11-24T06:32:57.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 -- 172.21.15.143:0/3592647959 shutdown_connections 2023-11-24T06:32:57.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 -- 172.21.15.143:0/3592647959 >> 172.21.15.143:0/3592647959 conn(0x7f4ddc0613d0 msgr2=0x7f4ddc0617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:57.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 -- 172.21.15.143:0/3592647959 shutdown_connections 2023-11-24T06:32:57.239 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 -- 172.21.15.143:0/3592647959 wait complete. 2023-11-24T06:32:57.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 Processor -- start 2023-11-24T06:32:57.240 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.232+0000 7f4de13df640 1 -- start start 2023-11-24T06:32:57.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4dc4003b40 0x7f4ddc167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 0x7f4ddc148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ddc0c95a0 0x7f4ddc0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1676e0 con 0x7f4ddc1665c0 2023-11-24T06:32:57.242 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc168040 con 0x7f4ddc0c95a0 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc166a60 con 0x7f4dc4003b40 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 0x7f4ddc148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 0x7f4ddc148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:50182/0 (socket says 172.21.15.143:50182) 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 -- 172.21.15.143:0/3325767014 learned_addr learned my addr 172.21.15.143:0/3325767014 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4dc4003b40 0x7f4ddc167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4ddb7fe640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ddc0c95a0 0x7f4ddc0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 -- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4dc4003b40 msgr2=0x7f4ddc167b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4dc4003b40 0x7f4ddc167b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 -- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ddc0c95a0 msgr2=0x7f4ddc0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ddc0c95a0 0x7f4ddc0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 -- 172.21.15.143:0/3325767014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc166d40 con 0x7f4ddc1665c0 2023-11-24T06:32:57.243 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dda7fc640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 0x7f4ddc148540 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00116a0 tx=0x7f4dd0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004220 con 0x7f4ddc1665c0 2023-11-24T06:32:57.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0004380 con 0x7f4ddc1665c0 2023-11-24T06:32:57.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc167020 con 0x7f4ddc1665c0 2023-11-24T06:32:57.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000f9e0 con 0x7f4ddc1665c0 2023-11-24T06:32:57.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc148a80 con 0x7f4ddc1665c0 2023-11-24T06:32:57.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc167820 con 0x7f4ddc1665c0 2023-11-24T06:32:57.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.236+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f4dd000fb40 con 0x7f4ddc1665c0 2023-11-24T06:32:57.245 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.240+0000 7f4dc37fe640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4dc8066a10 0x7f4dc8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.240+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f4dd0084a70 con 0x7f4ddc1665c0 2023-11-24T06:32:57.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.240+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4dc8066a10 0x7f4dc8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.240+0000 7f4ddaffd640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4dc8066a10 0x7f4dc8068ed0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0aa000 tx=0x7f4dcc001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.244+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ddc167820 con 0x7f4ddc1665c0 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.444+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4ddc167820 con 0x7f4ddc1665c0 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.444+0000 7f4dc37fe640 1 -- 172.21.15.143:0/3325767014 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4ddc167820 con 0x7f4ddc1665c0 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout: "auth_dump": [ 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.a", 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlWuCSIhAAKMkuDRGG9RqJzLtCfp1vCA==", 2023-11-24T06:32:57.452 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.b", 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlf8n2LhAAMvyPYRu3qEObeONQjusrVA==", 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.453 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.c", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBluDLuKRAALc+mQOHrtv0uuxq6Cl0Npg==", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:57.454 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.d", 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlKVt2NhAAsCPmVcKcKDDpZFRp+BnajQ==", 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.0", 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCcQmBljW9NFhAAopvoSY3up65Pca+e/ystTg==", 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.1", 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCfQmBl1Z7PHRAA2rH1INeQgE7hRKH4rsnqPg==", 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.456 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.2", 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCiQmBl9cHbIxAAfLK6ytrmX0UZ/REQZJsLwA==", 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.3", 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQClQmBlkqUBKxAArF/nWcX/gwnoWDHse7hXUw==", 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.4", 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCrQmBlZOOUMBAAY+hdJLVbXsLr8rhrYFetew==", 2023-11-24T06:32:57.458 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.5", 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCuQmBlD9yBNxAArR3Gqcp8XR2II718wl9uAQ==", 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.459 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.6", 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCyQmBlGgIkAhAAxezDbMbQRvdD8+gasyD5SQ==", 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.460 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.7", 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQC1QmBlnWLtCRAAbaSwAMtBcZMfA7RbiunBSA==", 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.0", 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA==", 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow r", 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.1", 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBldD55CBAA65jofcgDB5LhWSSAtehv4w==", 2023-11-24T06:32:57.462 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.2", 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBl5BXhBBAAbKqI99h1ovPioQGoPlrCiw==", 2023-11-24T06:32:57.463 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.3", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCZQmBlEwuMDhAAJep8u2NIUWIeKszqZdA4jw==", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2023-11-24T06:32:57.464 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.admin", 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlFbv3BRAAPWkl+V8uDy+7+/Qdzjn9Fw==", 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.x", 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBl6IMZHhAAwzUtimUU4HvQGrFGavWyQQ==", 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.y", 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYQmBlV5xMGhAAyrJ4mGEabrmH50t8yAAyDw==", 2023-11-24T06:32:57.466 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2023-11-24T06:32:57.467 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:32:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4dc8066a10 msgr2=0x7f4dc8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4dc8066a10 0x7f4dc8068ed0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0aa000 tx=0x7f4dcc001a00 comp rx=0 tx=0).stop 2023-11-24T06:32:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 msgr2=0x7f4ddc148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 0x7f4ddc148540 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00116a0 tx=0x7f4dd0011b60 comp rx=0 tx=0).stop 2023-11-24T06:32:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 shutdown_connections 2023-11-24T06:32:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4dc8066a10 0x7f4dc8068ed0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ddc0c95a0 0x7f4ddc0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc1665c0 0x7f4ddc148540 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 --2- 172.21.15.143:0/3325767014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4dc4003b40 0x7f4ddc167b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 >> 172.21.15.143:0/3325767014 conn(0x7f4ddc0613d0 msgr2=0x7f4ddc157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 shutdown_connections 2023-11-24T06:32:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.448+0000 7f4de13df640 1 -- 172.21.15.143:0/3325767014 wait complete. 2023-11-24T06:32:57.473 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:32:57.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cfb57640 1 Processor -- start 2023-11-24T06:32:57.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cfb57640 1 -- start start 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cfb57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff6c80ce8b0 0x7ff6c80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cfb57640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c806c0e0 con 0x7ff6c815d570 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cfb57640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80d1cc0 con 0x7ff6c80d3020 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cfb57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c80d1fa0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cd8f3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff6c815d570 0x7ff6c806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56414/0 (socket says 172.21.15.143:56414) 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cd8f3640 1 -- 172.21.15.143:0/2153950282 learned_addr learned my addr 172.21.15.143:0/2153950282 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6ce0f4640 1 --2- 172.21.15.143:0/2153950282 >> v2:172.21.15.143:3300/0 conn(0x7ff6c80ce8b0 0x7ff6c80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cc8f1640 1 -- 172.21.15.143:0/2153950282 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261886751 0 0) 0x7ff6c806c0e0 con 0x7ff6c815d570 2023-11-24T06:32:57.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6cc8f1640 1 -- 172.21.15.143:0/2153950282 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b4003530 con 0x7ff6c815d570 2023-11-24T06:32:57.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6ce0f4640 1 -- 172.21.15.143:0/2153950282 >> v1:172.21.15.146:6789/0 conn(0x7ff6c80d3020 legacy=0x7ff6c80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6ce0f4640 1 -- 172.21.15.143:0/2153950282 >> v1:172.21.15.143:6789/0 conn(0x7ff6c815d570 legacy=0x7ff6c806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.604+0000 7ff6ce0f4640 1 -- 172.21.15.143:0/2153950282 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80ce0b0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6ce0f4640 1 --2- 172.21.15.143:0/2153950282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c80ced60 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009d90 tx=0x7ff6c001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be4a646b12ed433 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cc8f1640 1 -- 172.21.15.143:0/2153950282 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00a59e0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cc8f1640 1 -- 172.21.15.143:0/2153950282 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00a5b40 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cc8f1640 1 -- 172.21.15.143:0/2153950282 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00ad440 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 -- 172.21.15.143:0/2153950282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 msgr2=0x7ff6c80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/2153950282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c80ced60 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009d90 tx=0x7ff6c001c920 comp rx=0 tx=0).stop 2023-11-24T06:32:57.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 -- 172.21.15.143:0/2153950282 shutdown_connections 2023-11-24T06:32:57.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/2153950282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c80ced60 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 -- 172.21.15.143:0/2153950282 >> 172.21.15.143:0/2153950282 conn(0x7ff6c808ceb0 msgr2=0x7ff6c809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:57.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 -- 172.21.15.143:0/2153950282 shutdown_connections 2023-11-24T06:32:57.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.608+0000 7ff6cfb57640 1 -- 172.21.15.143:0/2153950282 wait complete. 2023-11-24T06:32:57.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 Processor -- start 2023-11-24T06:32:57.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 -- start start 2023-11-24T06:32:57.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c8160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c80d3020 0x7ff6c80b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c815d570 0x7ff6c8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80b8f40 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c815dc70 con 0x7ff6c80d3020 2023-11-24T06:32:57.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c815e510 con 0x7ff6c815d570 2023-11-24T06:32:57.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c8160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c8160060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51226/0 (socket says 172.21.15.143:51226) 2023-11-24T06:32:57.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 -- 172.21.15.143:0/1145586811 learned_addr learned my addr 172.21.15.143:0/1145586811 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:57.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6ce0f4640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c815d570 0x7ff6c8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd0f2640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c80d3020 0x7ff6c80b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 -- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c815d570 msgr2=0x7ff6c8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c815d570 0x7ff6c8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 -- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c80d3020 msgr2=0x7ff6c80b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c80d3020 0x7ff6c80b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 -- 172.21.15.143:0/1145586811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0009a70 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd0f2640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c80d3020 0x7ff6c80b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cd8f3640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c8160060 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400c420 tx=0x7ff6c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4005cf0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c4005e50 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c8160720 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40072d0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.612+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c815e1a0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.616+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c8067520 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.616+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7ff6c4007430 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.616+0000 7ff6be7fc640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff6ac066a10 0x7ff6ac068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.616+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4885+0+0 (secure 0 0 0) 0x7ff6c4083a70 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.616+0000 7ff6cd0f2640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff6ac066a10 0x7ff6ac068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.616+0000 7ff6cd0f2640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff6ac066a10 0x7ff6ac068ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806ba40 tx=0x7ff6b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.620+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6c4050ab0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.768+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6c806b7b0 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6be7fc640 1 -- 172.21.15.143:0/1145586811 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12949 (secure 0 0 0) 0x7ff6c4017020 con 0x7ff6c80ce8b0 2023-11-24T06:32:57.778 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:57.778 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":81,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:32:57.056448+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:32:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff6ac066a10 msgr2=0x7ff6ac068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff6ac066a10 0x7ff6ac068ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806ba40 tx=0x7ff6b8009040 comp rx=0 tx=0).stop 2023-11-24T06:32:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 msgr2=0x7ff6c8160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c8160060 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400c420 tx=0x7ff6c400c8e0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 shutdown_connections 2023-11-24T06:32:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff6ac066a10 0x7ff6ac068ed0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c815d570 0x7ff6c8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c80d3020 0x7ff6c80b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 --2- 172.21.15.143:0/1145586811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c80ce8b0 0x7ff6c8160060 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 >> 172.21.15.143:0/1145586811 conn(0x7ff6c808ceb0 msgr2=0x7ff6c8155840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 shutdown_connections 2023-11-24T06:32:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.772+0000 7ff6cfb57640 1 -- 172.21.15.143:0/1145586811 wait complete. 2023-11-24T06:32:57.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:32:57.799 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:32:57.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.932+0000 7f7ed5994640 1 Processor -- start 2023-11-24T06:32:57.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.932+0000 7f7ed5994640 1 -- start start 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ed5994640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ed00b9060 0x7f7ed00b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ed5994640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed00b6e00 con 0x7f7ed015d2b0 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ed5994640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed00b70e0 con 0x7f7ed015d690 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ed5994640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed00b7a80 con 0x7f7ed00b9060 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7eceffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7ed015d2b0 0x7f7ed00b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56416/0 (socket says 172.21.15.143:56416) 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7eceffd640 1 -- 172.21.15.143:0/682315438 learned_addr learned my addr 172.21.15.143:0/682315438 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ece7fc640 1 --2- 172.21.15.143:0/682315438 >> v2:172.21.15.146:3300/0 conn(0x7f7ed00b9060 0x7f7ed00b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596781738 0 0) 0x7f7ed00b6e00 con 0x7f7ed015d2b0 2023-11-24T06:32:57.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb8003530 con 0x7f7ed015d2b0 2023-11-24T06:32:57.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181689879 0 0) 0x7f7eb8003530 con 0x7f7ed015d2b0 2023-11-24T06:32:57.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 >> v2:172.21.15.146:3300/0 conn(0x7f7ed00b9060 msgr2=0x7f7ed00b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 --2- 172.21.15.143:0/682315438 >> v2:172.21.15.146:3300/0 conn(0x7f7ed00b9060 0x7f7ed00b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 >> v1:172.21.15.146:6789/0 conn(0x7f7ed015d690 legacy=0x7f7ed00d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed00b73c0 con 0x7f7ed015d2b0 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f7ec0001680 con 0x7f7ed015d2b0 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 >> v1:172.21.15.143:6789/0 conn(0x7f7ed015d2b0 legacy=0x7f7ed00b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb8003980 0x7f7eb8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb80047d0 0x7f7eb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eb8005190 0x7f7eb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00b7a80 con 0x7f7eb8005190 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb800c030 con 0x7f7eb8003980 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb800c1f0 con 0x7f7eb80047d0 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ece7fc640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb80047d0 0x7f7eb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7eceffd640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb8003980 0x7f7eb8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eb8005190 0x7f7eb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb80047d0 msgr2=0x7f7eb8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb80047d0 0x7f7eb8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb8003980 msgr2=0x7f7eb8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:57.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb8003980 0x7f7eb8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/682315438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8003530 con 0x7f7eb8005190 2023-11-24T06:32:57.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.936+0000 7f7ece7fc640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb80047d0 0x7f7eb8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:32:57.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/682315438 reap_dead start 2023-11-24T06:32:57.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eb8005190 0x7f7eb800b990 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8001e40 tx=0x7f7ec801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b00123897592f4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8003b80 con 0x7f7eb8005190 2023-11-24T06:32:57.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8003ce0 con 0x7f7eb8005190 2023-11-24T06:32:57.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ecdffb640 1 -- 172.21.15.143:0/682315438 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8005240 con 0x7f7eb8005190 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 -- 172.21.15.143:0/682315438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eb8005190 msgr2=0x7f7eb800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eb8005190 0x7f7eb800b990 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8001e40 tx=0x7f7ec801c740 comp rx=0 tx=0).stop 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 -- 172.21.15.143:0/682315438 shutdown_connections 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 --2- 172.21.15.143:0/682315438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eb8005190 0x7f7eb800b990 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 -- 172.21.15.143:0/682315438 >> 172.21.15.143:0/682315438 conn(0x7f7ed00613d0 msgr2=0x7f7ed00617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 -- 172.21.15.143:0/682315438 shutdown_connections 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 -- 172.21.15.143:0/682315438 wait complete. 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.940+0000 7f7ed5994640 1 Processor -- start 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- start start 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb8005190 0x7f7ed0158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed015ece0 0x7f7ed01573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 0x7f7ed00d2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed015f160 con 0x7f7ed014b540 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed01586d0 con 0x7f7ed015ece0 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed014c0d0 con 0x7f7eb8005190 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 0x7f7ed00d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 0x7f7ed00d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51236/0 (socket says 172.21.15.143:51236) 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/3844340856 learned_addr learned my addr 172.21.15.143:0/3844340856 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:57.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7eceffd640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb8005190 0x7f7ed0158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ece7fc640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed015ece0 0x7f7ed01573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.955 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb8005190 msgr2=0x7f7ed0158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb8005190 0x7f7ed0158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed015ece0 msgr2=0x7f7ed01573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed015ece0 0x7f7ed01573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 -- 172.21.15.143:0/3844340856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0157ac0 con 0x7f7ed014b540 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ece7fc640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed015ece0 0x7f7ed01573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ecf7fe640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 0x7f7ed00d2710 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7ec801cfe0 tx=0x7f7eb8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80ac070 con 0x7f7ed014b540 2023-11-24T06:32:57.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec80050f0 con 0x7f7ed014b540 2023-11-24T06:32:57.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed0157da0 con 0x7f7ed014b540 2023-11-24T06:32:57.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8005460 con 0x7f7ed014b540 2023-11-24T06:32:57.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed0158360 con 0x7f7ed014b540 2023-11-24T06:32:57.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.944+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed0158880 con 0x7f7ed014b540 2023-11-24T06:32:57.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.948+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f7ec80055c0 con 0x7f7ed014b540 2023-11-24T06:32:57.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.948+0000 7f7eb7fff640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7ebc066a40 0x7f7ebc068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:57.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.948+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f7ec811d200 con 0x7f7ed014b540 2023-11-24T06:32:57.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.948+0000 7f7eceffd640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7ebc066a40 0x7f7ebc068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:57.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.948+0000 7f7eceffd640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7ebc066a40 0x7f7ebc068f00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0001060 tx=0x7f7ec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:57.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:57.952+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ed0158880 con 0x7f7ed014b540 2023-11-24T06:32:58.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ed01584f0 con 0x7f7ed014b540 2023-11-24T06:32:58.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7eb7fff640 1 -- 172.21.15.143:0/3844340856 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ec80ea130 con 0x7f7ed014b540 2023-11-24T06:32:58.111 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7ebc066a40 msgr2=0x7f7ebc068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7ebc066a40 0x7f7ebc068f00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0001060 tx=0x7f7ec0009040 comp rx=0 tx=0).stop 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 msgr2=0x7f7ed00d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 0x7f7ed00d2710 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7ec801cfe0 tx=0x7f7eb8005800 comp rx=0 tx=0).stop 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 shutdown_connections 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7ebc066a40 0x7f7ebc068f00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ed014b540 0x7f7ed00d2710 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed015ece0 0x7f7ed01573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 --2- 172.21.15.143:0/3844340856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7eb8005190 0x7f7ed0158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 >> 172.21.15.143:0/3844340856 conn(0x7f7ed00613d0 msgr2=0x7f7ed00b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:58.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.104+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 shutdown_connections 2023-11-24T06:32:58.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.108+0000 7f7ed5994640 1 -- 172.21.15.143:0/3844340856 wait complete. 2023-11-24T06:32:58.134 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:32:58.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.264+0000 7f11bb0ea640 1 Processor -- start 2023-11-24T06:32:58.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.264+0000 7f11bb0ea640 1 -- start start 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11bb0ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 0x7f11b406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11bb0ea640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11b40709c0 0x7f11b4070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11bb0ea640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b406d8b0 con 0x7f11b409cc20 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11bb0ea640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b4145020 con 0x7f11b40709c0 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11bb0ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b409d0a0 con 0x7f11b4144030 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 0x7f11b406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 0x7f11b406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:59702/0 (socket says 172.21.15.143:59702) 2023-11-24T06:32:58.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 -- 172.21.15.143:0/3248116691 learned_addr learned my addr 172.21.15.143:0/3248116691 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:58.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b9687640 1 --2- 172.21.15.143:0/3248116691 >> v2:172.21.15.146:3300/0 conn(0x7f11b40709c0 0x7f11b4070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 -- 172.21.15.143:0/3248116691 >> v2:172.21.15.146:3300/0 conn(0x7f11b40709c0 msgr2=0x7f11b4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:58.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 --2- 172.21.15.143:0/3248116691 >> v2:172.21.15.146:3300/0 conn(0x7f11b40709c0 0x7f11b4070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 -- 172.21.15.143:0/3248116691 >> v1:172.21.15.146:6789/0 conn(0x7f11b409cc20 legacy=0x7f11b406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.268+0000 7f11b8e86640 1 -- 172.21.15.143:0/3248116691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4071390 con 0x7f11b4144030 2023-11-24T06:32:58.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11b8e86640 1 --2- 172.21.15.143:0/3248116691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 0x7f11b406c650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc28c79dc21cabe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:58.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11b37fe640 1 -- 172.21.15.143:0/3248116691 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80aa670 con 0x7f11b4144030 2023-11-24T06:32:58.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11b37fe640 1 -- 172.21.15.143:0/3248116691 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a80aa7d0 con 0x7f11b4144030 2023-11-24T06:32:58.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11b37fe640 1 -- 172.21.15.143:0/3248116691 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80aab60 con 0x7f11b4144030 2023-11-24T06:32:58.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 -- 172.21.15.143:0/3248116691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 msgr2=0x7f11b406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/3248116691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 0x7f11b406c650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a801c510 comp rx=0 tx=0).stop 2023-11-24T06:32:58.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 -- 172.21.15.143:0/3248116691 shutdown_connections 2023-11-24T06:32:58.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/3248116691 >> v2:172.21.15.146:3300/0 conn(0x7f11b40709c0 0x7f11b4070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/3248116691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b4144030 0x7f11b406c650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 -- 172.21.15.143:0/3248116691 >> 172.21.15.143:0/3248116691 conn(0x7f11b40b0bf0 msgr2=0x7f11b40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:58.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 -- 172.21.15.143:0/3248116691 shutdown_connections 2023-11-24T06:32:58.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 -- 172.21.15.143:0/3248116691 wait complete. 2023-11-24T06:32:58.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 Processor -- start 2023-11-24T06:32:58.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.272+0000 7f11bb0ea640 1 -- start start 2023-11-24T06:32:58.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b40709c0 0x7f11b4136530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b409cc20 0x7f11b4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 0x7f11b40ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b415ae60 con 0x7f11b4144030 2023-11-24T06:32:58.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b4136dd0 con 0x7f11b40709c0 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b4159e50 con 0x7f11b409cc20 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 0x7f11b40ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 0x7f11b40ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51238/0 (socket says 172.21.15.143:51238) 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 -- 172.21.15.143:0/1113387903 learned_addr learned my addr 172.21.15.143:0/1113387903 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b8e86640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b40709c0 0x7f11b4136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b3fff640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b409cc20 0x7f11b4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 -- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b409cc20 msgr2=0x7f11b4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b409cc20 0x7f11b4154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 -- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b40709c0 msgr2=0x7f11b4136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b40709c0 0x7f11b4136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 -- 172.21.15.143:0/1113387903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a80094d0 con 0x7f11b4144030 2023-11-24T06:32:58.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b9687640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 0x7f11b40ae6d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009dd0 tx=0x7f11ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:58.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac014480 con 0x7f11b4144030 2023-11-24T06:32:58.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00f040 con 0x7f11b4144030 2023-11-24T06:32:58.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b415a0a0 con 0x7f11b4144030 2023-11-24T06:32:58.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac014840 con 0x7f11b4144030 2023-11-24T06:32:58.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b415a660 con 0x7f11b4144030 2023-11-24T06:32:58.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b406e400 con 0x7f11b4144030 2023-11-24T06:32:58.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.276+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f11ac0149a0 con 0x7f11b4144030 2023-11-24T06:32:58.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.280+0000 7f11b17fa640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1198066a10 0x7f1198068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.280+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f11ac085540 con 0x7f11b4144030 2023-11-24T06:32:58.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.280+0000 7f11b8e86640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1198066a10 0x7f1198068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.286 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.280+0000 7f11b8e86640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1198066a10 0x7f1198068ed0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f11a80ae000 tx=0x7f11a80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:58.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.284+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11ac0523c0 con 0x7f11b4144030 2023-11-24T06:32:58.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.432+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11b4067520 con 0x7f11b4144030 2023-11-24T06:32:58.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.432+0000 7f11b17fa640 1 -- 172.21.15.143:0/1113387903 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f11ac0559e0 con 0x7f11b4144030 2023-11-24T06:32:58.441 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:32:58.441 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:32:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:32:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2023-11-24T06:32:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2023-11-24T06:32:58.442 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:32:58.442 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:32:58.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1198066a10 msgr2=0x7f1198068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1198066a10 0x7f1198068ed0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f11a80ae000 tx=0x7f11a80a7000 comp rx=0 tx=0).stop 2023-11-24T06:32:58.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 msgr2=0x7f11b40ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 0x7f11b40ae6d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009dd0 tx=0x7f11ac00c490 comp rx=0 tx=0).stop 2023-11-24T06:32:58.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 shutdown_connections 2023-11-24T06:32:58.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1198066a10 0x7f1198068ed0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11b4144030 0x7f11b40ae6d0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11b409cc20 0x7f11b4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 --2- 172.21.15.143:0/1113387903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b40709c0 0x7f11b4136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 >> 172.21.15.143:0/1113387903 conn(0x7f11b40b0bf0 msgr2=0x7f11b40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:58.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 shutdown_connections 2023-11-24T06:32:58.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.436+0000 7f11bb0ea640 1 -- 172.21.15.143:0/1113387903 wait complete. 2023-11-24T06:32:58.463 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:32:58.463 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:32:58.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.596+0000 7f09996aa640 1 Processor -- start 2023-11-24T06:32:58.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.596+0000 7f09996aa640 1 -- start start 2023-11-24T06:32:58.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09996aa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f099415d730 0x7f09940cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09996aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f099409a0f0 0x7f09940cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09996aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940cb9f0 con 0x7f09940d04f0 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09996aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09940cbfb0 con 0x7f099409a0f0 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09996aa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099415db10 con 0x7f099415d730 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f099409a0f0 0x7f09940cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f099409a0f0 0x7f09940cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51254/0 (socket says 172.21.15.143:51254) 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 -- 172.21.15.143:0/1370718166 learned_addr learned my addr 172.21.15.143:0/1370718166 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f0992ffd640 1 --2- 172.21.15.143:0/1370718166 >> v2:172.21.15.146:3300/0 conn(0x7f099415d730 0x7f09940cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 -- 172.21.15.143:0/1370718166 >> v2:172.21.15.146:3300/0 conn(0x7f099415d730 msgr2=0x7f09940cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 --2- 172.21.15.143:0/1370718166 >> v2:172.21.15.146:3300/0 conn(0x7f099415d730 0x7f09940cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 -- 172.21.15.143:0/1370718166 >> v1:172.21.15.146:6789/0 conn(0x7f09940d04f0 legacy=0x7f09940999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.600+0000 7f09937fe640 1 -- 172.21.15.143:0/1370718166 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940d0a30 con 0x7f099409a0f0 2023-11-24T06:32:58.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09937fe640 1 --2- 172.21.15.143:0/1370718166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940cc440 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a82c0109216604d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:58.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f0991ffb640 1 -- 172.21.15.143:0/1370718166 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0a57d0 con 0x7f099409a0f0 2023-11-24T06:32:58.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f0991ffb640 1 -- 172.21.15.143:0/1370718166 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0a5930 con 0x7f099409a0f0 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f0991ffb640 1 -- 172.21.15.143:0/1370718166 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0a5cc0 con 0x7f099409a0f0 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 -- 172.21.15.143:0/1370718166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 msgr2=0x7f09940cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 --2- 172.21.15.143:0/1370718166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940cc440 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c01c910 comp rx=0 tx=0).stop 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 -- 172.21.15.143:0/1370718166 shutdown_connections 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 --2- 172.21.15.143:0/1370718166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940cc440 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 --2- 172.21.15.143:0/1370718166 >> v2:172.21.15.146:3300/0 conn(0x7f099415d730 0x7f09940cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 -- 172.21.15.143:0/1370718166 >> 172.21.15.143:0/1370718166 conn(0x7f09940b2e90 msgr2=0x7f09940b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:58.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 -- 172.21.15.143:0/1370718166 shutdown_connections 2023-11-24T06:32:58.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 -- 172.21.15.143:0/1370718166 wait complete. 2023-11-24T06:32:58.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 Processor -- start 2023-11-24T06:32:58.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.604+0000 7f09996aa640 1 -- start start 2023-11-24T06:32:58.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09940d04f0 0x7f09940c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f099415d730 0x7f09940af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940c7ff0 con 0x7f099409a0f0 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099414c6a0 con 0x7f09940d04f0 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940c8f20 con 0x7f099415d730 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51262/0 (socket says 172.21.15.143:51262) 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 -- 172.21.15.143:0/2035394442 learned_addr learned my addr 172.21.15.143:0/2035394442 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09937fe640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f099415d730 0x7f09940af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09927fc640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09940d04f0 0x7f09940c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 -- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f099415d730 msgr2=0x7f09940af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f099415d730 0x7f09940af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 -- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09940d04f0 msgr2=0x7f09940c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09940d04f0 0x7f09940c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 -- 172.21.15.143:0/2035394442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009b30 con 0x7f099409a0f0 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09937fe640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f099415d730 0x7f09940af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:32:58.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f0992ffd640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940c9fc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f098400e8a0 tx=0x7f098400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:58.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984009510 con 0x7f099409a0f0 2023-11-24T06:32:58.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400c940 con 0x7f099409a0f0 2023-11-24T06:32:58.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940c9200 con 0x7f099409a0f0 2023-11-24T06:32:58.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400ccb0 con 0x7f099409a0f0 2023-11-24T06:32:58.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09940c97c0 con 0x7f099409a0f0 2023-11-24T06:32:58.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099406b4b0 con 0x7f099409a0f0 2023-11-24T06:32:58.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.608+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f0984013470 con 0x7f099409a0f0 2023-11-24T06:32:58.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.612+0000 7f097b7fe640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0980066a40 0x7f0980068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:58.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.612+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4885+0+0 (secure 0 0 0) 0x7f09840846b0 con 0x7f099409a0f0 2023-11-24T06:32:58.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.612+0000 7f09927fc640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0980066a40 0x7f0980068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:58.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.612+0000 7f09927fc640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0980066a40 0x7f0980068f00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f09940ca500 tx=0x7f0988009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:58.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.616+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09840515b0 con 0x7f099409a0f0 2023-11-24T06:32:58.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:58.764+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0994067520 con 0x7f099409a0f0 2023-11-24T06:32:59.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-24T06:32:59.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.068+0000 7f097b7fe640 1 -- 172.21.15.143:0/2035394442 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0984054bd0 con 0x7f099409a0f0 2023-11-24T06:32:59.076 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0980066a40 msgr2=0x7f0980068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0980066a40 0x7f0980068f00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f09940ca500 tx=0x7f0988009040 comp rx=0 tx=0).stop 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 msgr2=0x7f09940c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940c9fc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f098400e8a0 tx=0x7f098400eca0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 shutdown_connections 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0980066a40 0x7f0980068f00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f099415d730 0x7f09940af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09940d04f0 0x7f09940c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 --2- 172.21.15.143:0/2035394442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f099409a0f0 0x7f09940c9fc0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 >> 172.21.15.143:0/2035394442 conn(0x7f09940b2e90 msgr2=0x7f09940cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:59.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 shutdown_connections 2023-11-24T06:32:59.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.072+0000 7f09996aa640 1 -- 172.21.15.143:0/2035394442 wait complete. 2023-11-24T06:32:59.104 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:32:59.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 Processor -- start 2023-11-24T06:32:59.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 -- start start 2023-11-24T06:32:59.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e40b25c0 0x7f23e40d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:59.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23e40d3880 0x7f23e40cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e406d050 con 0x7f23e415d720 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e40d2240 con 0x7f23e40d3880 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e9372640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40d3d30 con 0x7f23e40b25c0 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23e40d3880 0x7f23e40cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e2ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f23e415d720 0x7f23e40d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56418/0 (socket says 172.21.15.143:56418) 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e2ffd640 1 -- 172.21.15.143:0/331873807 learned_addr learned my addr 172.21.15.143:0/331873807 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:32:59.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23da7fc640 1 --2- 172.21.15.143:0/331873807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e40b25c0 0x7f23e40d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:59.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e37fe640 1 -- 172.21.15.143:0/331873807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e40b25c0 msgr2=0x7f23e40d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:32:59.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e37fe640 1 --2- 172.21.15.143:0/331873807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e40b25c0 0x7f23e40d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e37fe640 1 -- 172.21.15.143:0/331873807 >> v1:172.21.15.143:6789/0 conn(0x7f23e415d720 legacy=0x7f23e40d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:59.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e37fe640 1 -- 172.21.15.143:0/331873807 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e406c720 con 0x7f23e40d3880 2023-11-24T06:32:59.252 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.244+0000 7f23e27fc640 1 -- 172.21.15.143:0/331873807 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425385985 0 0) 0x7f23e406d050 con 0x7f23e415d720 2023-11-24T06:32:59.254 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e37fe640 1 --2- 172.21.15.143:0/331873807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e40cde10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097c0 tx=0x7f23dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7878df2cae6072 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e27fc640 1 -- 172.21.15.143:0/331873807 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0ab600 con 0x7f23e40d3880 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e27fc640 1 -- 172.21.15.143:0/331873807 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc0a7050 con 0x7f23e40d3880 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e27fc640 1 -- 172.21.15.143:0/331873807 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0ab980 con 0x7f23e40d3880 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 -- 172.21.15.143:0/331873807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 msgr2=0x7f23e40cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 --2- 172.21.15.143:0/331873807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e40cde10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097c0 tx=0x7f23dc01c480 comp rx=0 tx=0).stop 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 -- 172.21.15.143:0/331873807 shutdown_connections 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 --2- 172.21.15.143:0/331873807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e40cde10 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 --2- 172.21.15.143:0/331873807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e40b25c0 0x7f23e40d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 -- 172.21.15.143:0/331873807 >> 172.21.15.143:0/331873807 conn(0x7f23e408af70 msgr2=0x7f23e409c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:32:59.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 -- 172.21.15.143:0/331873807 shutdown_connections 2023-11-24T06:32:59.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 -- 172.21.15.143:0/331873807 wait complete. 2023-11-24T06:32:59.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 Processor -- start 2023-11-24T06:32:59.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.248+0000 7f23e9372640 1 -- start start 2023-11-24T06:32:59.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e40b25c0 0x7f23e40c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:59.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e415d720 0x7f23e414bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40cb180 con 0x7f23e40d3880 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40ca500 con 0x7f23e40b25c0 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40ca7e0 con 0x7f23e415d720 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e4156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51268/0 (socket says 172.21.15.143:51268) 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 -- 172.21.15.143:0/1419515138 learned_addr learned my addr 172.21.15.143:0/1419515138 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e2ffd640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e40b25c0 0x7f23e40c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e37fe640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e415d720 0x7f23e414bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 -- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e415d720 msgr2=0x7f23e414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:59.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e415d720 0x7f23e414bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 -- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e40b25c0 msgr2=0x7f23e40c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:32:59.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e40b25c0 0x7f23e40c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:32:59.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 -- 172.21.15.143:0/1419515138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc009420 con 0x7f23e40d3880 2023-11-24T06:32:59.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23da7fc640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e4156560 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00e9b0 tx=0x7f23cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:59.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0096b0 con 0x7f23e40d3880 2023-11-24T06:32:59.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00c9a0 con 0x7f23e40d3880 2023-11-24T06:32:59.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00cd30 con 0x7f23e40d3880 2023-11-24T06:32:59.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e40caac0 con 0x7f23e40d3880 2023-11-24T06:32:59.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e40c9ee0 con 0x7f23e40d3880 2023-11-24T06:32:59.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.252+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e40a1360 con 0x7f23e40d3880 2023-11-24T06:32:59.262 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.256+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f23cc013470 con 0x7f23e40d3880 2023-11-24T06:32:59.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.256+0000 7f23dbfff640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23c4066a10 0x7f23c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:32:59.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.256+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5255+0+0 (secure 0 0 0) 0x7f23cc084fb0 con 0x7f23e40d3880 2023-11-24T06:32:59.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.256+0000 7f23e2ffd640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23c4066a10 0x7f23c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:32:59.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.256+0000 7f23e2ffd640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23c4066a10 0x7f23c4068ed0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f23d40012f0 tx=0x7f23d4001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:32:59.266 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.260+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23cc051fc0 con 0x7f23e40d3880 2023-11-24T06:32:59.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:32:59.408+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f23e404e930 con 0x7f23e40d3880 2023-11-24T06:33:00.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.076+0000 7f23dbfff640 1 -- 172.21.15.143:0/1419515138 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f23cc0170d0 con 0x7f23e40d3880 2023-11-24T06:33:00.083 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2023-11-24T06:33:00.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23c4066a10 msgr2=0x7f23c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:00.085 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23c4066a10 0x7f23c4068ed0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f23d40012f0 tx=0x7f23d4001690 comp rx=0 tx=0).stop 2023-11-24T06:33:00.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 msgr2=0x7f23e4156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:00.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e4156560 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00e9b0 tx=0x7f23cc00ee70 comp rx=0 tx=0).stop 2023-11-24T06:33:00.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 shutdown_connections 2023-11-24T06:33:00.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f23c4066a10 0x7f23c4068ed0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23e415d720 0x7f23e414bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e40d3880 0x7f23e4156560 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 --2- 172.21.15.143:0/1419515138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23e40b25c0 0x7f23e40c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.087 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 >> 172.21.15.143:0/1419515138 conn(0x7f23e408af70 msgr2=0x7f23e40b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:00.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 shutdown_connections 2023-11-24T06:33:00.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.080+0000 7f23e9372640 1 -- 172.21.15.143:0/1419515138 wait complete. 2023-11-24T06:33:00.126 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:33:00.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.260+0000 7f7198c9a640 1 Processor -- start 2023-11-24T06:33:00.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7198c9a640 1 -- start start 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7198c9a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71940d39b0 0x7f719406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7198c9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940b2100 0x7f719406c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7198c9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940b0090 con 0x7f719415d7f0 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7198c9a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719406b980 con 0x7f71940d39b0 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7198c9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b0330 con 0x7f71940b2100 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f719259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f719415d7f0 0x7f71940d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56424/0 (socket says 172.21.15.143:56424) 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f719259c640 1 -- 172.21.15.143:0/768944687 learned_addr learned my addr 172.21.15.143:0/768944687 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7192d9d640 1 --2- 172.21.15.143:0/768944687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940b2100 0x7f719406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:00.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7191d9b640 1 --2- 172.21.15.143:0/768944687 >> v2:172.21.15.146:3300/0 conn(0x7f71940d39b0 0x7f719406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f719159a640 1 -- 172.21.15.143:0/768944687 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208520283 0 0) 0x7f71940b0090 con 0x7f719415d7f0 2023-11-24T06:33:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7192d9d640 1 -- 172.21.15.143:0/768944687 >> v2:172.21.15.146:3300/0 conn(0x7f71940d39b0 msgr2=0x7f719406bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7192d9d640 1 --2- 172.21.15.143:0/768944687 >> v2:172.21.15.146:3300/0 conn(0x7f71940d39b0 0x7f719406bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7192d9d640 1 -- 172.21.15.143:0/768944687 >> v1:172.21.15.143:6789/0 conn(0x7f719415d7f0 legacy=0x7f71940d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:00.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.264+0000 7f7192d9d640 1 -- 172.21.15.143:0/768944687 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940b0610 con 0x7f71940b2100 2023-11-24T06:33:00.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7192d9d640 1 --2- 172.21.15.143:0/768944687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940b2100 0x7f719406c210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f718c009d90 tx=0x7f718c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e88b1e4ae8bae359 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:00.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f719159a640 1 -- 172.21.15.143:0/768944687 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0a5900 con 0x7f71940b2100 2023-11-24T06:33:00.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f719159a640 1 -- 172.21.15.143:0/768944687 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0a5a60 con 0x7f71940b2100 2023-11-24T06:33:00.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f719159a640 1 -- 172.21.15.143:0/768944687 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0a5df0 con 0x7f71940b2100 2023-11-24T06:33:00.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 -- 172.21.15.143:0/768944687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940b2100 msgr2=0x7f719406c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:00.275 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 --2- 172.21.15.143:0/768944687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940b2100 0x7f719406c210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f718c009d90 tx=0x7f718c01c950 comp rx=0 tx=0).stop 2023-11-24T06:33:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 -- 172.21.15.143:0/768944687 shutdown_connections 2023-11-24T06:33:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 --2- 172.21.15.143:0/768944687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940b2100 0x7f719406c210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 --2- 172.21.15.143:0/768944687 >> v2:172.21.15.146:3300/0 conn(0x7f71940d39b0 0x7f719406bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 -- 172.21.15.143:0/768944687 >> 172.21.15.143:0/768944687 conn(0x7f719409c790 msgr2=0x7f719408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 -- 172.21.15.143:0/768944687 shutdown_connections 2023-11-24T06:33:00.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.268+0000 7f7198c9a640 1 -- 172.21.15.143:0/768944687 wait complete. 2023-11-24T06:33:00.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 Processor -- start 2023-11-24T06:33:00.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 -- start start 2023-11-24T06:33:00.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 0x7f7194152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:00.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940d39b0 0x7f71940cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:00.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f719415d7f0 0x7f71940b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:00.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b8ca0 con 0x7f71940b2100 2023-11-24T06:33:00.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940ce4f0 con 0x7f719415d7f0 2023-11-24T06:33:00.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940ce7d0 con 0x7f71940d39b0 2023-11-24T06:33:00.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 0x7f7194152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:00.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 0x7f7194152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51282/0 (socket says 172.21.15.143:51282) 2023-11-24T06:33:00.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 -- 172.21.15.143:0/317666076 learned_addr learned my addr 172.21.15.143:0/317666076 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:00.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7191d9b640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940d39b0 0x7f71940cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:00.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7192d9d640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f719415d7f0 0x7f71940b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 -- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940d39b0 msgr2=0x7f71940cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940d39b0 0x7f71940cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 -- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f719415d7f0 msgr2=0x7f71940b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f719415d7f0 0x7f71940b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 -- 172.21.15.143:0/317666076 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009a70 con 0x7f71940b2100 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7191d9b640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940d39b0 0x7f71940cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:00.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f719259c640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 0x7f7194152860 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f718400c480 tx=0x7f718400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:00.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840074e0 con 0x7f71940b2100 2023-11-24T06:33:00.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71940ceab0 con 0x7f71940b2100 2023-11-24T06:33:00.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71940cf070 con 0x7f71940b2100 2023-11-24T06:33:00.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7184007640 con 0x7f71940b2100 2023-11-24T06:33:00.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.272+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840049f0 con 0x7f71940b2100 2023-11-24T06:33:00.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.276+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178005260 con 0x7f71940b2100 2023-11-24T06:33:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.276+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f7184004b50 con 0x7f71940b2100 2023-11-24T06:33:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.276+0000 7f7182ffd640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7174066a10 0x7f7174068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.276+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5637+0+0 (secure 0 0 0) 0x7f7184083e50 con 0x7f71940b2100 2023-11-24T06:33:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.276+0000 7f7191d9b640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7174066a10 0x7f7174068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:00.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.276+0000 7f7191d9b640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7174066a10 0x7f7174068ed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f71941f9870 tx=0x7f7188009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:00.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.280+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7184050ad0 con 0x7f71940b2100 2023-11-24T06:33:00.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:00.468+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f71780057e0 con 0x7f71940b2100 2023-11-24T06:33:01.086 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7182ffd640 1 -- 172.21.15.143:0/317666076 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7184018020 con 0x7f71940b2100 2023-11-24T06:33:01.086 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 12 and data pool 13 2023-11-24T06:33:01.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7174066a10 msgr2=0x7f7174068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7174066a10 0x7f7174068ed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f71941f9870 tx=0x7f7188009190 comp rx=0 tx=0).stop 2023-11-24T06:33:01.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 msgr2=0x7f7194152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 0x7f7194152860 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f718400c480 tx=0x7f718400c940 comp rx=0 tx=0).stop 2023-11-24T06:33:01.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 shutdown_connections 2023-11-24T06:33:01.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7174066a10 0x7f7174068ed0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f719415d7f0 0x7f71940b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71940d39b0 0x7f71940cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 --2- 172.21.15.143:0/317666076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71940b2100 0x7f7194152860 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.080+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 >> 172.21.15.143:0/317666076 conn(0x7f719409c790 msgr2=0x7f71940cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:01.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.084+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 shutdown_connections 2023-11-24T06:33:01.091 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.084+0000 7f7198c9a640 1 -- 172.21.15.143:0/317666076 wait complete. 2023-11-24T06:33:01.140 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:01.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.272+0000 7f0c14757640 1 Processor -- start 2023-11-24T06:33:01.280 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.272+0000 7f0c14757640 1 -- start start 2023-11-24T06:33:01.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.272+0000 7f0c14757640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c15a320 0x7f0c0c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.272+0000 7f0c14757640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c0c070da0 0x7f0c0c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.272+0000 7f0c14757640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c15a700 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c14757640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c0b2430 con 0x7f0c0c070da0 2023-11-24T06:33:01.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c14757640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0b2620 con 0x7f0c0c15a320 2023-11-24T06:33:01.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c11cf2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0c0c0b36c0 0x7f0c0c070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56440/0 (socket says 172.21.15.143:56440) 2023-11-24T06:33:01.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c11cf2640 1 -- 172.21.15.143:0/3944041874 learned_addr learned my addr 172.21.15.143:0/3944041874 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c124f3640 1 --2- 172.21.15.143:0/3944041874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c15a320 0x7f0c0c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c12cf4640 1 --2- 172.21.15.143:0/3944041874 >> v2:172.21.15.146:3300/0 conn(0x7f0c0c070da0 0x7f0c0c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c114f1640 1 -- 172.21.15.143:0/3944041874 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828937075 0 0) 0x7f0c0c15a700 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c114f1640 1 -- 172.21.15.143:0/3944041874 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf8003530 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c124f3640 1 -- 172.21.15.143:0/3944041874 >> v2:172.21.15.146:3300/0 conn(0x7f0c0c070da0 msgr2=0x7f0c0c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c124f3640 1 --2- 172.21.15.143:0/3944041874 >> v2:172.21.15.146:3300/0 conn(0x7f0c0c070da0 0x7f0c0c15ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c124f3640 1 -- 172.21.15.143:0/3944041874 >> v1:172.21.15.143:6789/0 conn(0x7f0c0c0b36c0 legacy=0x7f0c0c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c124f3640 1 -- 172.21.15.143:0/3944041874 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0b2900 con 0x7f0c0c15a320 2023-11-24T06:33:01.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.276+0000 7f0c124f3640 1 --2- 172.21.15.143:0/3944041874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c15a320 0x7f0c0c0b1ef0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c080097c0 tx=0x7f0c0801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3c1a795eec23e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c114f1640 1 -- 172.21.15.143:0/3944041874 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080ad660 con 0x7f0c0c15a320 2023-11-24T06:33:01.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c114f1640 1 -- 172.21.15.143:0/3944041874 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c080ad7c0 con 0x7f0c0c15a320 2023-11-24T06:33:01.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c114f1640 1 -- 172.21.15.143:0/3944041874 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080adb30 con 0x7f0c0c15a320 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- 172.21.15.143:0/3944041874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c15a320 msgr2=0x7f0c0c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 --2- 172.21.15.143:0/3944041874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c15a320 0x7f0c0c0b1ef0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c080097c0 tx=0x7f0c0801c450 comp rx=0 tx=0).stop 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- 172.21.15.143:0/3944041874 shutdown_connections 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 --2- 172.21.15.143:0/3944041874 >> v2:172.21.15.146:3300/0 conn(0x7f0c0c070da0 0x7f0c0c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 --2- 172.21.15.143:0/3944041874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c15a320 0x7f0c0c0b1ef0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- 172.21.15.143:0/3944041874 >> 172.21.15.143:0/3944041874 conn(0x7f0c0c0b0bf0 msgr2=0x7f0c0c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- 172.21.15.143:0/3944041874 shutdown_connections 2023-11-24T06:33:01.287 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- 172.21.15.143:0/3944041874 wait complete. 2023-11-24T06:33:01.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 Processor -- start 2023-11-24T06:33:01.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- start start 2023-11-24T06:33:01.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c070da0 0x7f0c0c149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 0x7f0c0c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0c15a320 0x7f0c0c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.289 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c155580 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c149f60 con 0x7f0c0c15a320 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c14757640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c154620 con 0x7f0c0c070da0 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.280+0000 7f0c11cf2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 0x7f0c0c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 0x7f0c0c1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51298/0 (socket says 172.21.15.143:51298) 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 -- 172.21.15.143:0/4100899353 learned_addr learned my addr 172.21.15.143:0/4100899353 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c124f3640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c070da0 0x7f0c0c149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c12cf4640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0c15a320 0x7f0c0c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 -- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c070da0 msgr2=0x7f0c0c149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c070da0 0x7f0c0c149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 -- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0c15a320 msgr2=0x7f0c0c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0c15a320 0x7f0c0c152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 -- 172.21.15.143:0/4100899353 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c08009420 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c11cf2640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 0x7f0c0c1559a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c420 tx=0x7f0bfc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc005cf0 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc005e70 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c154900 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0072f0 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c154ec0 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c067520 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f0bfc007490 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c02ffd640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0bf0066a10 0x7f0bf0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.284+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0bfc083e30 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.288+0000 7f0c124f3640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0bf0066a10 0x7f0bf0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.288+0000 7f0c124f3640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0bf0066a10 0x7f0bf0068ed0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0c080af000 tx=0x7f0c080a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.292+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bfc050c20 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.440+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c0c0b3d80 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.440+0000 7f0c02ffd640 1 -- 172.21.15.143:0/4100899353 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16664 (secure 0 0 0) 0x7f0bfc017070 con 0x7f0c0c0b36c0 2023-11-24T06:33:01.448 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:01.448 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":84,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:00.473195+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0bf0066a10 msgr2=0x7f0bf0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0bf0066a10 0x7f0bf0068ed0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0c080af000 tx=0x7f0c080a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 msgr2=0x7f0c0c1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 0x7f0c0c1559a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c420 tx=0x7f0bfc00c8e0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 shutdown_connections 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0bf0066a10 0x7f0bf0068ed0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0c15a320 0x7f0c0c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c0b36c0 0x7f0c0c1559a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 --2- 172.21.15.143:0/4100899353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c0c070da0 0x7f0c0c149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 >> 172.21.15.143:0/4100899353 conn(0x7f0c0c0b0bf0 msgr2=0x7f0c0c070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 shutdown_connections 2023-11-24T06:33:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.444+0000 7f0c14757640 1 -- 172.21.15.143:0/4100899353 wait complete. 2023-11-24T06:33:01.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:01.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 Processor -- start 2023-11-24T06:33:01.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 -- start start 2023-11-24T06:33:01.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f08e00ce8b0 0x7f08e00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00d1cc0 con 0x7f08e00d3020 2023-11-24T06:33:01.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00d1fa0 con 0x7f08e00ce8b0 2023-11-24T06:33:01.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e7ed6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00ce0b0 con 0x7f08e015d570 2023-11-24T06:33:01.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f08e00ce8b0 0x7f08e00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f08e00ce8b0 0x7f08e00ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51312/0 (socket says 172.21.15.143:51312) 2023-11-24T06:33:01.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 -- 172.21.15.143:0/1648371753 learned_addr learned my addr 172.21.15.143:0/1648371753 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:01.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e5c72640 1 --2- 172.21.15.143:0/1648371753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 -- 172.21.15.143:0/1648371753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 msgr2=0x7f08e006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:01.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 --2- 172.21.15.143:0/1648371753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 -- 172.21.15.143:0/1648371753 >> v1:172.21.15.146:6789/0 conn(0x7f08e00d3020 legacy=0x7f08e00d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:01.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.600+0000 7f08e6473640 1 -- 172.21.15.143:0/1648371753 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00ce390 con 0x7f08e00ce8b0 2023-11-24T06:33:01.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e6473640 1 --2- 172.21.15.143:0/1648371753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00ce8b0 0x7f08e00ced40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009e50 tx=0x7f08d801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9e52b5ca187036 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e4c70640 1 -- 172.21.15.143:0/1648371753 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5830 con 0x7f08e00ce8b0 2023-11-24T06:33:01.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e4c70640 1 -- 172.21.15.143:0/1648371753 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80a5990 con 0x7f08e00ce8b0 2023-11-24T06:33:01.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e4c70640 1 -- 172.21.15.143:0/1648371753 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5d20 con 0x7f08e00ce8b0 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 -- 172.21.15.143:0/1648371753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00ce8b0 msgr2=0x7f08e00ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/1648371753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00ce8b0 0x7f08e00ced40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009e50 tx=0x7f08d801c9d0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 -- 172.21.15.143:0/1648371753 shutdown_connections 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/1648371753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00ce8b0 0x7f08e00ced40 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/1648371753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 -- 172.21.15.143:0/1648371753 >> 172.21.15.143:0/1648371753 conn(0x7f08e008ceb0 msgr2=0x7f08e009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:01.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 -- 172.21.15.143:0/1648371753 shutdown_connections 2023-11-24T06:33:01.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.604+0000 7f08e7ed6640 1 -- 172.21.15.143:0/1648371753 wait complete. 2023-11-24T06:33:01.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 Processor -- start 2023-11-24T06:33:01.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- start start 2023-11-24T06:33:01.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e00ce8b0 0x7f08e00c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 0x7f08e014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c7eb0 con 0x7f08e00d3020 2023-11-24T06:33:01.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e014c070 con 0x7f08e00ce8b0 2023-11-24T06:33:01.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c78f0 con 0x7f08e015d570 2023-11-24T06:33:01.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 0x7f08e014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 0x7f08e014b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51316/0 (socket says 172.21.15.143:51316) 2023-11-24T06:33:01.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 -- 172.21.15.143:0/4223463627 learned_addr learned my addr 172.21.15.143:0/4223463627 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:01.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e6473640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5c72640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e00ce8b0 0x7f08e00c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 -- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 msgr2=0x7f08e00ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e00ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 -- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e00ce8b0 msgr2=0x7f08e00c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e00ce8b0 0x7f08e00c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 -- 172.21.15.143:0/4223463627 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009b30 con 0x7f08e00d3020 2023-11-24T06:33:01.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5c72640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e00ce8b0 0x7f08e00c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:01.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e5471640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 0x7f08e014b160 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c450 tx=0x7f08d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0012830 con 0x7f08e00d3020 2023-11-24T06:33:01.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00129b0 con 0x7f08e00d3020 2023-11-24T06:33:01.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0012d60 con 0x7f08e00d3020 2023-11-24T06:33:01.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e00c7bd0 con 0x7f08e00d3020 2023-11-24T06:33:01.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e00cd180 con 0x7f08e00d3020 2023-11-24T06:33:01.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.608+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e014bb60 con 0x7f08e00d3020 2023-11-24T06:33:01.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.612+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f08d001c460 con 0x7f08e00d3020 2023-11-24T06:33:01.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.612+0000 7f08d67fc640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08c4066a10 0x7f08c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.612+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f08d0084680 con 0x7f08e00d3020 2023-11-24T06:33:01.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.612+0000 7f08e5c72640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08c4066a10 0x7f08c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.612+0000 7f08e5c72640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08c4066a10 0x7f08c4068ed0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00b9f0 tx=0x7f08dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.616+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08e014bb60 con 0x7f08e00d3020 2023-11-24T06:33:01.772 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.764+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e014bb60 con 0x7f08e00d3020 2023-11-24T06:33:01.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08d67fc640 1 -- 172.21.15.143:0/4223463627 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16664 (secure 0 0 0) 0x7f08e014bb60 con 0x7f08e00d3020 2023-11-24T06:33:01.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:01.773 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":84,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:00.473195+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:01.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08c4066a10 msgr2=0x7f08c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08c4066a10 0x7f08c4068ed0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00b9f0 tx=0x7f08dc008040 comp rx=0 tx=0).stop 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 msgr2=0x7f08e014b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 0x7f08e014b160 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c450 tx=0x7f08d000c910 comp rx=0 tx=0).stop 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 shutdown_connections 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f08c4066a10 0x7f08c4068ed0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e015d570 0x7f08e00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e00d3020 0x7f08e014b160 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 --2- 172.21.15.143:0/4223463627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e00ce8b0 0x7f08e00c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 >> 172.21.15.143:0/4223463627 conn(0x7f08e008ceb0 msgr2=0x7f08e00b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 shutdown_connections 2023-11-24T06:33:01.776 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.768+0000 7f08e7ed6640 1 -- 172.21.15.143:0/4223463627 wait complete. 2023-11-24T06:33:01.795 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:33:01.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.928+0000 7f4091535640 1 Processor -- start 2023-11-24T06:33:01.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.928+0000 7f4091535640 1 -- start start 2023-11-24T06:33:01.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.928+0000 7f4091535640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f408c0d19e0 0x7f408c0d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.928+0000 7f4091535640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f408c0cdf10 0x7f408c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f4091535640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c15dda0 con 0x7f408c161d70 2023-11-24T06:33:01.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f4091535640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0d3b10 con 0x7f408c0d19e0 2023-11-24T06:33:01.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f4091535640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0d42e0 con 0x7f408c0cdf10 2023-11-24T06:33:01.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f408c0d19e0 0x7f408c0d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f4083fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f408c161d70 0x7f408c0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56452/0 (socket says 172.21.15.143:56452) 2023-11-24T06:33:01.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f4083fff640 1 -- 172.21.15.143:0/3268785112 learned_addr learned my addr 172.21.15.143:0/3268785112 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:01.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 --2- 172.21.15.143:0/3268785112 >> v2:172.21.15.143:3300/0 conn(0x7f408c0d19e0 0x7f408c0d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51322/0 (socket says 172.21.15.143:51322) 2023-11-24T06:33:01.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408b7fe640 1 --2- 172.21.15.143:0/3268785112 >> v2:172.21.15.146:3300/0 conn(0x7f408c0cdf10 0x7f408c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 -- 172.21.15.143:0/3268785112 >> v2:172.21.15.146:3300/0 conn(0x7f408c0cdf10 msgr2=0x7f408c0ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:01.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 --2- 172.21.15.143:0/3268785112 >> v2:172.21.15.146:3300/0 conn(0x7f408c0cdf10 0x7f408c0ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 -- 172.21.15.143:0/3268785112 >> v1:172.21.15.143:6789/0 conn(0x7f408c161d70 legacy=0x7f408c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 -- 172.21.15.143:0/3268785112 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0d2300 con 0x7f408c0d19e0 2023-11-24T06:33:01.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408a7fc640 1 -- 172.21.15.143:0/3268785112 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996309034 0 0) 0x7f408c15dda0 con 0x7f408c161d70 2023-11-24T06:33:01.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408affd640 1 --2- 172.21.15.143:0/3268785112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0d19e0 0x7f408c0d1dc0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f408c08bd70 tx=0x7f407c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dd94bfbf2bfb14 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408a7fc640 1 -- 172.21.15.143:0/3268785112 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c0ab600 con 0x7f408c0d19e0 2023-11-24T06:33:01.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.932+0000 7f408a7fc640 1 -- 172.21.15.143:0/3268785112 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c0a7050 con 0x7f408c0d19e0 2023-11-24T06:33:01.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f408a7fc640 1 -- 172.21.15.143:0/3268785112 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c0ab980 con 0x7f408c0d19e0 2023-11-24T06:33:01.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- 172.21.15.143:0/3268785112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0d19e0 msgr2=0x7f408c0d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 --2- 172.21.15.143:0/3268785112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0d19e0 0x7f408c0d1dc0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f408c08bd70 tx=0x7f407c01c430 comp rx=0 tx=0).stop 2023-11-24T06:33:01.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- 172.21.15.143:0/3268785112 shutdown_connections 2023-11-24T06:33:01.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 --2- 172.21.15.143:0/3268785112 >> v2:172.21.15.146:3300/0 conn(0x7f408c0cdf10 0x7f408c0ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 --2- 172.21.15.143:0/3268785112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0d19e0 0x7f408c0d1dc0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- 172.21.15.143:0/3268785112 >> 172.21.15.143:0/3268785112 conn(0x7f408c09c760 msgr2=0x7f408c0d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:01.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- 172.21.15.143:0/3268785112 shutdown_connections 2023-11-24T06:33:01.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- 172.21.15.143:0/3268785112 wait complete. 2023-11-24T06:33:01.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 Processor -- start 2023-11-24T06:33:01.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- start start 2023-11-24T06:33:01.945 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 0x7f408c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f408c0d19e0 0x7f408c141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f408c161d70 0x7f408c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c140a10 con 0x7f408c0cdf10 2023-11-24T06:33:01.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c140cf0 con 0x7f408c161d70 2023-11-24T06:33:01.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f4091535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c140fd0 con 0x7f408c0d19e0 2023-11-24T06:33:01.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f408affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 0x7f408c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f408affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 0x7f408c1551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51330/0 (socket says 172.21.15.143:51330) 2023-11-24T06:33:01.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.936+0000 7f408affd640 1 -- 172.21.15.143:0/807446989 learned_addr learned my addr 172.21.15.143:0/807446989 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:01.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f4083fff640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f408c0d19e0 0x7f408c141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408b7fe640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f408c161d70 0x7f408c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408affd640 1 -- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f408c0d19e0 msgr2=0x7f408c141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408affd640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f408c0d19e0 0x7f408c141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408affd640 1 -- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f408c161d70 msgr2=0x7f408c1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:01.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408affd640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f408c161d70 0x7f408c1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:01.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408affd640 1 -- 172.21.15.143:0/807446989 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c009420 con 0x7f408c0cdf10 2023-11-24T06:33:01.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f408affd640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 0x7f408c1551c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f407c01a060 tx=0x7f407c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c0b4420 con 0x7f408c0cdf10 2023-11-24T06:33:01.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c0b4580 con 0x7f408c0cdf10 2023-11-24T06:33:01.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c0b4910 con 0x7f408c0cdf10 2023-11-24T06:33:01.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c1412b0 con 0x7f408c0cdf10 2023-11-24T06:33:01.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c155700 con 0x7f408c0cdf10 2023-11-24T06:33:01.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c04e8c0 con 0x7f408c0cdf10 2023-11-24T06:33:01.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f407c0b2070 con 0x7f408c0cdf10 2023-11-24T06:33:01.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f40837fe640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f406c066a10 0x7f406c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:01.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.940+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f407c11dc50 con 0x7f408c0cdf10 2023-11-24T06:33:01.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.944+0000 7f4083fff640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f406c066a10 0x7f406c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:01.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.944+0000 7f4083fff640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f406c066a10 0x7f406c068ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f408c06c4a0 tx=0x7f4074009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:01.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:01.948+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f407c0ea730 con 0x7f408c0cdf10 2023-11-24T06:33:02.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:02.140+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f408c0b9380 con 0x7f408c0cdf10 2023-11-24T06:33:03.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.112+0000 7f40837fe640 1 -- 172.21.15.143:0/807446989 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f407c0b9020 con 0x7f408c0cdf10 2023-11-24T06:33:03.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f406c066a10 msgr2=0x7f406c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f406c066a10 0x7f406c068ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f408c06c4a0 tx=0x7f4074009040 comp rx=0 tx=0).stop 2023-11-24T06:33:03.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 msgr2=0x7f408c1551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 0x7f408c1551c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f407c01a060 tx=0x7f407c01ac70 comp rx=0 tx=0).stop 2023-11-24T06:33:03.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 shutdown_connections 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f406c066a10 0x7f406c068ed0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f408c161d70 0x7f408c1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f408c0d19e0 0x7f408c141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 --2- 172.21.15.143:0/807446989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f408c0cdf10 0x7f408c1551c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 >> 172.21.15.143:0/807446989 conn(0x7f408c09c760 msgr2=0x7f408c0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 shutdown_connections 2023-11-24T06:33:03.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.116+0000 7f4091535640 1 -- 172.21.15.143:0/807446989 wait complete. 2023-11-24T06:33:03.144 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:33:03.145 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:33:03.290 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa842217640 1 Processor -- start 2023-11-24T06:33:03.291 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa842217640 1 -- start start 2023-11-24T06:33:03.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa842217640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa83c15a290 0x7fa83c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:03.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa842217640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c071170 con 0x7fa83c15ec60 2023-11-24T06:33:03.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa842217640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c0cb690 con 0x7fa83c0b1f80 2023-11-24T06:33:03.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa842217640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0cb970 con 0x7fa83c15a290 2023-11-24T06:33:03.292 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa833fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa83c15ec60 0x7fa83c0cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56462/0 (socket says 172.21.15.143:56462) 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa833fff640 1 -- 172.21.15.143:0/1523393458 learned_addr learned my addr 172.21.15.143:0/1523393458 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83b7fe640 1 --2- 172.21.15.143:0/1523393458 >> v2:172.21.15.146:3300/0 conn(0x7fa83c15a290 0x7fa83c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105605630 0 0) 0x7fa83c071170 con 0x7fa83c15ec60 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa828003530 con 0x7fa83c15ec60 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866437441 0 0) 0x7fa83c0cb690 con 0x7fa83c0b1f80 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa83c071170 con 0x7fa83c0b1f80 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543799475 0 0) 0x7fa828003530 con 0x7fa83c15ec60 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83b7fe640 1 -- 172.21.15.143:0/1523393458 >> v1:172.21.15.146:6789/0 conn(0x7fa83c0b1f80 legacy=0x7fa83c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83b7fe640 1 -- 172.21.15.143:0/1523393458 >> v1:172.21.15.143:6789/0 conn(0x7fa83c15ec60 legacy=0x7fa83c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.293 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.284+0000 7fa83b7fe640 1 -- 172.21.15.143:0/1523393458 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0cbc50 con 0x7fa83c15a290 2023-11-24T06:33:03.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa83b7fe640 1 --2- 172.21.15.143:0/1523393458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15a290 0x7fa83c0707f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0097c0 tx=0x7fa82c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c3b31f113d060c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:03.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824001680 con 0x7fa83c15a290 2023-11-24T06:33:03.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c0a7050 con 0x7fa83c15a290 2023-11-24T06:33:03.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa83affd640 1 -- 172.21.15.143:0/1523393458 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0ab620 con 0x7fa83c15a290 2023-11-24T06:33:03.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 -- 172.21.15.143:0/1523393458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15a290 msgr2=0x7fa83c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.296 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 --2- 172.21.15.143:0/1523393458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15a290 0x7fa83c0707f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0097c0 tx=0x7fa82c01c310 comp rx=0 tx=0).stop 2023-11-24T06:33:03.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 -- 172.21.15.143:0/1523393458 shutdown_connections 2023-11-24T06:33:03.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 --2- 172.21.15.143:0/1523393458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15a290 0x7fa83c0707f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 -- 172.21.15.143:0/1523393458 >> 172.21.15.143:0/1523393458 conn(0x7fa83c0b0c80 msgr2=0x7fa83c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:03.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 -- 172.21.15.143:0/1523393458 shutdown_connections 2023-11-24T06:33:03.297 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.288+0000 7fa842217640 1 -- 172.21.15.143:0/1523393458 wait complete. 2023-11-24T06:33:03.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 Processor -- start 2023-11-24T06:33:03.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 -- start start 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 0x7fa83c149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83c15a290 0x7fa83c150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15ec60 0x7fa83c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c150640 con 0x7fa83c0b1f80 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0b28a0 con 0x7fa83c15ec60 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0b2b40 con 0x7fa83c15a290 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 0x7fa83c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:03.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 0x7fa83c149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51336/0 (socket says 172.21.15.143:51336) 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 -- 172.21.15.143:0/2422928253 learned_addr learned my addr 172.21.15.143:0/2422928253 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa833fff640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83c15a290 0x7fa83c150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83bfff640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15ec60 0x7fa83c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 -- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83c15a290 msgr2=0x7fa83c150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83c15a290 0x7fa83c150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 -- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15ec60 msgr2=0x7fa83c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15ec60 0x7fa83c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 -- 172.21.15.143:0/2422928253 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c009420 con 0x7fa83c0b1f80 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83bfff640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15ec60 0x7fa83c0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa833fff640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83c15a290 0x7fa83c150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa83b7fe640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 0x7fa83c149370 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa82c019f40 tx=0x7fa82c0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:03.301 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0bb070 con 0x7fa83c0b1f80 2023-11-24T06:33:03.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c0abd10 con 0x7fa83c0b1f80 2023-11-24T06:33:03.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c070f40 con 0x7fa83c0b1f80 2023-11-24T06:33:03.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0b4640 con 0x7fa83c0b1f80 2023-11-24T06:33:03.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.292+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0abf60 con 0x7fa83c0b1f80 2023-11-24T06:33:03.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.296+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c0b2ff0 con 0x7fa83c0b1f80 2023-11-24T06:33:03.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.296+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fa82c0b2040 con 0x7fa83c0b1f80 2023-11-24T06:33:03.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.296+0000 7fa838ff9640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa81c066a40 0x7fa81c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:03.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.296+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa82c11da30 con 0x7fa83c0b1f80 2023-11-24T06:33:03.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.296+0000 7fa833fff640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa81c066a40 0x7fa81c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:03.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.296+0000 7fa833fff640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa81c066a40 0x7fa81c068f00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa83c071ed0 tx=0x7fa824009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:03.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.300+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa82c0ea490 con 0x7fa83c0b1f80 2023-11-24T06:33:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:03.484+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa83c04e8c0 con 0x7fa83c0b1f80 2023-11-24T06:33:04.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.120+0000 7fa838ff9640 1 -- 172.21.15.143:0/2422928253 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa82c0edab0 con 0x7fa83c0b1f80 2023-11-24T06:33:04.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.120+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa81c066a40 msgr2=0x7fa81c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.120+0000 7fa842217640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa81c066a40 0x7fa81c068f00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa83c071ed0 tx=0x7fa824009040 comp rx=0 tx=0).stop 2023-11-24T06:33:04.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.120+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 msgr2=0x7fa83c149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.120+0000 7fa842217640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 0x7fa83c149370 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa82c019f40 tx=0x7fa82c0190b0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 shutdown_connections 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa81c066a40 0x7fa81c068f00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa83c15ec60 0x7fa83c0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83c15a290 0x7fa83c150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 --2- 172.21.15.143:0/2422928253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b1f80 0x7fa83c149370 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 >> 172.21.15.143:0/2422928253 conn(0x7fa83c0b0c80 msgr2=0x7fa83c0af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 shutdown_connections 2023-11-24T06:33:04.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.124+0000 7fa842217640 1 -- 172.21.15.143:0/2422928253 wait complete. 2023-11-24T06:33:04.152 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:33:04.152 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:04.294 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 Processor -- start 2023-11-24T06:33:04.295 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 -- start start 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff11015d6f0 0x7ff1100d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff1100d3be0 0x7ff1100d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1100d1ef0 0x7ff1101610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100d2360 con 0x7ff1100d3be0 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11015dae0 con 0x7ff1100d1ef0 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff117172640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11015dda0 con 0x7ff11015d6f0 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff1100d3be0 0x7ff1100d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff1100d3be0 0x7ff1100d19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51350/0 (socket says 172.21.15.143:51350) 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 -- 172.21.15.143:0/1768536597 learned_addr learned my addr 172.21.15.143:0/1768536597 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:04.298 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff114f0e640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff11015d6f0 0x7ff1100d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff11570f640 1 --2- 172.21.15.143:0/1768536597 >> v2:172.21.15.146:3300/0 conn(0x7ff1100d1ef0 0x7ff1101610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 -- 172.21.15.143:0/1768536597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff11015d6f0 msgr2=0x7ff1100d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff11015d6f0 0x7ff1100d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 -- 172.21.15.143:0/1768536597 >> v2:172.21.15.146:3300/0 conn(0x7ff1100d1ef0 msgr2=0x7ff1101610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 --2- 172.21.15.143:0/1768536597 >> v2:172.21.15.146:3300/0 conn(0x7ff1100d1ef0 0x7ff1101610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff10ffff640 1 -- 172.21.15.143:0/1768536597 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11015e080 con 0x7ff1100d3be0 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff114f0e640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff11015d6f0 0x7ff1100d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:04.299 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.288+0000 7ff11570f640 1 --2- 172.21.15.143:0/1768536597 >> v2:172.21.15.146:3300/0 conn(0x7ff1100d1ef0 0x7ff1101610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff10ffff640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1100d3be0 0x7ff1100d19b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff1100cf970 tx=0x7ff0fc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8852c72fc407cb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff10f7fe640 1 -- 172.21.15.143:0/1768536597 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ab600 con 0x7ff1100d3be0 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff10f7fe640 1 -- 172.21.15.143:0/1768536597 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0a7050 con 0x7ff1100d3be0 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff10f7fe640 1 -- 172.21.15.143:0/1768536597 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ab980 con 0x7ff1100d3be0 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 -- 172.21.15.143:0/1768536597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1100d3be0 msgr2=0x7ff1100d19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1100d3be0 0x7ff1100d19b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff1100cf970 tx=0x7ff0fc01c240 comp rx=0 tx=0).stop 2023-11-24T06:33:04.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 -- 172.21.15.143:0/1768536597 shutdown_connections 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 --2- 172.21.15.143:0/1768536597 >> v2:172.21.15.146:3300/0 conn(0x7ff1100d1ef0 0x7ff1101610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1100d3be0 0x7ff1100d19b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 --2- 172.21.15.143:0/1768536597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff11015d6f0 0x7ff1100d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 -- 172.21.15.143:0/1768536597 >> 172.21.15.143:0/1768536597 conn(0x7ff11008af70 msgr2=0x7ff1100d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 -- 172.21.15.143:0/1768536597 shutdown_connections 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.292+0000 7ff117172640 1 -- 172.21.15.143:0/1768536597 wait complete. 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 Processor -- start 2023-11-24T06:33:04.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 -- start start 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100d1ef0 0x7ff110154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1100d3be0 0x7ff110158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 0x7ff11014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110154ab0 con 0x7ff11015b810 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110154d90 con 0x7ff1100d1ef0 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff110155070 con 0x7ff1100d3be0 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 0x7ff11014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 0x7ff11014c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51356/0 (socket says 172.21.15.143:51356) 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 -- 172.21.15.143:0/3556792777 learned_addr learned my addr 172.21.15.143:0/3556792777 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:04.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 -- 172.21.15.143:0/3556792777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1100d3be0 msgr2=0x7ff110158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1100d3be0 0x7ff110158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 -- 172.21.15.143:0/3556792777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100d1ef0 msgr2=0x7ff110154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100d1ef0 0x7ff110154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 -- 172.21.15.143:0/3556792777 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0094d0 con 0x7ff11015b810 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff11570f640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 0x7ff11014c410 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff108007d60 tx=0x7ff10800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080039a0 con 0x7ff11015b810 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800f040 con 0x7ff11015b810 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108003d40 con 0x7ff11015b810 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff110155350 con 0x7ff11015b810 2023-11-24T06:33:04.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.296+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff110154680 con 0x7ff11015b810 2023-11-24T06:33:04.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.300+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff110067520 con 0x7ff11015b810 2023-11-24T06:33:04.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.300+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7ff108004030 con 0x7ff11015b810 2023-11-24T06:33:04.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.300+0000 7ff10d7fa640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff0f4066a10 0x7ff0f4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.307 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.300+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff108084cc0 con 0x7ff11015b810 2023-11-24T06:33:04.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.300+0000 7ff114f0e640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff0f4066a10 0x7ff0f4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.300+0000 7ff114f0e640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff0f4066a10 0x7ff0f4068ed0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff104006f10 tx=0x7ff104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.304+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff108051760 con 0x7ff11015b810 2023-11-24T06:33:04.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.488+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff110151a70 con 0x7ff11015b810 2023-11-24T06:33:04.495 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.488+0000 7ff10d7fa640 1 -- 172.21.15.143:0/3556792777 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4918 (secure 0 0 0) 0x7ff10801a090 con 0x7ff11015b810 2023-11-24T06:33:04.495 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:04.495 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:33:00.473562+0000","modified":"2023-11-24T06:33:03.488843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7032":{"gid":7032,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/1990915261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1990915261},{"type":"v1","addr":"172.21.15.143:6837","nonce":1990915261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-24T06:33:04.495 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 54 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.488+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff0f4066a10 msgr2=0x7ff0f4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.488+0000 7ff117172640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff0f4066a10 0x7ff0f4068ed0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff104006f10 tx=0x7ff104008040 comp rx=0 tx=0).stop 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.488+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 msgr2=0x7ff11014c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.488+0000 7ff117172640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 0x7ff11014c410 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff108007d60 tx=0x7ff10800d4a0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 shutdown_connections 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ff0f4066a10 0x7ff0f4068ed0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff11015b810 0x7ff11014c410 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1100d3be0 0x7ff110158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 --2- 172.21.15.143:0/3556792777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100d1ef0 0x7ff110154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 >> 172.21.15.143:0/3556792777 conn(0x7ff11008af70 msgr2=0x7ff11015ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:04.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 shutdown_connections 2023-11-24T06:33:04.498 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.492+0000 7ff117172640 1 -- 172.21.15.143:0/3556792777 wait complete. 2023-11-24T06:33:04.517 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:04.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 Processor -- start 2023-11-24T06:33:04.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 -- start start 2023-11-24T06:33:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc40d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1bc40ce8b0 0x7f1bc40ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc406c0e0 con 0x7f1bc415d570 2023-11-24T06:33:04.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40d39c0 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc9a9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40d1cc0 con 0x7f1bc40d3020 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1bc415d570 0x7f1bc406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56466/0 (socket says 172.21.15.143:56466) 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc37fe640 1 -- 172.21.15.143:0/2258861574 learned_addr learned my addr 172.21.15.143:0/2258861574 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/2258861574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc40d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc3fff640 1 --2- 172.21.15.143:0/2258861574 >> v2:172.21.15.146:3300/0 conn(0x7f1bc40ce8b0 0x7f1bc40ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc27fc640 1 -- 172.21.15.143:0/2258861574 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449304020 0 0) 0x7f1bc406c0e0 con 0x7f1bc415d570 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc27fc640 1 -- 172.21.15.143:0/2258861574 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac003530 con 0x7f1bc415d570 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc2ffd640 1 -- 172.21.15.143:0/2258861574 >> v2:172.21.15.146:3300/0 conn(0x7f1bc40ce8b0 msgr2=0x7f1bc40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/2258861574 >> v2:172.21.15.146:3300/0 conn(0x7f1bc40ce8b0 0x7f1bc40ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc2ffd640 1 -- 172.21.15.143:0/2258861574 >> v1:172.21.15.143:6789/0 conn(0x7f1bc415d570 legacy=0x7f1bc406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.648+0000 7f1bc2ffd640 1 -- 172.21.15.143:0/2258861574 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40d1fa0 con 0x7f1bc40d3020 2023-11-24T06:33:04.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/2258861574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc40d3480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80097c0 tx=0x7f1bb801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e7ae8f894c0df06 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc27fc640 1 -- 172.21.15.143:0/2258861574 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80ab650 con 0x7f1bc40d3020 2023-11-24T06:33:04.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc27fc640 1 -- 172.21.15.143:0/2258861574 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80ab7b0 con 0x7f1bc40d3020 2023-11-24T06:33:04.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc27fc640 1 -- 172.21.15.143:0/2258861574 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80abb40 con 0x7f1bc40d3020 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/2258861574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 msgr2=0x7f1bc40d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/2258861574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc40d3480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80097c0 tx=0x7f1bb801c450 comp rx=0 tx=0).stop 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/2258861574 shutdown_connections 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/2258861574 >> v2:172.21.15.146:3300/0 conn(0x7f1bc40ce8b0 0x7f1bc40ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/2258861574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc40d3480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/2258861574 >> 172.21.15.143:0/2258861574 conn(0x7f1bc408ceb0 msgr2=0x7f1bc409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/2258861574 shutdown_connections 2023-11-24T06:33:04.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.652+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/2258861574 wait complete. 2023-11-24T06:33:04.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 Processor -- start 2023-11-24T06:33:04.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 -- start start 2023-11-24T06:33:04.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 0x7f1bc40c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc4151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc415d570 0x7f1bc40cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cd400 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cd120 con 0x7f1bc415d570 2023-11-24T06:33:04.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40ca600 con 0x7f1bc40d3020 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 0x7f1bc40c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 0x7f1bc40c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51362/0 (socket says 172.21.15.143:51362) 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 -- 172.21.15.143:0/1943556992 learned_addr learned my addr 172.21.15.143:0/1943556992 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc3fff640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc415d570 0x7f1bc40cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 -- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 msgr2=0x7f1bc4151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc4151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 -- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc415d570 msgr2=0x7f1bc40cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc415d570 0x7f1bc40cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 -- 172.21.15.143:0/1943556992 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8009420 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc37fe640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 0x7f1bc40c7b20 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c420 tx=0x7f1bb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4005cf0 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4005e50 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc40ca8e0 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40072d0 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.656+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc40ccd80 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.660+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4067520 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.660+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f1bb4007430 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.660+0000 7f1babfff640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1bb0066a40 0x7f1bb0068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.660+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f1bb4083d60 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.660+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1bb0066a40 0x7f1bb0068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.660+0000 7f1bc2ffd640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1bb0066a40 0x7f1bb0068f00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80af000 tx=0x7f1bb80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.664+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1bb4050a50 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bc406b7b0 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.822 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1babfff640 1 -- 172.21.15.143:0/1943556992 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f1bb4017020 con 0x7f1bc40ce8b0 2023-11-24T06:33:04.822 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:04.823 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":85,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:02.084666+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1bb0066a40 msgr2=0x7f1bb0068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1bb0066a40 0x7f1bb0068f00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80af000 tx=0x7f1bb80a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 msgr2=0x7f1bc40c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 0x7f1bc40c7b20 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c420 tx=0x7f1bb400c8e0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 shutdown_connections 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1bb0066a40 0x7f1bb0068f00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc415d570 0x7f1bc40cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bc40d3020 0x7f1bc4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 --2- 172.21.15.143:0/1943556992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bc40ce8b0 0x7f1bc40c7b20 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 >> 172.21.15.143:0/1943556992 conn(0x7f1bc408ceb0 msgr2=0x7f1bc40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 shutdown_connections 2023-11-24T06:33:04.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.816+0000 7f1bc9a9a640 1 -- 172.21.15.143:0/1943556992 wait complete. 2023-11-24T06:33:04.844 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:33:04.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:04.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f8757640 1 Processor -- start 2023-11-24T06:33:04.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f8757640 1 -- start start 2023-11-24T06:33:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f8757640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1f015ed00 0x7fd1f015e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f8757640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f015f110 con 0x7fd1f0160be0 2023-11-24T06:33:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f8757640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f015e900 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f8757640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f006c650 con 0x7fd1f015ed00 2023-11-24T06:33:04.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f6cf4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1f015ed00 0x7fd1f015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f64f3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd1f0160be0 0x7fd1f00b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56480/0 (socket says 172.21.15.143:56480) 2023-11-24T06:33:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f64f3640 1 -- 172.21.15.143:0/667279264 learned_addr learned my addr 172.21.15.143:0/667279264 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f6cf4640 1 -- 172.21.15.143:0/667279264 >> v1:172.21.15.146:6789/0 conn(0x7fd1f00b3ec0 legacy=0x7fd1f015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f6cf4640 1 -- 172.21.15.143:0/667279264 >> v1:172.21.15.143:6789/0 conn(0x7fd1f0160be0 legacy=0x7fd1f00b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.976+0000 7fd1f6cf4640 1 -- 172.21.15.143:0/667279264 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f006c830 con 0x7fd1f015ed00 2023-11-24T06:33:04.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f6cf4640 1 --2- 172.21.15.143:0/667279264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f015ed00 0x7fd1f015e250 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009d90 tx=0x7fd1e801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517f5a933a2b0355 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f54f1640 1 -- 172.21.15.143:0/667279264 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80a59e0 con 0x7fd1f015ed00 2023-11-24T06:33:04.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f54f1640 1 -- 172.21.15.143:0/667279264 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80a5b40 con 0x7fd1f015ed00 2023-11-24T06:33:04.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f54f1640 1 -- 172.21.15.143:0/667279264 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80ad440 con 0x7fd1f015ed00 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 -- 172.21.15.143:0/667279264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f015ed00 msgr2=0x7fd1f015e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 --2- 172.21.15.143:0/667279264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f015ed00 0x7fd1f015e250 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009d90 tx=0x7fd1e801c920 comp rx=0 tx=0).stop 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 -- 172.21.15.143:0/667279264 shutdown_connections 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 --2- 172.21.15.143:0/667279264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f015ed00 0x7fd1f015e250 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 -- 172.21.15.143:0/667279264 >> 172.21.15.143:0/667279264 conn(0x7fd1f00b0bf0 msgr2=0x7fd1f00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 -- 172.21.15.143:0/667279264 shutdown_connections 2023-11-24T06:33:04.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.980+0000 7fd1f8757640 1 -- 172.21.15.143:0/667279264 wait complete. 2023-11-24T06:33:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 Processor -- start 2023-11-24T06:33:04.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- start start 2023-11-24T06:33:04.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 0x7fd1f0141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f015ed00 0x7fd1f015a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f0160be0 0x7fd1f015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f009bc50 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f009bf30 con 0x7fd1f015ed00 2023-11-24T06:33:04.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f009c210 con 0x7fd1f0160be0 2023-11-24T06:33:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 0x7fd1f0141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 0x7fd1f0141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51366/0 (socket says 172.21.15.143:51366) 2023-11-24T06:33:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 -- 172.21.15.143:0/2724728130 learned_addr learned my addr 172.21.15.143:0/2724728130 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 -- 172.21.15.143:0/2724728130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f0160be0 msgr2=0x7fd1f015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f0160be0 0x7fd1f015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 -- 172.21.15.143:0/2724728130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f015ed00 msgr2=0x7fd1f015a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f015ed00 0x7fd1f015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 -- 172.21.15.143:0/2724728130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8009a70 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f64f3640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 0x7fd1f0141900 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00c400 tx=0x7fd1ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec005cf0 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec005e50 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f009c4f0 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0072d0 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f0141e40 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.984+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f009c9a0 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.988+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fd1ec007430 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.988+0000 7fd1e6ffd640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1d4066a10 0x7fd1d4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:04.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.988+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd1ec083de0 con 0x7fd1f00b3ec0 2023-11-24T06:33:04.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.988+0000 7fd1f5cf2640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1d4066a10 0x7fd1d4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:04.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.988+0000 7fd1f5cf2640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1d4066a10 0x7fd1d4068ed0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000f70 tx=0x7fd1e00079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:04.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:04.992+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1f009c9a0 con 0x7fd1f00b3ec0 2023-11-24T06:33:05.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.140+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1f009c9a0 con 0x7fd1d4066a10 2023-11-24T06:33:05.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.148+0000 7fd1e6ffd640 1 -- 172.21.15.143:0/2724728130 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288715 (secure 0 0 0) 0x7fd1f009c9a0 con 0x7fd1d4066a10 2023-11-24T06:33:05.158 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:05.160 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:05.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1d4066a10 msgr2=0x7fd1d4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1d4066a10 0x7fd1d4068ed0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000f70 tx=0x7fd1e00079c0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 msgr2=0x7fd1f0141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 0x7fd1f0141900 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00c400 tx=0x7fd1ec00c8c0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 shutdown_connections 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd1d4066a10 0x7fd1d4068ed0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f0160be0 0x7fd1f015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f015ed00 0x7fd1f015a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 --2- 172.21.15.143:0/2724728130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1f00b3ec0 0x7fd1f0141900 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 >> 172.21.15.143:0/2724728130 conn(0x7fd1f00b0bf0 msgr2=0x7fd1f00b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 shutdown_connections 2023-11-24T06:33:05.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.152+0000 7fd1f8757640 1 -- 172.21.15.143:0/2724728130 wait complete. 2023-11-24T06:33:05.179 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-24T06:33:04.244338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258828,"kb_used_data":9368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715892,"statfs":{"total":773094113280,"available":772829073408,"internally_reserved":0,"allocated":9592832,"data_stored":4753131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.168387"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334212+0000","last_change":"2023-11-24T06:33:01.107950+0000","last_active":"2023-11-24T06:33:02.334212+0000","last_peered":"2023-11-24T06:33:02.334212+0000","last_clean":"2023-11-24T06:33:02.334212+0000","last_became_active":"2023-11-24T06:33:01.107705+0000","last_became_peered":"2023-11-24T06:33:01.107705+0000","last_unstale":"2023-11-24T06:33:02.334212+0000","last_undegraded":"2023-11-24T06:33:02.334212+0000","last_fullsized":"2023-11-24T06:33:02.334212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:04.717790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091145+0000","last_change":"2023-11-24T06:33:01.097681+0000","last_active":"2023-11-24T06:33:02.091145+0000","last_peered":"2023-11-24T06:33:02.091145+0000","last_clean":"2023-11-24T06:33:02.091145+0000","last_became_active":"2023-11-24T06:33:01.097463+0000","last_became_peered":"2023-11-24T06:33:01.097463+0000","last_unstale":"2023-11-24T06:33:02.091145+0000","last_undegraded":"2023-11-24T06:33:02.091145+0000","last_fullsized":"2023-11-24T06:33:02.091145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:21.519447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466529+0000","last_change":"2023-11-24T06:33:01.109074+0000","last_active":"2023-11-24T06:33:02.466529+0000","last_peered":"2023-11-24T06:33:02.466529+0000","last_clean":"2023-11-24T06:33:02.466529+0000","last_became_active":"2023-11-24T06:33:01.106689+0000","last_became_peered":"2023-11-24T06:33:01.106689+0000","last_unstale":"2023-11-24T06:33:02.466529+0000","last_undegraded":"2023-11-24T06:33:02.466529+0000","last_fullsized":"2023-11-24T06:33:02.466529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:12.117735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091402+0000","last_change":"2023-11-24T06:33:01.123968+0000","last_active":"2023-11-24T06:33:02.091402+0000","last_peered":"2023-11-24T06:33:02.091402+0000","last_clean":"2023-11-24T06:33:02.091402+0000","last_became_active":"2023-11-24T06:33:01.123668+0000","last_became_peered":"2023-11-24T06:33:01.123668+0000","last_unstale":"2023-11-24T06:33:02.091402+0000","last_undegraded":"2023-11-24T06:33:02.091402+0000","last_fullsized":"2023-11-24T06:33:02.091402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:23.055838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465912+0000","last_change":"2023-11-24T06:33:01.114048+0000","last_active":"2023-11-24T06:33:02.465912+0000","last_peered":"2023-11-24T06:33:02.465912+0000","last_clean":"2023-11-24T06:33:02.465912+0000","last_became_active":"2023-11-24T06:33:01.113630+0000","last_became_peered":"2023-11-24T06:33:01.113630+0000","last_unstale":"2023-11-24T06:33:02.465912+0000","last_undegraded":"2023-11-24T06:33:02.465912+0000","last_fullsized":"2023-11-24T06:33:02.465912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:15.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465321+0000","last_change":"2023-11-24T06:33:01.114340+0000","last_active":"2023-11-24T06:33:02.465321+0000","last_peered":"2023-11-24T06:33:02.465321+0000","last_clean":"2023-11-24T06:33:02.465321+0000","last_became_active":"2023-11-24T06:33:01.114011+0000","last_became_peered":"2023-11-24T06:33:01.114011+0000","last_unstale":"2023-11-24T06:33:02.465321+0000","last_undegraded":"2023-11-24T06:33:02.465321+0000","last_fullsized":"2023-11-24T06:33:02.465321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:51.859171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090841+0000","last_change":"2023-11-24T06:33:01.114110+0000","last_active":"2023-11-24T06:33:02.090841+0000","last_peered":"2023-11-24T06:33:02.090841+0000","last_clean":"2023-11-24T06:33:02.090841+0000","last_became_active":"2023-11-24T06:33:01.113793+0000","last_became_peered":"2023-11-24T06:33:01.113793+0000","last_unstale":"2023-11-24T06:33:02.090841+0000","last_undegraded":"2023-11-24T06:33:02.090841+0000","last_fullsized":"2023-11-24T06:33:02.090841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:21.794803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465119+0000","last_change":"2023-11-24T06:33:01.104742+0000","last_active":"2023-11-24T06:33:02.465119+0000","last_peered":"2023-11-24T06:33:02.465119+0000","last_clean":"2023-11-24T06:33:02.465119+0000","last_became_active":"2023-11-24T06:33:01.104310+0000","last_became_peered":"2023-11-24T06:33:01.104310+0000","last_unstale":"2023-11-24T06:33:02.465119+0000","last_undegraded":"2023-11-24T06:33:02.465119+0000","last_fullsized":"2023-11-24T06:33:02.465119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:29.413914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465394+0000","last_change":"2023-11-24T06:33:01.129482+0000","last_active":"2023-11-24T06:33:02.465394+0000","last_peered":"2023-11-24T06:33:02.465394+0000","last_clean":"2023-11-24T06:33:02.465394+0000","last_became_active":"2023-11-24T06:33:01.129210+0000","last_became_peered":"2023-11-24T06:33:01.129210+0000","last_unstale":"2023-11-24T06:33:02.465394+0000","last_undegraded":"2023-11-24T06:33:02.465394+0000","last_fullsized":"2023-11-24T06:33:02.465394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:15.054108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334308+0000","last_change":"2023-11-24T06:33:01.100690+0000","last_active":"2023-11-24T06:33:02.334308+0000","last_peered":"2023-11-24T06:33:02.334308+0000","last_clean":"2023-11-24T06:33:02.334308+0000","last_became_active":"2023-11-24T06:33:01.100384+0000","last_became_peered":"2023-11-24T06:33:01.100384+0000","last_unstale":"2023-11-24T06:33:02.334308+0000","last_undegraded":"2023-11-24T06:33:02.334308+0000","last_fullsized":"2023-11-24T06:33:02.334308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:49.606868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091016+0000","last_change":"2023-11-24T06:33:01.105880+0000","last_active":"2023-11-24T06:33:02.091016+0000","last_peered":"2023-11-24T06:33:02.091016+0000","last_clean":"2023-11-24T06:33:02.091016+0000","last_became_active":"2023-11-24T06:33:01.105130+0000","last_became_peered":"2023-11-24T06:33:01.105130+0000","last_unstale":"2023-11-24T06:33:02.091016+0000","last_undegraded":"2023-11-24T06:33:02.091016+0000","last_fullsized":"2023-11-24T06:33:02.091016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:45.580395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333867+0000","last_change":"2023-11-24T06:33:01.101650+0000","last_active":"2023-11-24T06:33:02.333867+0000","last_peered":"2023-11-24T06:33:02.333867+0000","last_clean":"2023-11-24T06:33:02.333867+0000","last_became_active":"2023-11-24T06:33:01.100765+0000","last_became_peered":"2023-11-24T06:33:01.100765+0000","last_unstale":"2023-11-24T06:33:02.333867+0000","last_undegraded":"2023-11-24T06:33:02.333867+0000","last_fullsized":"2023-11-24T06:33:02.333867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:10:01.556975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466120+0000","last_change":"2023-11-24T06:33:01.107686+0000","last_active":"2023-11-24T06:33:02.466120+0000","last_peered":"2023-11-24T06:33:02.466120+0000","last_clean":"2023-11-24T06:33:02.466120+0000","last_became_active":"2023-11-24T06:33:01.107396+0000","last_became_peered":"2023-11-24T06:33:01.107396+0000","last_unstale":"2023-11-24T06:33:02.466120+0000","last_undegraded":"2023-11-24T06:33:02.466120+0000","last_fullsized":"2023-11-24T06:33:02.466120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:25.845112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091355+0000","last_change":"2023-11-24T06:33:01.113195+0000","last_active":"2023-11-24T06:33:02.091355+0000","last_peered":"2023-11-24T06:33:02.091355+0000","last_clean":"2023-11-24T06:33:02.091355+0000","last_became_active":"2023-11-24T06:33:01.112936+0000","last_became_peered":"2023-11-24T06:33:01.112936+0000","last_unstale":"2023-11-24T06:33:02.091355+0000","last_undegraded":"2023-11-24T06:33:02.091355+0000","last_fullsized":"2023-11-24T06:33:02.091355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:16.001471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092842+0000","last_change":"2023-11-24T06:33:01.107338+0000","last_active":"2023-11-24T06:33:02.092842+0000","last_peered":"2023-11-24T06:33:02.092842+0000","last_clean":"2023-11-24T06:33:02.092842+0000","last_became_active":"2023-11-24T06:33:01.106903+0000","last_became_peered":"2023-11-24T06:33:01.106903+0000","last_unstale":"2023-11-24T06:33:02.092842+0000","last_undegraded":"2023-11-24T06:33:02.092842+0000","last_fullsized":"2023-11-24T06:33:02.092842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:17.847810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465222+0000","last_change":"2023-11-24T06:33:01.103000+0000","last_active":"2023-11-24T06:33:02.465222+0000","last_peered":"2023-11-24T06:33:02.465222+0000","last_clean":"2023-11-24T06:33:02.465222+0000","last_became_active":"2023-11-24T06:33:01.102704+0000","last_became_peered":"2023-11-24T06:33:01.102704+0000","last_unstale":"2023-11-24T06:33:02.465222+0000","last_undegraded":"2023-11-24T06:33:02.465222+0000","last_fullsized":"2023-11-24T06:33:02.465222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:29.413914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466117+0000","last_change":"2023-11-24T06:33:01.112099+0000","last_active":"2023-11-24T06:33:02.466117+0000","last_peered":"2023-11-24T06:33:02.466117+0000","last_clean":"2023-11-24T06:33:02.466117+0000","last_became_active":"2023-11-24T06:33:01.111864+0000","last_became_peered":"2023-11-24T06:33:01.111864+0000","last_unstale":"2023-11-24T06:33:02.466117+0000","last_undegraded":"2023-11-24T06:33:02.466117+0000","last_fullsized":"2023-11-24T06:33:02.466117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:50:55.628735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091225+0000","last_change":"2023-11-24T06:33:01.117513+0000","last_active":"2023-11-24T06:33:02.091225+0000","last_peered":"2023-11-24T06:33:02.091225+0000","last_clean":"2023-11-24T06:33:02.091225+0000","last_became_active":"2023-11-24T06:33:01.117193+0000","last_became_peered":"2023-11-24T06:33:01.117193+0000","last_unstale":"2023-11-24T06:33:02.091225+0000","last_undegraded":"2023-11-24T06:33:02.091225+0000","last_fullsized":"2023-11-24T06:33:02.091225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:16:13.506250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464581+0000","last_change":"2023-11-24T06:33:01.117631+0000","last_active":"2023-11-24T06:33:02.464581+0000","last_peered":"2023-11-24T06:33:02.464581+0000","last_clean":"2023-11-24T06:33:02.464581+0000","last_became_active":"2023-11-24T06:33:01.116675+0000","last_became_peered":"2023-11-24T06:33:01.116675+0000","last_unstale":"2023-11-24T06:33:02.464581+0000","last_undegraded":"2023-11-24T06:33:02.464581+0000","last_fullsized":"2023-11-24T06:33:02.464581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:12.461599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091519+0000","last_change":"2023-11-24T06:33:01.130831+0000","last_active":"2023-11-24T06:33:02.091519+0000","last_peered":"2023-11-24T06:33:02.091519+0000","last_clean":"2023-11-24T06:33:02.091519+0000","last_became_active":"2023-11-24T06:33:01.130518+0000","last_became_peered":"2023-11-24T06:33:01.130518+0000","last_unstale":"2023-11-24T06:33:02.091519+0000","last_undegraded":"2023-11-24T06:33:02.091519+0000","last_fullsized":"2023-11-24T06:33:02.091519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:27.531691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091728+0000","last_change":"2023-11-24T06:33:01.130598+0000","last_active":"2023-11-24T06:33:02.091728+0000","last_peered":"2023-11-24T06:33:02.091728+0000","last_clean":"2023-11-24T06:33:02.091728+0000","last_became_active":"2023-11-24T06:33:01.130269+0000","last_became_peered":"2023-11-24T06:33:01.130269+0000","last_unstale":"2023-11-24T06:33:02.091728+0000","last_undegraded":"2023-11-24T06:33:02.091728+0000","last_fullsized":"2023-11-24T06:33:02.091728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:23.330740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091853+0000","last_change":"2023-11-24T06:33:01.119495+0000","last_active":"2023-11-24T06:33:02.091853+0000","last_peered":"2023-11-24T06:33:02.091853+0000","last_clean":"2023-11-24T06:33:02.091853+0000","last_became_active":"2023-11-24T06:33:01.119216+0000","last_became_peered":"2023-11-24T06:33:01.119216+0000","last_unstale":"2023-11-24T06:33:02.091853+0000","last_undegraded":"2023-11-24T06:33:02.091853+0000","last_fullsized":"2023-11-24T06:33:02.091853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:56:58.182074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333904+0000","last_change":"2023-11-24T06:33:01.119933+0000","last_active":"2023-11-24T06:33:02.333904+0000","last_peered":"2023-11-24T06:33:02.333904+0000","last_clean":"2023-11-24T06:33:02.333904+0000","last_became_active":"2023-11-24T06:33:01.119577+0000","last_became_peered":"2023-11-24T06:33:01.119577+0000","last_unstale":"2023-11-24T06:33:02.333904+0000","last_undegraded":"2023-11-24T06:33:02.333904+0000","last_fullsized":"2023-11-24T06:33:02.333904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:50:55.628735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090518+0000","last_change":"2023-11-24T06:33:01.130813+0000","last_active":"2023-11-24T06:33:02.090518+0000","last_peered":"2023-11-24T06:33:02.090518+0000","last_clean":"2023-11-24T06:33:02.090518+0000","last_became_active":"2023-11-24T06:33:01.130292+0000","last_became_peered":"2023-11-24T06:33:01.130292+0000","last_unstale":"2023-11-24T06:33:02.090518+0000","last_undegraded":"2023-11-24T06:33:02.090518+0000","last_fullsized":"2023-11-24T06:33:02.090518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:38.111066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091089+0000","last_change":"2023-11-24T06:33:01.092697+0000","last_active":"2023-11-24T06:33:02.091089+0000","last_peered":"2023-11-24T06:33:02.091089+0000","last_clean":"2023-11-24T06:33:02.091089+0000","last_became_active":"2023-11-24T06:33:01.092402+0000","last_became_peered":"2023-11-24T06:33:01.092402+0000","last_unstale":"2023-11-24T06:33:02.091089+0000","last_undegraded":"2023-11-24T06:33:02.091089+0000","last_fullsized":"2023-11-24T06:33:02.091089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:13.744267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466404+0000","last_change":"2023-11-24T06:33:01.112449+0000","last_active":"2023-11-24T06:33:02.466404+0000","last_peered":"2023-11-24T06:33:02.466404+0000","last_clean":"2023-11-24T06:33:02.466404+0000","last_became_active":"2023-11-24T06:33:01.112187+0000","last_became_peered":"2023-11-24T06:33:01.112187+0000","last_unstale":"2023-11-24T06:33:02.466404+0000","last_undegraded":"2023-11-24T06:33:02.466404+0000","last_fullsized":"2023-11-24T06:33:02.466404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:46.640977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465576+0000","last_change":"2023-11-24T06:33:01.107089+0000","last_active":"2023-11-24T06:33:02.465576+0000","last_peered":"2023-11-24T06:33:02.465576+0000","last_clean":"2023-11-24T06:33:02.465576+0000","last_became_active":"2023-11-24T06:33:01.106801+0000","last_became_peered":"2023-11-24T06:33:01.106801+0000","last_unstale":"2023-11-24T06:33:02.465576+0000","last_undegraded":"2023-11-24T06:33:02.465576+0000","last_fullsized":"2023-11-24T06:33:02.465576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:18:29.156927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334021+0000","last_change":"2023-11-24T06:33:01.110900+0000","last_active":"2023-11-24T06:33:02.334021+0000","last_peered":"2023-11-24T06:33:02.334021+0000","last_clean":"2023-11-24T06:33:02.334021+0000","last_became_active":"2023-11-24T06:33:01.110210+0000","last_became_peered":"2023-11-24T06:33:01.110210+0000","last_unstale":"2023-11-24T06:33:02.334021+0000","last_undegraded":"2023-11-24T06:33:02.334021+0000","last_fullsized":"2023-11-24T06:33:02.334021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:23.001025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091748+0000","last_change":"2023-11-24T06:33:01.105332+0000","last_active":"2023-11-24T06:33:02.091748+0000","last_peered":"2023-11-24T06:33:02.091748+0000","last_clean":"2023-11-24T06:33:02.091748+0000","last_became_active":"2023-11-24T06:33:01.103446+0000","last_became_peered":"2023-11-24T06:33:01.103446+0000","last_unstale":"2023-11-24T06:33:02.091748+0000","last_undegraded":"2023-11-24T06:33:02.091748+0000","last_fullsized":"2023-11-24T06:33:02.091748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:03.443353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091305+0000","last_change":"2023-11-24T06:33:01.113937+0000","last_active":"2023-11-24T06:33:02.091305+0000","last_peered":"2023-11-24T06:33:02.091305+0000","last_clean":"2023-11-24T06:33:02.091305+0000","last_became_active":"2023-11-24T06:33:01.112077+0000","last_became_peered":"2023-11-24T06:33:01.112077+0000","last_unstale":"2023-11-24T06:33:02.091305+0000","last_undegraded":"2023-11-24T06:33:02.091305+0000","last_fullsized":"2023-11-24T06:33:02.091305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:50.685553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465442+0000","last_change":"2023-11-24T06:33:01.120802+0000","last_active":"2023-11-24T06:33:02.465442+0000","last_peered":"2023-11-24T06:33:02.465442+0000","last_clean":"2023-11-24T06:33:02.465442+0000","last_became_active":"2023-11-24T06:33:01.120511+0000","last_became_peered":"2023-11-24T06:33:01.120511+0000","last_unstale":"2023-11-24T06:33:02.465442+0000","last_undegraded":"2023-11-24T06:33:02.465442+0000","last_fullsized":"2023-11-24T06:33:02.465442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:30.613643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333749+0000","last_change":"2023-11-24T06:33:01.097626+0000","last_active":"2023-11-24T06:33:02.333749+0000","last_peered":"2023-11-24T06:33:02.333749+0000","last_clean":"2023-11-24T06:33:02.333749+0000","last_became_active":"2023-11-24T06:33:01.097238+0000","last_became_peered":"2023-11-24T06:33:01.097238+0000","last_unstale":"2023-11-24T06:33:02.333749+0000","last_undegraded":"2023-11-24T06:33:02.333749+0000","last_fullsized":"2023-11-24T06:33:02.333749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:15.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465730+0000","last_change":"2023-11-24T06:33:01.108591+0000","last_active":"2023-11-24T06:33:02.465730+0000","last_peered":"2023-11-24T06:33:02.465730+0000","last_clean":"2023-11-24T06:33:02.465730+0000","last_became_active":"2023-11-24T06:33:01.105504+0000","last_became_peered":"2023-11-24T06:33:01.105504+0000","last_unstale":"2023-11-24T06:33:02.465730+0000","last_undegraded":"2023-11-24T06:33:02.465730+0000","last_fullsized":"2023-11-24T06:33:02.465730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:43:05.744195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"84'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334396+0000","last_change":"2023-11-24T06:33:00.106306+0000","last_active":"2023-11-24T06:33:02.334396+0000","last_peered":"2023-11-24T06:33:02.334396+0000","last_clean":"2023-11-24T06:33:02.334396+0000","last_became_active":"2023-11-24T06:33:00.105973+0000","last_became_peered":"2023-11-24T06:33:00.105973+0000","last_unstale":"2023-11-24T06:33:02.334396+0000","last_undegraded":"2023-11-24T06:33:02.334396+0000","last_fullsized":"2023-11-24T06:33:02.334396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:14.047569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334340+0000","last_change":"2023-11-24T06:33:01.119795+0000","last_active":"2023-11-24T06:33:02.334340+0000","last_peered":"2023-11-24T06:33:02.334340+0000","last_clean":"2023-11-24T06:33:02.334340+0000","last_became_active":"2023-11-24T06:33:01.119485+0000","last_became_peered":"2023-11-24T06:33:01.119485+0000","last_unstale":"2023-11-24T06:33:02.334340+0000","last_undegraded":"2023-11-24T06:33:02.334340+0000","last_fullsized":"2023-11-24T06:33:02.334340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:46.877361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466221+0000","last_change":"2023-11-24T06:33:00.104249+0000","last_active":"2023-11-24T06:33:02.466221+0000","last_peered":"2023-11-24T06:33:02.466221+0000","last_clean":"2023-11-24T06:33:02.466221+0000","last_became_active":"2023-11-24T06:33:00.103943+0000","last_became_peered":"2023-11-24T06:33:00.103943+0000","last_unstale":"2023-11-24T06:33:02.466221+0000","last_undegraded":"2023-11-24T06:33:02.466221+0000","last_fullsized":"2023-11-24T06:33:02.466221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:24.376758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334161+0000","last_change":"2023-11-24T06:33:01.103235+0000","last_active":"2023-11-24T06:33:02.334161+0000","last_peered":"2023-11-24T06:33:02.334161+0000","last_clean":"2023-11-24T06:33:02.334161+0000","last_became_active":"2023-11-24T06:33:01.102810+0000","last_became_peered":"2023-11-24T06:33:01.102810+0000","last_unstale":"2023-11-24T06:33:02.334161+0000","last_undegraded":"2023-11-24T06:33:02.334161+0000","last_fullsized":"2023-11-24T06:33:02.334161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:14:46.238892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464657+0000","last_change":"2023-11-24T06:33:00.112215+0000","last_active":"2023-11-24T06:33:02.464657+0000","last_peered":"2023-11-24T06:33:02.464657+0000","last_clean":"2023-11-24T06:33:02.464657+0000","last_became_active":"2023-11-24T06:33:00.111945+0000","last_became_peered":"2023-11-24T06:33:00.111945+0000","last_unstale":"2023-11-24T06:33:02.464657+0000","last_undegraded":"2023-11-24T06:33:02.464657+0000","last_fullsized":"2023-11-24T06:33:02.464657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:10:30.004015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466496+0000","last_change":"2023-11-24T06:33:01.113610+0000","last_active":"2023-11-24T06:33:02.466496+0000","last_peered":"2023-11-24T06:33:02.466496+0000","last_clean":"2023-11-24T06:33:02.466496+0000","last_became_active":"2023-11-24T06:33:01.113338+0000","last_became_peered":"2023-11-24T06:33:01.113338+0000","last_unstale":"2023-11-24T06:33:02.466496+0000","last_undegraded":"2023-11-24T06:33:02.466496+0000","last_fullsized":"2023-11-24T06:33:02.466496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:12.461599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464467+0000","last_change":"2023-11-24T06:33:00.112197+0000","last_active":"2023-11-24T06:33:02.464467+0000","last_peered":"2023-11-24T06:33:02.464467+0000","last_clean":"2023-11-24T06:33:02.464467+0000","last_became_active":"2023-11-24T06:33:00.111907+0000","last_became_peered":"2023-11-24T06:33:00.111907+0000","last_unstale":"2023-11-24T06:33:02.464467+0000","last_undegraded":"2023-11-24T06:33:02.464467+0000","last_fullsized":"2023-11-24T06:33:02.464467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:54:01.817949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091418+0000","last_change":"2023-11-24T06:33:01.114137+0000","last_active":"2023-11-24T06:33:02.091418+0000","last_peered":"2023-11-24T06:33:02.091418+0000","last_clean":"2023-11-24T06:33:02.091418+0000","last_became_active":"2023-11-24T06:33:01.111692+0000","last_became_peered":"2023-11-24T06:33:01.111692+0000","last_unstale":"2023-11-24T06:33:02.091418+0000","last_undegraded":"2023-11-24T06:33:02.091418+0000","last_fullsized":"2023-11-24T06:33:02.091418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:35.987001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465781+0000","last_change":"2023-11-24T06:33:00.116319+0000","last_active":"2023-11-24T06:33:02.465781+0000","last_peered":"2023-11-24T06:33:02.465781+0000","last_clean":"2023-11-24T06:33:02.465781+0000","last_became_active":"2023-11-24T06:33:00.116090+0000","last_became_peered":"2023-11-24T06:33:00.116090+0000","last_unstale":"2023-11-24T06:33:02.465781+0000","last_undegraded":"2023-11-24T06:33:02.465781+0000","last_fullsized":"2023-11-24T06:33:02.465781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:39.147169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465581+0000","last_change":"2023-11-24T06:33:01.113876+0000","last_active":"2023-11-24T06:33:02.465581+0000","last_peered":"2023-11-24T06:33:02.465581+0000","last_clean":"2023-11-24T06:33:02.465581+0000","last_became_active":"2023-11-24T06:33:01.113301+0000","last_became_peered":"2023-11-24T06:33:01.113301+0000","last_unstale":"2023-11-24T06:33:02.465581+0000","last_undegraded":"2023-11-24T06:33:02.465581+0000","last_fullsized":"2023-11-24T06:33:02.465581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:51.859171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465286+0000","last_change":"2023-11-24T06:33:00.110445+0000","last_active":"2023-11-24T06:33:02.465286+0000","last_peered":"2023-11-24T06:33:02.465286+0000","last_clean":"2023-11-24T06:33:02.465286+0000","last_became_active":"2023-11-24T06:33:00.110092+0000","last_became_peered":"2023-11-24T06:33:00.110092+0000","last_unstale":"2023-11-24T06:33:02.465286+0000","last_undegraded":"2023-11-24T06:33:02.465286+0000","last_fullsized":"2023-11-24T06:33:02.465286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:27.390662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465749+0000","last_change":"2023-11-24T06:33:01.113233+0000","last_active":"2023-11-24T06:33:02.465749+0000","last_peered":"2023-11-24T06:33:02.465749+0000","last_clean":"2023-11-24T06:33:02.465749+0000","last_became_active":"2023-11-24T06:33:01.112941+0000","last_became_peered":"2023-11-24T06:33:01.112941+0000","last_unstale":"2023-11-24T06:33:02.465749+0000","last_undegraded":"2023-11-24T06:33:02.465749+0000","last_fullsized":"2023-11-24T06:33:02.465749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:46.769685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464226+0000","last_change":"2023-11-24T06:33:00.104785+0000","last_active":"2023-11-24T06:33:02.464226+0000","last_peered":"2023-11-24T06:33:02.464226+0000","last_clean":"2023-11-24T06:33:02.464226+0000","last_became_active":"2023-11-24T06:33:00.104469+0000","last_became_peered":"2023-11-24T06:33:00.104469+0000","last_unstale":"2023-11-24T06:33:02.464226+0000","last_undegraded":"2023-11-24T06:33:02.464226+0000","last_fullsized":"2023-11-24T06:33:02.464226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:02.248865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092968+0000","last_change":"2023-11-24T06:33:01.107155+0000","last_active":"2023-11-24T06:33:02.092968+0000","last_peered":"2023-11-24T06:33:02.092968+0000","last_clean":"2023-11-24T06:33:02.092968+0000","last_became_active":"2023-11-24T06:33:01.106521+0000","last_became_peered":"2023-11-24T06:33:01.106521+0000","last_unstale":"2023-11-24T06:33:02.092968+0000","last_undegraded":"2023-11-24T06:33:02.092968+0000","last_fullsized":"2023-11-24T06:33:02.092968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:06:31.929818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090674+0000","last_change":"2023-11-24T06:33:00.112422+0000","last_active":"2023-11-24T06:33:02.090674+0000","last_peered":"2023-11-24T06:33:02.090674+0000","last_clean":"2023-11-24T06:33:02.090674+0000","last_became_active":"2023-11-24T06:33:00.112071+0000","last_became_peered":"2023-11-24T06:33:00.112071+0000","last_unstale":"2023-11-24T06:33:02.090674+0000","last_undegraded":"2023-11-24T06:33:02.090674+0000","last_fullsized":"2023-11-24T06:33:02.090674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:35.656126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.093075+0000","last_change":"2023-11-24T06:33:01.100636+0000","last_active":"2023-11-24T06:33:02.093075+0000","last_peered":"2023-11-24T06:33:02.093075+0000","last_clean":"2023-11-24T06:33:02.093075+0000","last_became_active":"2023-11-24T06:33:01.100344+0000","last_became_peered":"2023-11-24T06:33:01.100344+0000","last_unstale":"2023-11-24T06:33:02.093075+0000","last_undegraded":"2023-11-24T06:33:02.093075+0000","last_fullsized":"2023-11-24T06:33:02.093075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:05:53.160528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334447+0000","last_change":"2023-11-24T06:33:00.108354+0000","last_active":"2023-11-24T06:33:02.334447+0000","last_peered":"2023-11-24T06:33:02.334447+0000","last_clean":"2023-11-24T06:33:02.334447+0000","last_became_active":"2023-11-24T06:33:00.107998+0000","last_became_peered":"2023-11-24T06:33:00.107998+0000","last_unstale":"2023-11-24T06:33:02.334447+0000","last_undegraded":"2023-11-24T06:33:02.334447+0000","last_fullsized":"2023-11-24T06:33:02.334447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:50.852632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465459+0000","last_change":"2023-11-24T06:33:01.113697+0000","last_active":"2023-11-24T06:33:02.465459+0000","last_peered":"2023-11-24T06:33:02.465459+0000","last_clean":"2023-11-24T06:33:02.465459+0000","last_became_active":"2023-11-24T06:33:01.113399+0000","last_became_peered":"2023-11-24T06:33:01.113399+0000","last_unstale":"2023-11-24T06:33:02.465459+0000","last_undegraded":"2023-11-24T06:33:02.465459+0000","last_fullsized":"2023-11-24T06:33:02.465459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:43:05.744195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334337+0000","last_change":"2023-11-24T06:33:00.107198+0000","last_active":"2023-11-24T06:33:02.334337+0000","last_peered":"2023-11-24T06:33:02.334337+0000","last_clean":"2023-11-24T06:33:02.334337+0000","last_became_active":"2023-11-24T06:33:00.106883+0000","last_became_peered":"2023-11-24T06:33:00.106883+0000","last_unstale":"2023-11-24T06:33:02.334337+0000","last_undegraded":"2023-11-24T06:33:02.334337+0000","last_fullsized":"2023-11-24T06:33:02.334337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:28.407375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464465+0000","last_change":"2023-11-24T06:33:01.116582+0000","last_active":"2023-11-24T06:33:02.464465+0000","last_peered":"2023-11-24T06:33:02.464465+0000","last_clean":"2023-11-24T06:33:02.464465+0000","last_became_active":"2023-11-24T06:33:01.116248+0000","last_became_peered":"2023-11-24T06:33:01.116248+0000","last_unstale":"2023-11-24T06:33:02.464465+0000","last_undegraded":"2023-11-24T06:33:02.464465+0000","last_fullsized":"2023-11-24T06:33:02.464465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:06:20.540548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"84'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333947+0000","last_change":"2023-11-24T06:33:00.117748+0000","last_active":"2023-11-24T06:33:02.333947+0000","last_peered":"2023-11-24T06:33:02.333947+0000","last_clean":"2023-11-24T06:33:02.333947+0000","last_became_active":"2023-11-24T06:33:00.117495+0000","last_became_peered":"2023-11-24T06:33:00.117495+0000","last_unstale":"2023-11-24T06:33:02.333947+0000","last_undegraded":"2023-11-24T06:33:02.333947+0000","last_fullsized":"2023-11-24T06:33:02.333947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:26.396465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465651+0000","last_change":"2023-11-24T06:33:01.129862+0000","last_active":"2023-11-24T06:33:02.465651+0000","last_peered":"2023-11-24T06:33:02.465651+0000","last_clean":"2023-11-24T06:33:02.465651+0000","last_became_active":"2023-11-24T06:33:01.129539+0000","last_became_peered":"2023-11-24T06:33:01.129539+0000","last_unstale":"2023-11-24T06:33:02.465651+0000","last_undegraded":"2023-11-24T06:33:02.465651+0000","last_fullsized":"2023-11-24T06:33:02.465651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:15.054108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"84'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465444+0000","last_change":"2023-11-24T06:33:00.109463+0000","last_active":"2023-11-24T06:33:02.465444+0000","last_peered":"2023-11-24T06:33:02.465444+0000","last_clean":"2023-11-24T06:33:02.465444+0000","last_became_active":"2023-11-24T06:33:00.109064+0000","last_became_peered":"2023-11-24T06:33:00.109064+0000","last_unstale":"2023-11-24T06:33:02.465444+0000","last_undegraded":"2023-11-24T06:33:02.465444+0000","last_fullsized":"2023-11-24T06:33:02.465444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:39.147169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464320+0000","last_change":"2023-11-24T06:33:01.125683+0000","last_active":"2023-11-24T06:33:02.464320+0000","last_peered":"2023-11-24T06:33:02.464320+0000","last_clean":"2023-11-24T06:33:02.464320+0000","last_became_active":"2023-11-24T06:33:01.125427+0000","last_became_peered":"2023-11-24T06:33:01.125427+0000","last_unstale":"2023-11-24T06:33:02.464320+0000","last_undegraded":"2023-11-24T06:33:02.464320+0000","last_fullsized":"2023-11-24T06:33:02.464320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:25.845112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091734+0000","last_change":"2023-11-24T06:33:00.100467+0000","last_active":"2023-11-24T06:33:02.091734+0000","last_peered":"2023-11-24T06:33:02.091734+0000","last_clean":"2023-11-24T06:33:02.091734+0000","last_became_active":"2023-11-24T06:33:00.100154+0000","last_became_peered":"2023-11-24T06:33:00.100154+0000","last_unstale":"2023-11-24T06:33:02.091734+0000","last_undegraded":"2023-11-24T06:33:02.091734+0000","last_fullsized":"2023-11-24T06:33:02.091734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:43.509323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466499+0000","last_change":"2023-11-24T06:33:01.120745+0000","last_active":"2023-11-24T06:33:02.466499+0000","last_peered":"2023-11-24T06:33:02.466499+0000","last_clean":"2023-11-24T06:33:02.466499+0000","last_became_active":"2023-11-24T06:33:01.119944+0000","last_became_peered":"2023-11-24T06:33:01.119944+0000","last_unstale":"2023-11-24T06:33:02.466499+0000","last_undegraded":"2023-11-24T06:33:02.466499+0000","last_fullsized":"2023-11-24T06:33:02.466499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:13.968584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092609+0000","last_change":"2023-11-24T06:33:00.109027+0000","last_active":"2023-11-24T06:33:02.092609+0000","last_peered":"2023-11-24T06:33:02.092609+0000","last_clean":"2023-11-24T06:33:02.092609+0000","last_became_active":"2023-11-24T06:33:00.108765+0000","last_became_peered":"2023-11-24T06:33:00.108765+0000","last_unstale":"2023-11-24T06:33:02.092609+0000","last_undegraded":"2023-11-24T06:33:02.092609+0000","last_fullsized":"2023-11-24T06:33:02.092609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:43:21.615743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090599+0000","last_change":"2023-11-24T06:33:01.110976+0000","last_active":"2023-11-24T06:33:02.090599+0000","last_peered":"2023-11-24T06:33:02.090599+0000","last_clean":"2023-11-24T06:33:02.090599+0000","last_became_active":"2023-11-24T06:33:01.110598+0000","last_became_peered":"2023-11-24T06:33:01.110598+0000","last_unstale":"2023-11-24T06:33:02.090599+0000","last_undegraded":"2023-11-24T06:33:02.090599+0000","last_fullsized":"2023-11-24T06:33:02.090599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:00.158544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465243+0000","last_change":"2023-11-24T06:33:00.107228+0000","last_active":"2023-11-24T06:33:02.465243+0000","last_peered":"2023-11-24T06:33:02.465243+0000","last_clean":"2023-11-24T06:33:02.465243+0000","last_became_active":"2023-11-24T06:33:00.106906+0000","last_became_peered":"2023-11-24T06:33:00.106906+0000","last_unstale":"2023-11-24T06:33:02.465243+0000","last_undegraded":"2023-11-24T06:33:02.465243+0000","last_fullsized":"2023-11-24T06:33:02.465243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:24.376758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090615+0000","last_change":"2023-11-24T06:33:01.095671+0000","last_active":"2023-11-24T06:33:02.090615+0000","last_peered":"2023-11-24T06:33:02.090615+0000","last_clean":"2023-11-24T06:33:02.090615+0000","last_became_active":"2023-11-24T06:33:01.095408+0000","last_became_peered":"2023-11-24T06:33:01.095408+0000","last_unstale":"2023-11-24T06:33:02.090615+0000","last_undegraded":"2023-11-24T06:33:02.090615+0000","last_fullsized":"2023-11-24T06:33:02.090615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:59:55.888136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"84'8","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464094+0000","last_change":"2023-11-24T06:33:00.101828+0000","last_active":"2023-11-24T06:33:02.464094+0000","last_peered":"2023-11-24T06:33:02.464094+0000","last_clean":"2023-11-24T06:33:02.464094+0000","last_became_active":"2023-11-24T06:33:00.101532+0000","last_became_peered":"2023-11-24T06:33:00.101532+0000","last_unstale":"2023-11-24T06:33:02.464094+0000","last_undegraded":"2023-11-24T06:33:02.464094+0000","last_fullsized":"2023-11-24T06:33:02.464094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:03.711251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466424+0000","last_change":"2023-11-24T06:33:01.105712+0000","last_active":"2023-11-24T06:33:02.466424+0000","last_peered":"2023-11-24T06:33:02.466424+0000","last_clean":"2023-11-24T06:33:02.466424+0000","last_became_active":"2023-11-24T06:33:01.105424+0000","last_became_peered":"2023-11-24T06:33:01.105424+0000","last_unstale":"2023-11-24T06:33:02.466424+0000","last_undegraded":"2023-11-24T06:33:02.466424+0000","last_fullsized":"2023-11-24T06:33:02.466424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:06:20.540548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334499+0000","last_change":"2023-11-24T06:33:00.102149+0000","last_active":"2023-11-24T06:33:02.334499+0000","last_peered":"2023-11-24T06:33:02.334499+0000","last_clean":"2023-11-24T06:33:02.334499+0000","last_became_active":"2023-11-24T06:33:00.101859+0000","last_became_peered":"2023-11-24T06:33:00.101859+0000","last_unstale":"2023-11-24T06:33:02.334499+0000","last_undegraded":"2023-11-24T06:33:02.334499+0000","last_fullsized":"2023-11-24T06:33:02.334499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:43:04.737656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334332+0000","last_change":"2023-11-24T06:33:01.107458+0000","last_active":"2023-11-24T06:33:02.334332+0000","last_peered":"2023-11-24T06:33:02.334332+0000","last_clean":"2023-11-24T06:33:02.334332+0000","last_became_active":"2023-11-24T06:33:01.107073+0000","last_became_peered":"2023-11-24T06:33:01.107073+0000","last_unstale":"2023-11-24T06:33:02.334332+0000","last_undegraded":"2023-11-24T06:33:02.334332+0000","last_fullsized":"2023-11-24T06:33:02.334332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:54:02.824488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464450+0000","last_change":"2023-11-24T06:33:00.113036+0000","last_active":"2023-11-24T06:33:02.464450+0000","last_peered":"2023-11-24T06:33:02.464450+0000","last_clean":"2023-11-24T06:33:02.464450+0000","last_became_active":"2023-11-24T06:33:00.112771+0000","last_became_peered":"2023-11-24T06:33:00.112771+0000","last_unstale":"2023-11-24T06:33:02.464450+0000","last_undegraded":"2023-11-24T06:33:02.464450+0000","last_fullsized":"2023-11-24T06:33:02.464450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:45.870822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465935+0000","last_change":"2023-11-24T06:33:01.103929+0000","last_active":"2023-11-24T06:33:02.465935+0000","last_peered":"2023-11-24T06:33:02.465935+0000","last_clean":"2023-11-24T06:33:02.465935+0000","last_became_active":"2023-11-24T06:33:01.103667+0000","last_became_peered":"2023-11-24T06:33:01.103667+0000","last_unstale":"2023-11-24T06:33:02.465935+0000","last_undegraded":"2023-11-24T06:33:02.465935+0000","last_fullsized":"2023-11-24T06:33:02.465935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:10:01.556975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464562+0000","last_change":"2023-11-24T06:33:00.104867+0000","last_active":"2023-11-24T06:33:02.464562+0000","last_peered":"2023-11-24T06:33:02.464562+0000","last_clean":"2023-11-24T06:33:02.464562+0000","last_became_active":"2023-11-24T06:33:00.104620+0000","last_became_peered":"2023-11-24T06:33:00.104620+0000","last_unstale":"2023-11-24T06:33:02.464562+0000","last_undegraded":"2023-11-24T06:33:02.464562+0000","last_fullsized":"2023-11-24T06:33:02.464562+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:45.763146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091481+0000","last_change":"2023-11-24T06:33:01.123829+0000","last_active":"2023-11-24T06:33:02.091481+0000","last_peered":"2023-11-24T06:33:02.091481+0000","last_clean":"2023-11-24T06:33:02.091481+0000","last_became_active":"2023-11-24T06:33:01.123483+0000","last_became_peered":"2023-11-24T06:33:01.123483+0000","last_unstale":"2023-11-24T06:33:02.091481+0000","last_undegraded":"2023-11-24T06:33:02.091481+0000","last_fullsized":"2023-11-24T06:33:02.091481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:51.857305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092759+0000","last_change":"2023-11-24T06:33:00.108961+0000","last_active":"2023-11-24T06:33:02.092759+0000","last_peered":"2023-11-24T06:33:02.092759+0000","last_clean":"2023-11-24T06:33:02.092759+0000","last_became_active":"2023-11-24T06:33:00.108682+0000","last_became_peered":"2023-11-24T06:33:00.108682+0000","last_unstale":"2023-11-24T06:33:02.092759+0000","last_undegraded":"2023-11-24T06:33:02.092759+0000","last_fullsized":"2023-11-24T06:33:02.092759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:01.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465161+0000","last_change":"2023-11-24T06:33:01.104798+0000","last_active":"2023-11-24T06:33:02.465161+0000","last_peered":"2023-11-24T06:33:02.465161+0000","last_clean":"2023-11-24T06:33:02.465161+0000","last_became_active":"2023-11-24T06:33:01.104371+0000","last_became_peered":"2023-11-24T06:33:01.104371+0000","last_unstale":"2023-11-24T06:33:02.465161+0000","last_undegraded":"2023-11-24T06:33:02.465161+0000","last_fullsized":"2023-11-24T06:33:02.465161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:18:29.156927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091577+0000","last_change":"2023-11-24T06:33:00.104672+0000","last_active":"2023-11-24T06:33:02.091577+0000","last_peered":"2023-11-24T06:33:02.091577+0000","last_clean":"2023-11-24T06:33:02.091577+0000","last_became_active":"2023-11-24T06:33:00.104405+0000","last_became_peered":"2023-11-24T06:33:00.104405+0000","last_unstale":"2023-11-24T06:33:02.091577+0000","last_undegraded":"2023-11-24T06:33:02.091577+0000","last_fullsized":"2023-11-24T06:33:02.091577+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:23:02.436395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090635+0000","last_change":"2023-11-24T06:33:01.109804+0000","last_active":"2023-11-24T06:33:02.090635+0000","last_peered":"2023-11-24T06:33:02.090635+0000","last_clean":"2023-11-24T06:33:02.090635+0000","last_became_active":"2023-11-24T06:33:01.107758+0000","last_became_peered":"2023-11-24T06:33:01.107758+0000","last_unstale":"2023-11-24T06:33:02.090635+0000","last_undegraded":"2023-11-24T06:33:02.090635+0000","last_fullsized":"2023-11-24T06:33:02.090635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:45.913897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090893+0000","last_change":"2023-11-24T06:33:00.110308+0000","last_active":"2023-11-24T06:33:02.090893+0000","last_peered":"2023-11-24T06:33:02.090893+0000","last_clean":"2023-11-24T06:33:02.090893+0000","last_became_active":"2023-11-24T06:33:00.110046+0000","last_became_peered":"2023-11-24T06:33:00.110046+0000","last_unstale":"2023-11-24T06:33:02.090893+0000","last_undegraded":"2023-11-24T06:33:02.090893+0000","last_fullsized":"2023-11-24T06:33:02.090893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:17.879168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465148+0000","last_change":"2023-11-24T06:33:01.125133+0000","last_active":"2023-11-24T06:33:02.465148+0000","last_peered":"2023-11-24T06:33:02.465148+0000","last_clean":"2023-11-24T06:33:02.465148+0000","last_became_active":"2023-11-24T06:33:01.124848+0000","last_became_peered":"2023-11-24T06:33:01.124848+0000","last_unstale":"2023-11-24T06:33:02.465148+0000","last_undegraded":"2023-11-24T06:33:02.465148+0000","last_fullsized":"2023-11-24T06:33:02.465148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:30.613643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092438+0000","last_change":"2023-11-24T06:33:00.104850+0000","last_active":"2023-11-24T06:33:02.092438+0000","last_peered":"2023-11-24T06:33:02.092438+0000","last_clean":"2023-11-24T06:33:02.092438+0000","last_became_active":"2023-11-24T06:33:00.104293+0000","last_became_peered":"2023-11-24T06:33:00.104293+0000","last_unstale":"2023-11-24T06:33:02.092438+0000","last_undegraded":"2023-11-24T06:33:02.092438+0000","last_fullsized":"2023-11-24T06:33:02.092438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:12.962046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466117+0000","last_change":"2023-11-24T06:33:01.105189+0000","last_active":"2023-11-24T06:33:02.466117+0000","last_peered":"2023-11-24T06:33:02.466117+0000","last_clean":"2023-11-24T06:33:02.466117+0000","last_became_active":"2023-11-24T06:33:01.104928+0000","last_became_peered":"2023-11-24T06:33:01.104928+0000","last_unstale":"2023-11-24T06:33:02.466117+0000","last_undegraded":"2023-11-24T06:33:02.466117+0000","last_fullsized":"2023-11-24T06:33:02.466117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:28.806186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091176+0000","last_change":"2023-11-24T06:33:00.109830+0000","last_active":"2023-11-24T06:33:02.091176+0000","last_peered":"2023-11-24T06:33:02.091176+0000","last_clean":"2023-11-24T06:33:02.091176+0000","last_became_active":"2023-11-24T06:33:00.109516+0000","last_became_peered":"2023-11-24T06:33:00.109516+0000","last_unstale":"2023-11-24T06:33:02.091176+0000","last_undegraded":"2023-11-24T06:33:02.091176+0000","last_fullsized":"2023-11-24T06:33:02.091176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:21.514075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466563+0000","last_change":"2023-11-24T06:33:01.106778+0000","last_active":"2023-11-24T06:33:02.466563+0000","last_peered":"2023-11-24T06:33:02.466563+0000","last_clean":"2023-11-24T06:33:02.466563+0000","last_became_active":"2023-11-24T06:33:01.106509+0000","last_became_peered":"2023-11-24T06:33:01.106509+0000","last_unstale":"2023-11-24T06:33:02.466563+0000","last_undegraded":"2023-11-24T06:33:02.466563+0000","last_fullsized":"2023-11-24T06:33:02.466563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:37.769499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091218+0000","last_change":"2023-11-24T06:33:00.106875+0000","last_active":"2023-11-24T06:33:02.091218+0000","last_peered":"2023-11-24T06:33:02.091218+0000","last_clean":"2023-11-24T06:33:02.091218+0000","last_became_active":"2023-11-24T06:33:00.106593+0000","last_became_peered":"2023-11-24T06:33:00.106593+0000","last_unstale":"2023-11-24T06:33:02.091218+0000","last_undegraded":"2023-11-24T06:33:02.091218+0000","last_fullsized":"2023-11-24T06:33:02.091218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:44:17.333403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334233+0000","last_change":"2023-11-24T06:33:01.111086+0000","last_active":"2023-11-24T06:33:02.334233+0000","last_peered":"2023-11-24T06:33:02.334233+0000","last_clean":"2023-11-24T06:33:02.334233+0000","last_became_active":"2023-11-24T06:33:01.110613+0000","last_became_peered":"2023-11-24T06:33:01.110613+0000","last_unstale":"2023-11-24T06:33:02.334233+0000","last_undegraded":"2023-11-24T06:33:02.334233+0000","last_fullsized":"2023-11-24T06:33:02.334233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:03.255404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334087+0000","last_change":"2023-11-24T06:33:00.110763+0000","last_active":"2023-11-24T06:33:02.334087+0000","last_peered":"2023-11-24T06:33:02.334087+0000","last_clean":"2023-11-24T06:33:02.334087+0000","last_became_active":"2023-11-24T06:33:00.110000+0000","last_became_peered":"2023-11-24T06:33:00.110000+0000","last_unstale":"2023-11-24T06:33:02.334087+0000","last_undegraded":"2023-11-24T06:33:02.334087+0000","last_fullsized":"2023-11-24T06:33:02.334087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:24.376758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465822+0000","last_change":"2023-11-24T06:33:01.120956+0000","last_active":"2023-11-24T06:33:02.465822+0000","last_peered":"2023-11-24T06:33:02.465822+0000","last_clean":"2023-11-24T06:33:02.465822+0000","last_became_active":"2023-11-24T06:33:01.120580+0000","last_became_peered":"2023-11-24T06:33:01.120580+0000","last_unstale":"2023-11-24T06:33:02.465822+0000","last_undegraded":"2023-11-24T06:33:02.465822+0000","last_fullsized":"2023-11-24T06:33:02.465822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:23:10.123737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334247+0000","last_change":"2023-11-24T06:33:00.109650+0000","last_active":"2023-11-24T06:33:02.334247+0000","last_peered":"2023-11-24T06:33:02.334247+0000","last_clean":"2023-11-24T06:33:02.334247+0000","last_became_active":"2023-11-24T06:33:00.109402+0000","last_became_peered":"2023-11-24T06:33:00.109402+0000","last_unstale":"2023-11-24T06:33:02.334247+0000","last_undegraded":"2023-11-24T06:33:02.334247+0000","last_fullsized":"2023-11-24T06:33:02.334247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:29.607104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465477+0000","last_change":"2023-11-24T06:33:01.106564+0000","last_active":"2023-11-24T06:33:02.465477+0000","last_peered":"2023-11-24T06:33:02.465477+0000","last_clean":"2023-11-24T06:33:02.465477+0000","last_became_active":"2023-11-24T06:33:01.105019+0000","last_became_peered":"2023-11-24T06:33:01.105019+0000","last_unstale":"2023-11-24T06:33:02.465477+0000","last_undegraded":"2023-11-24T06:33:02.465477+0000","last_fullsized":"2023-11-24T06:33:02.465477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:23:10.123737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464449+0000","last_change":"2023-11-24T06:33:00.101935+0000","last_active":"2023-11-24T06:33:02.464449+0000","last_peered":"2023-11-24T06:33:02.464449+0000","last_clean":"2023-11-24T06:33:02.464449+0000","last_became_active":"2023-11-24T06:33:00.101681+0000","last_became_peered":"2023-11-24T06:33:00.101681+0000","last_unstale":"2023-11-24T06:33:02.464449+0000","last_undegraded":"2023-11-24T06:33:02.464449+0000","last_fullsized":"2023-11-24T06:33:02.464449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:48.600329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464335+0000","last_change":"2023-11-24T06:33:01.123537+0000","last_active":"2023-11-24T06:33:02.464335+0000","last_peered":"2023-11-24T06:33:02.464335+0000","last_clean":"2023-11-24T06:33:02.464335+0000","last_became_active":"2023-11-24T06:33:01.123200+0000","last_became_peered":"2023-11-24T06:33:01.123200+0000","last_unstale":"2023-11-24T06:33:02.464335+0000","last_undegraded":"2023-11-24T06:33:02.464335+0000","last_fullsized":"2023-11-24T06:33:02.464335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:46.640977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465360+0000","last_change":"2023-11-24T06:33:00.110313+0000","last_active":"2023-11-24T06:33:02.465360+0000","last_peered":"2023-11-24T06:33:02.465360+0000","last_clean":"2023-11-24T06:33:02.465360+0000","last_became_active":"2023-11-24T06:33:00.110046+0000","last_became_peered":"2023-11-24T06:33:00.110046+0000","last_unstale":"2023-11-24T06:33:02.465360+0000","last_undegraded":"2023-11-24T06:33:02.465360+0000","last_fullsized":"2023-11-24T06:33:02.465360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:26.396465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465848+0000","last_change":"2023-11-24T06:33:01.109419+0000","last_active":"2023-11-24T06:33:02.465848+0000","last_peered":"2023-11-24T06:33:02.465848+0000","last_clean":"2023-11-24T06:33:02.465848+0000","last_became_active":"2023-11-24T06:33:01.109095+0000","last_became_peered":"2023-11-24T06:33:01.109095+0000","last_unstale":"2023-11-24T06:33:02.465848+0000","last_undegraded":"2023-11-24T06:33:02.465848+0000","last_fullsized":"2023-11-24T06:33:02.465848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:49:52.218724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334014+0000","last_change":"2023-11-24T06:33:00.108365+0000","last_active":"2023-11-24T06:33:02.334014+0000","last_peered":"2023-11-24T06:33:02.334014+0000","last_clean":"2023-11-24T06:33:02.334014+0000","last_became_active":"2023-11-24T06:33:00.107976+0000","last_became_peered":"2023-11-24T06:33:00.107976+0000","last_unstale":"2023-11-24T06:33:02.334014+0000","last_undegraded":"2023-11-24T06:33:02.334014+0000","last_fullsized":"2023-11-24T06:33:02.334014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:45.685325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333905+0000","last_change":"2023-11-24T06:33:01.117734+0000","last_active":"2023-11-24T06:33:02.333905+0000","last_peered":"2023-11-24T06:33:02.333905+0000","last_clean":"2023-11-24T06:33:02.333905+0000","last_became_active":"2023-11-24T06:33:01.117527+0000","last_became_peered":"2023-11-24T06:33:01.117527+0000","last_unstale":"2023-11-24T06:33:02.333905+0000","last_undegraded":"2023-11-24T06:33:02.333905+0000","last_fullsized":"2023-11-24T06:33:02.333905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:28.806186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465177+0000","last_change":"2023-11-24T06:33:00.104103+0000","last_active":"2023-11-24T06:33:02.465177+0000","last_peered":"2023-11-24T06:33:02.465177+0000","last_clean":"2023-11-24T06:33:02.465177+0000","last_became_active":"2023-11-24T06:33:00.103841+0000","last_became_peered":"2023-11-24T06:33:00.103841+0000","last_unstale":"2023-11-24T06:33:02.465177+0000","last_undegraded":"2023-11-24T06:33:02.465177+0000","last_fullsized":"2023-11-24T06:33:02.465177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:40.472524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091438+0000","last_change":"2023-11-24T06:33:01.106971+0000","last_active":"2023-11-24T06:33:02.091438+0000","last_peered":"2023-11-24T06:33:02.091438+0000","last_clean":"2023-11-24T06:33:02.091438+0000","last_became_active":"2023-11-24T06:33:01.106720+0000","last_became_peered":"2023-11-24T06:33:01.106720+0000","last_unstale":"2023-11-24T06:33:02.091438+0000","last_undegraded":"2023-11-24T06:33:02.091438+0000","last_fullsized":"2023-11-24T06:33:02.091438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:40.329776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466611+0000","last_change":"2023-11-24T06:33:00.114816+0000","last_active":"2023-11-24T06:33:02.466611+0000","last_peered":"2023-11-24T06:33:02.466611+0000","last_clean":"2023-11-24T06:33:02.466611+0000","last_became_active":"2023-11-24T06:33:00.114524+0000","last_became_peered":"2023-11-24T06:33:00.114524+0000","last_unstale":"2023-11-24T06:33:02.466611+0000","last_undegraded":"2023-11-24T06:33:02.466611+0000","last_fullsized":"2023-11-24T06:33:02.466611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:45.870822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-24T06:33:01.098125+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:33:01.098125+0000","last_peered":"2023-11-24T06:33:01.098125+0000","last_clean":"2023-11-24T06:33:01.098125+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:01.098125+0000","last_undegraded":"2023-11-24T06:33:01.098125+0000","last_fullsized":"2023-11-24T06:33:01.098125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1642496,"data_stored":1037297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.619,"15min":1.619},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99099999999999999,"5min":1.417,"15min":1.417},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.97699999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":1.7,"15min":1.7},"last":0.629}]},{"osd":2,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78400000000000003,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.92600000000000005,"5min":1.55,"15min":1.55},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92600000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":447553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":2.637,"15min":2.637},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96799999999999997,"5min":1.619,"15min":1.619},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85799999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99399999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.754}]},{"osd":3,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.86899999999999999},"min":{"1min":0.504,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88}]},{"osd":4,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.72499999999999998,"15min":0.77500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":1.036,"15min":1.036},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":448493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.278,"15min":1.278},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.294,"5min":1.919,"15min":1.919},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.3500000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.75},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.427,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5189999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4059999999999999,"5min":1.998,"15min":1.998},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.274,"5min":1.343,"15min":1.343},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.63}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.462,"15min":1.462},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":440531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.022},"last":0.62},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.876,"5min":1.202,"15min":1.202},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94199999999999995,"5min":1.248,"15min":1.248},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.079,"15min":1.079},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.002,"5min":1.149,"15min":1.149},"last":0.88600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":448471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.629,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.625,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55500000000000005,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":1.095,"15min":1.095},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93300000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92400000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.264}]},{"osd":6,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.264,"15min":1.264},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.286,"15min":1.286},"last":1.2410000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88100000000000001,"5min":1.409,"15min":1.409},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.78100000000000003,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94699999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.121}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":447441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.43099999999999999,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51300000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63900000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49199999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59399999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88900000000000001,"5min":1.075,"15min":1.075},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83699999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.27,"15min":1.27},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":1.389,"15min":1.389},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83499999999999996,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.874,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.93000000000000005,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":447053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.044,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.877,"5min":1.02,"15min":1.02},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81000000000000005,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":1.048,"15min":1.048},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0940000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1638400,"data_stored":1036292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":1.393,"15min":1.393},"last":0.312},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66100000000000003,"5min":1.319,"15min":1.319},"last":0.374}]},{"osd":2,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0049999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71199999999999997,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.589,"15min":1.589},"last":0.437}]},{"osd":4,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.81200000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.778,"15min":1.778},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4099999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0089999999999999,"5min":1.496,"15min":1.496},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3740000000000001,"5min":1.454,"15min":1.454},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81100000000000005,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.829,"15min":1.829},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:05.184 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:05.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 Processor -- start 2023-11-24T06:33:05.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 -- start start 2023-11-24T06:33:05.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ea815a320 0x7f9ea80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ea8070bd0 0x7f9ea8071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80b2430 con 0x7f9ea8070bd0 2023-11-24T06:33:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea815a700 con 0x7f9ea815a320 2023-11-24T06:33:05.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9eacf72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8071580 con 0x7f9ea80b36c0 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ea8070bd0 0x7f9ea8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ea8070bd0 0x7f9ea8071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51368/0 (socket says 172.21.15.143:51368) 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea659c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ea815a320 0x7f9ea80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 -- 172.21.15.143:0/120564283 learned_addr learned my addr 172.21.15.143:0/120564283 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea5d9b640 1 --2- 172.21.15.143:0/120564283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 -- 172.21.15.143:0/120564283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 msgr2=0x7f9ea8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 --2- 172.21.15.143:0/120564283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 -- 172.21.15.143:0/120564283 >> v2:172.21.15.146:3300/0 conn(0x7f9ea815a320 msgr2=0x7f9ea80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 --2- 172.21.15.143:0/120564283 >> v2:172.21.15.146:3300/0 conn(0x7f9ea815a320 0x7f9ea80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea6d9d640 1 -- 172.21.15.143:0/120564283 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80b2620 con 0x7f9ea8070bd0 2023-11-24T06:33:05.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.352+0000 7f9ea659c640 1 --2- 172.21.15.143:0/120564283 >> v2:172.21.15.146:3300/0 conn(0x7f9ea815a320 0x7f9ea80b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:05.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9ea6d9d640 1 --2- 172.21.15.143:0/120564283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8071040 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9ea806c0c0 tx=0x7f9ea001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbee469a6104d9d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:05.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9ea559a640 1 -- 172.21.15.143:0/120564283 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000b2d0 con 0x7f9ea8070bd0 2023-11-24T06:33:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9ea559a640 1 -- 172.21.15.143:0/120564283 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea000b430 con 0x7f9ea8070bd0 2023-11-24T06:33:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9ea559a640 1 -- 172.21.15.143:0/120564283 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00a7b50 con 0x7f9ea8070bd0 2023-11-24T06:33:05.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 -- 172.21.15.143:0/120564283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 msgr2=0x7f9ea8071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 --2- 172.21.15.143:0/120564283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8071040 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9ea806c0c0 tx=0x7f9ea001eba0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 -- 172.21.15.143:0/120564283 shutdown_connections 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 --2- 172.21.15.143:0/120564283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8071040 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 --2- 172.21.15.143:0/120564283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 --2- 172.21.15.143:0/120564283 >> v2:172.21.15.146:3300/0 conn(0x7f9ea815a320 0x7f9ea80b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 -- 172.21.15.143:0/120564283 >> 172.21.15.143:0/120564283 conn(0x7f9ea80b0bf0 msgr2=0x7f9ea80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 -- 172.21.15.143:0/120564283 shutdown_connections 2023-11-24T06:33:05.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.356+0000 7f9eacf72640 1 -- 172.21.15.143:0/120564283 wait complete. 2023-11-24T06:33:05.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 Processor -- start 2023-11-24T06:33:05.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 -- start start 2023-11-24T06:33:05.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a320 0x7f9ea8158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81535f0 con 0x7f9ea8070bd0 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8152550 con 0x7f9ea815a320 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8152830 con 0x7f9ea80b36c0 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51380/0 (socket says 172.21.15.143:51380) 2023-11-24T06:33:05.368 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 -- 172.21.15.143:0/216853486 learned_addr learned my addr 172.21.15.143:0/216853486 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:05.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea5d9b640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea6d9d640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a320 0x7f9ea8158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 -- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 msgr2=0x7f9ea8151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 -- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a320 msgr2=0x7f9ea8158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a320 0x7f9ea8158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 -- 172.21.15.143:0/216853486 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009420 con 0x7f9ea8070bd0 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea6d9d640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a320 0x7f9ea8158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea5d9b640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9ea659c640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8151f70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800e980 tx=0x7f9e9800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:05.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800ca00 con 0x7f9ea8070bd0 2023-11-24T06:33:05.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800cb60 con 0x7f9ea8070bd0 2023-11-24T06:33:05.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea000bd40 con 0x7f9ea8070bd0 2023-11-24T06:33:05.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.360+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98013470 con 0x7f9ea8070bd0 2023-11-24T06:33:05.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea81530d0 con 0x7f9ea8070bd0 2023-11-24T06:33:05.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea8152a50 con 0x7f9ea8070bd0 2023-11-24T06:33:05.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f9e980135d0 con 0x7f9ea8070bd0 2023-11-24T06:33:05.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9e96ffd640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9e88066a10 0x7f9e88068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9e98084b50 con 0x7f9ea8070bd0 2023-11-24T06:33:05.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9ea5d9b640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9e88066a10 0x7f9e88068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.372 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.364+0000 7f9ea5d9b640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9e88066a10 0x7f9e88068ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ea81561a0 tx=0x7f9e9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:05.376 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.368+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e98051700 con 0x7f9ea8070bd0 2023-11-24T06:33:05.523 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.516+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ea8152c70 con 0x7f9e88066a10 2023-11-24T06:33:05.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.524+0000 7f9e96ffd640 1 -- 172.21.15.143:0/216853486 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288715 (secure 0 0 0) 0x7f9e9c0096d0 con 0x7f9e88066a10 2023-11-24T06:33:05.533 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:05.537 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9e88066a10 msgr2=0x7f9e88068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9e88066a10 0x7f9e88068ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ea81561a0 tx=0x7f9e9c008040 comp rx=0 tx=0).stop 2023-11-24T06:33:05.538 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 msgr2=0x7f9ea8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8151f70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800e980 tx=0x7f9e9800ee40 comp rx=0 tx=0).stop 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 shutdown_connections 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9e88066a10 0x7f9e88068ed0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a320 0x7f9ea8158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ea80b36c0 0x7f9ea8151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 --2- 172.21.15.143:0/216853486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ea8070bd0 0x7f9ea8151f70 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 >> 172.21.15.143:0/216853486 conn(0x7f9ea80b0bf0 msgr2=0x7f9ea8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 shutdown_connections 2023-11-24T06:33:05.539 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.528+0000 7f9eacf72640 1 -- 172.21.15.143:0/216853486 wait complete. 2023-11-24T06:33:05.553 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-24T06:33:04.244338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258828,"kb_used_data":9368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715892,"statfs":{"total":773094113280,"available":772829073408,"internally_reserved":0,"allocated":9592832,"data_stored":4753131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.168387"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334212+0000","last_change":"2023-11-24T06:33:01.107950+0000","last_active":"2023-11-24T06:33:02.334212+0000","last_peered":"2023-11-24T06:33:02.334212+0000","last_clean":"2023-11-24T06:33:02.334212+0000","last_became_active":"2023-11-24T06:33:01.107705+0000","last_became_peered":"2023-11-24T06:33:01.107705+0000","last_unstale":"2023-11-24T06:33:02.334212+0000","last_undegraded":"2023-11-24T06:33:02.334212+0000","last_fullsized":"2023-11-24T06:33:02.334212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:04.717790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091145+0000","last_change":"2023-11-24T06:33:01.097681+0000","last_active":"2023-11-24T06:33:02.091145+0000","last_peered":"2023-11-24T06:33:02.091145+0000","last_clean":"2023-11-24T06:33:02.091145+0000","last_became_active":"2023-11-24T06:33:01.097463+0000","last_became_peered":"2023-11-24T06:33:01.097463+0000","last_unstale":"2023-11-24T06:33:02.091145+0000","last_undegraded":"2023-11-24T06:33:02.091145+0000","last_fullsized":"2023-11-24T06:33:02.091145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:21.519447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466529+0000","last_change":"2023-11-24T06:33:01.109074+0000","last_active":"2023-11-24T06:33:02.466529+0000","last_peered":"2023-11-24T06:33:02.466529+0000","last_clean":"2023-11-24T06:33:02.466529+0000","last_became_active":"2023-11-24T06:33:01.106689+0000","last_became_peered":"2023-11-24T06:33:01.106689+0000","last_unstale":"2023-11-24T06:33:02.466529+0000","last_undegraded":"2023-11-24T06:33:02.466529+0000","last_fullsized":"2023-11-24T06:33:02.466529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:12.117735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091402+0000","last_change":"2023-11-24T06:33:01.123968+0000","last_active":"2023-11-24T06:33:02.091402+0000","last_peered":"2023-11-24T06:33:02.091402+0000","last_clean":"2023-11-24T06:33:02.091402+0000","last_became_active":"2023-11-24T06:33:01.123668+0000","last_became_peered":"2023-11-24T06:33:01.123668+0000","last_unstale":"2023-11-24T06:33:02.091402+0000","last_undegraded":"2023-11-24T06:33:02.091402+0000","last_fullsized":"2023-11-24T06:33:02.091402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:24:23.055838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465912+0000","last_change":"2023-11-24T06:33:01.114048+0000","last_active":"2023-11-24T06:33:02.465912+0000","last_peered":"2023-11-24T06:33:02.465912+0000","last_clean":"2023-11-24T06:33:02.465912+0000","last_became_active":"2023-11-24T06:33:01.113630+0000","last_became_peered":"2023-11-24T06:33:01.113630+0000","last_unstale":"2023-11-24T06:33:02.465912+0000","last_undegraded":"2023-11-24T06:33:02.465912+0000","last_fullsized":"2023-11-24T06:33:02.465912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:15.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465321+0000","last_change":"2023-11-24T06:33:01.114340+0000","last_active":"2023-11-24T06:33:02.465321+0000","last_peered":"2023-11-24T06:33:02.465321+0000","last_clean":"2023-11-24T06:33:02.465321+0000","last_became_active":"2023-11-24T06:33:01.114011+0000","last_became_peered":"2023-11-24T06:33:01.114011+0000","last_unstale":"2023-11-24T06:33:02.465321+0000","last_undegraded":"2023-11-24T06:33:02.465321+0000","last_fullsized":"2023-11-24T06:33:02.465321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:51.859171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090841+0000","last_change":"2023-11-24T06:33:01.114110+0000","last_active":"2023-11-24T06:33:02.090841+0000","last_peered":"2023-11-24T06:33:02.090841+0000","last_clean":"2023-11-24T06:33:02.090841+0000","last_became_active":"2023-11-24T06:33:01.113793+0000","last_became_peered":"2023-11-24T06:33:01.113793+0000","last_unstale":"2023-11-24T06:33:02.090841+0000","last_undegraded":"2023-11-24T06:33:02.090841+0000","last_fullsized":"2023-11-24T06:33:02.090841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:21.794803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465119+0000","last_change":"2023-11-24T06:33:01.104742+0000","last_active":"2023-11-24T06:33:02.465119+0000","last_peered":"2023-11-24T06:33:02.465119+0000","last_clean":"2023-11-24T06:33:02.465119+0000","last_became_active":"2023-11-24T06:33:01.104310+0000","last_became_peered":"2023-11-24T06:33:01.104310+0000","last_unstale":"2023-11-24T06:33:02.465119+0000","last_undegraded":"2023-11-24T06:33:02.465119+0000","last_fullsized":"2023-11-24T06:33:02.465119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:29.413914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465394+0000","last_change":"2023-11-24T06:33:01.129482+0000","last_active":"2023-11-24T06:33:02.465394+0000","last_peered":"2023-11-24T06:33:02.465394+0000","last_clean":"2023-11-24T06:33:02.465394+0000","last_became_active":"2023-11-24T06:33:01.129210+0000","last_became_peered":"2023-11-24T06:33:01.129210+0000","last_unstale":"2023-11-24T06:33:02.465394+0000","last_undegraded":"2023-11-24T06:33:02.465394+0000","last_fullsized":"2023-11-24T06:33:02.465394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:15.054108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334308+0000","last_change":"2023-11-24T06:33:01.100690+0000","last_active":"2023-11-24T06:33:02.334308+0000","last_peered":"2023-11-24T06:33:02.334308+0000","last_clean":"2023-11-24T06:33:02.334308+0000","last_became_active":"2023-11-24T06:33:01.100384+0000","last_became_peered":"2023-11-24T06:33:01.100384+0000","last_unstale":"2023-11-24T06:33:02.334308+0000","last_undegraded":"2023-11-24T06:33:02.334308+0000","last_fullsized":"2023-11-24T06:33:02.334308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:49.606868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091016+0000","last_change":"2023-11-24T06:33:01.105880+0000","last_active":"2023-11-24T06:33:02.091016+0000","last_peered":"2023-11-24T06:33:02.091016+0000","last_clean":"2023-11-24T06:33:02.091016+0000","last_became_active":"2023-11-24T06:33:01.105130+0000","last_became_peered":"2023-11-24T06:33:01.105130+0000","last_unstale":"2023-11-24T06:33:02.091016+0000","last_undegraded":"2023-11-24T06:33:02.091016+0000","last_fullsized":"2023-11-24T06:33:02.091016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:45.580395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333867+0000","last_change":"2023-11-24T06:33:01.101650+0000","last_active":"2023-11-24T06:33:02.333867+0000","last_peered":"2023-11-24T06:33:02.333867+0000","last_clean":"2023-11-24T06:33:02.333867+0000","last_became_active":"2023-11-24T06:33:01.100765+0000","last_became_peered":"2023-11-24T06:33:01.100765+0000","last_unstale":"2023-11-24T06:33:02.333867+0000","last_undegraded":"2023-11-24T06:33:02.333867+0000","last_fullsized":"2023-11-24T06:33:02.333867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:10:01.556975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466120+0000","last_change":"2023-11-24T06:33:01.107686+0000","last_active":"2023-11-24T06:33:02.466120+0000","last_peered":"2023-11-24T06:33:02.466120+0000","last_clean":"2023-11-24T06:33:02.466120+0000","last_became_active":"2023-11-24T06:33:01.107396+0000","last_became_peered":"2023-11-24T06:33:01.107396+0000","last_unstale":"2023-11-24T06:33:02.466120+0000","last_undegraded":"2023-11-24T06:33:02.466120+0000","last_fullsized":"2023-11-24T06:33:02.466120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:25.845112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091355+0000","last_change":"2023-11-24T06:33:01.113195+0000","last_active":"2023-11-24T06:33:02.091355+0000","last_peered":"2023-11-24T06:33:02.091355+0000","last_clean":"2023-11-24T06:33:02.091355+0000","last_became_active":"2023-11-24T06:33:01.112936+0000","last_became_peered":"2023-11-24T06:33:01.112936+0000","last_unstale":"2023-11-24T06:33:02.091355+0000","last_undegraded":"2023-11-24T06:33:02.091355+0000","last_fullsized":"2023-11-24T06:33:02.091355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:16.001471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092842+0000","last_change":"2023-11-24T06:33:01.107338+0000","last_active":"2023-11-24T06:33:02.092842+0000","last_peered":"2023-11-24T06:33:02.092842+0000","last_clean":"2023-11-24T06:33:02.092842+0000","last_became_active":"2023-11-24T06:33:01.106903+0000","last_became_peered":"2023-11-24T06:33:01.106903+0000","last_unstale":"2023-11-24T06:33:02.092842+0000","last_undegraded":"2023-11-24T06:33:02.092842+0000","last_fullsized":"2023-11-24T06:33:02.092842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:17.847810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465222+0000","last_change":"2023-11-24T06:33:01.103000+0000","last_active":"2023-11-24T06:33:02.465222+0000","last_peered":"2023-11-24T06:33:02.465222+0000","last_clean":"2023-11-24T06:33:02.465222+0000","last_became_active":"2023-11-24T06:33:01.102704+0000","last_became_peered":"2023-11-24T06:33:01.102704+0000","last_unstale":"2023-11-24T06:33:02.465222+0000","last_undegraded":"2023-11-24T06:33:02.465222+0000","last_fullsized":"2023-11-24T06:33:02.465222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:29.413914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466117+0000","last_change":"2023-11-24T06:33:01.112099+0000","last_active":"2023-11-24T06:33:02.466117+0000","last_peered":"2023-11-24T06:33:02.466117+0000","last_clean":"2023-11-24T06:33:02.466117+0000","last_became_active":"2023-11-24T06:33:01.111864+0000","last_became_peered":"2023-11-24T06:33:01.111864+0000","last_unstale":"2023-11-24T06:33:02.466117+0000","last_undegraded":"2023-11-24T06:33:02.466117+0000","last_fullsized":"2023-11-24T06:33:02.466117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:50:55.628735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091225+0000","last_change":"2023-11-24T06:33:01.117513+0000","last_active":"2023-11-24T06:33:02.091225+0000","last_peered":"2023-11-24T06:33:02.091225+0000","last_clean":"2023-11-24T06:33:02.091225+0000","last_became_active":"2023-11-24T06:33:01.117193+0000","last_became_peered":"2023-11-24T06:33:01.117193+0000","last_unstale":"2023-11-24T06:33:02.091225+0000","last_undegraded":"2023-11-24T06:33:02.091225+0000","last_fullsized":"2023-11-24T06:33:02.091225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:16:13.506250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464581+0000","last_change":"2023-11-24T06:33:01.117631+0000","last_active":"2023-11-24T06:33:02.464581+0000","last_peered":"2023-11-24T06:33:02.464581+0000","last_clean":"2023-11-24T06:33:02.464581+0000","last_became_active":"2023-11-24T06:33:01.116675+0000","last_became_peered":"2023-11-24T06:33:01.116675+0000","last_unstale":"2023-11-24T06:33:02.464581+0000","last_undegraded":"2023-11-24T06:33:02.464581+0000","last_fullsized":"2023-11-24T06:33:02.464581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:12.461599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091519+0000","last_change":"2023-11-24T06:33:01.130831+0000","last_active":"2023-11-24T06:33:02.091519+0000","last_peered":"2023-11-24T06:33:02.091519+0000","last_clean":"2023-11-24T06:33:02.091519+0000","last_became_active":"2023-11-24T06:33:01.130518+0000","last_became_peered":"2023-11-24T06:33:01.130518+0000","last_unstale":"2023-11-24T06:33:02.091519+0000","last_undegraded":"2023-11-24T06:33:02.091519+0000","last_fullsized":"2023-11-24T06:33:02.091519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:27.531691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091728+0000","last_change":"2023-11-24T06:33:01.130598+0000","last_active":"2023-11-24T06:33:02.091728+0000","last_peered":"2023-11-24T06:33:02.091728+0000","last_clean":"2023-11-24T06:33:02.091728+0000","last_became_active":"2023-11-24T06:33:01.130269+0000","last_became_peered":"2023-11-24T06:33:01.130269+0000","last_unstale":"2023-11-24T06:33:02.091728+0000","last_undegraded":"2023-11-24T06:33:02.091728+0000","last_fullsized":"2023-11-24T06:33:02.091728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:23.330740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091853+0000","last_change":"2023-11-24T06:33:01.119495+0000","last_active":"2023-11-24T06:33:02.091853+0000","last_peered":"2023-11-24T06:33:02.091853+0000","last_clean":"2023-11-24T06:33:02.091853+0000","last_became_active":"2023-11-24T06:33:01.119216+0000","last_became_peered":"2023-11-24T06:33:01.119216+0000","last_unstale":"2023-11-24T06:33:02.091853+0000","last_undegraded":"2023-11-24T06:33:02.091853+0000","last_fullsized":"2023-11-24T06:33:02.091853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:56:58.182074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333904+0000","last_change":"2023-11-24T06:33:01.119933+0000","last_active":"2023-11-24T06:33:02.333904+0000","last_peered":"2023-11-24T06:33:02.333904+0000","last_clean":"2023-11-24T06:33:02.333904+0000","last_became_active":"2023-11-24T06:33:01.119577+0000","last_became_peered":"2023-11-24T06:33:01.119577+0000","last_unstale":"2023-11-24T06:33:02.333904+0000","last_undegraded":"2023-11-24T06:33:02.333904+0000","last_fullsized":"2023-11-24T06:33:02.333904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:50:55.628735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090518+0000","last_change":"2023-11-24T06:33:01.130813+0000","last_active":"2023-11-24T06:33:02.090518+0000","last_peered":"2023-11-24T06:33:02.090518+0000","last_clean":"2023-11-24T06:33:02.090518+0000","last_became_active":"2023-11-24T06:33:01.130292+0000","last_became_peered":"2023-11-24T06:33:01.130292+0000","last_unstale":"2023-11-24T06:33:02.090518+0000","last_undegraded":"2023-11-24T06:33:02.090518+0000","last_fullsized":"2023-11-24T06:33:02.090518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:38.111066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091089+0000","last_change":"2023-11-24T06:33:01.092697+0000","last_active":"2023-11-24T06:33:02.091089+0000","last_peered":"2023-11-24T06:33:02.091089+0000","last_clean":"2023-11-24T06:33:02.091089+0000","last_became_active":"2023-11-24T06:33:01.092402+0000","last_became_peered":"2023-11-24T06:33:01.092402+0000","last_unstale":"2023-11-24T06:33:02.091089+0000","last_undegraded":"2023-11-24T06:33:02.091089+0000","last_fullsized":"2023-11-24T06:33:02.091089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:13.744267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466404+0000","last_change":"2023-11-24T06:33:01.112449+0000","last_active":"2023-11-24T06:33:02.466404+0000","last_peered":"2023-11-24T06:33:02.466404+0000","last_clean":"2023-11-24T06:33:02.466404+0000","last_became_active":"2023-11-24T06:33:01.112187+0000","last_became_peered":"2023-11-24T06:33:01.112187+0000","last_unstale":"2023-11-24T06:33:02.466404+0000","last_undegraded":"2023-11-24T06:33:02.466404+0000","last_fullsized":"2023-11-24T06:33:02.466404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:46.640977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465576+0000","last_change":"2023-11-24T06:33:01.107089+0000","last_active":"2023-11-24T06:33:02.465576+0000","last_peered":"2023-11-24T06:33:02.465576+0000","last_clean":"2023-11-24T06:33:02.465576+0000","last_became_active":"2023-11-24T06:33:01.106801+0000","last_became_peered":"2023-11-24T06:33:01.106801+0000","last_unstale":"2023-11-24T06:33:02.465576+0000","last_undegraded":"2023-11-24T06:33:02.465576+0000","last_fullsized":"2023-11-24T06:33:02.465576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:18:29.156927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334021+0000","last_change":"2023-11-24T06:33:01.110900+0000","last_active":"2023-11-24T06:33:02.334021+0000","last_peered":"2023-11-24T06:33:02.334021+0000","last_clean":"2023-11-24T06:33:02.334021+0000","last_became_active":"2023-11-24T06:33:01.110210+0000","last_became_peered":"2023-11-24T06:33:01.110210+0000","last_unstale":"2023-11-24T06:33:02.334021+0000","last_undegraded":"2023-11-24T06:33:02.334021+0000","last_fullsized":"2023-11-24T06:33:02.334021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:23.001025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091748+0000","last_change":"2023-11-24T06:33:01.105332+0000","last_active":"2023-11-24T06:33:02.091748+0000","last_peered":"2023-11-24T06:33:02.091748+0000","last_clean":"2023-11-24T06:33:02.091748+0000","last_became_active":"2023-11-24T06:33:01.103446+0000","last_became_peered":"2023-11-24T06:33:01.103446+0000","last_unstale":"2023-11-24T06:33:02.091748+0000","last_undegraded":"2023-11-24T06:33:02.091748+0000","last_fullsized":"2023-11-24T06:33:02.091748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:03.443353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091305+0000","last_change":"2023-11-24T06:33:01.113937+0000","last_active":"2023-11-24T06:33:02.091305+0000","last_peered":"2023-11-24T06:33:02.091305+0000","last_clean":"2023-11-24T06:33:02.091305+0000","last_became_active":"2023-11-24T06:33:01.112077+0000","last_became_peered":"2023-11-24T06:33:01.112077+0000","last_unstale":"2023-11-24T06:33:02.091305+0000","last_undegraded":"2023-11-24T06:33:02.091305+0000","last_fullsized":"2023-11-24T06:33:02.091305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:50.685553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465442+0000","last_change":"2023-11-24T06:33:01.120802+0000","last_active":"2023-11-24T06:33:02.465442+0000","last_peered":"2023-11-24T06:33:02.465442+0000","last_clean":"2023-11-24T06:33:02.465442+0000","last_became_active":"2023-11-24T06:33:01.120511+0000","last_became_peered":"2023-11-24T06:33:01.120511+0000","last_unstale":"2023-11-24T06:33:02.465442+0000","last_undegraded":"2023-11-24T06:33:02.465442+0000","last_fullsized":"2023-11-24T06:33:02.465442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:30.613643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333749+0000","last_change":"2023-11-24T06:33:01.097626+0000","last_active":"2023-11-24T06:33:02.333749+0000","last_peered":"2023-11-24T06:33:02.333749+0000","last_clean":"2023-11-24T06:33:02.333749+0000","last_became_active":"2023-11-24T06:33:01.097238+0000","last_became_peered":"2023-11-24T06:33:01.097238+0000","last_unstale":"2023-11-24T06:33:02.333749+0000","last_undegraded":"2023-11-24T06:33:02.333749+0000","last_fullsized":"2023-11-24T06:33:02.333749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:15.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465730+0000","last_change":"2023-11-24T06:33:01.108591+0000","last_active":"2023-11-24T06:33:02.465730+0000","last_peered":"2023-11-24T06:33:02.465730+0000","last_clean":"2023-11-24T06:33:02.465730+0000","last_became_active":"2023-11-24T06:33:01.105504+0000","last_became_peered":"2023-11-24T06:33:01.105504+0000","last_unstale":"2023-11-24T06:33:02.465730+0000","last_undegraded":"2023-11-24T06:33:02.465730+0000","last_fullsized":"2023-11-24T06:33:02.465730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:43:05.744195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"84'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334396+0000","last_change":"2023-11-24T06:33:00.106306+0000","last_active":"2023-11-24T06:33:02.334396+0000","last_peered":"2023-11-24T06:33:02.334396+0000","last_clean":"2023-11-24T06:33:02.334396+0000","last_became_active":"2023-11-24T06:33:00.105973+0000","last_became_peered":"2023-11-24T06:33:00.105973+0000","last_unstale":"2023-11-24T06:33:02.334396+0000","last_undegraded":"2023-11-24T06:33:02.334396+0000","last_fullsized":"2023-11-24T06:33:02.334396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:14.047569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334340+0000","last_change":"2023-11-24T06:33:01.119795+0000","last_active":"2023-11-24T06:33:02.334340+0000","last_peered":"2023-11-24T06:33:02.334340+0000","last_clean":"2023-11-24T06:33:02.334340+0000","last_became_active":"2023-11-24T06:33:01.119485+0000","last_became_peered":"2023-11-24T06:33:01.119485+0000","last_unstale":"2023-11-24T06:33:02.334340+0000","last_undegraded":"2023-11-24T06:33:02.334340+0000","last_fullsized":"2023-11-24T06:33:02.334340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:46.877361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466221+0000","last_change":"2023-11-24T06:33:00.104249+0000","last_active":"2023-11-24T06:33:02.466221+0000","last_peered":"2023-11-24T06:33:02.466221+0000","last_clean":"2023-11-24T06:33:02.466221+0000","last_became_active":"2023-11-24T06:33:00.103943+0000","last_became_peered":"2023-11-24T06:33:00.103943+0000","last_unstale":"2023-11-24T06:33:02.466221+0000","last_undegraded":"2023-11-24T06:33:02.466221+0000","last_fullsized":"2023-11-24T06:33:02.466221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:24.376758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334161+0000","last_change":"2023-11-24T06:33:01.103235+0000","last_active":"2023-11-24T06:33:02.334161+0000","last_peered":"2023-11-24T06:33:02.334161+0000","last_clean":"2023-11-24T06:33:02.334161+0000","last_became_active":"2023-11-24T06:33:01.102810+0000","last_became_peered":"2023-11-24T06:33:01.102810+0000","last_unstale":"2023-11-24T06:33:02.334161+0000","last_undegraded":"2023-11-24T06:33:02.334161+0000","last_fullsized":"2023-11-24T06:33:02.334161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:14:46.238892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464657+0000","last_change":"2023-11-24T06:33:00.112215+0000","last_active":"2023-11-24T06:33:02.464657+0000","last_peered":"2023-11-24T06:33:02.464657+0000","last_clean":"2023-11-24T06:33:02.464657+0000","last_became_active":"2023-11-24T06:33:00.111945+0000","last_became_peered":"2023-11-24T06:33:00.111945+0000","last_unstale":"2023-11-24T06:33:02.464657+0000","last_undegraded":"2023-11-24T06:33:02.464657+0000","last_fullsized":"2023-11-24T06:33:02.464657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:10:30.004015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466496+0000","last_change":"2023-11-24T06:33:01.113610+0000","last_active":"2023-11-24T06:33:02.466496+0000","last_peered":"2023-11-24T06:33:02.466496+0000","last_clean":"2023-11-24T06:33:02.466496+0000","last_became_active":"2023-11-24T06:33:01.113338+0000","last_became_peered":"2023-11-24T06:33:01.113338+0000","last_unstale":"2023-11-24T06:33:02.466496+0000","last_undegraded":"2023-11-24T06:33:02.466496+0000","last_fullsized":"2023-11-24T06:33:02.466496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:12.461599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464467+0000","last_change":"2023-11-24T06:33:00.112197+0000","last_active":"2023-11-24T06:33:02.464467+0000","last_peered":"2023-11-24T06:33:02.464467+0000","last_clean":"2023-11-24T06:33:02.464467+0000","last_became_active":"2023-11-24T06:33:00.111907+0000","last_became_peered":"2023-11-24T06:33:00.111907+0000","last_unstale":"2023-11-24T06:33:02.464467+0000","last_undegraded":"2023-11-24T06:33:02.464467+0000","last_fullsized":"2023-11-24T06:33:02.464467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:54:01.817949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091418+0000","last_change":"2023-11-24T06:33:01.114137+0000","last_active":"2023-11-24T06:33:02.091418+0000","last_peered":"2023-11-24T06:33:02.091418+0000","last_clean":"2023-11-24T06:33:02.091418+0000","last_became_active":"2023-11-24T06:33:01.111692+0000","last_became_peered":"2023-11-24T06:33:01.111692+0000","last_unstale":"2023-11-24T06:33:02.091418+0000","last_undegraded":"2023-11-24T06:33:02.091418+0000","last_fullsized":"2023-11-24T06:33:02.091418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:35.987001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465781+0000","last_change":"2023-11-24T06:33:00.116319+0000","last_active":"2023-11-24T06:33:02.465781+0000","last_peered":"2023-11-24T06:33:02.465781+0000","last_clean":"2023-11-24T06:33:02.465781+0000","last_became_active":"2023-11-24T06:33:00.116090+0000","last_became_peered":"2023-11-24T06:33:00.116090+0000","last_unstale":"2023-11-24T06:33:02.465781+0000","last_undegraded":"2023-11-24T06:33:02.465781+0000","last_fullsized":"2023-11-24T06:33:02.465781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:39.147169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465581+0000","last_change":"2023-11-24T06:33:01.113876+0000","last_active":"2023-11-24T06:33:02.465581+0000","last_peered":"2023-11-24T06:33:02.465581+0000","last_clean":"2023-11-24T06:33:02.465581+0000","last_became_active":"2023-11-24T06:33:01.113301+0000","last_became_peered":"2023-11-24T06:33:01.113301+0000","last_unstale":"2023-11-24T06:33:02.465581+0000","last_undegraded":"2023-11-24T06:33:02.465581+0000","last_fullsized":"2023-11-24T06:33:02.465581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:51.859171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465286+0000","last_change":"2023-11-24T06:33:00.110445+0000","last_active":"2023-11-24T06:33:02.465286+0000","last_peered":"2023-11-24T06:33:02.465286+0000","last_clean":"2023-11-24T06:33:02.465286+0000","last_became_active":"2023-11-24T06:33:00.110092+0000","last_became_peered":"2023-11-24T06:33:00.110092+0000","last_unstale":"2023-11-24T06:33:02.465286+0000","last_undegraded":"2023-11-24T06:33:02.465286+0000","last_fullsized":"2023-11-24T06:33:02.465286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:27.390662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465749+0000","last_change":"2023-11-24T06:33:01.113233+0000","last_active":"2023-11-24T06:33:02.465749+0000","last_peered":"2023-11-24T06:33:02.465749+0000","last_clean":"2023-11-24T06:33:02.465749+0000","last_became_active":"2023-11-24T06:33:01.112941+0000","last_became_peered":"2023-11-24T06:33:01.112941+0000","last_unstale":"2023-11-24T06:33:02.465749+0000","last_undegraded":"2023-11-24T06:33:02.465749+0000","last_fullsized":"2023-11-24T06:33:02.465749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:46.769685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464226+0000","last_change":"2023-11-24T06:33:00.104785+0000","last_active":"2023-11-24T06:33:02.464226+0000","last_peered":"2023-11-24T06:33:02.464226+0000","last_clean":"2023-11-24T06:33:02.464226+0000","last_became_active":"2023-11-24T06:33:00.104469+0000","last_became_peered":"2023-11-24T06:33:00.104469+0000","last_unstale":"2023-11-24T06:33:02.464226+0000","last_undegraded":"2023-11-24T06:33:02.464226+0000","last_fullsized":"2023-11-24T06:33:02.464226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:02.248865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092968+0000","last_change":"2023-11-24T06:33:01.107155+0000","last_active":"2023-11-24T06:33:02.092968+0000","last_peered":"2023-11-24T06:33:02.092968+0000","last_clean":"2023-11-24T06:33:02.092968+0000","last_became_active":"2023-11-24T06:33:01.106521+0000","last_became_peered":"2023-11-24T06:33:01.106521+0000","last_unstale":"2023-11-24T06:33:02.092968+0000","last_undegraded":"2023-11-24T06:33:02.092968+0000","last_fullsized":"2023-11-24T06:33:02.092968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:06:31.929818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090674+0000","last_change":"2023-11-24T06:33:00.112422+0000","last_active":"2023-11-24T06:33:02.090674+0000","last_peered":"2023-11-24T06:33:02.090674+0000","last_clean":"2023-11-24T06:33:02.090674+0000","last_became_active":"2023-11-24T06:33:00.112071+0000","last_became_peered":"2023-11-24T06:33:00.112071+0000","last_unstale":"2023-11-24T06:33:02.090674+0000","last_undegraded":"2023-11-24T06:33:02.090674+0000","last_fullsized":"2023-11-24T06:33:02.090674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:35.656126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.093075+0000","last_change":"2023-11-24T06:33:01.100636+0000","last_active":"2023-11-24T06:33:02.093075+0000","last_peered":"2023-11-24T06:33:02.093075+0000","last_clean":"2023-11-24T06:33:02.093075+0000","last_became_active":"2023-11-24T06:33:01.100344+0000","last_became_peered":"2023-11-24T06:33:01.100344+0000","last_unstale":"2023-11-24T06:33:02.093075+0000","last_undegraded":"2023-11-24T06:33:02.093075+0000","last_fullsized":"2023-11-24T06:33:02.093075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:05:53.160528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334447+0000","last_change":"2023-11-24T06:33:00.108354+0000","last_active":"2023-11-24T06:33:02.334447+0000","last_peered":"2023-11-24T06:33:02.334447+0000","last_clean":"2023-11-24T06:33:02.334447+0000","last_became_active":"2023-11-24T06:33:00.107998+0000","last_became_peered":"2023-11-24T06:33:00.107998+0000","last_unstale":"2023-11-24T06:33:02.334447+0000","last_undegraded":"2023-11-24T06:33:02.334447+0000","last_fullsized":"2023-11-24T06:33:02.334447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:50.852632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465459+0000","last_change":"2023-11-24T06:33:01.113697+0000","last_active":"2023-11-24T06:33:02.465459+0000","last_peered":"2023-11-24T06:33:02.465459+0000","last_clean":"2023-11-24T06:33:02.465459+0000","last_became_active":"2023-11-24T06:33:01.113399+0000","last_became_peered":"2023-11-24T06:33:01.113399+0000","last_unstale":"2023-11-24T06:33:02.465459+0000","last_undegraded":"2023-11-24T06:33:02.465459+0000","last_fullsized":"2023-11-24T06:33:02.465459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:43:05.744195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334337+0000","last_change":"2023-11-24T06:33:00.107198+0000","last_active":"2023-11-24T06:33:02.334337+0000","last_peered":"2023-11-24T06:33:02.334337+0000","last_clean":"2023-11-24T06:33:02.334337+0000","last_became_active":"2023-11-24T06:33:00.106883+0000","last_became_peered":"2023-11-24T06:33:00.106883+0000","last_unstale":"2023-11-24T06:33:02.334337+0000","last_undegraded":"2023-11-24T06:33:02.334337+0000","last_fullsized":"2023-11-24T06:33:02.334337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:28.407375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464465+0000","last_change":"2023-11-24T06:33:01.116582+0000","last_active":"2023-11-24T06:33:02.464465+0000","last_peered":"2023-11-24T06:33:02.464465+0000","last_clean":"2023-11-24T06:33:02.464465+0000","last_became_active":"2023-11-24T06:33:01.116248+0000","last_became_peered":"2023-11-24T06:33:01.116248+0000","last_unstale":"2023-11-24T06:33:02.464465+0000","last_undegraded":"2023-11-24T06:33:02.464465+0000","last_fullsized":"2023-11-24T06:33:02.464465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:06:20.540548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"84'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333947+0000","last_change":"2023-11-24T06:33:00.117748+0000","last_active":"2023-11-24T06:33:02.333947+0000","last_peered":"2023-11-24T06:33:02.333947+0000","last_clean":"2023-11-24T06:33:02.333947+0000","last_became_active":"2023-11-24T06:33:00.117495+0000","last_became_peered":"2023-11-24T06:33:00.117495+0000","last_unstale":"2023-11-24T06:33:02.333947+0000","last_undegraded":"2023-11-24T06:33:02.333947+0000","last_fullsized":"2023-11-24T06:33:02.333947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:26.396465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465651+0000","last_change":"2023-11-24T06:33:01.129862+0000","last_active":"2023-11-24T06:33:02.465651+0000","last_peered":"2023-11-24T06:33:02.465651+0000","last_clean":"2023-11-24T06:33:02.465651+0000","last_became_active":"2023-11-24T06:33:01.129539+0000","last_became_peered":"2023-11-24T06:33:01.129539+0000","last_unstale":"2023-11-24T06:33:02.465651+0000","last_undegraded":"2023-11-24T06:33:02.465651+0000","last_fullsized":"2023-11-24T06:33:02.465651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:15.054108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"84'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465444+0000","last_change":"2023-11-24T06:33:00.109463+0000","last_active":"2023-11-24T06:33:02.465444+0000","last_peered":"2023-11-24T06:33:02.465444+0000","last_clean":"2023-11-24T06:33:02.465444+0000","last_became_active":"2023-11-24T06:33:00.109064+0000","last_became_peered":"2023-11-24T06:33:00.109064+0000","last_unstale":"2023-11-24T06:33:02.465444+0000","last_undegraded":"2023-11-24T06:33:02.465444+0000","last_fullsized":"2023-11-24T06:33:02.465444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:39.147169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464320+0000","last_change":"2023-11-24T06:33:01.125683+0000","last_active":"2023-11-24T06:33:02.464320+0000","last_peered":"2023-11-24T06:33:02.464320+0000","last_clean":"2023-11-24T06:33:02.464320+0000","last_became_active":"2023-11-24T06:33:01.125427+0000","last_became_peered":"2023-11-24T06:33:01.125427+0000","last_unstale":"2023-11-24T06:33:02.464320+0000","last_undegraded":"2023-11-24T06:33:02.464320+0000","last_fullsized":"2023-11-24T06:33:02.464320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:25.845112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091734+0000","last_change":"2023-11-24T06:33:00.100467+0000","last_active":"2023-11-24T06:33:02.091734+0000","last_peered":"2023-11-24T06:33:02.091734+0000","last_clean":"2023-11-24T06:33:02.091734+0000","last_became_active":"2023-11-24T06:33:00.100154+0000","last_became_peered":"2023-11-24T06:33:00.100154+0000","last_unstale":"2023-11-24T06:33:02.091734+0000","last_undegraded":"2023-11-24T06:33:02.091734+0000","last_fullsized":"2023-11-24T06:33:02.091734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:43.509323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466499+0000","last_change":"2023-11-24T06:33:01.120745+0000","last_active":"2023-11-24T06:33:02.466499+0000","last_peered":"2023-11-24T06:33:02.466499+0000","last_clean":"2023-11-24T06:33:02.466499+0000","last_became_active":"2023-11-24T06:33:01.119944+0000","last_became_peered":"2023-11-24T06:33:01.119944+0000","last_unstale":"2023-11-24T06:33:02.466499+0000","last_undegraded":"2023-11-24T06:33:02.466499+0000","last_fullsized":"2023-11-24T06:33:02.466499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:13.968584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092609+0000","last_change":"2023-11-24T06:33:00.109027+0000","last_active":"2023-11-24T06:33:02.092609+0000","last_peered":"2023-11-24T06:33:02.092609+0000","last_clean":"2023-11-24T06:33:02.092609+0000","last_became_active":"2023-11-24T06:33:00.108765+0000","last_became_peered":"2023-11-24T06:33:00.108765+0000","last_unstale":"2023-11-24T06:33:02.092609+0000","last_undegraded":"2023-11-24T06:33:02.092609+0000","last_fullsized":"2023-11-24T06:33:02.092609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:43:21.615743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090599+0000","last_change":"2023-11-24T06:33:01.110976+0000","last_active":"2023-11-24T06:33:02.090599+0000","last_peered":"2023-11-24T06:33:02.090599+0000","last_clean":"2023-11-24T06:33:02.090599+0000","last_became_active":"2023-11-24T06:33:01.110598+0000","last_became_peered":"2023-11-24T06:33:01.110598+0000","last_unstale":"2023-11-24T06:33:02.090599+0000","last_undegraded":"2023-11-24T06:33:02.090599+0000","last_fullsized":"2023-11-24T06:33:02.090599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:00.158544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465243+0000","last_change":"2023-11-24T06:33:00.107228+0000","last_active":"2023-11-24T06:33:02.465243+0000","last_peered":"2023-11-24T06:33:02.465243+0000","last_clean":"2023-11-24T06:33:02.465243+0000","last_became_active":"2023-11-24T06:33:00.106906+0000","last_became_peered":"2023-11-24T06:33:00.106906+0000","last_unstale":"2023-11-24T06:33:02.465243+0000","last_undegraded":"2023-11-24T06:33:02.465243+0000","last_fullsized":"2023-11-24T06:33:02.465243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:24.376758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090615+0000","last_change":"2023-11-24T06:33:01.095671+0000","last_active":"2023-11-24T06:33:02.090615+0000","last_peered":"2023-11-24T06:33:02.090615+0000","last_clean":"2023-11-24T06:33:02.090615+0000","last_became_active":"2023-11-24T06:33:01.095408+0000","last_became_peered":"2023-11-24T06:33:01.095408+0000","last_unstale":"2023-11-24T06:33:02.090615+0000","last_undegraded":"2023-11-24T06:33:02.090615+0000","last_fullsized":"2023-11-24T06:33:02.090615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:59:55.888136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"84'8","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464094+0000","last_change":"2023-11-24T06:33:00.101828+0000","last_active":"2023-11-24T06:33:02.464094+0000","last_peered":"2023-11-24T06:33:02.464094+0000","last_clean":"2023-11-24T06:33:02.464094+0000","last_became_active":"2023-11-24T06:33:00.101532+0000","last_became_peered":"2023-11-24T06:33:00.101532+0000","last_unstale":"2023-11-24T06:33:02.464094+0000","last_undegraded":"2023-11-24T06:33:02.464094+0000","last_fullsized":"2023-11-24T06:33:02.464094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:03.711251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466424+0000","last_change":"2023-11-24T06:33:01.105712+0000","last_active":"2023-11-24T06:33:02.466424+0000","last_peered":"2023-11-24T06:33:02.466424+0000","last_clean":"2023-11-24T06:33:02.466424+0000","last_became_active":"2023-11-24T06:33:01.105424+0000","last_became_peered":"2023-11-24T06:33:01.105424+0000","last_unstale":"2023-11-24T06:33:02.466424+0000","last_undegraded":"2023-11-24T06:33:02.466424+0000","last_fullsized":"2023-11-24T06:33:02.466424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:06:20.540548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334499+0000","last_change":"2023-11-24T06:33:00.102149+0000","last_active":"2023-11-24T06:33:02.334499+0000","last_peered":"2023-11-24T06:33:02.334499+0000","last_clean":"2023-11-24T06:33:02.334499+0000","last_became_active":"2023-11-24T06:33:00.101859+0000","last_became_peered":"2023-11-24T06:33:00.101859+0000","last_unstale":"2023-11-24T06:33:02.334499+0000","last_undegraded":"2023-11-24T06:33:02.334499+0000","last_fullsized":"2023-11-24T06:33:02.334499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:43:04.737656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334332+0000","last_change":"2023-11-24T06:33:01.107458+0000","last_active":"2023-11-24T06:33:02.334332+0000","last_peered":"2023-11-24T06:33:02.334332+0000","last_clean":"2023-11-24T06:33:02.334332+0000","last_became_active":"2023-11-24T06:33:01.107073+0000","last_became_peered":"2023-11-24T06:33:01.107073+0000","last_unstale":"2023-11-24T06:33:02.334332+0000","last_undegraded":"2023-11-24T06:33:02.334332+0000","last_fullsized":"2023-11-24T06:33:02.334332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:54:02.824488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464450+0000","last_change":"2023-11-24T06:33:00.113036+0000","last_active":"2023-11-24T06:33:02.464450+0000","last_peered":"2023-11-24T06:33:02.464450+0000","last_clean":"2023-11-24T06:33:02.464450+0000","last_became_active":"2023-11-24T06:33:00.112771+0000","last_became_peered":"2023-11-24T06:33:00.112771+0000","last_unstale":"2023-11-24T06:33:02.464450+0000","last_undegraded":"2023-11-24T06:33:02.464450+0000","last_fullsized":"2023-11-24T06:33:02.464450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:45.870822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465935+0000","last_change":"2023-11-24T06:33:01.103929+0000","last_active":"2023-11-24T06:33:02.465935+0000","last_peered":"2023-11-24T06:33:02.465935+0000","last_clean":"2023-11-24T06:33:02.465935+0000","last_became_active":"2023-11-24T06:33:01.103667+0000","last_became_peered":"2023-11-24T06:33:01.103667+0000","last_unstale":"2023-11-24T06:33:02.465935+0000","last_undegraded":"2023-11-24T06:33:02.465935+0000","last_fullsized":"2023-11-24T06:33:02.465935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:10:01.556975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464562+0000","last_change":"2023-11-24T06:33:00.104867+0000","last_active":"2023-11-24T06:33:02.464562+0000","last_peered":"2023-11-24T06:33:02.464562+0000","last_clean":"2023-11-24T06:33:02.464562+0000","last_became_active":"2023-11-24T06:33:00.104620+0000","last_became_peered":"2023-11-24T06:33:00.104620+0000","last_unstale":"2023-11-24T06:33:02.464562+0000","last_undegraded":"2023-11-24T06:33:02.464562+0000","last_fullsized":"2023-11-24T06:33:02.464562+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:45.763146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091481+0000","last_change":"2023-11-24T06:33:01.123829+0000","last_active":"2023-11-24T06:33:02.091481+0000","last_peered":"2023-11-24T06:33:02.091481+0000","last_clean":"2023-11-24T06:33:02.091481+0000","last_became_active":"2023-11-24T06:33:01.123483+0000","last_became_peered":"2023-11-24T06:33:01.123483+0000","last_unstale":"2023-11-24T06:33:02.091481+0000","last_undegraded":"2023-11-24T06:33:02.091481+0000","last_fullsized":"2023-11-24T06:33:02.091481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:51.857305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092759+0000","last_change":"2023-11-24T06:33:00.108961+0000","last_active":"2023-11-24T06:33:02.092759+0000","last_peered":"2023-11-24T06:33:02.092759+0000","last_clean":"2023-11-24T06:33:02.092759+0000","last_became_active":"2023-11-24T06:33:00.108682+0000","last_became_peered":"2023-11-24T06:33:00.108682+0000","last_unstale":"2023-11-24T06:33:02.092759+0000","last_undegraded":"2023-11-24T06:33:02.092759+0000","last_fullsized":"2023-11-24T06:33:02.092759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:01.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465161+0000","last_change":"2023-11-24T06:33:01.104798+0000","last_active":"2023-11-24T06:33:02.465161+0000","last_peered":"2023-11-24T06:33:02.465161+0000","last_clean":"2023-11-24T06:33:02.465161+0000","last_became_active":"2023-11-24T06:33:01.104371+0000","last_became_peered":"2023-11-24T06:33:01.104371+0000","last_unstale":"2023-11-24T06:33:02.465161+0000","last_undegraded":"2023-11-24T06:33:02.465161+0000","last_fullsized":"2023-11-24T06:33:02.465161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:18:29.156927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091577+0000","last_change":"2023-11-24T06:33:00.104672+0000","last_active":"2023-11-24T06:33:02.091577+0000","last_peered":"2023-11-24T06:33:02.091577+0000","last_clean":"2023-11-24T06:33:02.091577+0000","last_became_active":"2023-11-24T06:33:00.104405+0000","last_became_peered":"2023-11-24T06:33:00.104405+0000","last_unstale":"2023-11-24T06:33:02.091577+0000","last_undegraded":"2023-11-24T06:33:02.091577+0000","last_fullsized":"2023-11-24T06:33:02.091577+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:23:02.436395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090635+0000","last_change":"2023-11-24T06:33:01.109804+0000","last_active":"2023-11-24T06:33:02.090635+0000","last_peered":"2023-11-24T06:33:02.090635+0000","last_clean":"2023-11-24T06:33:02.090635+0000","last_became_active":"2023-11-24T06:33:01.107758+0000","last_became_peered":"2023-11-24T06:33:01.107758+0000","last_unstale":"2023-11-24T06:33:02.090635+0000","last_undegraded":"2023-11-24T06:33:02.090635+0000","last_fullsized":"2023-11-24T06:33:02.090635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:45.913897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.090893+0000","last_change":"2023-11-24T06:33:00.110308+0000","last_active":"2023-11-24T06:33:02.090893+0000","last_peered":"2023-11-24T06:33:02.090893+0000","last_clean":"2023-11-24T06:33:02.090893+0000","last_became_active":"2023-11-24T06:33:00.110046+0000","last_became_peered":"2023-11-24T06:33:00.110046+0000","last_unstale":"2023-11-24T06:33:02.090893+0000","last_undegraded":"2023-11-24T06:33:02.090893+0000","last_fullsized":"2023-11-24T06:33:02.090893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:10:17.879168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465148+0000","last_change":"2023-11-24T06:33:01.125133+0000","last_active":"2023-11-24T06:33:02.465148+0000","last_peered":"2023-11-24T06:33:02.465148+0000","last_clean":"2023-11-24T06:33:02.465148+0000","last_became_active":"2023-11-24T06:33:01.124848+0000","last_became_peered":"2023-11-24T06:33:01.124848+0000","last_unstale":"2023-11-24T06:33:02.465148+0000","last_undegraded":"2023-11-24T06:33:02.465148+0000","last_fullsized":"2023-11-24T06:33:02.465148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:30.613643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.092438+0000","last_change":"2023-11-24T06:33:00.104850+0000","last_active":"2023-11-24T06:33:02.092438+0000","last_peered":"2023-11-24T06:33:02.092438+0000","last_clean":"2023-11-24T06:33:02.092438+0000","last_became_active":"2023-11-24T06:33:00.104293+0000","last_became_peered":"2023-11-24T06:33:00.104293+0000","last_unstale":"2023-11-24T06:33:02.092438+0000","last_undegraded":"2023-11-24T06:33:02.092438+0000","last_fullsized":"2023-11-24T06:33:02.092438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:12.962046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466117+0000","last_change":"2023-11-24T06:33:01.105189+0000","last_active":"2023-11-24T06:33:02.466117+0000","last_peered":"2023-11-24T06:33:02.466117+0000","last_clean":"2023-11-24T06:33:02.466117+0000","last_became_active":"2023-11-24T06:33:01.104928+0000","last_became_peered":"2023-11-24T06:33:01.104928+0000","last_unstale":"2023-11-24T06:33:02.466117+0000","last_undegraded":"2023-11-24T06:33:02.466117+0000","last_fullsized":"2023-11-24T06:33:02.466117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:28.806186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091176+0000","last_change":"2023-11-24T06:33:00.109830+0000","last_active":"2023-11-24T06:33:02.091176+0000","last_peered":"2023-11-24T06:33:02.091176+0000","last_clean":"2023-11-24T06:33:02.091176+0000","last_became_active":"2023-11-24T06:33:00.109516+0000","last_became_peered":"2023-11-24T06:33:00.109516+0000","last_unstale":"2023-11-24T06:33:02.091176+0000","last_undegraded":"2023-11-24T06:33:02.091176+0000","last_fullsized":"2023-11-24T06:33:02.091176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:21.514075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466563+0000","last_change":"2023-11-24T06:33:01.106778+0000","last_active":"2023-11-24T06:33:02.466563+0000","last_peered":"2023-11-24T06:33:02.466563+0000","last_clean":"2023-11-24T06:33:02.466563+0000","last_became_active":"2023-11-24T06:33:01.106509+0000","last_became_peered":"2023-11-24T06:33:01.106509+0000","last_unstale":"2023-11-24T06:33:02.466563+0000","last_undegraded":"2023-11-24T06:33:02.466563+0000","last_fullsized":"2023-11-24T06:33:02.466563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:37.769499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091218+0000","last_change":"2023-11-24T06:33:00.106875+0000","last_active":"2023-11-24T06:33:02.091218+0000","last_peered":"2023-11-24T06:33:02.091218+0000","last_clean":"2023-11-24T06:33:02.091218+0000","last_became_active":"2023-11-24T06:33:00.106593+0000","last_became_peered":"2023-11-24T06:33:00.106593+0000","last_unstale":"2023-11-24T06:33:02.091218+0000","last_undegraded":"2023-11-24T06:33:02.091218+0000","last_fullsized":"2023-11-24T06:33:02.091218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:44:17.333403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334233+0000","last_change":"2023-11-24T06:33:01.111086+0000","last_active":"2023-11-24T06:33:02.334233+0000","last_peered":"2023-11-24T06:33:02.334233+0000","last_clean":"2023-11-24T06:33:02.334233+0000","last_became_active":"2023-11-24T06:33:01.110613+0000","last_became_peered":"2023-11-24T06:33:01.110613+0000","last_unstale":"2023-11-24T06:33:02.334233+0000","last_undegraded":"2023-11-24T06:33:02.334233+0000","last_fullsized":"2023-11-24T06:33:02.334233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:03.255404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334087+0000","last_change":"2023-11-24T06:33:00.110763+0000","last_active":"2023-11-24T06:33:02.334087+0000","last_peered":"2023-11-24T06:33:02.334087+0000","last_clean":"2023-11-24T06:33:02.334087+0000","last_became_active":"2023-11-24T06:33:00.110000+0000","last_became_peered":"2023-11-24T06:33:00.110000+0000","last_unstale":"2023-11-24T06:33:02.334087+0000","last_undegraded":"2023-11-24T06:33:02.334087+0000","last_fullsized":"2023-11-24T06:33:02.334087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:24.376758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465822+0000","last_change":"2023-11-24T06:33:01.120956+0000","last_active":"2023-11-24T06:33:02.465822+0000","last_peered":"2023-11-24T06:33:02.465822+0000","last_clean":"2023-11-24T06:33:02.465822+0000","last_became_active":"2023-11-24T06:33:01.120580+0000","last_became_peered":"2023-11-24T06:33:01.120580+0000","last_unstale":"2023-11-24T06:33:02.465822+0000","last_undegraded":"2023-11-24T06:33:02.465822+0000","last_fullsized":"2023-11-24T06:33:02.465822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:23:10.123737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334247+0000","last_change":"2023-11-24T06:33:00.109650+0000","last_active":"2023-11-24T06:33:02.334247+0000","last_peered":"2023-11-24T06:33:02.334247+0000","last_clean":"2023-11-24T06:33:02.334247+0000","last_became_active":"2023-11-24T06:33:00.109402+0000","last_became_peered":"2023-11-24T06:33:00.109402+0000","last_unstale":"2023-11-24T06:33:02.334247+0000","last_undegraded":"2023-11-24T06:33:02.334247+0000","last_fullsized":"2023-11-24T06:33:02.334247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:29.607104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465477+0000","last_change":"2023-11-24T06:33:01.106564+0000","last_active":"2023-11-24T06:33:02.465477+0000","last_peered":"2023-11-24T06:33:02.465477+0000","last_clean":"2023-11-24T06:33:02.465477+0000","last_became_active":"2023-11-24T06:33:01.105019+0000","last_became_peered":"2023-11-24T06:33:01.105019+0000","last_unstale":"2023-11-24T06:33:02.465477+0000","last_undegraded":"2023-11-24T06:33:02.465477+0000","last_fullsized":"2023-11-24T06:33:02.465477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:23:10.123737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464449+0000","last_change":"2023-11-24T06:33:00.101935+0000","last_active":"2023-11-24T06:33:02.464449+0000","last_peered":"2023-11-24T06:33:02.464449+0000","last_clean":"2023-11-24T06:33:02.464449+0000","last_became_active":"2023-11-24T06:33:00.101681+0000","last_became_peered":"2023-11-24T06:33:00.101681+0000","last_unstale":"2023-11-24T06:33:02.464449+0000","last_undegraded":"2023-11-24T06:33:02.464449+0000","last_fullsized":"2023-11-24T06:33:02.464449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:31:48.600329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.464335+0000","last_change":"2023-11-24T06:33:01.123537+0000","last_active":"2023-11-24T06:33:02.464335+0000","last_peered":"2023-11-24T06:33:02.464335+0000","last_clean":"2023-11-24T06:33:02.464335+0000","last_became_active":"2023-11-24T06:33:01.123200+0000","last_became_peered":"2023-11-24T06:33:01.123200+0000","last_unstale":"2023-11-24T06:33:02.464335+0000","last_undegraded":"2023-11-24T06:33:02.464335+0000","last_fullsized":"2023-11-24T06:33:02.464335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:46.640977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465360+0000","last_change":"2023-11-24T06:33:00.110313+0000","last_active":"2023-11-24T06:33:02.465360+0000","last_peered":"2023-11-24T06:33:02.465360+0000","last_clean":"2023-11-24T06:33:02.465360+0000","last_became_active":"2023-11-24T06:33:00.110046+0000","last_became_peered":"2023-11-24T06:33:00.110046+0000","last_unstale":"2023-11-24T06:33:02.465360+0000","last_undegraded":"2023-11-24T06:33:02.465360+0000","last_fullsized":"2023-11-24T06:33:02.465360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:26.396465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465848+0000","last_change":"2023-11-24T06:33:01.109419+0000","last_active":"2023-11-24T06:33:02.465848+0000","last_peered":"2023-11-24T06:33:02.465848+0000","last_clean":"2023-11-24T06:33:02.465848+0000","last_became_active":"2023-11-24T06:33:01.109095+0000","last_became_peered":"2023-11-24T06:33:01.109095+0000","last_unstale":"2023-11-24T06:33:02.465848+0000","last_undegraded":"2023-11-24T06:33:02.465848+0000","last_fullsized":"2023-11-24T06:33:02.465848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:49:52.218724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.334014+0000","last_change":"2023-11-24T06:33:00.108365+0000","last_active":"2023-11-24T06:33:02.334014+0000","last_peered":"2023-11-24T06:33:02.334014+0000","last_clean":"2023-11-24T06:33:02.334014+0000","last_became_active":"2023-11-24T06:33:00.107976+0000","last_became_peered":"2023-11-24T06:33:00.107976+0000","last_unstale":"2023-11-24T06:33:02.334014+0000","last_undegraded":"2023-11-24T06:33:02.334014+0000","last_fullsized":"2023-11-24T06:33:02.334014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:45.685325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.333905+0000","last_change":"2023-11-24T06:33:01.117734+0000","last_active":"2023-11-24T06:33:02.333905+0000","last_peered":"2023-11-24T06:33:02.333905+0000","last_clean":"2023-11-24T06:33:02.333905+0000","last_became_active":"2023-11-24T06:33:01.117527+0000","last_became_peered":"2023-11-24T06:33:01.117527+0000","last_unstale":"2023-11-24T06:33:02.333905+0000","last_undegraded":"2023-11-24T06:33:02.333905+0000","last_fullsized":"2023-11-24T06:33:02.333905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:28.806186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.465177+0000","last_change":"2023-11-24T06:33:00.104103+0000","last_active":"2023-11-24T06:33:02.465177+0000","last_peered":"2023-11-24T06:33:02.465177+0000","last_clean":"2023-11-24T06:33:02.465177+0000","last_became_active":"2023-11-24T06:33:00.103841+0000","last_became_peered":"2023-11-24T06:33:00.103841+0000","last_unstale":"2023-11-24T06:33:02.465177+0000","last_undegraded":"2023-11-24T06:33:02.465177+0000","last_fullsized":"2023-11-24T06:33:02.465177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:40.472524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.091438+0000","last_change":"2023-11-24T06:33:01.106971+0000","last_active":"2023-11-24T06:33:02.091438+0000","last_peered":"2023-11-24T06:33:02.091438+0000","last_clean":"2023-11-24T06:33:02.091438+0000","last_became_active":"2023-11-24T06:33:01.106720+0000","last_became_peered":"2023-11-24T06:33:01.106720+0000","last_unstale":"2023-11-24T06:33:02.091438+0000","last_undegraded":"2023-11-24T06:33:02.091438+0000","last_fullsized":"2023-11-24T06:33:02.091438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:33:00.075377+0000","last_clean_scrub_stamp":"2023-11-24T06:33:00.075377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:40.329776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-24T06:33:02.466611+0000","last_change":"2023-11-24T06:33:00.114816+0000","last_active":"2023-11-24T06:33:02.466611+0000","last_peered":"2023-11-24T06:33:02.466611+0000","last_clean":"2023-11-24T06:33:02.466611+0000","last_became_active":"2023-11-24T06:33:00.114524+0000","last_became_peered":"2023-11-24T06:33:00.114524+0000","last_unstale":"2023-11-24T06:33:02.466611+0000","last_undegraded":"2023-11-24T06:33:02.466611+0000","last_fullsized":"2023-11-24T06:33:02.466611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:32:59.068838+0000","last_clean_scrub_stamp":"2023-11-24T06:32:59.068838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:45.870822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-24T06:33:01.098125+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:33:01.098125+0000","last_peered":"2023-11-24T06:33:01.098125+0000","last_clean":"2023-11-24T06:33:01.098125+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:01.098125+0000","last_undegraded":"2023-11-24T06:33:01.098125+0000","last_fullsized":"2023-11-24T06:33:01.098125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1642496,"data_stored":1037297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.619,"15min":1.619},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99099999999999999,"5min":1.417,"15min":1.417},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.97699999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":1.7,"15min":1.7},"last":0.629}]},{"osd":2,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78400000000000003,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.92600000000000005,"5min":1.55,"15min":1.55},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92600000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":447553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":2.637,"15min":2.637},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96799999999999997,"5min":1.619,"15min":1.619},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85799999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99399999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.754}]},{"osd":3,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.86899999999999999},"min":{"1min":0.504,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88}]},{"osd":4,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.72499999999999998,"15min":0.77500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":1.036,"15min":1.036},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":448493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.278,"15min":1.278},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.294,"5min":1.919,"15min":1.919},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.3500000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.75},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.427,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5189999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4059999999999999,"5min":1.998,"15min":1.998},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.274,"5min":1.343,"15min":1.343},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.63}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.462,"15min":1.462},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":440531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.022},"last":0.62},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.876,"5min":1.202,"15min":1.202},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94199999999999995,"5min":1.248,"15min":1.248},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.079,"15min":1.079},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.002,"5min":1.149,"15min":1.149},"last":0.88600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":448471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.629,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.625,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55500000000000005,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":1.095,"15min":1.095},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93300000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92400000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.264}]},{"osd":6,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.264,"15min":1.264},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.286,"15min":1.286},"last":1.2410000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88100000000000001,"5min":1.409,"15min":1.409},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.78100000000000003,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94699999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.121}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":447441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.43099999999999999,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51300000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63900000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49199999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59399999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88900000000000001,"5min":1.075,"15min":1.075},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83699999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.27,"15min":1.27},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":1.389,"15min":1.389},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83499999999999996,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.874,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.93000000000000005,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":447053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.044,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.877,"5min":1.02,"15min":1.02},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81000000000000005,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":1.048,"15min":1.048},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0940000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1638400,"data_stored":1036292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":1.393,"15min":1.393},"last":0.312},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66100000000000003,"5min":1.319,"15min":1.319},"last":0.374}]},{"osd":2,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0049999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71199999999999997,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.589,"15min":1.589},"last":0.437}]},{"osd":4,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.81200000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.778,"15min":1.778},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4099999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0089999999999999,"5min":1.496,"15min":1.496},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3740000000000001,"5min":1.454,"15min":1.454},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81100000000000005,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.829,"15min":1.829},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:05.558 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:33:05.559 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:33:05.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 Processor -- start 2023-11-24T06:33:05.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 -- start start 2023-11-24T06:33:05.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f354c15a180 0x7f354c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.745 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a560 0x7f354c0b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f354c0ca770 0x7f354c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c0ceff0 con 0x7f354c0ca770 2023-11-24T06:33:05.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c0ce3e0 con 0x7f354c15a180 2023-11-24T06:33:05.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3553faa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0ce6c0 con 0x7f354c15a560 2023-11-24T06:33:05.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f354c0ca770 0x7f354c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.747 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f354c0ca770 0x7f354c0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51386/0 (socket says 172.21.15.143:51386) 2023-11-24T06:33:05.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 -- 172.21.15.143:0/2413257001 learned_addr learned my addr 172.21.15.143:0/2413257001 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:05.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3551d46640 1 --2- 172.21.15.143:0/2413257001 >> v2:172.21.15.146:3300/0 conn(0x7f354c15a180 0x7f354c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3551545640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a560 0x7f354c0b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 -- 172.21.15.143:0/2413257001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a560 msgr2=0x7f354c0b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:05.748 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a560 0x7f354c0b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 -- 172.21.15.143:0/2413257001 >> v2:172.21.15.146:3300/0 conn(0x7f354c15a180 msgr2=0x7f354c0c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:05.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 --2- 172.21.15.143:0/2413257001 >> v2:172.21.15.146:3300/0 conn(0x7f354c15a180 0x7f354c0c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3552547640 1 -- 172.21.15.143:0/2413257001 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0ce9a0 con 0x7f354c0ca770 2023-11-24T06:33:05.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.736+0000 7f3551545640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a560 0x7f354c0b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:05.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c0ca770 0x7f354c0ccac0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f354c0b6330 tx=0x7f354401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d17017d2e80976 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:05.756 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3550d44640 1 -- 172.21.15.143:0/2413257001 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440a5780 con 0x7f354c0ca770 2023-11-24T06:33:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3550d44640 1 -- 172.21.15.143:0/2413257001 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35440a58e0 con 0x7f354c0ca770 2023-11-24T06:33:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3550d44640 1 -- 172.21.15.143:0/2413257001 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440a5c70 con 0x7f354c0ca770 2023-11-24T06:33:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/2413257001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c0ca770 msgr2=0x7f354c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c0ca770 0x7f354c0ccac0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f354c0b6330 tx=0x7f354401c9a0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/2413257001 shutdown_connections 2023-11-24T06:33:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c0ca770 0x7f354c0ccac0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- 172.21.15.143:0/2413257001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a560 0x7f354c0b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- 172.21.15.143:0/2413257001 >> v2:172.21.15.146:3300/0 conn(0x7f354c15a180 0x7f354c0c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/2413257001 >> 172.21.15.143:0/2413257001 conn(0x7f354c071ce0 msgr2=0x7f354c0b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:05.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/2413257001 shutdown_connections 2023-11-24T06:33:05.758 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/2413257001 wait complete. 2023-11-24T06:33:05.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 Processor -- start 2023-11-24T06:33:05.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- start start 2023-11-24T06:33:05.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f354c0ca770 0x7f354c1640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a180 0x7f354c0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 0x7f354c0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.759 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0b38a0 con 0x7f354c15a560 2023-11-24T06:33:05.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0b2f70 con 0x7f354c0ca770 2023-11-24T06:33:05.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0b3250 con 0x7f354c15a180 2023-11-24T06:33:05.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 0x7f354c0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 0x7f354c0b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51396/0 (socket says 172.21.15.143:51396) 2023-11-24T06:33:05.760 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 -- 172.21.15.143:0/1102107203 learned_addr learned my addr 172.21.15.143:0/1102107203 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:05.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3551d46640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f354c0ca770 0x7f354c1640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3551545640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a180 0x7f354c0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 -- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a180 msgr2=0x7f354c0b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a180 0x7f354c0b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.761 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 -- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f354c0ca770 msgr2=0x7f354c1640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:05.762 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f354c0ca770 0x7f354c1640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 -- 172.21.15.143:0/1102107203 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544009b30 con 0x7f354c15a560 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3552547640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 0x7f354c0b52a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f35440af040 tx=0x7f3544019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440b8670 con 0x7f354c15a560 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35440b87d0 con 0x7f354c15a560 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440b8b80 con 0x7f354c15a560 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c0b3530 con 0x7f354c15a560 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c0b57e0 con 0x7f354c15a560 2023-11-24T06:33:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.744+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c0b3a10 con 0x7f354c15a560 2023-11-24T06:33:05.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.748+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f35440b8ce0 con 0x7f354c15a560 2023-11-24T06:33:05.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.748+0000 7f35427fc640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3530066a10 0x7f3530068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:05.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.748+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f354411ffa0 con 0x7f354c15a560 2023-11-24T06:33:05.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.748+0000 7f3551d46640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3530066a10 0x7f3530068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:05.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.748+0000 7f3551d46640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3530066a10 0x7f3530068ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f354c0d0400 tx=0x7f3548008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:05.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.752+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35440ece70 con 0x7f354c15a560 2023-11-24T06:33:05.970 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.964+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f354c09e3d0 con 0x7f354c15a560 2023-11-24T06:33:06.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f35427fc640 1 -- 172.21.15.143:0/1102107203 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f35440bc0e0 con 0x7f354c15a560 2023-11-24T06:33:06.004 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-11-24T06:33:06.004 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYQmBlM3+MOhAAdY6Vc/x9aDG51yzEd4SEHA== 2023-11-24T06:33:06.004 INFO:teuthology.orchestra.run.smithi143.stdout: caps mds = "allow" 2023-11-24T06:33:06.004 INFO:teuthology.orchestra.run.smithi143.stdout: caps mon = "allow r" 2023-11-24T06:33:06.004 INFO:teuthology.orchestra.run.smithi143.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:33:06.006 INFO:teuthology.orchestra.run.smithi143.stderr:updated caps for client.0 2023-11-24T06:33:06.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3530066a10 msgr2=0x7f3530068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3530066a10 0x7f3530068ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f354c0d0400 tx=0x7f3548008040 comp rx=0 tx=0).stop 2023-11-24T06:33:06.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 msgr2=0x7f354c0b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 0x7f354c0b52a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f35440af040 tx=0x7f3544019740 comp rx=0 tx=0).stop 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 shutdown_connections 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f3530066a10 0x7f3530068ed0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f354c15a560 0x7f354c0b52a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f354c15a180 0x7f354c0b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 --2- 172.21.15.143:0/1102107203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f354c0ca770 0x7f354c1640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 >> 172.21.15.143:0/1102107203 conn(0x7f354c071ce0 msgr2=0x7f354c06df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 shutdown_connections 2023-11-24T06:33:06.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:05.968+0000 7f3553faa640 1 -- 172.21.15.143:0/1102107203 wait complete. 2023-11-24T06:33:06.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:06.074 INFO:tasks.ceph.mds.a.smithi143.stderr:2023-11-24T06:33:06.068+0000 7f7ec19e1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:33:06.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 Processor -- start 2023-11-24T06:33:06.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 -- start start 2023-11-24T06:33:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 0x7f0d3c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d3c070cf0 0x7f0d3c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c06dc20 con 0x7f0d3c158a50 2023-11-24T06:33:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c06e0b0 con 0x7f0d3c070cf0 2023-11-24T06:33:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.144+0000 7f0d444ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c071160 con 0x7f0d3c06e340 2023-11-24T06:33:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 0x7f0d3c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d42a87640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d3c070cf0 0x7f0d3c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 0x7f0d3c0707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:59918/0 (socket says 172.21.15.143:59918) 2023-11-24T06:33:06.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 -- 172.21.15.143:0/2656834508 learned_addr learned my addr 172.21.15.143:0/2656834508 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 -- 172.21.15.143:0/2656834508 >> v2:172.21.15.146:3300/0 conn(0x7f0d3c070cf0 msgr2=0x7f0d3c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 --2- 172.21.15.143:0/2656834508 >> v2:172.21.15.146:3300/0 conn(0x7f0d3c070cf0 0x7f0d3c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 -- 172.21.15.143:0/2656834508 >> v1:172.21.15.146:6789/0 conn(0x7f0d3c158a50 legacy=0x7f0d3c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 -- 172.21.15.143:0/2656834508 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c06cd60 con 0x7f0d3c06e340 2023-11-24T06:33:06.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d42a87640 1 --2- 172.21.15.143:0/2656834508 >> v2:172.21.15.146:3300/0 conn(0x7f0d3c070cf0 0x7f0d3c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:06.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 --2- 172.21.15.143:0/2656834508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 0x7f0d3c0707b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e88318a64b88218 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41284640 1 -- 172.21.15.143:0/2656834508 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0a9400 con 0x7f0d3c06e340 2023-11-24T06:33:06.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41284640 1 -- 172.21.15.143:0/2656834508 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0a9560 con 0x7f0d3c06e340 2023-11-24T06:33:06.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41284640 1 -- 172.21.15.143:0/2656834508 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0a98f0 con 0x7f0d3c06e340 2023-11-24T06:33:06.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- 172.21.15.143:0/2656834508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 msgr2=0x7f0d3c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 --2- 172.21.15.143:0/2656834508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 0x7f0d3c0707b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c01c540 comp rx=0 tx=0).stop 2023-11-24T06:33:06.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- 172.21.15.143:0/2656834508 shutdown_connections 2023-11-24T06:33:06.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 --2- 172.21.15.143:0/2656834508 >> v2:172.21.15.146:3300/0 conn(0x7f0d3c070cf0 0x7f0d3c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 --2- 172.21.15.143:0/2656834508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c06e340 0x7f0d3c0707b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- 172.21.15.143:0/2656834508 >> 172.21.15.143:0/2656834508 conn(0x7f0d3c0b0bf0 msgr2=0x7f0d3c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- 172.21.15.143:0/2656834508 shutdown_connections 2023-11-24T06:33:06.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- 172.21.15.143:0/2656834508 wait complete. 2023-11-24T06:33:06.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 Processor -- start 2023-11-24T06:33:06.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- start start 2023-11-24T06:33:06.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c06e340 0x7f0d3c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c070cf0 0x7f0d3c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 0x7f0d3c148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c148ed0 con 0x7f0d3c158a50 2023-11-24T06:33:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c155030 con 0x7f0d3c06e340 2023-11-24T06:33:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d444ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c161250 con 0x7f0d3c070cf0 2023-11-24T06:33:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d42a87640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 0x7f0d3c148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d42286640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c06e340 0x7f0d3c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d42a87640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 0x7f0d3c148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51398/0 (socket says 172.21.15.143:51398) 2023-11-24T06:33:06.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d42a87640 1 -- 172.21.15.143:0/267499245 learned_addr learned my addr 172.21.15.143:0/267499245 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.148+0000 7f0d41a85640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c070cf0 0x7f0d3c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42a87640 1 -- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c070cf0 msgr2=0x7f0d3c155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.162 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42a87640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c070cf0 0x7f0d3c155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42a87640 1 -- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c06e340 msgr2=0x7f0d3c154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42a87640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c06e340 0x7f0d3c154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42a87640 1 -- 172.21.15.143:0/267499245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009a70 con 0x7f0d3c158a50 2023-11-24T06:33:06.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42a87640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 0x7f0d3c148990 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400efc0 tx=0x7f0d3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34009cd0 con 0x7f0d3c158a50 2023-11-24T06:33:06.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400f040 con 0x7f0d3c158a50 2023-11-24T06:33:06.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c0094d0 con 0x7f0d3c158a50 2023-11-24T06:33:06.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340039a0 con 0x7f0d3c158a50 2023-11-24T06:33:06.164 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c161810 con 0x7f0d3c158a50 2023-11-24T06:33:06.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c1610b0 con 0x7f0d3c158a50 2023-11-24T06:33:06.165 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f0d34014480 con 0x7f0d3c158a50 2023-11-24T06:33:06.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d32ffd640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d20066a40 0x7f0d20068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0d34085550 con 0x7f0d3c158a50 2023-11-24T06:33:06.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.156+0000 7f0d42286640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d20066a40 0x7f0d20068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.166 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.160+0000 7f0d42286640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d20066a40 0x7f0d20068f00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c16b830 tx=0x7f0d38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.160+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d3c1610b0 con 0x7f0d3c158a50 2023-11-24T06:33:06.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d3c1610b0 con 0x7f0d3c158a50 2023-11-24T06:33:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d32ffd640 1 -- 172.21.15.143:0/267499245 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f0d3c1610b0 con 0x7f0d3c158a50 2023-11-24T06:33:06.347 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:06.347 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:33:00.473562+0000","modified":"2023-11-24T06:33:03.488843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7032":{"gid":7032,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/1990915261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1990915261},{"type":"v1","addr":"172.21.15.143:6837","nonce":1990915261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-24T06:33:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 54 2023-11-24T06:33:06.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d20066a40 msgr2=0x7f0d20068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d20066a40 0x7f0d20068f00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c16b830 tx=0x7f0d38009040 comp rx=0 tx=0).stop 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 msgr2=0x7f0d3c148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 0x7f0d3c148990 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400efc0 tx=0x7f0d3400c490 comp rx=0 tx=0).stop 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 shutdown_connections 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f0d20066a40 0x7f0d20068f00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c158a50 0x7f0d3c148990 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d3c070cf0 0x7f0d3c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 --2- 172.21.15.143:0/267499245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c06e340 0x7f0d3c154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 >> 172.21.15.143:0/267499245 conn(0x7f0d3c0b0bf0 msgr2=0x7f0d3c06c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 shutdown_connections 2023-11-24T06:33:06.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.344+0000 7f0d444ea640 1 -- 172.21.15.143:0/267499245 wait complete. 2023-11-24T06:33:06.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:33:00.473562+0000', 'modified': '2023-11-24T06:33:03.488843+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7032}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7032': {'gid': 7032, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/1990915261', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6836', 'nonce': 1990915261}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 1990915261}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:33:06.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:33:06.771 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-24T06:33:06.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 Processor -- start 2023-11-24T06:33:06.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 -- start start 2023-11-24T06:33:06.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f86e40d3020 0x7f86e40d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86e40ce8b0 0x7f86e40ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e406c0e0 con 0x7f86e415d570 2023-11-24T06:33:06.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40d39f0 con 0x7f86e40d3020 2023-11-24T06:33:06.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e9eaa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40d1cc0 con 0x7f86e40ce8b0 2023-11-24T06:33:06.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f86e415d570 0x7f86e406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56482/0 (socket says 172.21.15.143:56482) 2023-11-24T06:33:06.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e37fe640 1 -- 172.21.15.143:0/1678575519 learned_addr learned my addr 172.21.15.143:0/1678575519 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:06.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1678575519 >> v2:172.21.15.143:3300/0 conn(0x7f86e40d3020 0x7f86e40d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86dbfff640 1 -- 172.21.15.143:0/1678575519 >> v2:172.21.15.146:3300/0 conn(0x7f86e40ce8b0 msgr2=0x7f86e40ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1678575519 >> v2:172.21.15.146:3300/0 conn(0x7f86e40ce8b0 0x7f86e40ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86dbfff640 1 -- 172.21.15.143:0/1678575519 >> v1:172.21.15.143:6789/0 conn(0x7f86e415d570 legacy=0x7f86e406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86dbfff640 1 -- 172.21.15.143:0/1678575519 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40d1fa0 con 0x7f86e40d3020 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.908+0000 7f86e2ffd640 1 -- 172.21.15.143:0/1678575519 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925891149 0 0) 0x7f86e406c0e0 con 0x7f86e415d570 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1678575519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40d3020 0x7f86e40d34b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f86e406d730 tx=0x7f86cc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4282a75c1569bf6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e2ffd640 1 -- 172.21.15.143:0/1678575519 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0a7070 con 0x7f86e40d3020 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e2ffd640 1 -- 172.21.15.143:0/1678575519 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc0ab430 con 0x7f86e40d3020 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e2ffd640 1 -- 172.21.15.143:0/1678575519 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0ab7c0 con 0x7f86e40d3020 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1678575519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40d3020 msgr2=0x7f86e40d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1678575519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40d3020 0x7f86e40d34b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f86e406d730 tx=0x7f86cc01c430 comp rx=0 tx=0).stop 2023-11-24T06:33:06.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1678575519 shutdown_connections 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1678575519 >> v2:172.21.15.146:3300/0 conn(0x7f86e40ce8b0 0x7f86e40ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1678575519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40d3020 0x7f86e40d34b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1678575519 >> 172.21.15.143:0/1678575519 conn(0x7f86e408ceb0 msgr2=0x7f86e409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1678575519 shutdown_connections 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.912+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1678575519 wait complete. 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 Processor -- start 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 -- start start 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 0x7f86e4152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e40d3020 0x7f86e4156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86e415d570 0x7f86e40cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c6f30 con 0x7f86e40ce8b0 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41573d0 con 0x7f86e40d3020 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4157c70 con 0x7f86e415d570 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 0x7f86e4152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 0x7f86e4152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51422/0 (socket says 172.21.15.143:51422) 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 -- 172.21.15.143:0/1338812393 learned_addr learned my addr 172.21.15.143:0/1338812393 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e3fff640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86e415d570 0x7f86e40cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e40d3020 0x7f86e4156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 -- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86e415d570 msgr2=0x7f86e40cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.927 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86e415d570 0x7f86e40cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 -- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e40d3020 msgr2=0x7f86e4156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e40d3020 0x7f86e4156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 -- 172.21.15.143:0/1338812393 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc009420 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 0x7f86e4152d60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c480 tx=0x7f86d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e0ff9640 1 -- 172.21.15.143:0/1338812393 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40074e0 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e0ff9640 1 -- 172.21.15.143:0/1338812393 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4007660 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e0ff9640 1 -- 172.21.15.143:0/1338812393 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4004a30 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4156d00 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.916+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4157900 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86e0ff9640 1 -- 172.21.15.143:0/1338812393 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f86d4004b90 con 0x7f86e40ce8b0 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86e0ff9640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86c4066a10 0x7f86c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86e0ff9640 1 -- 172.21.15.143:0/1338812393 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f86d4083a90 con 0x7f86e40ce8b0 2023-11-24T06:33:06.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86c4066a10 0x7f86c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86ed21c000 1 Processor -- start 2023-11-24T06:33:06.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86ed21c000 1 -- start start 2023-11-24T06:33:06.929 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.920+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86c4066a10 0x7f86c4068ed0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0af000 tx=0x7f86cc0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea7e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea33de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea34700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.935 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee89e130 con 0x55bbeea7e5b0 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee88b9a0 con 0x55bbeea7dc90 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbee888ed0 con 0x55bbeea34320 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea33de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea7e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea33de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51438/0 (socket says 172.21.15.143:51438) 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 -- 172.21.15.143:0/4098112856 learned_addr learned my addr 172.21.15.143:0/4098112856 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86e3fff640 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea34700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 -- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 msgr2=0x55bbeea34700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea34700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 -- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 msgr2=0x55bbeea7e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.936 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea7e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 -- 172.21.15.143:0/4098112856 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbee57c890 con 0x55bbeea7e5b0 2023-11-24T06:33:06.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86dbfff640 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea33de0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000c10 tx=0x7f86cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5cf1d738a0f594 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86d97fa640 1 -- 172.21.15.143:0/4098112856 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0b47b0 con 0x55bbeea7e5b0 2023-11-24T06:33:06.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86d97fa640 1 -- 172.21.15.143:0/4098112856 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc0c4070 con 0x55bbeea7e5b0 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86d97fa640 1 -- 172.21.15.143:0/4098112856 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0b4b50 con 0x55bbeea7e5b0 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- 172.21.15.143:0/4098112856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 msgr2=0x55bbeea33de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea33de0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000c10 tx=0x7f86cc004740 comp rx=0 tx=0).stop 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- 172.21.15.143:0/4098112856 shutdown_connections 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea34700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea33de0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 --2- 172.21.15.143:0/4098112856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea7e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- 172.21.15.143:0/4098112856 >> 172.21.15.143:0/4098112856 conn(0x55bbeea302d0 msgr2=0x55bbeea326c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- 172.21.15.143:0/4098112856 shutdown_connections 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- 172.21.15.143:0/4098112856 wait complete. 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 -- start start 2023-11-24T06:33:06.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.924+0000 7f86ed21c000 1 Processor -- start 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 0x55bbeea38d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea39280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7e5b0 0x55bbeea4c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee8847c0 con 0x55bbeea34320 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee83cbf0 con 0x55bbeea7dc90 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbee842a90 con 0x55bbeea7e5b0 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 10 client.0 _ll_register_callbacks cb 0x55bbeea1f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 0x55bbeea38d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 0x55bbeea38d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51446/0 (socket says 172.21.15.143:51446) 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 -- 172.21.15.143:0/1417877275 learned_addr learned my addr 172.21.15.143:0/1417877275 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e3fff640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7e5b0 0x55bbeea4c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea39280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 -- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7e5b0 msgr2=0x55bbeea4c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7e5b0 0x55bbeea4c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 -- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 msgr2=0x55bbeea39280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea39280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 -- 172.21.15.143:0/1417877275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc0ba070 con 0x55bbeea34320 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 0x55bbeea38d40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f86d40508d0 tx=0x7f86d4054550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8591f3c6cbf15f6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 1 -- 172.21.15.143:0/1417877275 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4081690 con 0x55bbeea34320 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 1 -- 172.21.15.143:0/1417877275 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f86d4053ac0 con 0x55bbeea34320 2023-11-24T06:33:06.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbee846470 con 0x55bbeea34320 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 1 -- 172.21.15.143:0/1417877275 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86d4081260 con 0x55bbeea34320 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 10 client.7161 fetch_fsmap learned FSMap version 54 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55bbee845190 con 0x55bbeea34320 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 1 -- 172.21.15.143:0/1417877275 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d406f030 con 0x55bbeea34320 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 1 -- 172.21.15.143:0/1417877275 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f86d405c240 con 0x55bbeea34320 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 10 client.7161 fetch_fsmap finished waiting for FSMap version 54 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 10 client.7161 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 20 client.7161 populate_metadata read hostname 'smithi143' 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea4d320 0x55bbeea8ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 4 client.7161 mds_command: new command op to 7032 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 --> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbee849b50 con 0x55bbeea4d320 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea4d320 0x55bbeea8ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 10 client.7161 ms_handle_connect on v2:172.21.15.143:6836/1990915261 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea4d320 0x55bbeea8ff50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24af866d6c874b6f server_cookie=cd70b9ca91abb741 in_seq=0 out_seq=0 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 1 -- 172.21.15.143:0/1417877275 <== mds.0 v2:172.21.15.143:6836/1990915261 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bbee849b50 con 0x55bbeea4d320 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.928+0000 7f86c27fc640 10 client.7161 handle_command_reply: tid=0 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 client.7161 shutdown 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 msgr2=0x55bbeea38d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 0x55bbeea38d40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f86d40508d0 tx=0x7f86d4054550 comp rx=0 tx=0).stop 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 shutdown_connections 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7e5b0 0x55bbeea4c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea4d320 0x55bbeea8ff50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7dc90 0x55bbeea39280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1417877275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea34320 0x55bbeea38d40 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 >> 172.21.15.143:0/1417877275 conn(0x55bbeea302d0 msgr2=0x55bbeea326c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86c27fc640 0 client.7161 ms_handle_reset on v2:172.21.15.143:6836/1990915261 2023-11-24T06:33:06.944 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 shutdown_connections 2023-11-24T06:33:06.944 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 1 -- 172.21.15.143:0/1417877275 wait complete. 2023-11-24T06:33:06.944 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.932+0000 7f86ed21c000 20 client.7161 trim_cache size 0 max 16384 2023-11-24T06:33:06.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.944+0000 7f86ed21c000 1 Processor -- start 2023-11-24T06:33:06.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.944+0000 7f86ed21c000 1 -- start start 2023-11-24T06:33:06.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea34320 0x55bbeea7ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7dc90 0x55bbeea7bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea7c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbeea30190 con 0x55bbeea7e5b0 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee53d940 con 0x55bbeea34320 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbee8805c0 con 0x55bbeea7dc90 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea7c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea7c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51450/0 (socket says 172.21.15.143:51450) 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 -- 172.21.15.143:0/1927865200 learned_addr learned my addr 172.21.15.143:0/1927865200 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86dbfff640 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7dc90 0x55bbeea7bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e37fe640 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea34320 0x55bbeea7ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 -- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7dc90 msgr2=0x55bbeea7bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7dc90 0x55bbeea7bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 -- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea34320 msgr2=0x55bbeea7ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea34320 0x55bbeea7ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 -- 172.21.15.143:0/1927865200 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbee82b490 con 0x55bbeea7e5b0 2023-11-24T06:33:06.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86e3fff640 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea7c070 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00a750 tx=0x7f86dc0097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dfe2784f9c7cf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86d9ffb640 1 -- 172.21.15.143:0/1927865200 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007b40 con 0x55bbeea7e5b0 2023-11-24T06:33:06.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86d9ffb640 1 -- 172.21.15.143:0/1927865200 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc014040 con 0x55bbeea7e5b0 2023-11-24T06:33:06.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86d9ffb640 1 -- 172.21.15.143:0/1927865200 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0183f0 con 0x55bbeea7e5b0 2023-11-24T06:33:06.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- 172.21.15.143:0/1927865200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 msgr2=0x55bbeea7c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea7c070 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00a750 tx=0x7f86dc0097a0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- 172.21.15.143:0/1927865200 shutdown_connections 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7e5b0 0x55bbeea7c070 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea7dc90 0x55bbeea7bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 --2- 172.21.15.143:0/1927865200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea34320 0x55bbeea7ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- 172.21.15.143:0/1927865200 >> 172.21.15.143:0/1927865200 conn(0x55bbeea302d0 msgr2=0x55bbeea326c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- 172.21.15.143:0/1927865200 shutdown_connections 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- 172.21.15.143:0/1927865200 wait complete. 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 -- start start 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.948+0000 7f86ed21c000 1 Processor -- start 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea90fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 0x55bbeea914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7e5b0 0x55bbeea9b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee883fd0 con 0x55bbeea7dc90 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbee84e6c0 con 0x55bbeea7e5b0 2023-11-24T06:33:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbee84e2e0 con 0x55bbeea34320 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 10 client.0 _ll_register_callbacks cb 0x55bbee8d2c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 0x55bbeea914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 0x55bbeea914e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51456/0 (socket says 172.21.15.143:51456) 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 -- 172.21.15.143:0/2230245421 learned_addr learned my addr 172.21.15.143:0/2230245421 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 -- 172.21.15.143:0/2230245421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 msgr2=0x55bbeea90fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea90fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 -- 172.21.15.143:0/2230245421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7e5b0 msgr2=0x55bbeea9b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7e5b0 0x55bbeea9b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 -- 172.21.15.143:0/2230245421 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc00a400 con 0x55bbeea7dc90 2023-11-24T06:33:06.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86dbfff640 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 0x55bbeea914e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000c10 tx=0x7f86cc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98370e41ac384cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 1 -- 172.21.15.143:0/2230245421 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0ab880 con 0x55bbeea7dc90 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 1 -- 172.21.15.143:0/2230245421 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f86cc0b4770 con 0x55bbeea7dc90 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbee883110 con 0x55bbeea7dc90 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 1 -- 172.21.15.143:0/2230245421 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86cc0b4930 con 0x55bbeea7dc90 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 10 client.7167 fetch_fsmap learned FSMap version 54 2023-11-24T06:33:06.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55bbee57ccc0 con 0x55bbeea7dc90 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 1 -- 172.21.15.143:0/2230245421 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbee883110 con 0x55bbeea7dc90 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 1 -- 172.21.15.143:0/2230245421 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f86cc0d0040 con 0x55bbeea7dc90 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 10 client.7167 fetch_fsmap finished waiting for FSMap version 54 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 10 client.7167 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 20 client.7167 populate_metadata read hostname 'smithi143' 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea9bf20 0x55bbeea9c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:06.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 4 client.7167 mds_command: new command op to 7032 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 --> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bbee8b29a0 con 0x55bbeea9bf20 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86e37fe640 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea9bf20 0x55bbeea9c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86e37fe640 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea9bf20 0x55bbeea9c300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32d68019f58f0cf6 server_cookie=5ff4c2d2fc73b304 in_seq=0 out_seq=0 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 10 client.7167 ms_handle_connect on v2:172.21.15.143:6836/1990915261 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 1 -- 172.21.15.143:0/2230245421 <== mds.0 v2:172.21.15.143:6836/1990915261 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55bbee8b29a0 con 0x55bbeea9bf20 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 10 client.7167 handle_command_reply: tid=0 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 client.7167 shutdown 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 msgr2=0x55bbeea914e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 0x55bbeea914e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000c10 tx=0x7f86cc0046d0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 shutdown_connections 2023-11-24T06:33:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:6836/1990915261,v1:172.21.15.143:6837/1990915261] conn(0x55bbeea9bf20 0x55bbeea9c300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbeea7e5b0 0x55bbeea9b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bbeea7dc90 0x55bbeea914e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86c27fc640 0 client.7167 ms_handle_reset on v2:172.21.15.143:6836/1990915261 2023-11-24T06:33:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 --2- 172.21.15.143:0/2230245421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55bbeea34320 0x55bbeea90fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 >> 172.21.15.143:0/2230245421 conn(0x55bbeea302d0 msgr2=0x55bbeea8b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 shutdown_connections 2023-11-24T06:33:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 1 -- 172.21.15.143:0/2230245421 wait complete. 2023-11-24T06:33:06.967 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.952+0000 7f86ed21c000 20 client.7167 trim_cache size 0 max 16384 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "039ed6d4-b5c2-4e8e-a15f-05a601a78248", 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 7032, 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2023-11-24T06:33:06.969 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2023-11-24T06:33:06.970 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 5.8697621680000003, 2023-11-24T06:33:06.970 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 54, 2023-11-24T06:33:06.970 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 85, 2023-11-24T06:33:06.970 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 85, 2023-11-24T06:33:06.970 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 11.739158843 2023-11-24T06:33:06.970 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86c4066a10 msgr2=0x7f86c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86c4066a10 0x7f86c4068ed0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0af000 tx=0x7f86cc0a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 msgr2=0x7f86e4152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 0x7f86e4152d60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c480 tx=0x7f86d400c940 comp rx=0 tx=0).stop 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 shutdown_connections 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f86c4066a10 0x7f86c4068ed0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86e415d570 0x7f86e40cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e40d3020 0x7f86e4156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 --2- 172.21.15.143:0/1338812393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86e40ce8b0 0x7f86e4152d60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:06.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 >> 172.21.15.143:0/1338812393 conn(0x7f86e408ceb0 msgr2=0x7f86e40b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:06.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 shutdown_connections 2023-11-24T06:33:06.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:06.956+0000 7f86e9eaa640 1 -- 172.21.15.143:0/1338812393 wait complete. 2023-11-24T06:33:06.976 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:33:07.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70c3aa640 1 Processor -- start 2023-11-24T06:33:07.115 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70c3aa640 1 -- start start 2023-11-24T06:33:07.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70c3aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7040b36c0 0x7fe7040b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:07.116 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70c3aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70415a700 con 0x7fe70415a320 2023-11-24T06:33:07.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70c3aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040b2620 con 0x7fe704070da0 2023-11-24T06:33:07.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70c3aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040b2430 con 0x7fe7040b36c0 2023-11-24T06:33:07.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70a146640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe70415a320 0x7fe704070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:56498/0 (socket says 172.21.15.143:56498) 2023-11-24T06:33:07.117 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.112+0000 7fe70a146640 1 -- 172.21.15.143:0/1237841514 learned_addr learned my addr 172.21.15.143:0/1237841514 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:07.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709945640 1 --2- 172.21.15.143:0/1237841514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7040b36c0 0x7fe7040b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:07.118 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709144640 1 -- 172.21.15.143:0/1237841514 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275205548 0 0) 0x7fe70415a700 con 0x7fe70415a320 2023-11-24T06:33:07.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709144640 1 -- 172.21.15.143:0/1237841514 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003530 con 0x7fe70415a320 2023-11-24T06:33:07.119 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709945640 1 -- 172.21.15.143:0/1237841514 >> v1:172.21.15.146:6789/0 conn(0x7fe704070da0 legacy=0x7fe70415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709945640 1 -- 172.21.15.143:0/1237841514 >> v1:172.21.15.143:6789/0 conn(0x7fe70415a320 legacy=0x7fe704070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.120 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709945640 1 -- 172.21.15.143:0/1237841514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040b2900 con 0x7fe7040b36c0 2023-11-24T06:33:07.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709945640 1 --2- 172.21.15.143:0/1237841514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7040b36c0 0x7fe7040b1ef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097f0 tx=0x7fe6f401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61b88261aa3848f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:07.121 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709144640 1 -- 172.21.15.143:0/1237841514 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40ac600 con 0x7fe7040b36c0 2023-11-24T06:33:07.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709144640 1 -- 172.21.15.143:0/1237841514 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40a8050 con 0x7fe7040b36c0 2023-11-24T06:33:07.122 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.116+0000 7fe709144640 1 -- 172.21.15.143:0/1237841514 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40ac960 con 0x7fe7040b36c0 2023-11-24T06:33:07.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- 172.21.15.143:0/1237841514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7040b36c0 msgr2=0x7fe7040b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/1237841514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7040b36c0 0x7fe7040b1ef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097f0 tx=0x7fe6f401c490 comp rx=0 tx=0).stop 2023-11-24T06:33:07.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- 172.21.15.143:0/1237841514 shutdown_connections 2023-11-24T06:33:07.123 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/1237841514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7040b36c0 0x7fe7040b1ef0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- 172.21.15.143:0/1237841514 >> 172.21.15.143:0/1237841514 conn(0x7fe7040b0bf0 msgr2=0x7fe7040b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:07.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- 172.21.15.143:0/1237841514 shutdown_connections 2023-11-24T06:33:07.124 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- 172.21.15.143:0/1237841514 wait complete. 2023-11-24T06:33:07.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 Processor -- start 2023-11-24T06:33:07.126 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- start start 2023-11-24T06:33:07.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 0x7fe7041567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:07.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7040b36c0 0x7fe70413e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:07.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe70415a320 0x7fe70413d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:07.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040cc770 con 0x7fe704070da0 2023-11-24T06:33:07.127 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040cebb0 con 0x7fe7040b36c0 2023-11-24T06:33:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70c3aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040cdfa0 con 0x7fe70415a320 2023-11-24T06:33:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70a146640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 0x7fe7041567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70a146640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 0x7fe7041567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51462/0 (socket says 172.21.15.143:51462) 2023-11-24T06:33:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70a146640 1 -- 172.21.15.143:0/3603951636 learned_addr learned my addr 172.21.15.143:0/3603951636 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe70a947640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe70415a320 0x7fe70413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.120+0000 7fe709945640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7040b36c0 0x7fe70413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70a146640 1 -- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe70415a320 msgr2=0x7fe70413d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70a146640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe70415a320 0x7fe70413d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70a146640 1 -- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7040b36c0 msgr2=0x7fe70413e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70a146640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7040b36c0 0x7fe70413e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.129 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70a146640 1 -- 172.21.15.143:0/3603951636 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009420 con 0x7fe704070da0 2023-11-24T06:33:07.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe709945640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7040b36c0 0x7fe70413e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:07.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70a146640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 0x7fe7041567d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c450 tx=0x7fe70000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:07.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700005cf0 con 0x7fe704070da0 2023-11-24T06:33:07.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005e50 con 0x7fe704070da0 2023-11-24T06:33:07.130 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700007270 con 0x7fe704070da0 2023-11-24T06:33:07.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040ce280 con 0x7fe704070da0 2023-11-24T06:33:07.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7040ce840 con 0x7fe704070da0 2023-11-24T06:33:07.131 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe704073c20 con 0x7fe704070da0 2023-11-24T06:33:07.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fe7000073d0 con 0x7fe704070da0 2023-11-24T06:33:07.132 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe6faffd640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6e8066a10 0x7fe6e8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:07.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe700083ce0 con 0x7fe704070da0 2023-11-24T06:33:07.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.124+0000 7fe709945640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6e8066a10 0x7fe6e8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:07.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.128+0000 7fe709945640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6e8066a10 0x7fe6e8068ed0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ae000 tx=0x7fe6f40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:07.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.128+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe700050980 con 0x7fe704070da0 2023-11-24T06:33:07.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.312+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe704067520 con 0x7fe704070da0 2023-11-24T06:33:07.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.312+0000 7fe6faffd640 1 -- 172.21.15.143:0/3603951636 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe700017070 con 0x7fe704070da0 2023-11-24T06:33:07.316 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:33:07.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6e8066a10 msgr2=0x7fe6e8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6e8066a10 0x7fe6e8068ed0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ae000 tx=0x7fe6f40a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:07.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 msgr2=0x7fe7041567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 0x7fe7041567d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c450 tx=0x7fe70000c910 comp rx=0 tx=0).stop 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 shutdown_connections 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe6e8066a10 0x7fe6e8068ed0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe70415a320 0x7fe70413d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7040b36c0 0x7fe70413e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 --2- 172.21.15.143:0/3603951636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe704070da0 0x7fe7041567d0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 >> 172.21.15.143:0/3603951636 conn(0x7fe7040b0bf0 msgr2=0x7fe70406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 shutdown_connections 2023-11-24T06:33:07.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:07.316+0000 7fe70c3aa640 1 -- 172.21.15.143:0/3603951636 wait complete. 2023-11-24T06:33:07.336 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:33:07.337 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:33:07.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.338 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-11-24T06:33:07.348 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42176sec preferred_lft 42176sec 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-11-24T06:33:07.349 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:00:6f:5b:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:33:07.350 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run.smithi143.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:07.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.351 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:33:07.411 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-11-24T06:33:07.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.413 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-11-24T06:33:07.467 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:33:07.468 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:33:07.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.469 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-11-24T06:33:07.469 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-11-24T06:33:07.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:33:07.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:33:07.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:33:07.469 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-11-24T06:33:07.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.560 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:33:07.569 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:33:07.569 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:33:07.569 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:33:07.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.569 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-11-24T06:33:07.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:33:07.633 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:33:07.685 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:33:07.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:33:07.685 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:33:07.736 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:33:07.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.737 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:33:07.830 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:33:07.830 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:33:07.844 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:33:07.844 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:33:07.844 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:33:07.844 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:33:07.844 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:33:07.847 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:33:07.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.848 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:33:07.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:07.913 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:33:07.973 INFO:teuthology.orchestra.run.smithi143.stdout:client7176 2023-11-24T06:33:07.973 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:33:07.973 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:08.025 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:33:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.204+0000 7f7e6f59e640 1 Processor -- start 2023-11-24T06:33:08.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.204+0000 7f7e6f59e640 1 -- start start 2023-11-24T06:33:08.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6f59e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e7015a6b0 0x7f7e7006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:08.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e7015ab60 0x7f7e7006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:08.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6f59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7015b100 con 0x7f7e70143a90 2023-11-24T06:33:08.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6f59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7015b3e0 con 0x7f7e7015ab60 2023-11-24T06:33:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6f59e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7015ddb0 con 0x7f7e7015a6b0 2023-11-24T06:33:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6e59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7e70143a90 0x7f7e7015e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54672/0 (socket says 172.21.15.143:54672) 2023-11-24T06:33:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e7015ab60 0x7f7e7006dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6e59c640 1 -- 172.21.15.143:0/1077859451 learned_addr learned my addr 172.21.15.143:0/1077859451 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6dd9b640 1 --2- 172.21.15.143:0/1077859451 >> v2:172.21.15.146:3300/0 conn(0x7f7e7015a6b0 0x7f7e7006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:08.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6ed9d640 1 -- 172.21.15.143:0/1077859451 >> v2:172.21.15.146:3300/0 conn(0x7f7e7015a6b0 msgr2=0x7f7e7006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:08.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6ed9d640 1 --2- 172.21.15.143:0/1077859451 >> v2:172.21.15.146:3300/0 conn(0x7f7e7015a6b0 0x7f7e7006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6ed9d640 1 -- 172.21.15.143:0/1077859451 >> v1:172.21.15.143:6789/0 conn(0x7f7e70143a90 legacy=0x7f7e7015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:08.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6ed9d640 1 -- 172.21.15.143:0/1077859451 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7015e090 con 0x7f7e7015ab60 2023-11-24T06:33:08.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.208+0000 7f7e6d59a640 1 -- 172.21.15.143:0/1077859451 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761279297 0 0) 0x7f7e7015b100 con 0x7f7e70143a90 2023-11-24T06:33:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6ed9d640 1 --2- 172.21.15.143:0/1077859451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015ab60 0x7f7e7006dcb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7e700aea10 tx=0x7f7e6801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc6e9c6f923de8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6d59a640 1 -- 172.21.15.143:0/1077859451 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680ad660 con 0x7f7e7015ab60 2023-11-24T06:33:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6d59a640 1 -- 172.21.15.143:0/1077859451 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e680ad7c0 con 0x7f7e7015ab60 2023-11-24T06:33:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6d59a640 1 -- 172.21.15.143:0/1077859451 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680adb50 con 0x7f7e7015ab60 2023-11-24T06:33:08.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- 172.21.15.143:0/1077859451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015ab60 msgr2=0x7f7e7006dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/1077859451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015ab60 0x7f7e7006dcb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7e700aea10 tx=0x7f7e6801c340 comp rx=0 tx=0).stop 2023-11-24T06:33:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- 172.21.15.143:0/1077859451 shutdown_connections 2023-11-24T06:33:08.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/1077859451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015ab60 0x7f7e7006dcb0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/1077859451 >> v2:172.21.15.146:3300/0 conn(0x7f7e7015a6b0 0x7f7e7006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- 172.21.15.143:0/1077859451 >> 172.21.15.143:0/1077859451 conn(0x7f7e700cb840 msgr2=0x7f7e700cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- 172.21.15.143:0/1077859451 shutdown_connections 2023-11-24T06:33:08.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- 172.21.15.143:0/1077859451 wait complete. 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 Processor -- start 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- start start 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70143a90 0x7f7e70164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 0x7f7e7015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e7015ab60 0x7f7e70161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701601b0 con 0x7f7e7015a6b0 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70160640 con 0x7f7e70143a90 2023-11-24T06:33:08.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.212+0000 7f7e6f59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7015f5a0 con 0x7f7e7015ab60 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 0x7f7e7015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 0x7f7e7015ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41324/0 (socket says 172.21.15.143:41324) 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 -- 172.21.15.143:0/472843043 learned_addr learned my addr 172.21.15.143:0/472843043 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6ed9d640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e7015ab60 0x7f7e70161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6e59c640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70143a90 0x7f7e70164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 -- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e7015ab60 msgr2=0x7f7e70161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e7015ab60 0x7f7e70161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 -- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70143a90 msgr2=0x7f7e70164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70143a90 0x7f7e70164910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 -- 172.21.15.143:0/472843043 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009420 con 0x7f7e7015a6b0 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6dd9b640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 0x7f7e7015ed50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400d800 tx=0x7f7e6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:08.220 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400b6c0 con 0x7f7e7015a6b0 2023-11-24T06:33:08.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400b820 con 0x7f7e7015a6b0 2023-11-24T06:33:08.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400bb90 con 0x7f7e7015a6b0 2023-11-24T06:33:08.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70070e60 con 0x7f7e7015a6b0 2023-11-24T06:33:08.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7015fb60 con 0x7f7e7015a6b0 2023-11-24T06:33:08.221 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7004e850 con 0x7f7e7015a6b0 2023-11-24T06:33:08.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f7e6400bcf0 con 0x7f7e7015a6b0 2023-11-24T06:33:08.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.216+0000 7f7e5effd640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e50066a10 0x7f7e50068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:08.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.220+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7e64084dd0 con 0x7f7e7015a6b0 2023-11-24T06:33:08.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.220+0000 7f7e6e59c640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e50066a10 0x7f7e50068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:08.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.220+0000 7f7e6e59c640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e50066a10 0x7f7e50068ed0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e600012f0 tx=0x7f7e60005ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:08.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.224+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e64051980 con 0x7f7e7015a6b0 2023-11-24T06:33:08.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7e700cd760 con 0x7f7e7015a6b0 2023-11-24T06:33:08.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e5effd640 1 -- 172.21.15.143:0/472843043 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7e64054fa0 con 0x7f7e7015a6b0 2023-11-24T06:33:08.410 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e50066a10 msgr2=0x7f7e50068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e50066a10 0x7f7e50068ed0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e600012f0 tx=0x7f7e60005ec0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 msgr2=0x7f7e7015ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 0x7f7e7015ed50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400d800 tx=0x7f7e6400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 shutdown_connections 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e50066a10 0x7f7e50068ed0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e7015ab60 0x7f7e70161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7015a6b0 0x7f7e7015ed50 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 --2- 172.21.15.143:0/472843043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70143a90 0x7f7e70164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:08.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 >> 172.21.15.143:0/472843043 conn(0x7f7e700cb840 msgr2=0x7f7e7015d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:08.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 shutdown_connections 2023-11-24T06:33:08.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:08.408+0000 7f7e6f59e640 1 -- 172.21.15.143:0/472843043 wait complete. 2023-11-24T06:33:08.431 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:33:08.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:33:08.431 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-11-24T06:33:08.431 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:33:08.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:33:08.432 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:33:08.432 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:33:08.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:33:08.432 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:33:08.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.432 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-11-24T06:33:08.443 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:33:08.443 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:33:08.443 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:33:08.443 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.443 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-11-24T06:33:08.444 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.444 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:33:08.444 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:08.444 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-11-24T06:33:08.444 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:33:08.445 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:08.445 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-11-24T06:33:08.445 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:4b:93:56:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T06:33:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.447 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:33:08.448 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:33:08.448 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T06:33:08.448 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:33:08.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.449 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:33:08.510 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-11-24T06:33:08.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.513 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-11-24T06:33:08.523 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:33:08.527 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:33:08.564 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T06:33:08.565 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:33:08.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.566 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-11-24T06:33:08.566 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-11-24T06:33:08.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:33:08.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:33:08.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:33:08.566 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-11-24T06:33:08.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.705 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:33:08.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:33:08.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:33:08.715 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:33:08.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-11-24T06:33:08.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:33:08.782 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:33:08.833 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:33:08.834 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:33:08.834 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:33:08.884 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:33:08.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:33:08.976 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:33:08.976 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:33:08.991 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:33:08.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:33:08.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.146:3300,172.21.15.146:3301" 2023-11-24T06:33:08.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 1@039ed6d4-b5c2-4e8e-a15f-05a601a78248.cephfs=/ 2023-11-24T06:33:08.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.146:3300/172.21.15.146:3301" will pass to kernel 2023-11-24T06:33:08.996 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:33:08.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:08.997 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:33:09.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:09.017 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:33:09.069 INFO:teuthology.orchestra.run.smithi146.stdout:client7188 2023-11-24T06:33:09.069 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:33:09.069 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:09.122 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:33:09.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 Processor -- start 2023-11-24T06:33:09.271 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 -- start start 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed815a320 0x7f5ed80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ed8070da0 0x7f5ed815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed815a700 con 0x7f5ed80b36c0 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed80b2430 con 0x7f5ed8070da0 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.268+0000 7f5edd1e7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80b2620 con 0x7f5ed815a320 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ed8070da0 0x7f5ed815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ed8070da0 0x7f5ed815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41338/0 (socket says 172.21.15.143:41338) 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 -- 172.21.15.143:0/1440673907 learned_addr learned my addr 172.21.15.143:0/1440673907 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:09.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed6d9d640 1 --2- 172.21.15.143:0/1440673907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed815a320 0x7f5ed80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:09.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed659c640 1 -- 172.21.15.143:0/1440673907 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079288980 0 0) 0x7f5ed815a700 con 0x7f5ed80b36c0 2023-11-24T06:33:09.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 -- 172.21.15.143:0/1440673907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed815a320 msgr2=0x7f5ed80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:09.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 --2- 172.21.15.143:0/1440673907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed815a320 0x7f5ed80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:09.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 -- 172.21.15.143:0/1440673907 >> v1:172.21.15.143:6789/0 conn(0x7f5ed80b36c0 legacy=0x7f5ed8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:09.274 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 -- 172.21.15.143:0/1440673907 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80b2900 con 0x7f5ed8070da0 2023-11-24T06:33:09.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed759e640 1 --2- 172.21.15.143:0/1440673907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed8070da0 0x7f5ed815ddd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009e50 tx=0x7f5ed001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da70ea47ec8a015e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:09.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed659c640 1 -- 172.21.15.143:0/1440673907 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00a7ae0 con 0x7f5ed8070da0 2023-11-24T06:33:09.276 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed659c640 1 -- 172.21.15.143:0/1440673907 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed00a7c40 con 0x7f5ed8070da0 2023-11-24T06:33:09.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.272+0000 7f5ed659c640 1 -- 172.21.15.143:0/1440673907 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00af3f0 con 0x7f5ed8070da0 2023-11-24T06:33:09.277 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- 172.21.15.143:0/1440673907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed8070da0 msgr2=0x7f5ed815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/1440673907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed8070da0 0x7f5ed815ddd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009e50 tx=0x7f5ed001ebf0 comp rx=0 tx=0).stop 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- 172.21.15.143:0/1440673907 shutdown_connections 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/1440673907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed8070da0 0x7f5ed815ddd0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/1440673907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed815a320 0x7f5ed80b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- 172.21.15.143:0/1440673907 >> 172.21.15.143:0/1440673907 conn(0x7f5ed80b0bf0 msgr2=0x7f5ed80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- 172.21.15.143:0/1440673907 shutdown_connections 2023-11-24T06:33:09.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- 172.21.15.143:0/1440673907 wait complete. 2023-11-24T06:33:09.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 Processor -- start 2023-11-24T06:33:09.279 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- start start 2023-11-24T06:33:09.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed8070da0 0x7f5ed813e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:09.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed80b36c0 0x7f5ed8163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:09.281 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 0x7f5ed8163850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8158690 con 0x7f5ed815a320 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed813ebf0 con 0x7f5ed80b36c0 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5edd1e7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8157a50 con 0x7f5ed8070da0 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 0x7f5ed8163850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 0x7f5ed8163850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41340/0 (socket says 172.21.15.143:41340) 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 -- 172.21.15.143:0/783947053 learned_addr learned my addr 172.21.15.143:0/783947053 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed6d9d640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed8070da0 0x7f5ed813e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ecffff640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed80b36c0 0x7f5ed8163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 -- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed8070da0 msgr2=0x7f5ed813e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed8070da0 0x7f5ed813e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 -- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed80b36c0 msgr2=0x7f5ed8163310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:09.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed80b36c0 0x7f5ed8163310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.276+0000 7f5ed759e640 1 -- 172.21.15.143:0/783947053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009b30 con 0x7f5ed815a320 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ed759e640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 0x7f5ed8163850 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00b1040 tx=0x7f5ed001b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00a7ae0 con 0x7f5ed815a320 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000e150 con 0x7f5ed815a320 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0007df0 con 0x7f5ed815a320 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed8157cf0 con 0x7f5ed815a320 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81582b0 con 0x7f5ed815a320 2023-11-24T06:33:09.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed81587d0 con 0x7f5ed815a320 2023-11-24T06:33:09.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f5ed00af3f0 con 0x7f5ed815a320 2023-11-24T06:33:09.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ecf7fe640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5eb8066a10 0x7f5eb8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:09.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5ed011eae0 con 0x7f5ed815a320 2023-11-24T06:33:09.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.280+0000 7f5ed6d9d640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5eb8066a10 0x7f5eb8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:09.285 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.284+0000 7f5ed6d9d640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5eb8066a10 0x7f5eb8068ed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009ac0 tx=0x7f5ec8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:09.288 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.284+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ed81587d0 con 0x7f5ed815a320 2023-11-24T06:33:09.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:09.468+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ed81587d0 con 0x7f5ed815a320 2023-11-24T06:33:10.155 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.152+0000 7f5ecf7fe640 1 -- 172.21.15.143:0/783947053 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5ed81587d0 con 0x7f5ed815a320 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5eb8066a10 msgr2=0x7f5eb8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5eb8066a10 0x7f5eb8068ed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009ac0 tx=0x7f5ec8009190 comp rx=0 tx=0).stop 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 msgr2=0x7f5ed8163850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 0x7f5ed8163850 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00b1040 tx=0x7f5ed001b990 comp rx=0 tx=0).stop 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 shutdown_connections 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5eb8066a10 0x7f5eb8068ed0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ed815a320 0x7f5ed8163850 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed80b36c0 0x7f5ed8163310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 --2- 172.21.15.143:0/783947053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ed8070da0 0x7f5ed813e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 >> 172.21.15.143:0/783947053 conn(0x7f5ed80b0bf0 msgr2=0x7f5ed8070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:10.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 shutdown_connections 2023-11-24T06:33:10.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.156+0000 7f5edd1e7640 1 -- 172.21.15.143:0/783947053 wait complete. 2023-11-24T06:33:10.178 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:33:10.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a5dd0640 1 Processor -- start 2023-11-24T06:33:10.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a5dd0640 1 -- start start 2023-11-24T06:33:10.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a5dd0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43a00b8ed0 0x7f43a00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a5dd0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b6a30 con 0x7f43a00cdf80 2023-11-24T06:33:10.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a5dd0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b6c70 con 0x7f43a01608f0 2023-11-24T06:33:10.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a5dd0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a0160cd0 con 0x7f43a00b8ed0 2023-11-24T06:33:10.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a55cf640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f43a00cdf80 0x7f43a00ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54680/0 (socket says 172.21.15.143:54680) 2023-11-24T06:33:10.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f43a55cf640 1 -- 172.21.15.143:0/1886646280 learned_addr learned my addr 172.21.15.143:0/1886646280 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:10.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439ffff640 1 --2- 172.21.15.143:0/1886646280 >> v2:172.21.15.146:3300/0 conn(0x7f43a00b8ed0 0x7f43a00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9229062 0 0) 0x7f43980014a0 con 0x7f43a00cdf80 2023-11-24T06:33:10.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4390003530 con 0x7f43a00cdf80 2023-11-24T06:33:10.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216759052 0 0) 0x7f43a00b6c70 con 0x7f43a01608f0 2023-11-24T06:33:10.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43980014a0 con 0x7f43a01608f0 2023-11-24T06:33:10.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439ffff640 1 -- 172.21.15.143:0/1886646280 >> v1:172.21.15.146:6789/0 conn(0x7f43a01608f0 legacy=0x7f43a00b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439ffff640 1 -- 172.21.15.143:0/1886646280 >> v1:172.21.15.143:6789/0 conn(0x7f43a00cdf80 legacy=0x7f43a00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.322 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.316+0000 7f439ffff640 1 -- 172.21.15.143:0/1886646280 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00b6f50 con 0x7f43a00b8ed0 2023-11-24T06:33:10.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f439ffff640 1 --2- 172.21.15.143:0/1886646280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00b8ed0 0x7f43a00d12f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f438c0097c0 tx=0x7f438c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c4a5da97b6d90a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:10.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c0ab650 con 0x7f43a00b8ed0 2023-11-24T06:33:10.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c0ab7b0 con 0x7f43a00b8ed0 2023-11-24T06:33:10.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f439f7fe640 1 -- 172.21.15.143:0/1886646280 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c0abb40 con 0x7f43a00b8ed0 2023-11-24T06:33:10.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 -- 172.21.15.143:0/1886646280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00b8ed0 msgr2=0x7f43a00d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/1886646280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00b8ed0 0x7f43a00d12f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f438c0097c0 tx=0x7f438c01c450 comp rx=0 tx=0).stop 2023-11-24T06:33:10.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 -- 172.21.15.143:0/1886646280 shutdown_connections 2023-11-24T06:33:10.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/1886646280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00b8ed0 0x7f43a00d12f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 -- 172.21.15.143:0/1886646280 >> 172.21.15.143:0/1886646280 conn(0x7f43a00613d0 msgr2=0x7f43a00617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:10.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 -- 172.21.15.143:0/1886646280 shutdown_connections 2023-11-24T06:33:10.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.320+0000 7f43a5dd0640 1 -- 172.21.15.143:0/1886646280 wait complete. 2023-11-24T06:33:10.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 Processor -- start 2023-11-24T06:33:10.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 -- start start 2023-11-24T06:33:10.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43a00b8ed0 0x7f43a014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00cdf80 0x7f43a00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 0x7f43a00c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00b9310 con 0x7f43a01608f0 2023-11-24T06:33:10.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00b78f0 con 0x7f43a00cdf80 2023-11-24T06:33:10.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0155d00 con 0x7f43a00b8ed0 2023-11-24T06:33:10.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 0x7f43a00c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 0x7f43a00c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41348/0 (socket says 172.21.15.143:41348) 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 -- 172.21.15.143:0/3771518649 learned_addr learned my addr 172.21.15.143:0/3771518649 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f439ffff640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00cdf80 0x7f43a00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a4dce640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43a00b8ed0 0x7f43a014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 -- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43a00b8ed0 msgr2=0x7f43a014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43a00b8ed0 0x7f43a014b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 -- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00cdf80 msgr2=0x7f43a00c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00cdf80 0x7f43a00c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 -- 172.21.15.143:0/3771518649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c009420 con 0x7f43a01608f0 2023-11-24T06:33:10.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a55cf640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 0x7f43a00c77e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4398001f70 tx=0x7f439800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:10.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398012400 con 0x7f43a01608f0 2023-11-24T06:33:10.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398012560 con 0x7f43a01608f0 2023-11-24T06:33:10.331 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43980128f0 con 0x7f43a01608f0 2023-11-24T06:33:10.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a014e820 con 0x7f43a01608f0 2023-11-24T06:33:10.332 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.324+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a01561f0 con 0x7f43a01608f0 2023-11-24T06:33:10.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.328+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a014ea10 con 0x7f43a01608f0 2023-11-24T06:33:10.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.328+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f4398007070 con 0x7f43a01608f0 2023-11-24T06:33:10.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.328+0000 7f439d7fa640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4384066a40 0x7f4384068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.328+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4398084830 con 0x7f43a01608f0 2023-11-24T06:33:10.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.328+0000 7f43a4dce640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4384066a40 0x7f4384068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.333 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.328+0000 7f43a4dce640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4384066a40 0x7f4384068f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f43940011f0 tx=0x7f4394009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:10.336 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.332+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43a014ea10 con 0x7f43a01608f0 2023-11-24T06:33:10.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.500+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f43a00d2ba0 con 0x7f4384066a40 2023-11-24T06:33:10.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f439d7fa640 1 -- 172.21.15.143:0/3771518649 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f43a00d2ba0 con 0x7f4384066a40 2023-11-24T06:33:10.506 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2023-11-24T06:33:10.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2023-11-24T06:33:10.506 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "cephfs" 2023-11-24T06:33:10.506 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-11-24T06:33:10.506 INFO:teuthology.orchestra.run.smithi143.stdout:] 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4384066a40 msgr2=0x7f4384068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4384066a40 0x7f4384068f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f43940011f0 tx=0x7f4394009040 comp rx=0 tx=0).stop 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 msgr2=0x7f43a00c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 0x7f43a00c77e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4398001f70 tx=0x7f439800a430 comp rx=0 tx=0).stop 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 shutdown_connections 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4384066a40 0x7f4384068f00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43a01608f0 0x7f43a00c77e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a00cdf80 0x7f43a00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 --2- 172.21.15.143:0/3771518649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43a00b8ed0 0x7f43a014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 >> 172.21.15.143:0/3771518649 conn(0x7f43a00613d0 msgr2=0x7f43a00d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:10.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 shutdown_connections 2023-11-24T06:33:10.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.504+0000 7f43a5dd0640 1 -- 172.21.15.143:0/3771518649 wait complete. 2023-11-24T06:33:10.527 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:33:10.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 Processor -- start 2023-11-24T06:33:10.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 -- start start 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1af4140590 0x7f1af406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1af40cb850 0x7f1af406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cdb10 0x7f1af40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af4161280 con 0x7f1af40cb850 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af4161560 con 0x7f1af4140590 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1afa901640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4161840 con 0x7f1af40cdb10 2023-11-24T06:33:10.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1af40cb850 0x7f1af406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1af40cb850 0x7f1af406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41354/0 (socket says 172.21.15.143:41354) 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 -- 172.21.15.143:0/252974323 learned_addr learned my addr 172.21.15.143:0/252974323 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af3fff640 1 --2- 172.21.15.143:0/252974323 >> v2:172.21.15.146:3300/0 conn(0x7f1af4140590 0x7f1af406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af8e9e640 1 --2- 172.21.15.143:0/252974323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cdb10 0x7f1af40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 -- 172.21.15.143:0/252974323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cdb10 msgr2=0x7f1af40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 --2- 172.21.15.143:0/252974323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cdb10 0x7f1af40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 -- 172.21.15.143:0/252974323 >> v2:172.21.15.146:3300/0 conn(0x7f1af4140590 msgr2=0x7f1af406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 --2- 172.21.15.143:0/252974323 >> v2:172.21.15.146:3300/0 conn(0x7f1af4140590 0x7f1af406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.664+0000 7f1af37fe640 1 -- 172.21.15.143:0/252974323 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4161b20 con 0x7f1af40cb850 2023-11-24T06:33:10.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1af37fe640 1 --2- 172.21.15.143:0/252974323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af40cb850 0x7f1af406bc00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1af406e430 tx=0x7f1ae801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da18d67bc11854c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:10.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1af2ffd640 1 -- 172.21.15.143:0/252974323 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80ab650 con 0x7f1af40cb850 2023-11-24T06:33:10.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1af2ffd640 1 -- 172.21.15.143:0/252974323 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae80ab7b0 con 0x7f1af40cb850 2023-11-24T06:33:10.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1af2ffd640 1 -- 172.21.15.143:0/252974323 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80abb40 con 0x7f1af40cb850 2023-11-24T06:33:10.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 -- 172.21.15.143:0/252974323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af40cb850 msgr2=0x7f1af406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 --2- 172.21.15.143:0/252974323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af40cb850 0x7f1af406bc00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1af406e430 tx=0x7f1ae801c470 comp rx=0 tx=0).stop 2023-11-24T06:33:10.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 -- 172.21.15.143:0/252974323 shutdown_connections 2023-11-24T06:33:10.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 --2- 172.21.15.143:0/252974323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cdb10 0x7f1af40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 --2- 172.21.15.143:0/252974323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af40cb850 0x7f1af406bc00 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 --2- 172.21.15.143:0/252974323 >> v2:172.21.15.146:3300/0 conn(0x7f1af4140590 0x7f1af406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 -- 172.21.15.143:0/252974323 >> 172.21.15.143:0/252974323 conn(0x7f1af40b2e50 msgr2=0x7f1af40b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:10.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 -- 172.21.15.143:0/252974323 shutdown_connections 2023-11-24T06:33:10.674 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.668+0000 7f1afa901640 1 -- 172.21.15.143:0/252974323 wait complete. 2023-11-24T06:33:10.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 Processor -- start 2023-11-24T06:33:10.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 -- start start 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cb850 0x7f1af415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1af40cdb10 0x7f1af413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 0x7f1af4155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af415e5e0 con 0x7f1af4140590 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af414ffa0 con 0x7f1af40cdb10 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af415e7f0 con 0x7f1af40cb850 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 0x7f1af4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 0x7f1af4155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41370/0 (socket says 172.21.15.143:41370) 2023-11-24T06:33:10.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 -- 172.21.15.143:0/175836139 learned_addr learned my addr 172.21.15.143:0/175836139 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af3fff640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cb850 0x7f1af415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af37fe640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1af40cdb10 0x7f1af413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 -- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cb850 msgr2=0x7f1af415f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cb850 0x7f1af415f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 -- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1af40cdb10 msgr2=0x7f1af413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1af40cdb10 0x7f1af413f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 -- 172.21.15.143:0/175836139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80094d0 con 0x7f1af4140590 2023-11-24T06:33:10.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af8e9e640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 0x7f1af4155240 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00eed0 tx=0x7f1aec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:10.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec010040 con 0x7f1af4140590 2023-11-24T06:33:10.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00bd10 con 0x7f1af4140590 2023-11-24T06:33:10.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af415ead0 con 0x7f1af4140590 2023-11-24T06:33:10.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec014640 con 0x7f1af4140590 2023-11-24T06:33:10.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.672+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af413fef0 con 0x7f1af4140590 2023-11-24T06:33:10.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.676+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af404e8c0 con 0x7f1af4140590 2023-11-24T06:33:10.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.676+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f1aec0147a0 con 0x7f1af4140590 2023-11-24T06:33:10.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.676+0000 7f1af0ff9640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ae0066a10 0x7f1ae0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.676+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f1aec084f50 con 0x7f1af4140590 2023-11-24T06:33:10.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.676+0000 7f1af3fff640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ae0066a10 0x7f1ae0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.676+0000 7f1af3fff640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ae0066a10 0x7f1ae0068ed0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009ac0 tx=0x7f1ae4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:10.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.680+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1aec051aa0 con 0x7f1af4140590 2023-11-24T06:33:10.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.828+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1af415ef80 con 0x7f1af4140590 2023-11-24T06:33:10.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.828+0000 7f1af0ff9640 1 -- 172.21.15.143:0/175836139 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1aec0180c0 con 0x7f1af4140590 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ae0066a10 msgr2=0x7f1ae0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ae0066a10 0x7f1ae0068ed0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009ac0 tx=0x7f1ae4009190 comp rx=0 tx=0).stop 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 msgr2=0x7f1af4155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 0x7f1af4155240 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00eed0 tx=0x7f1aec00b480 comp rx=0 tx=0).stop 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 shutdown_connections 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1ae0066a10 0x7f1ae0068ed0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4140590 0x7f1af4155240 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1af40cdb10 0x7f1af413f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 --2- 172.21.15.143:0/175836139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1af40cb850 0x7f1af415f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 >> 172.21.15.143:0/175836139 conn(0x7f1af40b2e50 msgr2=0x7f1af40c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 shutdown_connections 2023-11-24T06:33:10.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.832+0000 7f1afa901640 1 -- 172.21.15.143:0/175836139 wait complete. 2023-11-24T06:33:10.854 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp7831 2023-11-24T06:33:10.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.992+0000 7f2f5d7f5640 1 Processor -- start 2023-11-24T06:33:10.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.992+0000 7f2f5d7f5640 1 -- start start 2023-11-24T06:33:10.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.992+0000 7f2f5d7f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 0x7f2f5806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:10.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.992+0000 7f2f5d7f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5815a050 con 0x7f2f580b1f80 2023-11-24T06:33:10.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f5d7f5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f580722e0 con 0x7f2f580ccef0 2023-11-24T06:33:10.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f5d7f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58072860 con 0x7f2f580ce2e0 2023-11-24T06:33:10.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f577fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f2f580b1f80 0x7f2f58163730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54686/0 (socket says 172.21.15.143:54686) 2023-11-24T06:33:10.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f577fe640 1 -- 172.21.15.143:0/4012728925 learned_addr learned my addr 172.21.15.143:0/4012728925 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:10.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f567fc640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 0x7f2f5806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:10.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663869096 0 0) 0x7f2f5815a050 con 0x7f2f580b1f80 2023-11-24T06:33:10.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f40003530 con 0x7f2f580b1f80 2023-11-24T06:33:10.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392221192 0 0) 0x7f2f580722e0 con 0x7f2f580ccef0 2023-11-24T06:33:10.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5815a050 con 0x7f2f580ccef0 2023-11-24T06:33:10.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024476681 0 0) 0x7f2f40003530 con 0x7f2f580b1f80 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 msgr2=0x7f2f5806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 0x7f2f5806da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 >> v1:172.21.15.146:6789/0 conn(0x7f2f580ccef0 legacy=0x7f2f5806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580705e0 con 0x7f2f580b1f80 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f2f50001a00 con 0x7f2f580b1f80 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 >> v1:172.21.15.143:6789/0 conn(0x7f2f580b1f80 legacy=0x7f2f58163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f40003b40 0x7f2f40003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 0x7f2f400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40004d10 0x7f2f40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58072860 con 0x7f2f40003b40 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4000bad0 con 0x7f2f40004d10 2023-11-24T06:33:11.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4000bc90 con 0x7f2f580ce2e0 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f56ffd640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f40003b40 0x7f2f40003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f567fc640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 0x7f2f400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f577fe640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40004d10 0x7f2f40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f56ffd640 1 -- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 msgr2=0x7f2f400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f56ffd640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580ce2e0 0x7f2f400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f56ffd640 1 -- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40004d10 msgr2=0x7f2f40005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f56ffd640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40004d10 0x7f2f40005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:10.996+0000 7f2f56ffd640 1 -- 172.21.15.143:0/4012728925 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40003530 con 0x7f2f40003b40 2023-11-24T06:33:11.002 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f56ffd640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f40003b40 0x7f2f40003f40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2f480018d0 tx=0x7f2f4801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c62318bb3e63c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480052d0 con 0x7f2f40003b40 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480a7050 con 0x7f2f40003b40 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f55ffb640 1 -- 172.21.15.143:0/4012728925 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48003600 con 0x7f2f40003b40 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4012728925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f40003b40 msgr2=0x7f2f40003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4012728925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f40003b40 0x7f2f40003f40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2f480018d0 tx=0x7f2f4801c470 comp rx=0 tx=0).stop 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f577fe640 1 -- 172.21.15.143:0/4012728925 reap_dead start 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4012728925 shutdown_connections 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4012728925 >> 172.21.15.143:0/4012728925 conn(0x7f2f580b0c80 msgr2=0x7f2f580b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4012728925 shutdown_connections 2023-11-24T06:33:11.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4012728925 wait complete. 2023-11-24T06:33:11.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 Processor -- start 2023-11-24T06:33:11.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.000+0000 7f2f5d7f5640 1 -- start start 2023-11-24T06:33:11.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40003b40 0x7f2f5815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580993b0 0x7f2f58144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 0x7f2f58145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ac750 con 0x7f2f58099830 2023-11-24T06:33:11.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5809c860 con 0x7f2f40003b40 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ac100 con 0x7f2f580993b0 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 0x7f2f58145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 0x7f2f58145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41388/0 (socket says 172.21.15.143:41388) 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f56ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40003b40 0x7f2f5815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 -- 172.21.15.143:0/4004294697 learned_addr learned my addr 172.21.15.143:0/4004294697 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f567fc640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580993b0 0x7f2f58144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 -- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580993b0 msgr2=0x7f2f58144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580993b0 0x7f2f58144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 -- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40003b40 msgr2=0x7f2f5815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40003b40 0x7f2f5815a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 -- 172.21.15.143:0/4004294697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580ac3e0 con 0x7f2f58099830 2023-11-24T06:33:11.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f577fe640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 0x7f2f58145500 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cb950 tx=0x7f2f5000a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:11.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000abe0 con 0x7f2f58099830 2023-11-24T06:33:11.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000ad40 con 0x7f2f58099830 2023-11-24T06:33:11.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5809bae0 con 0x7f2f58099830 2023-11-24T06:33:11.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50013630 con 0x7f2f58099830 2023-11-24T06:33:11.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5809bf90 con 0x7f2f58099830 2023-11-24T06:33:11.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f580abf60 con 0x7f2f58099830 2023-11-24T06:33:11.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.004+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f2f50013790 con 0x7f2f58099830 2023-11-24T06:33:11.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.008+0000 7f2f3f7fe640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2f44066a40 0x7f2f44068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.008+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f2f500850d0 con 0x7f2f58099830 2023-11-24T06:33:11.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.008+0000 7f2f56ffd640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2f44066a40 0x7f2f44068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.008+0000 7f2f56ffd640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2f44066a40 0x7f2f44068f00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2f480ac000 tx=0x7f2f480a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:11.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.012+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f580abf60 con 0x7f2f58099830 2023-11-24T06:33:11.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.184+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp7831", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f580cca20 con 0x7f2f44066a40 2023-11-24T06:33:11.191 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:33:11.188+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:33:11.191 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:33:11.188+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:33:11.191 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:33:11.188+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:33:11.191 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:33:11.188+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:33:11.191 INFO:tasks.ceph.mgr.y.smithi143.stderr:2023-11-24T06:33:11.188+0000 7f509801b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:33:11.207 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f3f7fe640 1 -- 172.21.15.143:0/4004294697 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2f580cca20 con 0x7f2f44066a40 2023-11-24T06:33:11.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2f44066a40 msgr2=0x7f2f44068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2f44066a40 0x7f2f44068f00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2f480ac000 tx=0x7f2f480a6000 comp rx=0 tx=0).stop 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 msgr2=0x7f2f58145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 0x7f2f58145500 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cb950 tx=0x7f2f5000a600 comp rx=0 tx=0).stop 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 shutdown_connections 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2f44066a40 0x7f2f44068f00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f58099830 0x7f2f58145500 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f580993b0 0x7f2f58144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 --2- 172.21.15.143:0/4004294697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40003b40 0x7f2f5815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 >> 172.21.15.143:0/4004294697 conn(0x7f2f580b0c80 msgr2=0x7f2f580afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 shutdown_connections 2023-11-24T06:33:11.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.204+0000 7f2f5d7f5640 1 -- 172.21.15.143:0/4004294697 wait complete. 2023-11-24T06:33:11.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol9054 --group_name subvol_grp7831 2023-11-24T06:33:11.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 Processor -- start 2023-11-24T06:33:11.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 -- start start 2023-11-24T06:33:11.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb328144030 0x7fb32806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb32806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32806d8b0 con 0x7fb32806e280 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328145020 con 0x7fb328144030 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.368+0000 7fb32d832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32809d0a0 con 0x7fb32809cc20 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb3277fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb32806e280 0x7fb3280709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54690/0 (socket says 172.21.15.143:54690) 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb3277fe640 1 -- 172.21.15.143:0/3559008682 learned_addr learned my addr 172.21.15.143:0/3559008682 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb326ffd640 1 --2- 172.21.15.143:0/3559008682 >> v2:172.21.15.146:3300/0 conn(0x7fb328144030 0x7fb32806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb31ffff640 1 --2- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb32806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.374 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb3267fc640 1 -- 172.21.15.143:0/3559008682 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752457387 0 0) 0x7fb32806d8b0 con 0x7fb32806e280 2023-11-24T06:33:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb3267fc640 1 -- 172.21.15.143:0/3559008682 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb314003530 con 0x7fb32806e280 2023-11-24T06:33:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb326ffd640 1 -- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 msgr2=0x7fb32806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb326ffd640 1 --2- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb32806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb326ffd640 1 -- 172.21.15.143:0/3559008682 >> v1:172.21.15.143:6789/0 conn(0x7fb32806e280 legacy=0x7fb3280709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb326ffd640 1 -- 172.21.15.143:0/3559008682 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32806cca0 con 0x7fb328144030 2023-11-24T06:33:11.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.372+0000 7fb326ffd640 1 --2- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb32806c650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097c0 tx=0x7fb31801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fdff43c50b8f7ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:11.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb3267fc640 1 -- 172.21.15.143:0/3559008682 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180ab650 con 0x7fb328144030 2023-11-24T06:33:11.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb3267fc640 1 -- 172.21.15.143:0/3559008682 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180ab7b0 con 0x7fb328144030 2023-11-24T06:33:11.377 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb3267fc640 1 -- 172.21.15.143:0/3559008682 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180abb40 con 0x7fb328144030 2023-11-24T06:33:11.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 msgr2=0x7fb32806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 --2- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb32806c650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097c0 tx=0x7fb31801c450 comp rx=0 tx=0).stop 2023-11-24T06:33:11.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- 172.21.15.143:0/3559008682 shutdown_connections 2023-11-24T06:33:11.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 --2- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb32806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 --2- 172.21.15.143:0/3559008682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb32806c650 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- 172.21.15.143:0/3559008682 >> 172.21.15.143:0/3559008682 conn(0x7fb3280b0bf0 msgr2=0x7fb3280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:11.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- 172.21.15.143:0/3559008682 shutdown_connections 2023-11-24T06:33:11.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- 172.21.15.143:0/3559008682 wait complete. 2023-11-24T06:33:11.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 Processor -- start 2023-11-24T06:33:11.379 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- start start 2023-11-24T06:33:11.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 0x7fb328143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb3280b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb3280b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328142cf0 con 0x7fb32806e280 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281420e0 con 0x7fb328144030 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb32d832640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281423c0 con 0x7fb32809cc20 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb326ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 0x7fb328143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb326ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 0x7fb328143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41418/0 (socket says 172.21.15.143:41418) 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb326ffd640 1 -- 172.21.15.143:0/3100014863 learned_addr learned my addr 172.21.15.143:0/3100014863 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.376+0000 7fb3277fe640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb3280b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb31ffff640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb3280b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb326ffd640 1 -- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 msgr2=0x7fb3280b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb326ffd640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb3280b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb326ffd640 1 -- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 msgr2=0x7fb3280b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.382 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb326ffd640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb3280b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb326ffd640 1 -- 172.21.15.143:0/3100014863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009420 con 0x7fb32806e280 2023-11-24T06:33:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb326ffd640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 0x7fb328143180 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb3180ad040 tx=0x7fb31801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180bf610 con 0x7fb32806e280 2023-11-24T06:33:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180bf7b0 con 0x7fb32806e280 2023-11-24T06:33:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180bfb60 con 0x7fb32806e280 2023-11-24T06:33:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3281426a0 con 0x7fb32806e280 2023-11-24T06:33:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb328141d90 con 0x7fb32806e280 2023-11-24T06:33:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb328067520 con 0x7fb32806e280 2023-11-24T06:33:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb3180b5400 con 0x7fb32806e280 2023-11-24T06:33:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.380+0000 7fb324ff9640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb308066a40 0x7fb308068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:11.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.384+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb31811f670 con 0x7fb32806e280 2023-11-24T06:33:11.385 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.384+0000 7fb31ffff640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb308066a40 0x7fb308068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.384+0000 7fb31ffff640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb308066a40 0x7fb308068f00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb3281f92f0 tx=0x7fb310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.384+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3180ec3d0 con 0x7fb32806e280 2023-11-24T06:33:11.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.556+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol9054", "group_name": "subvol_grp7831", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3280ae6d0 con 0x7fb308066a40 2023-11-24T06:33:11.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.580+0000 7fb324ff9640 1 -- 172.21.15.143:0/3100014863 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb310009820 con 0x7fb308066a40 2023-11-24T06:33:11.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb308066a40 msgr2=0x7fb308068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb308066a40 0x7fb308068f00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb3281f92f0 tx=0x7fb310008040 comp rx=0 tx=0).stop 2023-11-24T06:33:11.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 msgr2=0x7fb328143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:11.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 0x7fb328143180 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb3180ad040 tx=0x7fb31801ac90 comp rx=0 tx=0).stop 2023-11-24T06:33:11.588 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 shutdown_connections 2023-11-24T06:33:11.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb308066a40 0x7fb308068f00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb328144030 0x7fb3280b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.589 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32809cc20 0x7fb3280b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 --2- 172.21.15.143:0/3100014863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb32806e280 0x7fb328143180 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:11.590 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 >> 172.21.15.143:0/3100014863 conn(0x7fb3280b0bf0 msgr2=0x7fb3280b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:11.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 shutdown_connections 2023-11-24T06:33:11.591 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:11.584+0000 7fb32d832640 1 -- 172.21.15.143:0/3100014863 wait complete. 2023-11-24T06:33:11.606 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:33:11.606 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:33:11.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:33:11.757 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:33:11.757 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:33:11.757 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:11.767 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:33:11.767 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:11.821 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:12.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faac130e640 1 Processor -- start 2023-11-24T06:33:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faac130e640 1 -- start start 2023-11-24T06:33:12.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faac130e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faabc144910 0x7faabc0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faac130e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cfd60 con 0x7faabc0b1270 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faac130e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cc790 con 0x7faabc072510 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faac130e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0cf8d0 con 0x7faabc144910 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faabb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faabc144910 0x7faabc0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faab27fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7faabc0b1270 0x7faabc15f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54704/0 (socket says 172.21.15.143:54704) 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faab27fc640 1 -- 172.21.15.143:0/1410783714 learned_addr learned my addr 172.21.15.143:0/1410783714 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faabb7fe640 1 -- 172.21.15.143:0/1410783714 >> v1:172.21.15.146:6789/0 conn(0x7faabc072510 legacy=0x7faabc0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faabb7fe640 1 -- 172.21.15.143:0/1410783714 >> v1:172.21.15.143:6789/0 conn(0x7faabc0b1270 legacy=0x7faabc15f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faaba7fc640 1 -- 172.21.15.143:0/1410783714 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860579019 0 0) 0x7faabc0cfd60 con 0x7faabc0b1270 2023-11-24T06:33:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.004+0000 7faabb7fe640 1 -- 172.21.15.143:0/1410783714 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc145190 con 0x7faabc144910 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faabb7fe640 1 --2- 172.21.15.143:0/1410783714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc144910 0x7faabc0cc090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7faab40097c0 tx=0x7faab401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76747522d59c86de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faaba7fc640 1 -- 172.21.15.143:0/1410783714 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40ab680 con 0x7faabc144910 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faaba7fc640 1 -- 172.21.15.143:0/1410783714 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40ab7e0 con 0x7faabc144910 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faaba7fc640 1 -- 172.21.15.143:0/1410783714 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40abb70 con 0x7faabc144910 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 -- 172.21.15.143:0/1410783714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc144910 msgr2=0x7faabc0cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 --2- 172.21.15.143:0/1410783714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc144910 0x7faabc0cc090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7faab40097c0 tx=0x7faab401c480 comp rx=0 tx=0).stop 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 -- 172.21.15.143:0/1410783714 shutdown_connections 2023-11-24T06:33:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 --2- 172.21.15.143:0/1410783714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc144910 0x7faabc0cc090 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 -- 172.21.15.143:0/1410783714 >> 172.21.15.143:0/1410783714 conn(0x7faabc06a5b0 msgr2=0x7faabc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 -- 172.21.15.143:0/1410783714 shutdown_connections 2023-11-24T06:33:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.008+0000 7faac130e640 1 -- 172.21.15.143:0/1410783714 wait complete. 2023-11-24T06:33:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 Processor -- start 2023-11-24T06:33:12.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 -- start start 2023-11-24T06:33:12.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faabc072510 0x7faabc13eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 0x7faabc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faabc144910 0x7faabc142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0b2200 con 0x7faabc0b1270 2023-11-24T06:33:12.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0b3fe0 con 0x7faabc144910 2023-11-24T06:33:12.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0b3740 con 0x7faabc072510 2023-11-24T06:33:12.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 0x7faabc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 0x7faabc15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41430/0 (socket says 172.21.15.143:41430) 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 -- 172.21.15.143:0/3216199602 learned_addr learned my addr 172.21.15.143:0/3216199602 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faabb7fe640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faabc144910 0x7faabc142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faabaffd640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faabc072510 0x7faabc13eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 -- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faabc072510 msgr2=0x7faabc13eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faabc072510 0x7faabc13eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 -- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faabc144910 msgr2=0x7faabc142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faabc144910 0x7faabc142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 -- 172.21.15.143:0/3216199602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009420 con 0x7faabc0b1270 2023-11-24T06:33:12.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faabb7fe640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faabc144910 0x7faabc142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faabaffd640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faabc072510 0x7faabc13eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab27fc640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 0x7faabc15ab50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c8c0 tx=0x7faaa400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400a640 con 0x7faabc0b1270 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa400a7a0 con 0x7faabc0b1270 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400ab90 con 0x7faabc0b1270 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc0b3a20 con 0x7faabc0b1270 2023-11-24T06:33:12.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.012+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc0b3340 con 0x7faabc0b1270 2023-11-24T06:33:12.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.016+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0b2340 con 0x7faabc0b1270 2023-11-24T06:33:12.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.016+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7faaa400acf0 con 0x7faabc0b1270 2023-11-24T06:33:12.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.016+0000 7faab3fff640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faa9c066a10 0x7faa9c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.016+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7faaa4083eb0 con 0x7faabc0b1270 2023-11-24T06:33:12.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.016+0000 7faabaffd640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faa9c066a10 0x7faa9c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.016+0000 7faabaffd640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faa9c066a10 0x7faa9c068ed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faaac000f70 tx=0x7faaac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.020+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faabc0b2340 con 0x7faabc0b1270 2023-11-24T06:33:12.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.172+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faabc0b2340 con 0x7faabc0b1270 2023-11-24T06:33:12.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faab3fff640 1 -- 172.21.15.143:0/3216199602 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16651 (secure 0 0 0) 0x7faabc0b2340 con 0x7faabc0b1270 2023-11-24T06:33:12.177 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:12.177 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":85,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:02.084666+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faa9c066a10 msgr2=0x7faa9c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faa9c066a10 0x7faa9c068ed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faaac000f70 tx=0x7faaac009040 comp rx=0 tx=0).stop 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 msgr2=0x7faabc15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 0x7faabc15ab50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c8c0 tx=0x7faaa400cd80 comp rx=0 tx=0).stop 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 shutdown_connections 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7faa9c066a10 0x7faa9c068ed0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faabc144910 0x7faabc142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faabc0b1270 0x7faabc15ab50 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 --2- 172.21.15.143:0/3216199602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faabc072510 0x7faabc13eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 >> 172.21.15.143:0/3216199602 conn(0x7faabc06a5b0 msgr2=0x7faabc0cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:12.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 shutdown_connections 2023-11-24T06:33:12.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.176+0000 7faac130e640 1 -- 172.21.15.143:0/3216199602 wait complete. 2023-11-24T06:33:12.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:32:58.815639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:32:59.459362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:33:12.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:33:12.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 Processor -- start 2023-11-24T06:33:12.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 -- start start 2023-11-24T06:33:12.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1b80ccef0 0x7fc1b8071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc1b80cd380 0x7fc1b80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b80723c0 con 0x7fc1b81624f0 2023-11-24T06:33:12.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b8072980 con 0x7fc1b80cd380 2023-11-24T06:33:12.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bfdd1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b80726a0 con 0x7fc1b80ccef0 2023-11-24T06:33:12.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1be36e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc1b80cd380 0x7fc1b80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1be36e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc1b80cd380 0x7fc1b80cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41442/0 (socket says 172.21.15.143:41442) 2023-11-24T06:33:12.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bdb6d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc1b81624f0 0x7fc1b81628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54712/0 (socket says 172.21.15.143:54712) 2023-11-24T06:33:12.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1be36e640 1 -- 172.21.15.143:0/2019298151 learned_addr learned my addr 172.21.15.143:0/2019298151 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:12.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.340+0000 7fc1bd36c640 1 --2- 172.21.15.143:0/2019298151 >> v2:172.21.15.146:3300/0 conn(0x7fc1b80ccef0 0x7fc1b8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1be36e640 1 -- 172.21.15.143:0/2019298151 >> v2:172.21.15.146:3300/0 conn(0x7fc1b80ccef0 msgr2=0x7fc1b8071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:12.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1be36e640 1 --2- 172.21.15.143:0/2019298151 >> v2:172.21.15.146:3300/0 conn(0x7fc1b80ccef0 0x7fc1b8071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1be36e640 1 -- 172.21.15.143:0/2019298151 >> v1:172.21.15.143:6789/0 conn(0x7fc1b81624f0 legacy=0x7fc1b81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1be36e640 1 -- 172.21.15.143:0/2019298151 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b806c7e0 con 0x7fc1b80cd380 2023-11-24T06:33:12.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bcb6b640 1 -- 172.21.15.143:0/2019298151 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398033170 0 0) 0x7fc1b80723c0 con 0x7fc1b81624f0 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1be36e640 1 --2- 172.21.15.143:0/2019298151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80cd380 0x7fc1b80cb9e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ceea0 tx=0x7fc1b001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6a00d1e113233b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bcb6b640 1 -- 172.21.15.143:0/2019298151 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00a57f0 con 0x7fc1b80cd380 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bcb6b640 1 -- 172.21.15.143:0/2019298151 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b00a5950 con 0x7fc1b80cd380 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bcb6b640 1 -- 172.21.15.143:0/2019298151 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00a5ce0 con 0x7fc1b80cd380 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/2019298151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80cd380 msgr2=0x7fc1b80cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/2019298151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80cd380 0x7fc1b80cb9e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ceea0 tx=0x7fc1b001c910 comp rx=0 tx=0).stop 2023-11-24T06:33:12.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/2019298151 shutdown_connections 2023-11-24T06:33:12.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/2019298151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80cd380 0x7fc1b80cb9e0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/2019298151 >> v2:172.21.15.146:3300/0 conn(0x7fc1b80ccef0 0x7fc1b8071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.344+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/2019298151 >> 172.21.15.143:0/2019298151 conn(0x7fc1b80b0c80 msgr2=0x7fc1b80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:12.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/2019298151 shutdown_connections 2023-11-24T06:33:12.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/2019298151 wait complete. 2023-11-24T06:33:12.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 Processor -- start 2023-11-24T06:33:12.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 -- start start 2023-11-24T06:33:12.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 0x7fc1b8099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1b80cd380 0x7fc1b8155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b81624f0 0x7fc1b80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80b2740 con 0x7fc1b80ccef0 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b809ccb0 con 0x7fc1b81624f0 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bfdd1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80ad8c0 con 0x7fc1b80cd380 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 0x7fc1b8099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 0x7fc1b8099cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41456/0 (socket says 172.21.15.143:41456) 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 -- 172.21.15.143:0/3184673618 learned_addr learned my addr 172.21.15.143:0/3184673618 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:12.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1be36e640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b81624f0 0x7fc1b80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bd36c640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1b80cd380 0x7fc1b8155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 -- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1b80cd380 msgr2=0x7fc1b8155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1b80cd380 0x7fc1b8155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 -- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b81624f0 msgr2=0x7fc1b80acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b81624f0 0x7fc1b80acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 -- 172.21.15.143:0/3184673618 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0009b30 con 0x7fc1b80ccef0 2023-11-24T06:33:12.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bd36c640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1b80cd380 0x7fc1b8155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:12.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1be36e640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b81624f0 0x7fc1b80acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1bdb6d640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 0x7fc1b8099cd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400c480 tx=0x7fc1b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40074e0 con 0x7fc1b80ccef0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4007660 con 0x7fc1b80ccef0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.348+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4004a30 con 0x7fc1b80ccef0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80b1e10 con 0x7fc1b80ccef0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b80b23d0 con 0x7fc1b80ccef0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b804e8c0 con 0x7fc1b80ccef0 2023-11-24T06:33:12.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fc1b4004b90 con 0x7fc1b80ccef0 2023-11-24T06:33:12.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1ae7fc640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc19c066a40 0x7fc19c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc1b4083a10 con 0x7fc1b80ccef0 2023-11-24T06:33:12.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1bd36c640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc19c066a40 0x7fc19c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.352+0000 7fc1bd36c640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc19c066a40 0x7fc19c068f00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc1b81fe3b0 tx=0x7fc1a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.356+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1b40540e0 con 0x7fc1b80ccef0 2023-11-24T06:33:12.509 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1b816d760 con 0x7fc1b80ccef0 2023-11-24T06:33:12.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1ae7fc640 1 -- 172.21.15.143:0/3184673618 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1b40180a0 con 0x7fc1b80ccef0 2023-11-24T06:33:12.510 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:33:12.512 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc19c066a40 msgr2=0x7fc19c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc19c066a40 0x7fc19c068f00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc1b81fe3b0 tx=0x7fc1a8008040 comp rx=0 tx=0).stop 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 msgr2=0x7fc1b8099cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 0x7fc1b8099cd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400c480 tx=0x7fc1b400c940 comp rx=0 tx=0).stop 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 shutdown_connections 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc19c066a40 0x7fc19c068f00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b81624f0 0x7fc1b80acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1b80cd380 0x7fc1b8155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 --2- 172.21.15.143:0/3184673618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1b80ccef0 0x7fc1b8099cd0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 >> 172.21.15.143:0/3184673618 conn(0x7fc1b80b0c80 msgr2=0x7fc1b80aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 shutdown_connections 2023-11-24T06:33:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.508+0000 7fc1bfdd1640 1 -- 172.21.15.143:0/3184673618 wait complete. 2023-11-24T06:33:12.531 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:33:12.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f22e4640 1 Processor -- start 2023-11-24T06:33:12.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f22e4640 1 -- start start 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f22e4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa0ec0cd850 0x7fa0ec15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f22e4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec0b3510 con 0x7fa0ec0ce420 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f22e4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec0b37f0 con 0x7fa0ec0ae4a0 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f22e4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ec0b3ad0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f0881640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa0ec0cd850 0x7fa0ec15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f0881640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa0ec0cd850 0x7fa0ec15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41458/0 (socket says 172.21.15.143:41458) 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f0881640 1 -- 172.21.15.143:0/3342926005 learned_addr learned my addr 172.21.15.143:0/3342926005 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:12.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0eb7fe640 1 --1- 172.21.15.143:0/3342926005 >> v1:172.21.15.143:6789/0 conn(0x7fa0ec0ce420 0x7fa0ec06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54724/0 (socket says 172.21.15.143:54724) 2023-11-24T06:33:12.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f0881640 1 -- 172.21.15.143:0/3342926005 >> v1:172.21.15.146:6789/0 conn(0x7fa0ec0ae4a0 legacy=0x7fa0ec0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f0881640 1 -- 172.21.15.143:0/3342926005 >> v1:172.21.15.143:6789/0 conn(0x7fa0ec0ce420 legacy=0x7fa0ec06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0f0881640 1 -- 172.21.15.143:0/3342926005 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0b3db0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.673 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.668+0000 7fa0eaffd640 1 -- 172.21.15.143:0/3342926005 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937790465 0 0) 0x7fa0ec0b3510 con 0x7fa0ec0ce420 2023-11-24T06:33:12.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f0881640 1 --2- 172.21.15.143:0/3342926005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15ba00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009e50 tx=0x7fa0e401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caa0ce14dbf7cbd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0eaffd640 1 -- 172.21.15.143:0/3342926005 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40a58d0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0eaffd640 1 -- 172.21.15.143:0/3342926005 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e40a5a30 con 0x7fa0ec0cd850 2023-11-24T06:33:12.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0eaffd640 1 -- 172.21.15.143:0/3342926005 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40a5dc0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 -- 172.21.15.143:0/3342926005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 msgr2=0x7fa0ec15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/3342926005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15ba00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009e50 tx=0x7fa0e401c9e0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 -- 172.21.15.143:0/3342926005 shutdown_connections 2023-11-24T06:33:12.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/3342926005 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15ba00 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.676 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 -- 172.21.15.143:0/3342926005 >> 172.21.15.143:0/3342926005 conn(0x7fa0ec0b0c80 msgr2=0x7fa0ec0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:12.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 -- 172.21.15.143:0/3342926005 shutdown_connections 2023-11-24T06:33:12.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.672+0000 7fa0f22e4640 1 -- 172.21.15.143:0/3342926005 wait complete. 2023-11-24T06:33:12.677 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 Processor -- start 2023-11-24T06:33:12.678 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 -- start start 2023-11-24T06:33:12.679 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec0ae4a0 0x7fa0ec15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec0ce420 0x7fa0ec151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec09d160 con 0x7fa0ec0cd850 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec15f3a0 con 0x7fa0ec0ae4a0 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0709c0 con 0x7fa0ec0ce420 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41462/0 (socket says 172.21.15.143:41462) 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 -- 172.21.15.143:0/2179516354 learned_addr learned my addr 172.21.15.143:0/2179516354 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0ebfff640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec0ae4a0 0x7fa0ec15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f0881640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec0ce420 0x7fa0ec151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.680 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 -- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec0ce420 msgr2=0x7fa0ec151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec0ce420 0x7fa0ec151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 -- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec0ae4a0 msgr2=0x7fa0ec15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec0ae4a0 0x7fa0ec15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 -- 172.21.15.143:0/2179516354 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009b30 con 0x7fa0ec0cd850 2023-11-24T06:33:12.681 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0eb7fe640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15a730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c410 tx=0x7fa0e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00074e0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0007640 con 0x7fa0ec0cd850 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec070ca0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0004a30 con 0x7fa0ec0cd850 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.676+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec071260 con 0x7fa0ec0cd850 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.680+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec04e8c0 con 0x7fa0ec0cd850 2023-11-24T06:33:12.682 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.680+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fa0e0004b90 con 0x7fa0ec0cd850 2023-11-24T06:33:12.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.680+0000 7fa0e8ff9640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0d8066a10 0x7fa0d8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.680+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa0e0084580 con 0x7fa0ec0cd850 2023-11-24T06:33:12.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.680+0000 7fa0ebfff640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0d8066a10 0x7fa0d8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:12.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.680+0000 7fa0ebfff640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0d8066a10 0x7fa0d8068ed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc007fd0 tx=0x7fa0dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:12.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.684+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0e0051200 con 0x7fa0ec0cd850 2023-11-24T06:33:12.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.832+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0ec0ac000 con 0x7fa0ec0cd850 2023-11-24T06:33:12.836 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.832+0000 7fa0e8ff9640 1 -- 172.21.15.143:0/2179516354 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0e0054820 con 0x7fa0ec0cd850 2023-11-24T06:33:12.836 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0d8066a10 msgr2=0x7fa0d8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0d8066a10 0x7fa0d8068ed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc007fd0 tx=0x7fa0dc009040 comp rx=0 tx=0).stop 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 msgr2=0x7fa0ec15a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15a730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c410 tx=0x7fa0e000c8d0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 shutdown_connections 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa0d8066a10 0x7fa0d8068ed0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec0ce420 0x7fa0ec151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0ec0cd850 0x7fa0ec15a730 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 --2- 172.21.15.143:0/2179516354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec0ae4a0 0x7fa0ec15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:12.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 >> 172.21.15.143:0/2179516354 conn(0x7fa0ec0b0c80 msgr2=0x7fa0ec15bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:12.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 shutdown_connections 2023-11-24T06:33:12.839 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.836+0000 7fa0f22e4640 1 -- 172.21.15.143:0/2179516354 wait complete. 2023-11-24T06:33:12.858 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:33:12.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c84b57640 1 Processor -- start 2023-11-24T06:33:12.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c84b57640 1 -- start start 2023-11-24T06:33:12.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c84b57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c800d19e0 0x7f9c800d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:12.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c84b57640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8015dda0 con 0x7f9c80161d70 2023-11-24T06:33:12.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c84b57640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c800d42e0 con 0x7f9c800cdf10 2023-11-24T06:33:13.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c84b57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c800d3b10 con 0x7f9c800d19e0 2023-11-24T06:33:13.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c7e59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c800d19e0 0x7f9c800d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c75d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9c80161d70 0x7f9c800d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54728/0 (socket says 172.21.15.143:54728) 2023-11-24T06:33:13.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c75d9b640 1 -- 172.21.15.143:0/674462167 learned_addr learned my addr 172.21.15.143:0/674462167 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:13.000 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c7dd9b640 1 -- 172.21.15.143:0/674462167 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223980099 0 0) 0x7f9c8015dda0 con 0x7f9c80161d70 2023-11-24T06:33:13.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c7dd9b640 1 -- 172.21.15.143:0/674462167 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003530 con 0x7f9c80161d70 2023-11-24T06:33:13.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c7e59c640 1 -- 172.21.15.143:0/674462167 >> v1:172.21.15.146:6789/0 conn(0x7f9c800cdf10 legacy=0x7f9c8015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c7e59c640 1 -- 172.21.15.143:0/674462167 >> v1:172.21.15.143:6789/0 conn(0x7f9c80161d70 legacy=0x7f9c800d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:12.996+0000 7f9c7e59c640 1 -- 172.21.15.143:0/674462167 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c800d2300 con 0x7f9c800d19e0 2023-11-24T06:33:13.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c7e59c640 1 --2- 172.21.15.143:0/674462167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c800d1dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009d90 tx=0x7f9c7001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8782e140251b330b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c7dd9b640 1 -- 172.21.15.143:0/674462167 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700a58f0 con 0x7f9c800d19e0 2023-11-24T06:33:13.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c7dd9b640 1 -- 172.21.15.143:0/674462167 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c700a5a50 con 0x7f9c800d19e0 2023-11-24T06:33:13.004 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c7dd9b640 1 -- 172.21.15.143:0/674462167 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700a5dc0 con 0x7f9c800d19e0 2023-11-24T06:33:13.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 -- 172.21.15.143:0/674462167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 msgr2=0x7f9c800d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 --2- 172.21.15.143:0/674462167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c800d1dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009d90 tx=0x7f9c7001c920 comp rx=0 tx=0).stop 2023-11-24T06:33:13.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 -- 172.21.15.143:0/674462167 shutdown_connections 2023-11-24T06:33:13.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 --2- 172.21.15.143:0/674462167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c800d1dc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.005 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 -- 172.21.15.143:0/674462167 >> 172.21.15.143:0/674462167 conn(0x7f9c8009c760 msgr2=0x7f9c800d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:13.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 -- 172.21.15.143:0/674462167 shutdown_connections 2023-11-24T06:33:13.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.000+0000 7f9c84b57640 1 -- 172.21.15.143:0/674462167 wait complete. 2023-11-24T06:33:13.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 Processor -- start 2023-11-24T06:33:13.006 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 -- start start 2023-11-24T06:33:13.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c800cdf10 0x7f9c800b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c80154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c80161d70 0x7f9c800cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800b56d0 con 0x7f9c800d19e0 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800b40f0 con 0x7f9c80161d70 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800b43d0 con 0x7f9c800cdf10 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c80154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c80154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41488/0 (socket says 172.21.15.143:41488) 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 -- 172.21.15.143:0/437973724 learned_addr learned my addr 172.21.15.143:0/437973724 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c7e59c640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c800cdf10 0x7f9c800b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c7ed9d640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c80161d70 0x7f9c800cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 -- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c800cdf10 msgr2=0x7f9c800b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c800cdf10 0x7f9c800b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 -- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c80161d70 msgr2=0x7f9c800cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c80161d70 0x7f9c800cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 -- 172.21.15.143:0/437973724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70009a70 con 0x7f9c800d19e0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c75d9b640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c80154380 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001270 tx=0x7f9c6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680074e0 con 0x7f9c800d19e0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c800b46b0 con 0x7f9c800d19e0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c68007640 con 0x7f9c800d19e0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680059b0 con 0x7f9c800d19e0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.004+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c800b4c70 con 0x7f9c800d19e0 2023-11-24T06:33:13.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.008+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c80067a40 con 0x7f9c800d19e0 2023-11-24T06:33:13.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.008+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f9c68005b10 con 0x7f9c800d19e0 2023-11-24T06:33:13.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.008+0000 7f9c777fe640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c60066a10 0x7f9c60068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.008+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9c68083e90 con 0x7f9c800d19e0 2023-11-24T06:33:13.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.008+0000 7f9c7e59c640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c60066a10 0x7f9c60068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.008+0000 7f9c7e59c640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c60066a10 0x7f9c60068ed0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9c700af000 tx=0x7f9c700a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.012+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c680545c0 con 0x7f9c800d19e0 2023-11-24T06:33:13.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.164+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c8004e8c0 con 0x7f9c800d19e0 2023-11-24T06:33:13.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.164+0000 7f9c777fe640 1 -- 172.21.15.143:0/437973724 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c68017070 con 0x7f9c800d19e0 2023-11-24T06:33:13.168 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c60066a10 msgr2=0x7f9c60068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c60066a10 0x7f9c60068ed0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9c700af000 tx=0x7f9c700a7070 comp rx=0 tx=0).stop 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 msgr2=0x7f9c80154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c80154380 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001270 tx=0x7f9c6800c8e0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 shutdown_connections 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9c60066a10 0x7f9c60068ed0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c80161d70 0x7f9c800cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c800d19e0 0x7f9c80154380 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 --2- 172.21.15.143:0/437973724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c800cdf10 0x7f9c800b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 >> 172.21.15.143:0/437973724 conn(0x7f9c8009c760 msgr2=0x7f9c8006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:13.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 shutdown_connections 2023-11-24T06:33:13.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.168+0000 7f9c84b57640 1 -- 172.21.15.143:0/437973724 wait complete. 2023-11-24T06:33:13.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:33:13.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 Processor -- start 2023-11-24T06:33:13.335 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 -- start start 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f239c15b600 0x7f239c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f239c0c9650 0x7f239c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0abed0 con 0x7f239c15b220 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c072710 con 0x7f239c0c9650 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f23a1a79640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c0c9fa0 con 0x7f239c15b600 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f239bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f239c0c9650 0x7f239c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f239bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f239c0c9650 0x7f239c0c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41498/0 (socket says 172.21.15.143:41498) 2023-11-24T06:33:13.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f239bfff640 1 -- 172.21.15.143:0/3118507938 learned_addr learned my addr 172.21.15.143:0/3118507938 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:13.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f239affd640 1 --2- 172.21.15.143:0/3118507938 >> v2:172.21.15.146:3300/0 conn(0x7f239c15b600 0x7f239c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f239bfff640 1 -- 172.21.15.143:0/3118507938 >> v2:172.21.15.146:3300/0 conn(0x7f239c15b600 msgr2=0x7f239c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:13.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.332+0000 7f239bfff640 1 --2- 172.21.15.143:0/3118507938 >> v2:172.21.15.146:3300/0 conn(0x7f239c15b600 0x7f239c0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f239bfff640 1 -- 172.21.15.143:0/3118507938 >> v1:172.21.15.146:6789/0 conn(0x7f239c15b220 legacy=0x7f239c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f239bfff640 1 -- 172.21.15.143:0/3118507938 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c072370 con 0x7f239c0c9650 2023-11-24T06:33:13.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f239bfff640 1 --2- 172.21.15.143:0/3118507938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c0c9650 0x7f239c0c9a60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f239c06e320 tx=0x7f239401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77beabe32f14dd56 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f239a7fc640 1 -- 172.21.15.143:0/3118507938 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940a5860 con 0x7f239c0c9650 2023-11-24T06:33:13.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f239a7fc640 1 -- 172.21.15.143:0/3118507938 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940a59c0 con 0x7f239c0c9650 2023-11-24T06:33:13.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f239a7fc640 1 -- 172.21.15.143:0/3118507938 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940a5d50 con 0x7f239c0c9650 2023-11-24T06:33:13.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 -- 172.21.15.143:0/3118507938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c0c9650 msgr2=0x7f239c0c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 --2- 172.21.15.143:0/3118507938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c0c9650 0x7f239c0c9a60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f239c06e320 tx=0x7f239401c9a0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 -- 172.21.15.143:0/3118507938 shutdown_connections 2023-11-24T06:33:13.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 --2- 172.21.15.143:0/3118507938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c0c9650 0x7f239c0c9a60 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 --2- 172.21.15.143:0/3118507938 >> v2:172.21.15.146:3300/0 conn(0x7f239c15b600 0x7f239c0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 -- 172.21.15.143:0/3118507938 >> 172.21.15.143:0/3118507938 conn(0x7f239c0b0bf0 msgr2=0x7f239c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:13.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 -- 172.21.15.143:0/3118507938 shutdown_connections 2023-11-24T06:33:13.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.336+0000 7f23a1a79640 1 -- 172.21.15.143:0/3118507938 wait complete. 2023-11-24T06:33:13.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 Processor -- start 2023-11-24T06:33:13.343 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 -- start start 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f239c0c9650 0x7f239c1644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f239c15b220 0x7f239c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 0x7f239c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c152b90 con 0x7f239c15b600 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c1657d0 con 0x7f239c15b220 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0ce150 con 0x7f239c0c9650 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 0x7f239c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 0x7f239c0cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41504/0 (socket says 172.21.15.143:41504) 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 -- 172.21.15.143:0/2133402045 learned_addr learned my addr 172.21.15.143:0/2133402045 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239affd640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f239c15b220 0x7f239c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239b7fe640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f239c0c9650 0x7f239c1644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 -- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f239c0c9650 msgr2=0x7f239c1644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f239c0c9650 0x7f239c1644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 -- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f239c15b220 msgr2=0x7f239c152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f239c15b220 0x7f239c152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 -- 172.21.15.143:0/2133402045 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394009b30 con 0x7f239c15b600 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239affd640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f239c15b220 0x7f239c152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f239bfff640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 0x7f239c0cdc10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f239401a5d0 tx=0x7f2394019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940b8670 con 0x7f239c15b600 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940b87f0 con 0x7f239c15b600 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c164bc0 con 0x7f239c15b600 2023-11-24T06:33:13.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.340+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940b8ba0 con 0x7f239c15b600 2023-11-24T06:33:13.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c165180 con 0x7f239c15b600 2023-11-24T06:33:13.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c09d250 con 0x7f239c15b600 2023-11-24T06:33:13.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f23940b8d00 con 0x7f239c15b600 2023-11-24T06:33:13.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f2383fff640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2388066ad0 0x7f2388068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f239411f880 con 0x7f239c15b600 2023-11-24T06:33:13.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f239b7fe640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2388066ad0 0x7f2388068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.344+0000 7f239b7fe640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2388066ad0 0x7f2388068f90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f239c1564f0 tx=0x7f238c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.348+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23940ec370 con 0x7f239c15b600 2023-11-24T06:33:13.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f239c165910 con 0x7f239c15b600 2023-11-24T06:33:13.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f2383fff640 1 -- 172.21.15.143:0/2133402045 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) v1 ==== 80+0+0 (secure 0 0 0) 0x7f23940ef990 con 0x7f239c15b600 2023-11-24T06:33:13.515 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:33:13.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2388066ad0 msgr2=0x7f2388068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2388066ad0 0x7f2388068f90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f239c1564f0 tx=0x7f238c009040 comp rx=0 tx=0).stop 2023-11-24T06:33:13.518 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 msgr2=0x7f239c0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 0x7f239c0cdc10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f239401a5d0 tx=0x7f2394019740 comp rx=0 tx=0).stop 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 shutdown_connections 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2388066ad0 0x7f2388068f90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f239c15b600 0x7f239c0cdc10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f239c15b220 0x7f239c152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 --2- 172.21.15.143:0/2133402045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f239c0c9650 0x7f239c1644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 >> 172.21.15.143:0/2133402045 conn(0x7f239c0b0bf0 msgr2=0x7f239c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 shutdown_connections 2023-11-24T06:33:13.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.512+0000 7f23a1a79640 1 -- 172.21.15.143:0/2133402045 wait complete. 2023-11-24T06:33:13.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:33:13.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:13.537 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:33:13.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:33:13.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:13.566 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:33:13.618 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:33:13.619 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:13.629 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:33:13.629 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:13.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:13.816 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.812+0000 7f9acad7d640 1 Processor -- start 2023-11-24T06:33:13.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.812+0000 7f9acad7d640 1 -- start start 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9acad7d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ac415a6b0 0x7f9ac406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9acad7d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ac415ab60 0x7f9ac406dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9acad7d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac415b100 con 0x7f9ac4143a90 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9acad7d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac415b3e0 con 0x7f9ac415ab60 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9acad7d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac415ddb0 con 0x7f9ac415a6b0 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9ac9d7b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9ac4143a90 0x7f9ac415e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54740/0 (socket says 172.21.15.143:54740) 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9ac9d7b640 1 -- 172.21.15.143:0/1443636101 learned_addr learned my addr 172.21.15.143:0/1443636101 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9aca57c640 1 --2- 172.21.15.143:0/1443636101 >> v2:172.21.15.143:3300/0 conn(0x7f9ac415ab60 0x7f9ac406dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9ac957a640 1 --2- 172.21.15.143:0/1443636101 >> v2:172.21.15.146:3300/0 conn(0x7f9ac415a6b0 0x7f9ac406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9ac8d79640 1 -- 172.21.15.143:0/1443636101 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553517991 0 0) 0x7f9ac415b100 con 0x7f9ac4143a90 2023-11-24T06:33:13.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9ac8d79640 1 -- 172.21.15.143:0/1443636101 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab0003530 con 0x7f9ac4143a90 2023-11-24T06:33:13.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9aca57c640 1 -- 172.21.15.143:0/1443636101 >> v2:172.21.15.146:3300/0 conn(0x7f9ac415a6b0 msgr2=0x7f9ac406d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:13.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9aca57c640 1 --2- 172.21.15.143:0/1443636101 >> v2:172.21.15.146:3300/0 conn(0x7f9ac415a6b0 0x7f9ac406d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9aca57c640 1 -- 172.21.15.143:0/1443636101 >> v1:172.21.15.143:6789/0 conn(0x7f9ac4143a90 legacy=0x7f9ac415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.816+0000 7f9aca57c640 1 -- 172.21.15.143:0/1443636101 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac415e090 con 0x7f9ac415ab60 2023-11-24T06:33:13.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9aca57c640 1 --2- 172.21.15.143:0/1443636101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac415ab60 0x7f9ac406dcb0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40aea10 tx=0x7f9abc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a557fb3350fc6c88 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9ac8d79640 1 -- 172.21.15.143:0/1443636101 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a58d0 con 0x7f9ac415ab60 2023-11-24T06:33:13.828 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9ac8d79640 1 -- 172.21.15.143:0/1443636101 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0a5a30 con 0x7f9ac415ab60 2023-11-24T06:33:13.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9ac8d79640 1 -- 172.21.15.143:0/1443636101 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a5da0 con 0x7f9ac415ab60 2023-11-24T06:33:13.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 -- 172.21.15.143:0/1443636101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac415ab60 msgr2=0x7f9ac406dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1443636101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac415ab60 0x7f9ac406dcb0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40aea10 tx=0x7f9abc01c7f0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 -- 172.21.15.143:0/1443636101 shutdown_connections 2023-11-24T06:33:13.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1443636101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac415ab60 0x7f9ac406dcb0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1443636101 >> v2:172.21.15.146:3300/0 conn(0x7f9ac415a6b0 0x7f9ac406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 -- 172.21.15.143:0/1443636101 >> 172.21.15.143:0/1443636101 conn(0x7f9ac40cb840 msgr2=0x7f9ac40cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:13.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 -- 172.21.15.143:0/1443636101 shutdown_connections 2023-11-24T06:33:13.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 -- 172.21.15.143:0/1443636101 wait complete. 2023-11-24T06:33:13.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 Processor -- start 2023-11-24T06:33:13.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.820+0000 7f9acad7d640 1 -- start start 2023-11-24T06:33:13.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 0x7f9ac41426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac415a6b0 0x7f9ac4159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415ab60 0x7f9ac40af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41409e0 con 0x7f9ac4143a90 2023-11-24T06:33:13.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac413d560 con 0x7f9ac415ab60 2023-11-24T06:33:13.831 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac413d840 con 0x7f9ac415a6b0 2023-11-24T06:33:13.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 0x7f9ac41426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 0x7f9ac41426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41522/0 (socket says 172.21.15.143:41522) 2023-11-24T06:33:13.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 -- 172.21.15.143:0/1444039542 learned_addr learned my addr 172.21.15.143:0/1444039542 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:13.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9aca57c640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415ab60 0x7f9ac40af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.832 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 -- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac415a6b0 msgr2=0x7f9ac4159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac415a6b0 0x7f9ac4159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 -- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415ab60 msgr2=0x7f9ac40af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415ab60 0x7f9ac40af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 -- 172.21.15.143:0/1444039542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009a70 con 0x7f9ac4143a90 2023-11-24T06:33:13.833 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9aca57c640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415ab60 0x7f9ac40af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:13.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9ac9d7b640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 0x7f9ac41426c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c450 tx=0x7f9ac000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0005cf0 con 0x7f9ac4143a90 2023-11-24T06:33:13.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac0005e50 con 0x7f9ac4143a90 2023-11-24T06:33:13.834 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0007290 con 0x7f9ac4143a90 2023-11-24T06:33:13.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac4070e60 con 0x7f9ac4143a90 2023-11-24T06:33:13.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac413de00 con 0x7f9ac4143a90 2023-11-24T06:33:13.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac404e850 con 0x7f9ac4143a90 2023-11-24T06:33:13.835 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.824+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f9ac00073f0 con 0x7f9ac4143a90 2023-11-24T06:33:13.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.828+0000 7f9aba7fc640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aa8066aa0 0x7f9aa8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:13.837 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.828+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9ac0084040 con 0x7f9ac4143a90 2023-11-24T06:33:13.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.828+0000 7f9ac957a640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aa8066aa0 0x7f9aa8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:13.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.828+0000 7f9ac957a640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aa8066aa0 0x7f9aa8068f60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006aa0 tx=0x7f9ab4006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:13.838 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.832+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ac0050b20 con 0x7f9ac4143a90 2023-11-24T06:33:13.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.980+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ac40cd760 con 0x7f9ac4143a90 2023-11-24T06:33:13.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9aba7fc640 1 -- 172.21.15.143:0/1444039542 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f9ac0017070 con 0x7f9ac4143a90 2023-11-24T06:33:13.985 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:13.985 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":85,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:02.084666+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aa8066aa0 msgr2=0x7f9aa8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aa8066aa0 0x7f9aa8068f60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006aa0 tx=0x7f9ab4006a30 comp rx=0 tx=0).stop 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 msgr2=0x7f9ac41426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 0x7f9ac41426c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c450 tx=0x7f9ac000c910 comp rx=0 tx=0).stop 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 shutdown_connections 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f9aa8066aa0 0x7f9aa8068f60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415ab60 0x7f9ac40af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ac415a6b0 0x7f9ac4159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 --2- 172.21.15.143:0/1444039542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac4143a90 0x7f9ac41426c0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:13.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 >> 172.21.15.143:0/1444039542 conn(0x7f9ac40cb840 msgr2=0x7f9ac4165380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:13.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 shutdown_connections 2023-11-24T06:33:13.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:13.984+0000 7f9acad7d640 1 -- 172.21.15.143:0/1444039542 wait complete. 2023-11-24T06:33:14.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:32:58.815639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:32:59.459362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:33:14.007 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:33:14.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 Processor -- start 2023-11-24T06:33:14.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 -- start start 2023-11-24T06:33:14.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740ae4a0 0x7fe27415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe2740cd850 0x7fe2740cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740b3510 con 0x7fe2740ce250 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2740ce6e0 con 0x7fe2740cd850 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe27b98d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740b37f0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe278f28640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe2740cd850 0x7fe2740cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe279f2a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe2740ce250 0x7fe27415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54754/0 (socket says 172.21.15.143:54754) 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe279f2a640 1 -- 172.21.15.143:0/3942570023 learned_addr learned my addr 172.21.15.143:0/3942570023 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe279729640 1 --2- 172.21.15.143:0/3942570023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740ae4a0 0x7fe27415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe278f28640 1 -- 172.21.15.143:0/3942570023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740ae4a0 msgr2=0x7fe27415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe278f28640 1 --2- 172.21.15.143:0/3942570023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740ae4a0 0x7fe27415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe278f28640 1 -- 172.21.15.143:0/3942570023 >> v1:172.21.15.143:6789/0 conn(0x7fe2740ce250 legacy=0x7fe27415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe278f28640 1 -- 172.21.15.143:0/3942570023 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740b3ad0 con 0x7fe2740cd850 2023-11-24T06:33:14.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.144+0000 7fe26bfff640 1 -- 172.21.15.143:0/3942570023 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135002892 0 0) 0x7fe2740b3510 con 0x7fe2740ce250 2023-11-24T06:33:14.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe278f28640 1 --2- 172.21.15.143:0/3942570023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740cd850 0x7fe2740cdd10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe2640097c0 tx=0x7fe26401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be209a29a474b80 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.151 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe26bfff640 1 -- 172.21.15.143:0/3942570023 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2640ab650 con 0x7fe2740cd850 2023-11-24T06:33:14.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe26bfff640 1 -- 172.21.15.143:0/3942570023 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2640ab7b0 con 0x7fe2740cd850 2023-11-24T06:33:14.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe26bfff640 1 -- 172.21.15.143:0/3942570023 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2640abb40 con 0x7fe2740cd850 2023-11-24T06:33:14.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 -- 172.21.15.143:0/3942570023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740cd850 msgr2=0x7fe2740cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 --2- 172.21.15.143:0/3942570023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740cd850 0x7fe2740cdd10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe2640097c0 tx=0x7fe26401c450 comp rx=0 tx=0).stop 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 -- 172.21.15.143:0/3942570023 shutdown_connections 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 --2- 172.21.15.143:0/3942570023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740cd850 0x7fe2740cdd10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 --2- 172.21.15.143:0/3942570023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740ae4a0 0x7fe27415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 -- 172.21.15.143:0/3942570023 >> 172.21.15.143:0/3942570023 conn(0x7fe2740b0c80 msgr2=0x7fe2740b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 -- 172.21.15.143:0/3942570023 shutdown_connections 2023-11-24T06:33:14.153 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.148+0000 7fe27b98d640 1 -- 172.21.15.143:0/3942570023 wait complete. 2023-11-24T06:33:14.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 Processor -- start 2023-11-24T06:33:14.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 -- start start 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 0x7fe27414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740cd850 0x7fe274149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740ce250 0x7fe2740ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27414b220 con 0x7fe2740ae4a0 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741548f0 con 0x7fe2740ce250 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe274154bd0 con 0x7fe2740cd850 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 0x7fe27414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 0x7fe27414a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41538/0 (socket says 172.21.15.143:41538) 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 -- 172.21.15.143:0/892729161 learned_addr learned my addr 172.21.15.143:0/892729161 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe278f28640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740cd850 0x7fe274149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.156 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279f2a640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740ce250 0x7fe2740ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 -- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740cd850 msgr2=0x7fe274149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740cd850 0x7fe274149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 -- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740ce250 msgr2=0x7fe2740ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740ce250 0x7fe2740ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 -- 172.21.15.143:0/892729161 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264009420 con 0x7fe2740ae4a0 2023-11-24T06:33:14.157 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe279729640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 0x7fe27414a3c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe27000d5f0 tx=0x7fe27000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700125f0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270012750 con 0x7fe2740ae4a0 2023-11-24T06:33:14.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe274154eb0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270012ae0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.152+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27414aa10 con 0x7fe2740ae4a0 2023-11-24T06:33:14.158 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.156+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2741550f0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.156+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fe270012c40 con 0x7fe2740ae4a0 2023-11-24T06:33:14.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.156+0000 7fe269ffb640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe258066aa0 0x7fe258068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.156+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe270084ec0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.159 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.156+0000 7fe278f28640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe258066aa0 0x7fe258068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.160 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.156+0000 7fe278f28640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe258066aa0 0x7fe258068f60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe2640af000 tx=0x7fe2640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.163 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.160+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2741550f0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.312+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2741550f0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.312+0000 7fe269ffb640 1 -- 172.21.15.143:0/892729161 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2741550f0 con 0x7fe2740ae4a0 2023-11-24T06:33:14.316 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:33:14.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe258066aa0 msgr2=0x7fe258068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe258066aa0 0x7fe258068f60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe2640af000 tx=0x7fe2640a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:14.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 msgr2=0x7fe27414a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 0x7fe27414a3c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe27000d5f0 tx=0x7fe27000dab0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 shutdown_connections 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe258066aa0 0x7fe258068f60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740ce250 0x7fe2740ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2740cd850 0x7fe274149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 --2- 172.21.15.143:0/892729161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2740ae4a0 0x7fe27414a3c0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 >> 172.21.15.143:0/892729161 conn(0x7fe2740b0c80 msgr2=0x7fe274164410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 shutdown_connections 2023-11-24T06:33:14.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.316+0000 7fe27b98d640 1 -- 172.21.15.143:0/892729161 wait complete. 2023-11-24T06:33:14.337 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:33:14.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 Processor -- start 2023-11-24T06:33:14.478 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 -- start start 2023-11-24T06:33:14.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccdc0cd350 0x7fccdc0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0723c0 con 0x7fccdc0ccef0 2023-11-24T06:33:14.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc072980 con 0x7fccdc0cd350 2023-11-24T06:33:14.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce3279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0726a0 con 0x7fccdc1624f0 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1816640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccdc0cd350 0x7fccdc0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1015640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce0814640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fccdc0ccef0 0x7fccdc071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:55832/0 (socket says 172.21.15.143:55832) 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce0814640 1 -- 172.21.15.143:0/622177661 learned_addr learned my addr 172.21.15.143:0/622177661 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fccd3fff640 1 -- 172.21.15.143:0/622177661 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924908709 0 0) 0x7fccdc0723c0 con 0x7fccdc0ccef0 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fccd3fff640 1 -- 172.21.15.143:0/622177661 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc8003530 con 0x7fccdc0ccef0 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1015640 1 -- 172.21.15.143:0/622177661 >> v2:172.21.15.146:3300/0 conn(0x7fccdc0cd350 msgr2=0x7fccdc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1015640 1 --2- 172.21.15.143:0/622177661 >> v2:172.21.15.146:3300/0 conn(0x7fccdc0cd350 0x7fccdc0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1015640 1 -- 172.21.15.143:0/622177661 >> v1:172.21.15.146:6789/0 conn(0x7fccdc0ccef0 legacy=0x7fccdc071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1015640 1 -- 172.21.15.143:0/622177661 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc06c7e0 con 0x7fccdc1624f0 2023-11-24T06:33:14.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.476+0000 7fcce1816640 1 --2- 172.21.15.143:0/622177661 >> v2:172.21.15.146:3300/0 conn(0x7fccdc0cd350 0x7fccdc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:14.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce1015640 1 --2- 172.21.15.143:0/622177661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc1628d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fccd80097c0 tx=0x7fccd801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b71c280056c1394 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fccd3fff640 1 -- 172.21.15.143:0/622177661 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80ab600 con 0x7fccdc1624f0 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fccd3fff640 1 -- 172.21.15.143:0/622177661 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80a7050 con 0x7fccdc1624f0 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fccd3fff640 1 -- 172.21.15.143:0/622177661 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80ab980 con 0x7fccdc1624f0 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 -- 172.21.15.143:0/622177661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 msgr2=0x7fccdc1628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 --2- 172.21.15.143:0/622177661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc1628d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fccd80097c0 tx=0x7fccd801c3c0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 -- 172.21.15.143:0/622177661 shutdown_connections 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 --2- 172.21.15.143:0/622177661 >> v2:172.21.15.146:3300/0 conn(0x7fccdc0cd350 0x7fccdc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.485 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 --2- 172.21.15.143:0/622177661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc1628d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 -- 172.21.15.143:0/622177661 >> 172.21.15.143:0/622177661 conn(0x7fccdc0b0c80 msgr2=0x7fccdc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:14.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 -- 172.21.15.143:0/622177661 shutdown_connections 2023-11-24T06:33:14.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.480+0000 7fcce3279640 1 -- 172.21.15.143:0/622177661 wait complete. 2023-11-24T06:33:14.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 Processor -- start 2023-11-24T06:33:14.486 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 -- start start 2023-11-24T06:33:14.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccdc0ccef0 0x7fccdc15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 0x7fccdc158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc15de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.488 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc15aae0 con 0x7fccdc0cd350 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b2150 con 0x7fccdc0ccef0 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc15b190 con 0x7fccdc1624f0 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 0x7fccdc158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 0x7fccdc158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41542/0 (socket says 172.21.15.143:41542) 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 -- 172.21.15.143:0/910495809 learned_addr learned my addr 172.21.15.143:0/910495809 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce1015640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccdc0ccef0 0x7fccdc15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce1816640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.489 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 -- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 msgr2=0x7fccdc15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc15de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 -- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccdc0ccef0 msgr2=0x7fccdc15fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccdc0ccef0 0x7fccdc15fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 -- 172.21.15.143:0/910495809 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009a70 con 0x7fccdc0cd350 2023-11-24T06:33:14.490 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce1015640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccdc0ccef0 0x7fccdc15fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:14.491 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce0814640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 0x7fccdc158770 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c4d0 tx=0x7fcccc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc005cf0 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc005e50 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd8009420 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc007270 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.484+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc15b750 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.488+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc0b2290 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.488+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fcccc0073d0 con 0x7fccdc0cd350 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.488+0000 7fccd1ffb640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fccc0066aa0 0x7fccc0068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.488+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fcccc083e80 con 0x7fccdc0cd350 2023-11-24T06:33:14.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.488+0000 7fcce1015640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fccc0066aa0 0x7fccc0068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.488+0000 7fcce1015640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fccc0066aa0 0x7fccc0068f60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fccd80ad000 tx=0x7fccd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.492+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccdc0b2290 con 0x7fccdc0cd350 2023-11-24T06:33:14.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccdc0b2290 con 0x7fccdc0cd350 2023-11-24T06:33:14.647 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fccd1ffb640 1 -- 172.21.15.143:0/910495809 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccdc0b2290 con 0x7fccdc0cd350 2023-11-24T06:33:14.648 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:33:14.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fccc0066aa0 msgr2=0x7fccc0068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fccc0066aa0 0x7fccc0068f60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fccd80ad000 tx=0x7fccd8008040 comp rx=0 tx=0).stop 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 msgr2=0x7fccdc158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 0x7fccdc158770 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c4d0 tx=0x7fcccc00c990 comp rx=0 tx=0).stop 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 shutdown_connections 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fccc0066aa0 0x7fccc0068f60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccdc1624f0 0x7fccdc15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccdc0cd350 0x7fccdc158770 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 --2- 172.21.15.143:0/910495809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccdc0ccef0 0x7fccdc15fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 >> 172.21.15.143:0/910495809 conn(0x7fccdc0b0c80 msgr2=0x7fccdc0aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:14.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 shutdown_connections 2023-11-24T06:33:14.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.644+0000 7fcce3279640 1 -- 172.21.15.143:0/910495809 wait complete. 2023-11-24T06:33:14.668 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:33:14.807 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb48d69a640 1 Processor -- start 2023-11-24T06:33:14.808 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb48d69a640 1 -- start start 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb48d69a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb48815a290 0x7fb4880707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb48d69a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb488071170 con 0x7fb4880b1f80 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb48d69a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880cb690 con 0x7fb48815ec60 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb48d69a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880cb970 con 0x7fb48815a290 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb4877fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb4880b1f80 0x7fb48806d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54770/0 (socket says 172.21.15.143:54770) 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.804+0000 7fb4877fe640 1 -- 172.21.15.143:0/3243649792 learned_addr learned my addr 172.21.15.143:0/3243649792 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:14.809 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb486ffd640 1 --2- 172.21.15.143:0/3243649792 >> v2:172.21.15.146:3300/0 conn(0x7fb48815a290 0x7fb4880707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220299133 0 0) 0x7fb488071170 con 0x7fb4880b1f80 2023-11-24T06:33:14.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb474003530 con 0x7fb4880b1f80 2023-11-24T06:33:14.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937325702 0 0) 0x7fb4880cb690 con 0x7fb48815ec60 2023-11-24T06:33:14.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb488071170 con 0x7fb48815ec60 2023-11-24T06:33:14.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb486ffd640 1 -- 172.21.15.143:0/3243649792 >> v1:172.21.15.146:6789/0 conn(0x7fb48815ec60 legacy=0x7fb4880cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb486ffd640 1 -- 172.21.15.143:0/3243649792 >> v1:172.21.15.143:6789/0 conn(0x7fb4880b1f80 legacy=0x7fb48806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb486ffd640 1 -- 172.21.15.143:0/3243649792 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880cbc50 con 0x7fb48815a290 2023-11-24T06:33:14.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb486ffd640 1 --2- 172.21.15.143:0/3243649792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb4880707f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb4780097c0 tx=0x7fb47801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ad6d4fb913ed2d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780ac640 con 0x7fb48815a290 2023-11-24T06:33:14.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780ac7a0 con 0x7fb48815a290 2023-11-24T06:33:14.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.808+0000 7fb4867fc640 1 -- 172.21.15.143:0/3243649792 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780acb30 con 0x7fb48815a290 2023-11-24T06:33:14.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- 172.21.15.143:0/3243649792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 msgr2=0x7fb4880707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3243649792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb4880707f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb4780097c0 tx=0x7fb47801c3f0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- 172.21.15.143:0/3243649792 shutdown_connections 2023-11-24T06:33:14.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3243649792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb4880707f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- 172.21.15.143:0/3243649792 >> 172.21.15.143:0/3243649792 conn(0x7fb4880b0c80 msgr2=0x7fb4880b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:14.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- 172.21.15.143:0/3243649792 shutdown_connections 2023-11-24T06:33:14.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- 172.21.15.143:0/3243649792 wait complete. 2023-11-24T06:33:14.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 Processor -- start 2023-11-24T06:33:14.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- start start 2023-11-24T06:33:14.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 0x7fb488152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb48814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48815ec60 0x7fb488146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880ad820 con 0x7fb4880b1f80 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48814b540 con 0x7fb48815a290 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb48d69a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48814b820 con 0x7fb48815ec60 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 0x7fb488152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 0x7fb488152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41552/0 (socket says 172.21.15.143:41552) 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 -- 172.21.15.143:0/3946930385 learned_addr learned my addr 172.21.15.143:0/3946930385 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb4877fe640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48815ec60 0x7fb488146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb47e7fc640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb48814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 -- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48815ec60 msgr2=0x7fb488146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48815ec60 0x7fb488146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 -- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 msgr2=0x7fb48814d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.818 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb48814d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.812+0000 7fb486ffd640 1 -- 172.21.15.143:0/3946930385 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009420 con 0x7fb4880b1f80 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb486ffd640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 0x7fb488152f80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb4780af040 tx=0x7fb47801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780b8650 con 0x7fb4880b1f80 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780b87b0 con 0x7fb4880b1f80 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780b8b60 con 0x7fb4880b1f80 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb488070f40 con 0x7fb4880b1f80 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4880addc0 con 0x7fb4880b1f80 2023-11-24T06:33:14.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48814b9e0 con 0x7fb4880b1f80 2023-11-24T06:33:14.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fb4780b8cc0 con 0x7fb4880b1f80 2023-11-24T06:33:14.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47ffff640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb468066aa0 0x7fb468068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:14.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb47811f300 con 0x7fb4880b1f80 2023-11-24T06:33:14.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.816+0000 7fb47e7fc640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb468066aa0 0x7fb468068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:14.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.820+0000 7fb47e7fc640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb468066aa0 0x7fb468068f60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb48814fe20 tx=0x7fb470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:14.824 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.820+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4780ebf90 con 0x7fb4880b1f80 2023-11-24T06:33:14.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.968+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4880adfb0 con 0x7fb4880b1f80 2023-11-24T06:33:14.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.968+0000 7fb47ffff640 1 -- 172.21.15.143:0/3946930385 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4780ef5b0 con 0x7fb4880b1f80 2023-11-24T06:33:14.973 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:33:14.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb468066aa0 msgr2=0x7fb468068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb468066aa0 0x7fb468068f60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb48814fe20 tx=0x7fb470009040 comp rx=0 tx=0).stop 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 msgr2=0x7fb488152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 0x7fb488152f80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb4780af040 tx=0x7fb47801ac30 comp rx=0 tx=0).stop 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 shutdown_connections 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb468066aa0 0x7fb468068f60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48815ec60 0x7fb488146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48815a290 0x7fb48814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 --2- 172.21.15.143:0/3946930385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4880b1f80 0x7fb488152f80 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:14.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 >> 172.21.15.143:0/3946930385 conn(0x7fb4880b0c80 msgr2=0x7fb48806d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:14.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 shutdown_connections 2023-11-24T06:33:14.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:14.972+0000 7fb48d69a640 1 -- 172.21.15.143:0/3946930385 wait complete. 2023-11-24T06:33:14.995 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:33:15.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 Processor -- start 2023-11-24T06:33:15.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 -- start start 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa71415a4d0 0x7fa7140c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7140cad20 0x7fa71415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71415a8b0 con 0x7fa71406d740 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7140c9c30 con 0x7fa7140cad20 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa7195aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71415ee80 con 0x7fa71415a4d0 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa70bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7140cad20 0x7fa71415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa70bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7140cad20 0x7fa71415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41564/0 (socket says 172.21.15.143:41564) 2023-11-24T06:33:15.138 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa70bfff640 1 -- 172.21.15.143:0/4192563576 learned_addr learned my addr 172.21.15.143:0/4192563576 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.132+0000 7fa712ffd640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa71415a4d0 0x7fa7140c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa70bfff640 1 -- 172.21.15.143:0/4192563576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa71415a4d0 msgr2=0x7fa7140c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa70bfff640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa71415a4d0 0x7fa7140c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa70bfff640 1 -- 172.21.15.143:0/4192563576 >> v1:172.21.15.146:6789/0 conn(0x7fa71406d740 legacy=0x7fa7140cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa70bfff640 1 -- 172.21.15.143:0/4192563576 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140c9f60 con 0x7fa7140cad20 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa712ffd640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa71415a4d0 0x7fa7140c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:15.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa70bfff640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7140cad20 0x7fa71415e940 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00bb10 tx=0x7fa6fc01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14eca3b7242e4f03 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7127fc640 1 -- 172.21.15.143:0/4192563576 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0a7c20 con 0x7fa7140cad20 2023-11-24T06:33:15.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7127fc640 1 -- 172.21.15.143:0/4192563576 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc0a7d80 con 0x7fa7140cad20 2023-11-24T06:33:15.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7127fc640 1 -- 172.21.15.143:0/4192563576 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0af660 con 0x7fa7140cad20 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7195aa640 1 -- 172.21.15.143:0/4192563576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7140cad20 msgr2=0x7fa71415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7195aa640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7140cad20 0x7fa71415e940 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00bb10 tx=0x7fa6fc01eb50 comp rx=0 tx=0).stop 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7195aa640 1 -- 172.21.15.143:0/4192563576 shutdown_connections 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7195aa640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7140cad20 0x7fa71415e940 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7195aa640 1 --2- 172.21.15.143:0/4192563576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa71415a4d0 0x7fa7140c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.136+0000 7fa7195aa640 1 -- 172.21.15.143:0/4192563576 >> 172.21.15.143:0/4192563576 conn(0x7fa7140b0bf0 msgr2=0x7fa7140b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 -- 172.21.15.143:0/4192563576 shutdown_connections 2023-11-24T06:33:15.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 -- 172.21.15.143:0/4192563576 wait complete. 2023-11-24T06:33:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 Processor -- start 2023-11-24T06:33:15.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 -- start start 2023-11-24T06:33:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 0x7fa714157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7140cad20 0x7fa71415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa71415a4d0 0x7fa714164070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7141650e0 con 0x7fa71406d740 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714163be0 con 0x7fa71415a4d0 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7195aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa714157d50 con 0x7fa7140cad20 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 0x7fa714157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 0x7fa714157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41576/0 (socket says 172.21.15.143:41576) 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 -- 172.21.15.143:0/858617028 learned_addr learned my addr 172.21.15.143:0/858617028 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa7137fe640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa71415a4d0 0x7fa714164070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa70bfff640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7140cad20 0x7fa71415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 -- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7140cad20 msgr2=0x7fa71415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7140cad20 0x7fa71415d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 -- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa71415a4d0 msgr2=0x7fa714164070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa71415a4d0 0x7fa714164070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 -- 172.21.15.143:0/858617028 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc00b770 con 0x7fa71406d740 2023-11-24T06:33:15.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa712ffd640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 0x7fa714157810 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa70400d800 tx=0x7fa70400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.140+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7040096c0 con 0x7fa71406d740 2023-11-24T06:33:15.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704009820 con 0x7fa71406d740 2023-11-24T06:33:15.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704009bd0 con 0x7fa71406d740 2023-11-24T06:33:15.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71406e0e0 con 0x7fa71406d740 2023-11-24T06:33:15.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa714163590 con 0x7fa71406d740 2023-11-24T06:33:15.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71409d250 con 0x7fa71406d740 2023-11-24T06:33:15.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fa704009d30 con 0x7fa71406d740 2023-11-24T06:33:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70b7fe640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6f4066aa0 0x7fa6f4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa704084f50 con 0x7fa71406d740 2023-11-24T06:33:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70bfff640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6f4066aa0 0x7fa6f4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.144+0000 7fa70bfff640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6f4066aa0 0x7fa6f4068f60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0b1000 tx=0x7fa6fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.152 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.148+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa704051bb0 con 0x7fa71406d740 2023-11-24T06:33:15.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.312+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa71404e930 con 0x7fa71406d740 2023-11-24T06:33:15.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.312+0000 7fa70b7fe640 1 -- 172.21.15.143:0/858617028 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa7040551d0 con 0x7fa71406d740 2023-11-24T06:33:15.317 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2023-11-24T06:33:15.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6f4066aa0 msgr2=0x7fa6f4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6f4066aa0 0x7fa6f4068f60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0b1000 tx=0x7fa6fc008040 comp rx=0 tx=0).stop 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 msgr2=0x7fa714157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 0x7fa714157810 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa70400d800 tx=0x7fa70400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 shutdown_connections 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa6f4066aa0 0x7fa6f4068f60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa71415a4d0 0x7fa714164070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7140cad20 0x7fa71415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 --2- 172.21.15.143:0/858617028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71406d740 0x7fa714157810 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 >> 172.21.15.143:0/858617028 conn(0x7fa7140b0bf0 msgr2=0x7fa714071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 shutdown_connections 2023-11-24T06:33:15.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.316+0000 7fa7195aa640 1 -- 172.21.15.143:0/858617028 wait complete. 2023-11-24T06:33:15.337 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:33:15.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:15.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:33:15.371 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:33:15.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:15.372 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:33:15.423 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:33:15.423 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:15.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:33:15.433 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:33:15.433 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:15.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:33:15.478 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:15.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 Processor -- start 2023-11-24T06:33:15.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 -- start start 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61ac0b3ec0 0x7f61ac15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61ac15db40 0x7f61ac15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac15e900 con 0x7f61ac160be0 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac06c650 con 0x7f61ac15db40 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b3b01640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac06c830 con 0x7f61ac0b3ec0 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b209e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61ac15db40 0x7f61ac15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b209e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61ac15db40 0x7f61ac15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41586/0 (socket says 172.21.15.143:41586) 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b209e640 1 -- 172.21.15.143:0/2964894494 learned_addr learned my addr 172.21.15.143:0/2964894494 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.612+0000 7f61b109c640 1 --2- 172.21.15.143:0/2964894494 >> v2:172.21.15.146:3300/0 conn(0x7f61ac0b3ec0 0x7f61ac15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b209e640 1 -- 172.21.15.143:0/2964894494 >> v2:172.21.15.146:3300/0 conn(0x7f61ac0b3ec0 msgr2=0x7f61ac15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b209e640 1 --2- 172.21.15.143:0/2964894494 >> v2:172.21.15.146:3300/0 conn(0x7f61ac0b3ec0 0x7f61ac15ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b209e640 1 -- 172.21.15.143:0/2964894494 >> v1:172.21.15.143:6789/0 conn(0x7f61ac160be0 legacy=0x7f61ac0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b209e640 1 -- 172.21.15.143:0/2964894494 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac06cb10 con 0x7f61ac15db40 2023-11-24T06:33:15.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b089b640 1 -- 172.21.15.143:0/2964894494 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608908451 0 0) 0x7f61ac15e900 con 0x7f61ac160be0 2023-11-24T06:33:15.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b209e640 1 --2- 172.21.15.143:0/2964894494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac15db40 0x7f61ac15df50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f61ac070620 tx=0x7f61a401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83399e376aa0330b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b089b640 1 -- 172.21.15.143:0/2964894494 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40a5880 con 0x7f61ac15db40 2023-11-24T06:33:15.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b089b640 1 -- 172.21.15.143:0/2964894494 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40a59e0 con 0x7f61ac15db40 2023-11-24T06:33:15.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b089b640 1 -- 172.21.15.143:0/2964894494 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40a5d70 con 0x7f61ac15db40 2023-11-24T06:33:15.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 -- 172.21.15.143:0/2964894494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac15db40 msgr2=0x7f61ac15df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 --2- 172.21.15.143:0/2964894494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac15db40 0x7f61ac15df50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f61ac070620 tx=0x7f61a401c9a0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 -- 172.21.15.143:0/2964894494 shutdown_connections 2023-11-24T06:33:15.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 --2- 172.21.15.143:0/2964894494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac15db40 0x7f61ac15df50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 --2- 172.21.15.143:0/2964894494 >> v2:172.21.15.146:3300/0 conn(0x7f61ac0b3ec0 0x7f61ac15ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 -- 172.21.15.143:0/2964894494 >> 172.21.15.143:0/2964894494 conn(0x7f61ac0b0bf0 msgr2=0x7f61ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:15.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.616+0000 7f61b3b01640 1 -- 172.21.15.143:0/2964894494 shutdown_connections 2023-11-24T06:33:15.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 -- 172.21.15.143:0/2964894494 wait complete. 2023-11-24T06:33:15.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 Processor -- start 2023-11-24T06:33:15.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 -- start start 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61ac0b3ec0 0x7f61ac140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61ac15db40 0x7f61ac0999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 0x7f61ac13d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09c220 con 0x7f61ac160be0 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09b650 con 0x7f61ac15db40 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac099f20 con 0x7f61ac0b3ec0 2023-11-24T06:33:15.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 0x7f61ac13d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 0x7f61ac13d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41592/0 (socket says 172.21.15.143:41592) 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 -- 172.21.15.143:0/266100616 learned_addr learned my addr 172.21.15.143:0/266100616 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b109c640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61ac15db40 0x7f61ac0999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 -- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61ac0b3ec0 msgr2=0x7f61ac140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b189d640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61ac0b3ec0 0x7f61ac140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61ac0b3ec0 0x7f61ac140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 -- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61ac15db40 msgr2=0x7f61ac0999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61ac15db40 0x7f61ac0999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 -- 172.21.15.143:0/266100616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009b30 con 0x7f61ac160be0 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b189d640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61ac0b3ec0 0x7f61ac140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:15.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b209e640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 0x7f61ac13d050 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f61a40195b0 tx=0x7f61a4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40b8670 con 0x7f61ac160be0 2023-11-24T06:33:15.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40b87f0 con 0x7f61ac160be0 2023-11-24T06:33:15.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40b8ba0 con 0x7f61ac160be0 2023-11-24T06:33:15.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.620+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac09b880 con 0x7f61ac160be0 2023-11-24T06:33:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac09be40 con 0x7f61ac160be0 2023-11-24T06:33:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac06ea40 con 0x7f61ac160be0 2023-11-24T06:33:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f61a40b8d00 con 0x7f61ac160be0 2023-11-24T06:33:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61a27fc640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6190066ad0 0x7f6190068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f61ac15e6a0 con 0x7f61ac160be0 2023-11-24T06:33:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61b189d640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6190066ad0 0x7f6190068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.624+0000 7f61b189d640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6190066ad0 0x7f6190068f90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f61a8000f70 tx=0x7f61a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.628+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61a40ec970 con 0x7f61ac160be0 2023-11-24T06:33:15.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.808+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61ac09c360 con 0x7f61ac160be0 2023-11-24T06:33:15.812 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.808+0000 7f61a27fc640 1 -- 172.21.15.143:0/266100616 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f61ac09c360 con 0x7f61ac160be0 2023-11-24T06:33:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:15.813 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:33:00.473562+0000","modified":"2023-11-24T06:33:03.488843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7032":{"gid":7032,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/1990915261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1990915261},{"type":"v1","addr":"172.21.15.143:6837","nonce":1990915261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-24T06:33:15.813 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 55 2023-11-24T06:33:15.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6190066ad0 msgr2=0x7f6190068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6190066ad0 0x7f6190068f90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f61a8000f70 tx=0x7f61a8009040 comp rx=0 tx=0).stop 2023-11-24T06:33:15.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 msgr2=0x7f61ac13d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 0x7f61ac13d050 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f61a40195b0 tx=0x7f61a4019740 comp rx=0 tx=0).stop 2023-11-24T06:33:15.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 shutdown_connections 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6190066ad0 0x7f6190068f90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61ac160be0 0x7f61ac13d050 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61ac15db40 0x7f61ac0999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 --2- 172.21.15.143:0/266100616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61ac0b3ec0 0x7f61ac140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 >> 172.21.15.143:0/266100616 conn(0x7f61ac0b0bf0 msgr2=0x7f61ac0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 shutdown_connections 2023-11-24T06:33:15.815 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.812+0000 7f61b3b01640 1 -- 172.21.15.143:0/266100616 wait complete. 2023-11-24T06:33:15.833 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:15.971 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 Processor -- start 2023-11-24T06:33:15.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 -- start start 2023-11-24T06:33:15.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f380b36c0 0x7f6f38070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.973 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f38070bd0 0x7f6f38071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380b2430 con 0x7f6f380b36c0 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3815a700 con 0x7f6f38070bd0 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f3e335640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38071580 con 0x7f6f3815a320 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f377fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f380b36c0 0x7f6f38070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f377fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f380b36c0 0x7f6f38070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41608/0 (socket says 172.21.15.143:41608) 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f377fe640 1 -- 172.21.15.143:0/684749921 learned_addr learned my addr 172.21.15.143:0/684749921 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.968+0000 7f6f37fff640 1 --2- 172.21.15.143:0/684749921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f3c8d2640 1 --2- 172.21.15.143:0/684749921 >> v2:172.21.15.146:3300/0 conn(0x7f6f38070bd0 0x7f6f38071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f377fe640 1 -- 172.21.15.143:0/684749921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 msgr2=0x7f6f380b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:15.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f377fe640 1 --2- 172.21.15.143:0/684749921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f377fe640 1 -- 172.21.15.143:0/684749921 >> v2:172.21.15.146:3300/0 conn(0x7f6f38070bd0 msgr2=0x7f6f38071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:15.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f377fe640 1 --2- 172.21.15.143:0/684749921 >> v2:172.21.15.146:3300/0 conn(0x7f6f38070bd0 0x7f6f38071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f377fe640 1 -- 172.21.15.143:0/684749921 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380b2620 con 0x7f6f380b36c0 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f377fe640 1 --2- 172.21.15.143:0/684749921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f38070690 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6f380b5040 tx=0x7f6f2c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7878861e80c0d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f36ffd640 1 -- 172.21.15.143:0/684749921 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0ad640 con 0x7f6f380b36c0 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f36ffd640 1 -- 172.21.15.143:0/684749921 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0ad7a0 con 0x7f6f380b36c0 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.972+0000 7f6f36ffd640 1 -- 172.21.15.143:0/684749921 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0adb30 con 0x7f6f380b36c0 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- 172.21.15.143:0/684749921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 msgr2=0x7f6f38070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- 172.21.15.143:0/684749921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f38070690 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6f380b5040 tx=0x7f6f2c01c4d0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- 172.21.15.143:0/684749921 shutdown_connections 2023-11-24T06:33:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- 172.21.15.143:0/684749921 >> v2:172.21.15.146:3300/0 conn(0x7f6f38070bd0 0x7f6f38071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- 172.21.15.143:0/684749921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f38070690 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- 172.21.15.143:0/684749921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- 172.21.15.143:0/684749921 >> 172.21.15.143:0/684749921 conn(0x7f6f380b0bf0 msgr2=0x7f6f380b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- 172.21.15.143:0/684749921 shutdown_connections 2023-11-24T06:33:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- 172.21.15.143:0/684749921 wait complete. 2023-11-24T06:33:15.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 Processor -- start 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- start start 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f38070bd0 0x7f6f38145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f380afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3815cb40 con 0x7f6f380b36c0 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38146680 con 0x7f6f38070bd0 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3e335640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38146960 con 0x7f6f3815a320 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f380afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f380afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41618/0 (socket says 172.21.15.143:41618) 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 -- 172.21.15.143:0/422203633 learned_addr learned my addr 172.21.15.143:0/422203633 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f37fff640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f38070bd0 0x7f6f38145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f3c8d2640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 -- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 msgr2=0x7f6f380b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 -- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f38070bd0 msgr2=0x7f6f38145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f38070bd0 0x7f6f38145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 -- 172.21.15.143:0/422203633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0094d0 con 0x7f6f380b36c0 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.976+0000 7f6f377fe640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f380afe00 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0b0040 tx=0x7f6f2c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0b8670 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0a6040 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0b8a30 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f38146c40 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3815d160 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f38067520 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f6f2c0b4070 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f34ff9640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f24066ad0 0x7f6f24068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6f2c11f130 con 0x7f6f380b36c0 2023-11-24T06:33:15.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f37fff640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f24066ad0 0x7f6f24068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:15.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.980+0000 7f6f37fff640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f24066ad0 0x7f6f24068f90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009ac0 tx=0x7f6f28009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:15.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:15.984+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f2c0ebd00 con 0x7f6f380b36c0 2023-11-24T06:33:16.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.140+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f381470f0 con 0x7f6f380b36c0 2023-11-24T06:33:16.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f34ff9640 1 -- 172.21.15.143:0/422203633 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f6f2c0ef320 con 0x7f6f380b36c0 2023-11-24T06:33:16.146 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":85,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:02.084666+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:16.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f24066ad0 msgr2=0x7f6f24068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f24066ad0 0x7f6f24068f90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009ac0 tx=0x7f6f28009190 comp rx=0 tx=0).stop 2023-11-24T06:33:16.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 msgr2=0x7f6f380afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f380afe00 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0b0040 tx=0x7f6f2c019270 comp rx=0 tx=0).stop 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 shutdown_connections 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6f24066ad0 0x7f6f24068f90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f3815a320 0x7f6f380b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f380b36c0 0x7f6f380afe00 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 --2- 172.21.15.143:0/422203633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f38070bd0 0x7f6f38145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 >> 172.21.15.143:0/422203633 conn(0x7f6f380b0bf0 msgr2=0x7f6f3809baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 shutdown_connections 2023-11-24T06:33:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.144+0000 7f6f3e335640 1 -- 172.21.15.143:0/422203633 wait complete. 2023-11-24T06:33:16.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:29:28.270057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:32:58.815639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:32:59.459362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:33:16.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:33:16.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.308+0000 7fadad3f8640 1 Processor -- start 2023-11-24T06:33:16.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.308+0000 7fadad3f8640 1 -- start start 2023-11-24T06:33:16.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fadad3f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada806d3f0 0x7fada8168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fadad3f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada80b0090 con 0x7fada815d7f0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fadad3f8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada80b0330 con 0x7fada80d39b0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fadad3f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada806b980 con 0x7fada806d3f0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fada815d7f0 0x7fada80d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54776/0 (socket says 172.21.15.143:54776) 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada6ffd640 1 -- 172.21.15.143:0/904177943 learned_addr learned my addr 172.21.15.143:0/904177943 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada806d3f0 0x7fada8168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105770431 0 0) 0x7fada80b0090 con 0x7fada815d7f0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad94003530 con 0x7fada815d7f0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807959716 0 0) 0x7fada80b0330 con 0x7fada80d39b0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada80b0090 con 0x7fada80d39b0 2023-11-24T06:33:16.315 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 716844396 0 0) 0x7fad94003530 con 0x7fada815d7f0 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada806d3f0 msgr2=0x7fada8168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada806d3f0 0x7fada8168220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 >> v1:172.21.15.146:6789/0 conn(0x7fada80d39b0 legacy=0x7fada806bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80b0610 con 0x7fada815d7f0 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fad98001680 con 0x7fada815d7f0 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 >> v1:172.21.15.143:6789/0 conn(0x7fada815d7f0 legacy=0x7fada80d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad94003b40 0x7fad94003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad940047d0 0x7fad94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fad9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada806b980 con 0x7fad94005190 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9400bf80 con 0x7fad94003b40 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9400c140 con 0x7fad940047d0 2023-11-24T06:33:16.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada806d3f0 0x7fada8168220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada6ffd640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad94003b40 0x7fad94003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fad9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fad9e7fc640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad940047d0 0x7fad94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 -- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad940047d0 msgr2=0x7fad94004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad940047d0 0x7fad94004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 -- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad94003b40 msgr2=0x7fad94003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad94003b40 0x7fad94003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada77fe640 1 -- 172.21.15.143:0/904177943 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94003530 con 0x7fad94005190 2023-11-24T06:33:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.312+0000 7fada6ffd640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad94003b40 0x7fad94003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fada77fe640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fad9400b990 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fada806d7d0 tx=0x7fada001cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd15ca64cef70d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0003ba0 con 0x7fad94005190 2023-11-24T06:33:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada000f040 con 0x7fad94005190 2023-11-24T06:33:16.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fada67fc640 1 -- 172.21.15.143:0/904177943 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00a5930 con 0x7fad94005190 2023-11-24T06:33:16.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 -- 172.21.15.143:0/904177943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 msgr2=0x7fad9400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 --2- 172.21.15.143:0/904177943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fad9400b990 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fada806d7d0 tx=0x7fada001cd00 comp rx=0 tx=0).stop 2023-11-24T06:33:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fada77fe640 1 -- 172.21.15.143:0/904177943 reap_dead start 2023-11-24T06:33:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 -- 172.21.15.143:0/904177943 shutdown_connections 2023-11-24T06:33:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 -- 172.21.15.143:0/904177943 >> 172.21.15.143:0/904177943 conn(0x7fada809c790 msgr2=0x7fada808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 -- 172.21.15.143:0/904177943 shutdown_connections 2023-11-24T06:33:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 -- 172.21.15.143:0/904177943 wait complete. 2023-11-24T06:33:16.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 Processor -- start 2023-11-24T06:33:16.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.316+0000 7fadad3f8640 1 -- start start 2023-11-24T06:33:16.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fada8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada80a0c60 0x7fada8158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.324 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada8158cd0 0x7fada809d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada80a0440 con 0x7fad94005190 2023-11-24T06:33:16.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada80a0160 con 0x7fada80a0c60 2023-11-24T06:33:16.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada8159460 con 0x7fada8158cd0 2023-11-24T06:33:16.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fada8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.325 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fada8153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41622/0 (socket says 172.21.15.143:41622) 2023-11-24T06:33:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 -- 172.21.15.143:0/2403653112 learned_addr learned my addr 172.21.15.143:0/2403653112 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fad9e7fc640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada80a0c60 0x7fada8158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada77fe640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada8158cd0 0x7fada809d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 -- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada8158cd0 msgr2=0x7fada809d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada8158cd0 0x7fada809d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 -- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada80a0c60 msgr2=0x7fada8158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada80a0c60 0x7fada8158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 -- 172.21.15.143:0/2403653112 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8159740 con 0x7fad94005190 2023-11-24T06:33:16.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fada6ffd640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fada8153ba0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fad98012540 tx=0x7fad98012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98014750 con 0x7fad94005190 2023-11-24T06:33:16.327 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad980148b0 con 0x7fad94005190 2023-11-24T06:33:16.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada8159a20 con 0x7fad94005190 2023-11-24T06:33:16.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98014c40 con 0x7fad94005190 2023-11-24T06:33:16.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada8159150 con 0x7fad94005190 2023-11-24T06:33:16.328 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.320+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada80a0580 con 0x7fad94005190 2023-11-24T06:33:16.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.324+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fad980153e0 con 0x7fad94005190 2023-11-24T06:33:16.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.324+0000 7fad9ffff640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad88066aa0 0x7fad88068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.324+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fad98087250 con 0x7fad94005190 2023-11-24T06:33:16.329 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.324+0000 7fad9e7fc640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad88066aa0 0x7fad88068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.324+0000 7fad9e7fc640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad88066aa0 0x7fad88068f60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fada81f61a0 tx=0x7fad90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.330 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.328+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad98053f70 con 0x7fad94005190 2023-11-24T06:33:16.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.476+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fada804e8c0 con 0x7fad94005190 2023-11-24T06:33:16.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fad9ffff640 1 -- 172.21.15.143:0/2403653112 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad98057590 con 0x7fad94005190 2023-11-24T06:33:16.482 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2023-11-24T06:33:16.483 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad88066aa0 msgr2=0x7fad88068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad88066aa0 0x7fad88068f60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fada81f61a0 tx=0x7fad90009040 comp rx=0 tx=0).stop 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 msgr2=0x7fada8153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fada8153ba0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fad98012540 tx=0x7fad98012940 comp rx=0 tx=0).stop 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 shutdown_connections 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fad88066aa0 0x7fad88068f60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada8158cd0 0x7fada809d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada80a0c60 0x7fada8158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 --2- 172.21.15.143:0/2403653112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94005190 0x7fada8153ba0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 >> 172.21.15.143:0/2403653112 conn(0x7fada809c790 msgr2=0x7fada80cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 shutdown_connections 2023-11-24T06:33:16.484 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.480+0000 7fadad3f8640 1 -- 172.21.15.143:0/2403653112 wait complete. 2023-11-24T06:33:16.502 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:33:16.643 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.640+0000 7f662c3d1640 1 Processor -- start 2023-11-24T06:33:16.644 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.640+0000 7f662c3d1640 1 -- start start 2023-11-24T06:33:16.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662c3d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 0x7f66240d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662c3d1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f662406cce0 0x7f662406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662c3d1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66240d3c60 con 0x7f66240d37e0 2023-11-24T06:33:16.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662c3d1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662406b980 con 0x7f662406cce0 2023-11-24T06:33:16.645 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662c3d1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240b0090 con 0x7f662415d7f0 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 0x7f66240d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 0x7f66240d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.143:48582/0 (socket says 172.21.15.143:48582) 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 -- 172.21.15.143:0/2521066219 learned_addr learned my addr 172.21.15.143:0/2521066219 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a96e640 1 --2- 172.21.15.143:0/2521066219 >> v2:172.21.15.146:3300/0 conn(0x7f662406cce0 0x7f662406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 -- 172.21.15.143:0/2521066219 >> v2:172.21.15.146:3300/0 conn(0x7f662406cce0 msgr2=0x7f662406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 --2- 172.21.15.143:0/2521066219 >> v2:172.21.15.146:3300/0 conn(0x7f662406cce0 0x7f662406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 -- 172.21.15.143:0/2521066219 >> v1:172.21.15.146:6789/0 conn(0x7f66240d37e0 legacy=0x7f66240b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.646 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 -- 172.21.15.143:0/2521066219 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662406d6b0 con 0x7f662415d7f0 2023-11-24T06:33:16.648 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.644+0000 7f662a16d640 1 --2- 172.21.15.143:0/2521066219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 0x7f66240d32a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6620009870 tx=0x7f662001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b788bf6e0789ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662916b640 1 -- 172.21.15.143:0/2521066219 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200a7070 con 0x7f662415d7f0 2023-11-24T06:33:16.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662916b640 1 -- 172.21.15.143:0/2521066219 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200ab430 con 0x7f662415d7f0 2023-11-24T06:33:16.649 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662916b640 1 -- 172.21.15.143:0/2521066219 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200ab7c0 con 0x7f662415d7f0 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- 172.21.15.143:0/2521066219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 msgr2=0x7f66240d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 --2- 172.21.15.143:0/2521066219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 0x7f66240d32a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6620009870 tx=0x7f662001c540 comp rx=0 tx=0).stop 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- 172.21.15.143:0/2521066219 shutdown_connections 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 --2- 172.21.15.143:0/2521066219 >> v2:172.21.15.146:3300/0 conn(0x7f662406cce0 0x7f662406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 --2- 172.21.15.143:0/2521066219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f662415d7f0 0x7f66240d32a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- 172.21.15.143:0/2521066219 >> 172.21.15.143:0/2521066219 conn(0x7f662409c790 msgr2=0x7f662408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:16.650 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- 172.21.15.143:0/2521066219 shutdown_connections 2023-11-24T06:33:16.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- 172.21.15.143:0/2521066219 wait complete. 2023-11-24T06:33:16.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 Processor -- start 2023-11-24T06:33:16.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- start start 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 0x7f662414d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240d37e0 0x7f66240c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f662415d7f0 0x7f662414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66240b8de0 con 0x7f662415d7f0 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66240b5c80 con 0x7f662406cce0 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.648+0000 7f662c3d1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240b8a40 con 0x7f66240d37e0 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 0x7f662414d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a96e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f662415d7f0 0x7f662414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662996c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240d37e0 0x7f66240c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 0x7f662414d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.143:50206/0 (socket says 172.21.15.143:50206) 2023-11-24T06:33:16.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 -- 172.21.15.143:0/892694424 learned_addr learned my addr 172.21.15.143:0/892694424 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:16.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 -- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240d37e0 msgr2=0x7f66240c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240d37e0 0x7f66240c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 -- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f662415d7f0 msgr2=0x7f662414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f662415d7f0 0x7f662414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 -- 172.21.15.143:0/892694424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200094d0 con 0x7f662406cce0 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a96e640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f662415d7f0 0x7f662414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662a16d640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 0x7f662414d6b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66200ad040 tx=0x7f66200192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200b4620 con 0x7f662406cce0 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200b4780 con 0x7f662406cce0 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200b4b30 con 0x7f662406cce0 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66240b56c0 con 0x7f662406cce0 2023-11-24T06:33:16.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66240b9200 con 0x7f662406cce0 2023-11-24T06:33:16.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662404e8c0 con 0x7f662406cce0 2023-11-24T06:33:16.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.652+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f66200b4c90 con 0x7f662406cce0 2023-11-24T06:33:16.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.656+0000 7f661affd640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6608066ad0 0x7f6608068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.656+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f662011ec80 con 0x7f662406cce0 2023-11-24T06:33:16.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.656+0000 7f662996c640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6608066ad0 0x7f6608068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.656+0000 7f662996c640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6608066ad0 0x7f6608068f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f66240cb5e0 tx=0x7f6614009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.660+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66200eb700 con 0x7f662406cce0 2023-11-24T06:33:16.810 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.808+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66240d12c0 con 0x7f662406cce0 2023-11-24T06:33:16.811 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.808+0000 7f661affd640 1 -- 172.21.15.143:0/892694424 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66200eed20 con 0x7f662406cce0 2023-11-24T06:33:16.811 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2023-11-24T06:33:16.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.808+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6608066ad0 msgr2=0x7f6608068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.808+0000 7f662c3d1640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6608066ad0 0x7f6608068f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f66240cb5e0 tx=0x7f6614009040 comp rx=0 tx=0).stop 2023-11-24T06:33:16.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.808+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 msgr2=0x7f662414d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.808+0000 7f662c3d1640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 0x7f662414d6b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66200ad040 tx=0x7f66200192e0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.813 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 shutdown_connections 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6608066ad0 0x7f6608068f90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f662415d7f0 0x7f662414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240d37e0 0x7f66240c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 --2- 172.21.15.143:0/892694424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f662406cce0 0x7f662414d6b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 >> 172.21.15.143:0/892694424 conn(0x7f662409c790 msgr2=0x7f66240cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 shutdown_connections 2023-11-24T06:33:16.814 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.812+0000 7f662c3d1640 1 -- 172.21.15.143:0/892694424 wait complete. 2023-11-24T06:33:16.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:33:16.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.968+0000 7fc0b4bf8640 1 Processor -- start 2023-11-24T06:33:16.972 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.968+0000 7fc0b4bf8640 1 -- start start 2023-11-24T06:33:16.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0b4bf8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0b0072490 0x7fc0b006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.974 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0b4bf8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b00c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0b4bf8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b00ce090 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0b4bf8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b0159f50 con 0x7fc0b0072490 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0b4bf8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0071610 con 0x7fc0b006cdb0 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0b0072490 0x7fc0b006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0b0072490 0x7fc0b006c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41636/0 (socket says 172.21.15.143:41636) 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 -- 172.21.15.143:0/3588808 learned_addr learned my addr 172.21.15.143:0/3588808 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0affff640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b00c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 -- 172.21.15.143:0/3588808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 msgr2=0x7fc0b00c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b00c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 -- 172.21.15.143:0/3588808 >> v1:172.21.15.146:6789/0 conn(0x7fc0b00cb4f0 legacy=0x7fc0b00ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0a7fff640 1 -- 172.21.15.143:0/3588808 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00cb8d0 con 0x7fc0b0072490 2023-11-24T06:33:16.976 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.972+0000 7fc0affff640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b00c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:16.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0a7fff640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b0072490 0x7fc0b006c870 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc098009870 tx=0x7fc09801fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98df156ad8745a48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0aeffd640 1 -- 172.21.15.143:0/3588808 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980a9b40 con 0x7fc0b0072490 2023-11-24T06:33:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0aeffd640 1 -- 172.21.15.143:0/3588808 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980a9ca0 con 0x7fc0b0072490 2023-11-24T06:33:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0aeffd640 1 -- 172.21.15.143:0/3588808 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980b1660 con 0x7fc0b0072490 2023-11-24T06:33:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/3588808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b0072490 msgr2=0x7fc0b006c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b0072490 0x7fc0b006c870 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc098009870 tx=0x7fc09801fe40 comp rx=0 tx=0).stop 2023-11-24T06:33:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/3588808 shutdown_connections 2023-11-24T06:33:16.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b00c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/3588808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b0072490 0x7fc0b006c870 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/3588808 >> 172.21.15.143:0/3588808 conn(0x7fc0b00cbb50 msgr2=0x7fc0b00cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:16.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/3588808 shutdown_connections 2023-11-24T06:33:16.979 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/3588808 wait complete. 2023-11-24T06:33:16.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 Processor -- start 2023-11-24T06:33:16.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.976+0000 7fc0b4bf8640 1 -- start start 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b009b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b0072490 0x7fc0b00b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 0x7fc0b00b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b009aa30 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b009b260 con 0x7fc0b0072490 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b00b2220 con 0x7fc0b006cdb0 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 0x7fc0b00b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 0x7fc0b00b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41640/0 (socket says 172.21.15.143:41640) 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 -- 172.21.15.143:0/2014879 learned_addr learned my addr 172.21.15.143:0/2014879 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:16.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0a7fff640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b0072490 0x7fc0b00b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0af7fe640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b009b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 -- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 msgr2=0x7fc0b009b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b009b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 -- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b0072490 msgr2=0x7fc0b00b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b0072490 0x7fc0b00b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 -- 172.21.15.143:0/2014879 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980094d0 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.983 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0affff640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 0x7fc0b00b2c40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009fa0 tx=0x7fc0a800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8003ba0 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800f040 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8004030 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b009ac10 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b009bc30 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b009b3d0 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.984 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.980+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fc0a8004190 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.984+0000 7fc0acff9640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc090066aa0 0x7fc090068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:16.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.984+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc0a8084e50 con 0x7fc0b00cb4f0 2023-11-24T06:33:16.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.984+0000 7fc0af7fe640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc090066aa0 0x7fc090068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:16.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.984+0000 7fc0af7fe640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc090066aa0 0x7fc090068f60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0007fd0 tx=0x7fc0a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:16.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:16.988+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0a80518d0 con 0x7fc0b00cb4f0 2023-11-24T06:33:17.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0b004e850 con 0x7fc0b00cb4f0 2023-11-24T06:33:17.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0acff9640 1 -- 172.21.15.143:0/2014879 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0a801a0a0 con 0x7fc0b00cb4f0 2023-11-24T06:33:17.145 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc090066aa0 msgr2=0x7fc090068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc090066aa0 0x7fc090068f60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0007fd0 tx=0x7fc0a0009040 comp rx=0 tx=0).stop 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 msgr2=0x7fc0b00b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 0x7fc0b00b2c40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009fa0 tx=0x7fc0a800d560 comp rx=0 tx=0).stop 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 shutdown_connections 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc090066aa0 0x7fc090068f60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b00cb4f0 0x7fc0b00b2c40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b0072490 0x7fc0b00b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 --2- 172.21.15.143:0/2014879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b006cdb0 0x7fc0b009b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 >> 172.21.15.143:0/2014879 conn(0x7fc0b00cbb50 msgr2=0x7fc0b014f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:17.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 shutdown_connections 2023-11-24T06:33:17.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.144+0000 7fc0b4bf8640 1 -- 172.21.15.143:0/2014879 wait complete. 2023-11-24T06:33:17.167 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:17.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 Processor -- start 2023-11-24T06:33:17.306 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 -- start start 2023-11-24T06:33:17.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efce015a320 0x7efce00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efce00b36c0 0x7efce0070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce015a700 con 0x7efce0070bd0 2023-11-24T06:33:17.308 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce00b2430 con 0x7efce00b36c0 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce7f8d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce00b2620 con 0x7efce015a320 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efce00b36c0 0x7efce0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efce00b36c0 0x7efce0070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41646/0 (socket says 172.21.15.143:41646) 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 -- 172.21.15.143:0/3730467749 learned_addr learned my addr 172.21.15.143:0/3730467749 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5d29640 1 --2- 172.21.15.143:0/3730467749 >> v2:172.21.15.146:3300/0 conn(0x7efce015a320 0x7efce00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 -- 172.21.15.143:0/3730467749 >> v2:172.21.15.146:3300/0 conn(0x7efce015a320 msgr2=0x7efce00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 --2- 172.21.15.143:0/3730467749 >> v2:172.21.15.146:3300/0 conn(0x7efce015a320 0x7efce00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 -- 172.21.15.143:0/3730467749 >> v1:172.21.15.146:6789/0 conn(0x7efce0070bd0 legacy=0x7efce0071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:17.309 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.304+0000 7efce5528640 1 -- 172.21.15.143:0/3730467749 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce00b2900 con 0x7efce00b36c0 2023-11-24T06:33:17.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce5528640 1 --2- 172.21.15.143:0/3730467749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce00b36c0 0x7efce0070690 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7efce006c0c0 tx=0x7efcd001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f52b8dea28451b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce4d27640 1 -- 172.21.15.143:0/3730467749 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00a7b30 con 0x7efce00b36c0 2023-11-24T06:33:17.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce4d27640 1 -- 172.21.15.143:0/3730467749 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd00a7c90 con 0x7efce00b36c0 2023-11-24T06:33:17.311 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce4d27640 1 -- 172.21.15.143:0/3730467749 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00af440 con 0x7efce00b36c0 2023-11-24T06:33:17.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 -- 172.21.15.143:0/3730467749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce00b36c0 msgr2=0x7efce0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.312 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 --2- 172.21.15.143:0/3730467749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce00b36c0 0x7efce0070690 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7efce006c0c0 tx=0x7efcd001eb60 comp rx=0 tx=0).stop 2023-11-24T06:33:17.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 -- 172.21.15.143:0/3730467749 shutdown_connections 2023-11-24T06:33:17.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 --2- 172.21.15.143:0/3730467749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce00b36c0 0x7efce0070690 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 --2- 172.21.15.143:0/3730467749 >> v2:172.21.15.146:3300/0 conn(0x7efce015a320 0x7efce00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 -- 172.21.15.143:0/3730467749 >> 172.21.15.143:0/3730467749 conn(0x7efce00b0bf0 msgr2=0x7efce00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:17.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 -- 172.21.15.143:0/3730467749 shutdown_connections 2023-11-24T06:33:17.313 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.308+0000 7efce7f8d640 1 -- 172.21.15.143:0/3730467749 wait complete. 2023-11-24T06:33:17.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 Processor -- start 2023-11-24T06:33:17.314 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 -- start start 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 0x7efce0155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efce00b36c0 0x7efce0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce015a320 0x7efce0157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce0156640 con 0x7efce0070bd0 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce0156080 con 0x7efce015a320 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce0156360 con 0x7efce00b36c0 2023-11-24T06:33:17.316 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 0x7efce0155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 0x7efce0155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:41662/0 (socket says 172.21.15.143:41662) 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 -- 172.21.15.143:0/2859675532 learned_addr learned my addr 172.21.15.143:0/2859675532 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce652a640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce015a320 0x7efce0157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5528640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efce00b36c0 0x7efce0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 -- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efce00b36c0 msgr2=0x7efce0150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efce00b36c0 0x7efce0150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 -- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce015a320 msgr2=0x7efce0157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce015a320 0x7efce0157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 -- 172.21.15.143:0/2859675532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd000b770 con 0x7efce0070bd0 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5528640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efce00b36c0 0x7efce0150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce652a640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce015a320 0x7efce0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:17.317 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce5d29640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 0x7efce0155400 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00d5f0 tx=0x7efcdc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0125f0 con 0x7efce0070bd0 2023-11-24T06:33:17.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc012750 con 0x7efce0070bd0 2023-11-24T06:33:17.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce0154ee0 con 0x7efce0070bd0 2023-11-24T06:33:17.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc012ae0 con 0x7efce0070bd0 2023-11-24T06:33:17.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.312+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce014f0f0 con 0x7efce0070bd0 2023-11-24T06:33:17.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.316+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce0067520 con 0x7efce0070bd0 2023-11-24T06:33:17.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.316+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7efcdc012c40 con 0x7efce0070bd0 2023-11-24T06:33:17.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.316+0000 7efcd67fc640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcc4066aa0 0x7efcc4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.316+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7efcdc084ea0 con 0x7efce0070bd0 2023-11-24T06:33:17.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.316+0000 7efce5528640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcc4066aa0 0x7efcc4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.316+0000 7efce5528640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcc4066aa0 0x7efcc4068f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efcd00b1000 tx=0x7efcd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.323 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.320+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efcdc051a10 con 0x7efce0070bd0 2023-11-24T06:33:17.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.496+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efce0164650 con 0x7efce0070bd0 2023-11-24T06:33:17.501 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efcd67fc640 1 -- 172.21.15.143:0/2859675532 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4918 (secure 0 0 0) 0x7efcdc007380 con 0x7efce0070bd0 2023-11-24T06:33:17.501 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:17.501 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:33:00.473562+0000","modified":"2023-11-24T06:33:03.488843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7032":{"gid":7032,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/1990915261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1990915261},{"type":"v1","addr":"172.21.15.143:6837","nonce":1990915261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-24T06:33:17.502 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 55 2023-11-24T06:33:17.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcc4066aa0 msgr2=0x7efcc4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcc4066aa0 0x7efcc4068f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efcd00b1000 tx=0x7efcd0008040 comp rx=0 tx=0).stop 2023-11-24T06:33:17.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 msgr2=0x7efce0155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 0x7efce0155400 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00d5f0 tx=0x7efcdc00dab0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 shutdown_connections 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7efcc4066aa0 0x7efcc4068f60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce015a320 0x7efce0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efce00b36c0 0x7efce0150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 --2- 172.21.15.143:0/2859675532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efce0070bd0 0x7efce0155400 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 >> 172.21.15.143:0/2859675532 conn(0x7efce00b0bf0 msgr2=0x7efce0151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 shutdown_connections 2023-11-24T06:33:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.500+0000 7efce7f8d640 1 -- 172.21.15.143:0/2859675532 wait complete. 2023-11-24T06:33:17.522 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:17.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41b1a0640 1 Processor -- start 2023-11-24T06:33:17.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41b1a0640 1 -- start start 2023-11-24T06:33:17.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41b1a0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa4140d1d30 0x7fa4140cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41b1a0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140cef10 con 0x7fa414160b60 2023-11-24T06:33:17.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41b1a0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140d2190 con 0x7fa4140d00f0 2023-11-24T06:33:17.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41b1a0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4140d2e50 con 0x7fa4140d1d30 2023-11-24T06:33:17.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.656+0000 7fa41999d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa4140d1d30 0x7fa4140cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.661 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41a19e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa414160b60 0x7fa4140ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37420/0 (socket says 172.21.15.143:37420) 2023-11-24T06:33:17.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41a19e640 1 -- 172.21.15.143:0/310567053 learned_addr learned my addr 172.21.15.143:0/310567053 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:17.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41999d640 1 -- 172.21.15.143:0/310567053 >> v1:172.21.15.146:6789/0 conn(0x7fa4140d00f0 legacy=0x7fa4140c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:17.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41999d640 1 -- 172.21.15.143:0/310567053 >> v1:172.21.15.143:6789/0 conn(0x7fa414160b60 legacy=0x7fa4140ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41999d640 1 -- 172.21.15.143:0/310567053 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140d0f70 con 0x7fa4140d1d30 2023-11-24T06:33:17.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41919c640 1 -- 172.21.15.143:0/310567053 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847128659 0 0) 0x7fa4140cef10 con 0x7fa414160b60 2023-11-24T06:33:17.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41999d640 1 --2- 172.21.15.143:0/310567053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140cfbb0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa4040097c0 tx=0x7fa40401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5895ffb05d69b14 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41919c640 1 -- 172.21.15.143:0/310567053 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040a8930 con 0x7fa4140d1d30 2023-11-24T06:33:17.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41919c640 1 -- 172.21.15.143:0/310567053 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040a8a90 con 0x7fa4140d1d30 2023-11-24T06:33:17.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.660+0000 7fa41919c640 1 -- 172.21.15.143:0/310567053 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040a8e20 con 0x7fa4140d1d30 2023-11-24T06:33:17.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- 172.21.15.143:0/310567053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 msgr2=0x7fa4140cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/310567053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140cfbb0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa4040097c0 tx=0x7fa40401ec30 comp rx=0 tx=0).stop 2023-11-24T06:33:17.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- 172.21.15.143:0/310567053 shutdown_connections 2023-11-24T06:33:17.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/310567053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140cfbb0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- 172.21.15.143:0/310567053 >> 172.21.15.143:0/310567053 conn(0x7fa41409c520 msgr2=0x7fa4140d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:17.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- 172.21.15.143:0/310567053 shutdown_connections 2023-11-24T06:33:17.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- 172.21.15.143:0/310567053 wait complete. 2023-11-24T06:33:17.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 Processor -- start 2023-11-24T06:33:17.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- start start 2023-11-24T06:33:17.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4140d00f0 0x7fa414149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414160b60 0x7fa4140cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c79d0 con 0x7fa4140d1d30 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa414149ba0 con 0x7fa4140d00f0 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41b1a0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4141529c0 con 0x7fa414160b60 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38650/0 (socket says 172.21.15.143:38650) 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 -- 172.21.15.143:0/1361539677 learned_addr learned my addr 172.21.15.143:0/1361539677 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41a19e640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4140d00f0 0x7fa414149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41a99f640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414160b60 0x7fa4140cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 -- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414160b60 msgr2=0x7fa4140cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414160b60 0x7fa4140cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 -- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4140d00f0 msgr2=0x7fa414149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.669 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4140d00f0 0x7fa414149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.664+0000 7fa41999d640 1 -- 172.21.15.143:0/1361539677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009420 con 0x7fa4140d1d30 2023-11-24T06:33:17.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa41999d640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140ccbc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa4040b3040 tx=0x7fa40401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.670 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040a8930 con 0x7fa4140d1d30 2023-11-24T06:33:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040b9410 con 0x7fa4140d1d30 2023-11-24T06:33:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040b97e0 con 0x7fa4140d1d30 2023-11-24T06:33:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4140c6dc0 con 0x7fa4140d1d30 2023-11-24T06:33:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4140c7380 con 0x7fa4140d1d30 2023-11-24T06:33:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4140d0c00 con 0x7fa4140d1d30 2023-11-24T06:33:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fa4040b7040 con 0x7fa4140d1d30 2023-11-24T06:33:17.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa40affd640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa3f8066aa0 0x7fa3f8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa404122680 con 0x7fa4140d1d30 2023-11-24T06:33:17.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa41a19e640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa3f8066aa0 0x7fa3f8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.672 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.668+0000 7fa41a19e640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa3f8066aa0 0x7fa3f8068f60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa410000f70 tx=0x7fa410007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.672+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4040ef2a0 con 0x7fa4140d1d30 2023-11-24T06:33:17.825 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4140d0c00 con 0x7fa4140d1d30 2023-11-24T06:33:17.826 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa40affd640 1 -- 172.21.15.143:0/1361539677 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16651 (secure 0 0 0) 0x7fa4040b5020 con 0x7fa4140d1d30 2023-11-24T06:33:17.827 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:17.827 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":85,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:02.084666+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa3f8066aa0 msgr2=0x7fa3f8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa3f8066aa0 0x7fa3f8068f60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa410000f70 tx=0x7fa410007c10 comp rx=0 tx=0).stop 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 msgr2=0x7fa4140ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140ccbc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa4040b3040 tx=0x7fa40401b9d0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 shutdown_connections 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa3f8066aa0 0x7fa3f8068f60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414160b60 0x7fa4140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4140d1d30 0x7fa4140ccbc0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.829 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 --2- 172.21.15.143:0/1361539677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4140d00f0 0x7fa414149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.824+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 >> 172.21.15.143:0/1361539677 conn(0x7fa41409c520 msgr2=0x7fa4140b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:17.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.828+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 shutdown_connections 2023-11-24T06:33:17.830 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.828+0000 7fa41b1a0640 1 -- 172.21.15.143:0/1361539677 wait complete. 2023-11-24T06:33:17.848 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:33:17.848 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:17.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 Processor -- start 2023-11-24T06:33:17.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 -- start start 2023-11-24T06:33:17.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d0815d570 0x7f8d0806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8d080d3020 0x7f8d080d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080d39f0 con 0x7f8d080ce8b0 2023-11-24T06:33:17.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080d1cc0 con 0x7f8d080d3020 2023-11-24T06:33:17.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d1025a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080d1fa0 con 0x7f8d0815d570 2023-11-24T06:33:17.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8d080d3020 0x7f8d080d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8d080d3020 0x7f8d080d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38666/0 (socket says 172.21.15.143:38666) 2023-11-24T06:33:17.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/2401278732 learned_addr learned my addr 172.21.15.143:0/2401278732 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:17.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/2401278732 >> v2:172.21.15.146:3300/0 conn(0x7f8d0815d570 msgr2=0x7f8d0806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:17.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 --2- 172.21.15.143:0/2401278732 >> v2:172.21.15.146:3300/0 conn(0x7f8d0815d570 0x7f8d0806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/2401278732 >> v1:172.21.15.146:6789/0 conn(0x7f8d080ce8b0 legacy=0x7f8d080ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:17.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.984+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/2401278732 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080ce0b0 con 0x7f8d080d3020 2023-11-24T06:33:17.990 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d0d7f5640 1 --2- 172.21.15.143:0/2401278732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080d34b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f8d080d0eb0 tx=0x7f8cf801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367d95098391ac70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d0cff4640 1 -- 172.21.15.143:0/2401278732 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80aa610 con 0x7f8d080d3020 2023-11-24T06:33:17.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d0cff4640 1 -- 172.21.15.143:0/2401278732 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80a6040 con 0x7f8d080d3020 2023-11-24T06:33:17.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d0cff4640 1 -- 172.21.15.143:0/2401278732 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80aa990 con 0x7f8d080d3020 2023-11-24T06:33:17.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 -- 172.21.15.143:0/2401278732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 msgr2=0x7f8d080d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 --2- 172.21.15.143:0/2401278732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080d34b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f8d080d0eb0 tx=0x7f8cf801c490 comp rx=0 tx=0).stop 2023-11-24T06:33:17.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 -- 172.21.15.143:0/2401278732 shutdown_connections 2023-11-24T06:33:17.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 --2- 172.21.15.143:0/2401278732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080d34b0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 --2- 172.21.15.143:0/2401278732 >> v2:172.21.15.146:3300/0 conn(0x7f8d0815d570 0x7f8d0806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 -- 172.21.15.143:0/2401278732 >> 172.21.15.143:0/2401278732 conn(0x7f8d0808ceb0 msgr2=0x7f8d0809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:17.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 -- 172.21.15.143:0/2401278732 shutdown_connections 2023-11-24T06:33:17.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.988+0000 7f8d1025a640 1 -- 172.21.15.143:0/2401278732 wait complete. 2023-11-24T06:33:17.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 Processor -- start 2023-11-24T06:33:17.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 -- start start 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080ce8b0 0x7f8d0815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0815d570 0x7f8d0815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08160bc0 con 0x7f8d080d3020 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08160040 con 0x7f8d0815d570 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08160320 con 0x7f8d080ce8b0 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38676/0 (socket says 172.21.15.143:38676) 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/943408705 learned_addr learned my addr 172.21.15.143:0/943408705 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:17.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0e7f7640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0815d570 0x7f8d0815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0dff6640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080ce8b0 0x7f8d0815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:17.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080ce8b0 msgr2=0x7f8d0815f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080ce8b0 0x7f8d0815f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0815d570 msgr2=0x7f8d0815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:17.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0815d570 0x7f8d0815db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:17.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 -- 172.21.15.143:0/943408705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf80094d0 con 0x7f8d080d3020 2023-11-24T06:33:17.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0dff6640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080ce8b0 0x7f8d0815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:17.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d0d7f5640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080ccd00 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80ac040 tx=0x7f8cf801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:17.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80bd5f0 con 0x7f8d080d3020 2023-11-24T06:33:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80bd770 con 0x7f8d080d3020 2023-11-24T06:33:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80bdb20 con 0x7f8d080d3020 2023-11-24T06:33:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08160600 con 0x7f8d080d3020 2023-11-24T06:33:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.992+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d080cd240 con 0x7f8d080d3020 2023-11-24T06:33:17.999 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.996+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08067520 con 0x7f8d080d3020 2023-11-24T06:33:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.996+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f8cf80b33f0 con 0x7f8d080d3020 2023-11-24T06:33:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.996+0000 7f8cfe7fc640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8cec066aa0 0x7f8cec068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.996+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8cf811f820 con 0x7f8d080d3020 2023-11-24T06:33:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.996+0000 7f8d0dff6640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8cec066aa0 0x7f8cec068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.001 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:17.996+0000 7f8d0dff6640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8cec066aa0 0x7f8cec068f60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8d04006fd0 tx=0x7f8d04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.003 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.000+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8cf80ec370 con 0x7f8d080d3020 2023-11-24T06:33:18.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d08160460 con 0x7f8d080d3020 2023-11-24T06:33:18.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8cfe7fc640 1 -- 172.21.15.143:0/943408705 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f8d08160460 con 0x7f8d080d3020 2023-11-24T06:33:18.187 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:18.187 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:33:00.473562+0000","modified":"2023-11-24T06:33:03.488843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7032":{"gid":7032,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/1990915261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1990915261},{"type":"v1","addr":"172.21.15.143:6837","nonce":1990915261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-24T06:33:18.188 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 55 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8cec066aa0 msgr2=0x7f8cec068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8cec066aa0 0x7f8cec068f60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8d04006fd0 tx=0x7f8d04008040 comp rx=0 tx=0).stop 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 msgr2=0x7f8d080ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080ccd00 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80ac040 tx=0x7f8cf801acd0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 shutdown_connections 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8cec066aa0 0x7f8cec068f60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0815d570 0x7f8d0815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d080d3020 0x7f8d080ccd00 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 --2- 172.21.15.143:0/943408705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080ce8b0 0x7f8d0815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 >> 172.21.15.143:0/943408705 conn(0x7f8d0808ceb0 msgr2=0x7f8d0815c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:18.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 shutdown_connections 2023-11-24T06:33:18.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.184+0000 7f8d1025a640 1 -- 172.21.15.143:0/943408705 wait complete. 2023-11-24T06:33:18.209 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:18.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.344+0000 7fc531f2a640 1 Processor -- start 2023-11-24T06:33:18.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.344+0000 7fc531f2a640 1 -- start start 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc531f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc52c159a80 0x7fc52c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc531f2a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc52c06cee0 0x7fc52c06d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc531f2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52c0ae950 con 0x7fc52c0b2660 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc531f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c06d8b0 con 0x7fc52c159a80 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc531f2a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c0b1ef0 con 0x7fc52c06cee0 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc52c159a80 0x7fc52c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.350 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc52c0b2660 0x7fc52c0b2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37428/0 (socket says 172.21.15.143:37428) 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52bfff640 1 -- 172.21.15.143:0/1795788875 learned_addr learned my addr 172.21.15.143:0/1795788875 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc52c159a80 0x7fc52c06de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38692/0 (socket says 172.21.15.143:38692) 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52affd640 1 --2- 172.21.15.143:0/1795788875 >> v2:172.21.15.146:3300/0 conn(0x7fc52c06cee0 0x7fc52c06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52b7fe640 1 -- 172.21.15.143:0/1795788875 >> v2:172.21.15.146:3300/0 conn(0x7fc52c06cee0 msgr2=0x7fc52c06d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52b7fe640 1 --2- 172.21.15.143:0/1795788875 >> v2:172.21.15.146:3300/0 conn(0x7fc52c06cee0 0x7fc52c06d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52b7fe640 1 -- 172.21.15.143:0/1795788875 >> v1:172.21.15.143:6789/0 conn(0x7fc52c0b2660 legacy=0x7fc52c0b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52b7fe640 1 -- 172.21.15.143:0/1795788875 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0adca0 con 0x7fc52c159a80 2023-11-24T06:33:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.348+0000 7fc52affd640 1 --2- 172.21.15.143:0/1795788875 >> v2:172.21.15.146:3300/0 conn(0x7fc52c06cee0 0x7fc52c06d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:18.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc52b7fe640 1 --2- 172.21.15.143:0/1795788875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c159a80 0x7fc52c06de50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc52c06c0c0 tx=0x7fc51c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0846b722966f07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc52a7fc640 1 -- 172.21.15.143:0/1795788875 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0ab650 con 0x7fc52c159a80 2023-11-24T06:33:18.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc52a7fc640 1 -- 172.21.15.143:0/1795788875 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c0ab7b0 con 0x7fc52c159a80 2023-11-24T06:33:18.354 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc52a7fc640 1 -- 172.21.15.143:0/1795788875 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0abb40 con 0x7fc52c159a80 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 -- 172.21.15.143:0/1795788875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c159a80 msgr2=0x7fc52c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 --2- 172.21.15.143:0/1795788875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c159a80 0x7fc52c06de50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc52c06c0c0 tx=0x7fc51c01c430 comp rx=0 tx=0).stop 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 -- 172.21.15.143:0/1795788875 shutdown_connections 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 --2- 172.21.15.143:0/1795788875 >> v2:172.21.15.146:3300/0 conn(0x7fc52c06cee0 0x7fc52c06d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 --2- 172.21.15.143:0/1795788875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c159a80 0x7fc52c06de50 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 -- 172.21.15.143:0/1795788875 >> 172.21.15.143:0/1795788875 conn(0x7fc52c0b0bf0 msgr2=0x7fc52c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 -- 172.21.15.143:0/1795788875 shutdown_connections 2023-11-24T06:33:18.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 -- 172.21.15.143:0/1795788875 wait complete. 2023-11-24T06:33:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 Processor -- start 2023-11-24T06:33:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.352+0000 7fc531f2a640 1 -- start start 2023-11-24T06:33:18.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 0x7fc52c151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc52c0b2660 0x7fc52c1670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc52c159a80 0x7fc52c148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c14fe20 con 0x7fc52c06cee0 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c14ab40 con 0x7fc52c159a80 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1681c0 con 0x7fc52c0b2660 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 0x7fc52c151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 0x7fc52c151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38694/0 (socket says 172.21.15.143:38694) 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 -- 172.21.15.143:0/3577196793 learned_addr learned my addr 172.21.15.143:0/3577196793 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52affd640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc52c0b2660 0x7fc52c1670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52bfff640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc52c159a80 0x7fc52c148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 -- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc52c0b2660 msgr2=0x7fc52c1670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc52c0b2660 0x7fc52c1670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 -- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc52c159a80 msgr2=0x7fc52c148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc52c159a80 0x7fc52c148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 -- 172.21.15.143:0/3577196793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009420 con 0x7fc52c06cee0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc52b7fe640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 0x7fc52c151270 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0ad040 tx=0x7fc51c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0b5810 con 0x7fc52c06cee0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c0b5970 con 0x7fc52c06cee0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0b5d20 con 0x7fc52c06cee0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c1684a0 con 0x7fc52c06cee0 2023-11-24T06:33:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c167e90 con 0x7fc52c06cee0 2023-11-24T06:33:18.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52c067520 con 0x7fc52c06cee0 2023-11-24T06:33:18.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.356+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fc51c0bf410 con 0x7fc52c06cee0 2023-11-24T06:33:18.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.360+0000 7fc513fff640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc518066aa0 0x7fc518068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.360+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc51c11f650 con 0x7fc52c06cee0 2023-11-24T06:33:18.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.360+0000 7fc52affd640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc518066aa0 0x7fc518068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.360+0000 7fc52affd640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc518066aa0 0x7fc518068f60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc52c09cd00 tx=0x7fc520008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.364+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc51c0ec340 con 0x7fc52c06cee0 2023-11-24T06:33:18.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.540+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc52c15a080 con 0x7fc52c06cee0 2023-11-24T06:33:18.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc513fff640 1 -- 172.21.15.143:0/3577196793 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fc51c0ef960 con 0x7fc52c06cee0 2023-11-24T06:33:18.545 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:18.545 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:33:00.473562+0000","modified":"2023-11-24T06:33:03.488843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7032":{"gid":7032,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/1990915261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":1990915261},{"type":"v1","addr":"172.21.15.143:6837","nonce":1990915261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-24T06:33:18.545 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 55 2023-11-24T06:33:18.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc518066aa0 msgr2=0x7fc518068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc518066aa0 0x7fc518068f60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc52c09cd00 tx=0x7fc520008040 comp rx=0 tx=0).stop 2023-11-24T06:33:18.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 msgr2=0x7fc52c151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 0x7fc52c151270 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0ad040 tx=0x7fc51c01ac70 comp rx=0 tx=0).stop 2023-11-24T06:33:18.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 shutdown_connections 2023-11-24T06:33:18.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fc518066aa0 0x7fc518068f60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc52c159a80 0x7fc52c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc52c0b2660 0x7fc52c1670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 --2- 172.21.15.143:0/3577196793 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52c06cee0 0x7fc52c151270 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 >> 172.21.15.143:0/3577196793 conn(0x7fc52c0b0bf0 msgr2=0x7fc52c0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:18.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 shutdown_connections 2023-11-24T06:33:18.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.544+0000 7fc531f2a640 1 -- 172.21.15.143:0/3577196793 wait complete. 2023-11-24T06:33:18.570 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:18.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.704+0000 7f786f279640 1 Processor -- start 2023-11-24T06:33:18.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786f279640 1 -- start start 2023-11-24T06:33:18.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786f279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d3e90 0x7f78680cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786f279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f78680d1880 0x7f78680d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786f279640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786815db80 con 0x7f786815d7a0 2023-11-24T06:33:18.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786f279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680d2250 con 0x7f78680d1880 2023-11-24T06:33:18.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786f279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680cf270 con 0x7f78680d3e90 2023-11-24T06:33:18.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d816640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f78680d1880 0x7f78680d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d015640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f786815d7a0 0x7f78680cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37442/0 (socket says 172.21.15.143:37442) 2023-11-24T06:33:18.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d015640 1 -- 172.21.15.143:0/753405977 learned_addr learned my addr 172.21.15.143:0/753405977 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:18.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786c814640 1 --2- 172.21.15.143:0/753405977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d3e90 0x7f78680cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d816640 1 -- 172.21.15.143:0/753405977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d3e90 msgr2=0x7f78680cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:18.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d816640 1 --2- 172.21.15.143:0/753405977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d3e90 0x7f78680cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d816640 1 -- 172.21.15.143:0/753405977 >> v1:172.21.15.143:6789/0 conn(0x7f786815d7a0 legacy=0x7f78680cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f786d816640 1 -- 172.21.15.143:0/753405977 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680d42f0 con 0x7f78680d1880 2023-11-24T06:33:18.713 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.708+0000 7f785ffff640 1 -- 172.21.15.143:0/753405977 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003849961 0 0) 0x7f786815db80 con 0x7f786815d7a0 2023-11-24T06:33:18.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786d816640 1 --2- 172.21.15.143:0/753405977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d1880 0x7f78680d1d10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7860009d90 tx=0x7f786001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798be658b951e5a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f785ffff640 1 -- 172.21.15.143:0/753405977 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600a5980 con 0x7f78680d1880 2023-11-24T06:33:18.714 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f785ffff640 1 -- 172.21.15.143:0/753405977 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600a5ae0 con 0x7f78680d1880 2023-11-24T06:33:18.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f785ffff640 1 -- 172.21.15.143:0/753405977 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600a5e70 con 0x7f78680d1880 2023-11-24T06:33:18.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 -- 172.21.15.143:0/753405977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d1880 msgr2=0x7f78680d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 --2- 172.21.15.143:0/753405977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d1880 0x7f78680d1d10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7860009d90 tx=0x7f786001c8c0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 -- 172.21.15.143:0/753405977 shutdown_connections 2023-11-24T06:33:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 --2- 172.21.15.143:0/753405977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d1880 0x7f78680d1d10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 --2- 172.21.15.143:0/753405977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d3e90 0x7f78680cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 -- 172.21.15.143:0/753405977 >> 172.21.15.143:0/753405977 conn(0x7f786809c780 msgr2=0x7f78680d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 -- 172.21.15.143:0/753405977 shutdown_connections 2023-11-24T06:33:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 -- 172.21.15.143:0/753405977 wait complete. 2023-11-24T06:33:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.712+0000 7f786f279640 1 Processor -- start 2023-11-24T06:33:18.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- start start 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d1880 0x7f7868153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 0x7f7868159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786815d7a0 0x7f78680c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681543c0 con 0x7f78680d3e90 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786815a4b0 con 0x7f786815d7a0 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7868155db0 con 0x7f78680d1880 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 0x7f7868159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 0x7f7868159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38724/0 (socket says 172.21.15.143:38724) 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 -- 172.21.15.143:0/4188821116 learned_addr learned my addr 172.21.15.143:0/4188821116 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:18.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786d015640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d1880 0x7f7868153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786d816640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786815d7a0 0x7f78680c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 -- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d1880 msgr2=0x7f7868153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d1880 0x7f7868153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 -- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786815d7a0 msgr2=0x7f78680c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786815d7a0 0x7f78680c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 -- 172.21.15.143:0/4188821116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009a70 con 0x7f78680d3e90 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786d015640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d1880 0x7f7868153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786c814640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 0x7f7868159f70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f785800e990 tx=0x7f785800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858009690 con 0x7f78680d3e90 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800c9e0 con 0x7f78680d3e90 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7868154a40 con 0x7f78680d3e90 2023-11-24T06:33:18.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800cd50 con 0x7f78680d3e90 2023-11-24T06:33:18.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7868155000 con 0x7f78680d3e90 2023-11-24T06:33:18.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.716+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7868067520 con 0x7f78680d3e90 2023-11-24T06:33:18.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.720+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f7858013470 con 0x7f78680d3e90 2023-11-24T06:33:18.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.720+0000 7f785dffb640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f784c066aa0 0x7f784c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:18.722 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.720+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7858084c50 con 0x7f78680d3e90 2023-11-24T06:33:18.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.720+0000 7f786d015640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f784c066aa0 0x7f784c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:18.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.720+0000 7f786d015640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f784c066aa0 0x7f784c068f60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7864000f70 tx=0x7f7864007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:18.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.724+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7858051730 con 0x7f78680d3e90 2023-11-24T06:33:18.878 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.876+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78680d1450 con 0x7f78680d3e90 2023-11-24T06:33:18.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.876+0000 7f785dffb640 1 -- 172.21.15.143:0/4188821116 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f7858017090 con 0x7f78680d3e90 2023-11-24T06:33:18.879 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":85,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:02.084666+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:32:58.815639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-24T06:32:59.459362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:18.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f784c066aa0 msgr2=0x7f784c068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f784c066aa0 0x7f784c068f60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7864000f70 tx=0x7f7864007cb0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 msgr2=0x7f7868159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 0x7f7868159f70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f785800e990 tx=0x7f785800ee50 comp rx=0 tx=0).stop 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 shutdown_connections 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f784c066aa0 0x7f784c068f60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786815d7a0 0x7f78680c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78680d3e90 0x7f7868159f70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 --2- 172.21.15.143:0/4188821116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78680d1880 0x7f7868153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 >> 172.21.15.143:0/4188821116 conn(0x7f786809c780 msgr2=0x7f786815db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:18.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 shutdown_connections 2023-11-24T06:33:18.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:18.880+0000 7f786f279640 1 -- 172.21.15.143:0/4188821116 wait complete. 2023-11-24T06:33:18.901 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:33:19.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 Processor -- start 2023-11-24T06:33:19.039 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 -- start start 2023-11-24T06:33:19.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f607415a4d0 0x7f60740c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60740cad20 0x7f607415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f607406d740 0x7f607406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.042 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607406e0d0 con 0x7f60740cad20 2023-11-24T06:33:19.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607415a8b0 con 0x7f607406d740 2023-11-24T06:33:19.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6079e9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740c9c30 con 0x7f607415a4d0 2023-11-24T06:33:19.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60740cad20 0x7f607415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60740cad20 0x7f607415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38730/0 (socket says 172.21.15.143:38730) 2023-11-24T06:33:19.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 -- 172.21.15.143:0/2186920106 learned_addr learned my addr 172.21.15.143:0/2186920106 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:19.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f60737fe640 1 --2- 172.21.15.143:0/2186920106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f607415a4d0 0x7f60740c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6073fff640 1 --2- 172.21.15.143:0/2186920106 >> v2:172.21.15.146:3300/0 conn(0x7f607406d740 0x7f607406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 -- 172.21.15.143:0/2186920106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f607415a4d0 msgr2=0x7f60740c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:19.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 --2- 172.21.15.143:0/2186920106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f607415a4d0 0x7f60740c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.044 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 -- 172.21.15.143:0/2186920106 >> v2:172.21.15.146:3300/0 conn(0x7f607406d740 msgr2=0x7f607406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:19.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 --2- 172.21.15.143:0/2186920106 >> v2:172.21.15.146:3300/0 conn(0x7f607406d740 0x7f607406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.036+0000 7f6072ffd640 1 -- 172.21.15.143:0/2186920106 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607415ee80 con 0x7f60740cad20 2023-11-24T06:33:19.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6072ffd640 1 --2- 172.21.15.143:0/2186920106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60740cad20 0x7f607415e940 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f60740729f0 tx=0x7f606801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8657f41d5759bcba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:19.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f60727fc640 1 -- 172.21.15.143:0/2186920106 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680ab600 con 0x7f60740cad20 2023-11-24T06:33:19.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f60727fc640 1 -- 172.21.15.143:0/2186920106 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60680ab760 con 0x7f60740cad20 2023-11-24T06:33:19.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f60727fc640 1 -- 172.21.15.143:0/2186920106 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680abaf0 con 0x7f60740cad20 2023-11-24T06:33:19.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 -- 172.21.15.143:0/2186920106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60740cad20 msgr2=0x7f607415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 --2- 172.21.15.143:0/2186920106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60740cad20 0x7f607415e940 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f60740729f0 tx=0x7f606801c440 comp rx=0 tx=0).stop 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 -- 172.21.15.143:0/2186920106 shutdown_connections 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 --2- 172.21.15.143:0/2186920106 >> v2:172.21.15.146:3300/0 conn(0x7f607406d740 0x7f607406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 --2- 172.21.15.143:0/2186920106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60740cad20 0x7f607415e940 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 --2- 172.21.15.143:0/2186920106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f607415a4d0 0x7f60740c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 -- 172.21.15.143:0/2186920106 >> 172.21.15.143:0/2186920106 conn(0x7f60740b0bf0 msgr2=0x7f60740b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:19.050 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 -- 172.21.15.143:0/2186920106 shutdown_connections 2023-11-24T06:33:19.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.040+0000 7f6079e9a640 1 -- 172.21.15.143:0/2186920106 wait complete. 2023-11-24T06:33:19.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 Processor -- start 2023-11-24T06:33:19.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 -- start start 2023-11-24T06:33:19.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 0x7f60740b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60740cad20 0x7f607415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.051 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607415a4d0 0x7f60740b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740ac9a0 con 0x7f607406d740 2023-11-24T06:33:19.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074156f00 con 0x7f607415a4d0 2023-11-24T06:33:19.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074155310 con 0x7f60740cad20 2023-11-24T06:33:19.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 0x7f60740b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 0x7f60740b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38742/0 (socket says 172.21.15.143:38742) 2023-11-24T06:33:19.052 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 -- 172.21.15.143:0/3812415448 learned_addr learned my addr 172.21.15.143:0/3812415448 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:19.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 -- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60740cad20 msgr2=0x7f607415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6072ffd640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60740cad20 0x7f607415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60740cad20 0x7f607415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 -- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607415a4d0 msgr2=0x7f60740b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.053 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607415a4d0 0x7f60740b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 -- 172.21.15.143:0/3812415448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680094d0 con 0x7f607406d740 2023-11-24T06:33:19.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6072ffd640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60740cad20 0x7f607415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:19.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f60737fe640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 0x7f60740b46a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f606400e870 tx=0x7f606400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:19.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064009510 con 0x7f607406d740 2023-11-24T06:33:19.054 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400eec0 con 0x7f607406d740 2023-11-24T06:33:19.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400cb40 con 0x7f607406d740 2023-11-24T06:33:19.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60741555f0 con 0x7f607406d740 2023-11-24T06:33:19.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.044+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607415af60 con 0x7f607406d740 2023-11-24T06:33:19.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.048+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607409d250 con 0x7f607406d740 2023-11-24T06:33:19.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.048+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f606400cca0 con 0x7f607406d740 2023-11-24T06:33:19.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.048+0000 7f605bfff640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6060066ad0 0x7f6060068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.048+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6064084a90 con 0x7f607406d740 2023-11-24T06:33:19.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.048+0000 7f6072ffd640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6060066ad0 0x7f6060068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.048+0000 7f6072ffd640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6060066ad0 0x7f6060068f90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60680af000 tx=0x7f6068008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:19.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.052+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6064051600 con 0x7f607406d740 2023-11-24T06:33:19.241 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.240+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f60740c2910 con 0x7f607406d740 2023-11-24T06:33:19.242 INFO:tasks.ceph.mon.a.smithi143.stderr:2023-11-24T06:33:19.240+0000 7f12a8d9d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:33:19.244 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.240+0000 7f605bfff640 1 -- 172.21.15.143:0/3812415448 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6064017090 con 0x7f607406d740 2023-11-24T06:33:19.244 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:33:19.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6060066ad0 msgr2=0x7f6060068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6060066ad0 0x7f6060068f90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60680af000 tx=0x7f6068008040 comp rx=0 tx=0).stop 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 msgr2=0x7f60740b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 0x7f60740b46a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f606400e870 tx=0x7f606400ec70 comp rx=0 tx=0).stop 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 shutdown_connections 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6060066ad0 0x7f6060068f90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607415a4d0 0x7f60740b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60740cad20 0x7f607415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 --2- 172.21.15.143:0/3812415448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607406d740 0x7f60740b46a0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.247 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 >> 172.21.15.143:0/3812415448 conn(0x7f60740b0bf0 msgr2=0x7f6074163820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:19.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 shutdown_connections 2023-11-24T06:33:19.248 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.244+0000 7f6079e9a640 1 -- 172.21.15.143:0/3812415448 wait complete. 2023-11-24T06:33:19.257 INFO:tasks.ceph.mds.a.smithi143.stderr: -5399> 2023-11-24T06:33:06.068+0000 7f7ec19e1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:33:19.270 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:33:19.307 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2023-11-24T06:33:19.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.408+0000 7f33bec06640 1 Processor -- start 2023-11-24T06:33:19.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.408+0000 7f33bec06640 1 -- start start 2023-11-24T06:33:19.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bec06640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33b815a290 0x7f33b80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bec06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bec06640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b8071170 con 0x7f33b80cc6b0 2023-11-24T06:33:19.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bec06640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80cb690 con 0x7f33b815a290 2023-11-24T06:33:19.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bec06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80cb970 con 0x7f33b815ec60 2023-11-24T06:33:19.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bd1a3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f33b80cc6b0 0x7f33b80b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37456/0 (socket says 172.21.15.143:37456) 2023-11-24T06:33:19.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bd1a3640 1 -- 172.21.15.143:0/261941359 learned_addr learned my addr 172.21.15.143:0/261941359 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:19.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bc9a2640 1 --2- 172.21.15.143:0/261941359 >> v2:172.21.15.146:3300/0 conn(0x7f33b815a290 0x7f33b80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33affff640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.416 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33af7fe640 1 -- 172.21.15.143:0/261941359 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957899277 0 0) 0x7f33b8071170 con 0x7f33b80cc6b0 2023-11-24T06:33:19.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33af7fe640 1 -- 172.21.15.143:0/261941359 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a0003530 con 0x7f33b80cc6b0 2023-11-24T06:33:19.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33af7fe640 1 -- 172.21.15.143:0/261941359 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 784298772 0 0) 0x7f33a0003530 con 0x7f33b80cc6b0 2023-11-24T06:33:19.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bc9a2640 1 -- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 msgr2=0x7f33b80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:19.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bc9a2640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.417 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bc9a2640 1 -- 172.21.15.143:0/261941359 >> v1:172.21.15.143:6789/0 conn(0x7f33b80cc6b0 legacy=0x7f33b80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33bc9a2640 1 -- 172.21.15.143:0/261941359 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80cbc50 con 0x7f33b815a290 2023-11-24T06:33:19.418 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.412+0000 7f33affff640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:19.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bc9a2640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b815a290 0x7f33b80707f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f33b40097c0 tx=0x7f33b401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d28d170513476c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:19.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33af7fe640 1 -- 172.21.15.143:0/261941359 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0001a00 con 0x7f33b815a290 2023-11-24T06:33:19.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33af7fe640 1 -- 172.21.15.143:0/261941359 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40a7050 con 0x7f33b815a290 2023-11-24T06:33:19.421 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33af7fe640 1 -- 172.21.15.143:0/261941359 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40ab620 con 0x7f33b815a290 2023-11-24T06:33:19.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 -- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b815a290 msgr2=0x7f33b80707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b815a290 0x7f33b80707f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f33b40097c0 tx=0x7f33b401c310 comp rx=0 tx=0).stop 2023-11-24T06:33:19.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 -- 172.21.15.143:0/261941359 shutdown_connections 2023-11-24T06:33:19.422 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 --2- 172.21.15.143:0/261941359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b815a290 0x7f33b80707f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 -- 172.21.15.143:0/261941359 >> 172.21.15.143:0/261941359 conn(0x7f33b80b0c80 msgr2=0x7f33b80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:19.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 -- 172.21.15.143:0/261941359 shutdown_connections 2023-11-24T06:33:19.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 -- 172.21.15.143:0/261941359 wait complete. 2023-11-24T06:33:19.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 Processor -- start 2023-11-24T06:33:19.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.416+0000 7f33bec06640 1 -- start start 2023-11-24T06:33:19.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b80cc6b0 0x7f33b8152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 0x7f33b80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80ac470 con 0x7f33b815a290 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8152d80 con 0x7f33b80cc6b0 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81550c0 con 0x7f33b815ec60 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 0x7f33b80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 0x7f33b80ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38782/0 (socket says 172.21.15.143:38782) 2023-11-24T06:33:19.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 -- 172.21.15.143:0/3014023611 learned_addr learned my addr 172.21.15.143:0/3014023611 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:19.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bc9a2640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b80cc6b0 0x7f33b8152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bd1a3640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 -- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 msgr2=0x7f33b80b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 -- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b80cc6b0 msgr2=0x7f33b8152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:19.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b80cc6b0 0x7f33b8152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:19.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 -- 172.21.15.143:0/3014023611 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8009420 con 0x7f33b815a290 2023-11-24T06:33:19.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bd1a3640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:19.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33affff640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 0x7f33b80ac890 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e9e0 tx=0x7f33a800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:19.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800c9d0 con 0x7f33b815a290 2023-11-24T06:33:19.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800cb30 con 0x7f33b815a290 2023-11-24T06:33:19.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800cee0 con 0x7f33b815a290 2023-11-24T06:33:19.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b4009420 con 0x7f33b815a290 2023-11-24T06:33:19.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b80ac090 con 0x7f33b815a290 2023-11-24T06:33:19.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.420+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b804e8c0 con 0x7f33b815a290 2023-11-24T06:33:19.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.424+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f33a8013470 con 0x7f33b815a290 2023-11-24T06:33:19.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.424+0000 7f33ad7fa640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f33a4066aa0 0x7f33a4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:19.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.424+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f33a80846e0 con 0x7f33b815a290 2023-11-24T06:33:19.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.424+0000 7f33bc9a2640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f33a4066aa0 0x7f33a4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:19.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.424+0000 7f33bc9a2640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f33a4066aa0 0x7f33a4068f60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ad000 tx=0x7f33b40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:19.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.428+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33a80513b0 con 0x7f33b815a290 2023-11-24T06:33:19.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:19.608+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33b80b18e0 con 0x7f33b815a290 2023-11-24T06:33:20.246 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.244+0000 7f33ad7fa640 1 -- 172.21.15.143:0/3014023611 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33a80549d0 con 0x7f33b815a290 2023-11-24T06:33:20.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f33a4066aa0 msgr2=0x7f33a4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:20.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f33a4066aa0 0x7f33a4068f60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ad000 tx=0x7f33b40a6000 comp rx=0 tx=0).stop 2023-11-24T06:33:20.249 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 msgr2=0x7f33b80ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:20.250 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 0x7f33b80ac890 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e9e0 tx=0x7f33a800eea0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 shutdown_connections 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f33a4066aa0 0x7f33a4068f60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33b815ec60 0x7f33b80b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33b815a290 0x7f33b80ac890 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 --2- 172.21.15.143:0/3014023611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b80cc6b0 0x7f33b8152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 >> 172.21.15.143:0/3014023611 conn(0x7f33b80b0c80 msgr2=0x7f33b80b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 shutdown_connections 2023-11-24T06:33:20.251 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.248+0000 7f33bec06640 1 -- 172.21.15.143:0/3014023611 wait complete. 2023-11-24T06:33:20.271 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:33:20.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 Processor -- start 2023-11-24T06:33:20.455 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 -- start start 2023-11-24T06:33:20.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f51e806c650 0x7f51e809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:20.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e80709c0 0x7f51e8070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e806d8b0 con 0x7f51e8144030 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e8145020 con 0x7f51e806c650 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ec86b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8071390 con 0x7f51e80709c0 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ddd9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f51e806c650 0x7f51e809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51e659c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f51e8144030 0x7f51e806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37472/0 (socket says 172.21.15.143:37472) 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51e659c640 1 -- 172.21.15.143:0/2455702303 learned_addr learned my addr 172.21.15.143:0/2455702303 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51e6d9d640 1 --2- 172.21.15.143:0/2455702303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e80709c0 0x7f51e8070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ddd9b640 1 -- 172.21.15.143:0/2455702303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e80709c0 msgr2=0x7f51e8070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ddd9b640 1 --2- 172.21.15.143:0/2455702303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e80709c0 0x7f51e8070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.457 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ddd9b640 1 -- 172.21.15.143:0/2455702303 >> v1:172.21.15.143:6789/0 conn(0x7f51e8144030 legacy=0x7f51e806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:20.458 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.452+0000 7f51ddd9b640 1 -- 172.21.15.143:0/2455702303 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e806cca0 con 0x7f51e806c650 2023-11-24T06:33:20.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ddd9b640 1 --2- 172.21.15.143:0/2455702303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e806c650 0x7f51e809cc20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f51d00097c0 tx=0x7f51d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cc21f36464920 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:20.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51e5d9b640 1 -- 172.21.15.143:0/2455702303 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00ab600 con 0x7f51e806c650 2023-11-24T06:33:20.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51e5d9b640 1 -- 172.21.15.143:0/2455702303 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d00a7050 con 0x7f51e806c650 2023-11-24T06:33:20.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51e5d9b640 1 -- 172.21.15.143:0/2455702303 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00ab980 con 0x7f51e806c650 2023-11-24T06:33:20.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 -- 172.21.15.143:0/2455702303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e806c650 msgr2=0x7f51e809cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:20.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 --2- 172.21.15.143:0/2455702303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e806c650 0x7f51e809cc20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f51d00097c0 tx=0x7f51d001c480 comp rx=0 tx=0).stop 2023-11-24T06:33:20.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 -- 172.21.15.143:0/2455702303 shutdown_connections 2023-11-24T06:33:20.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 --2- 172.21.15.143:0/2455702303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e80709c0 0x7f51e8070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 --2- 172.21.15.143:0/2455702303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e806c650 0x7f51e809cc20 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 -- 172.21.15.143:0/2455702303 >> 172.21.15.143:0/2455702303 conn(0x7f51e80b0bf0 msgr2=0x7f51e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:20.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 -- 172.21.15.143:0/2455702303 shutdown_connections 2023-11-24T06:33:20.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.456+0000 7f51ec86b640 1 -- 172.21.15.143:0/2455702303 wait complete. 2023-11-24T06:33:20.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 Processor -- start 2023-11-24T06:33:20.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 -- start start 2023-11-24T06:33:20.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e806c650 0x7f51e815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:20.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 0x7f51e8159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:20.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e8144030 0x7f51e80af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:20.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80ccfd0 con 0x7f51e80709c0 2023-11-24T06:33:20.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80cab80 con 0x7f51e8144030 2023-11-24T06:33:20.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80cae60 con 0x7f51e806c650 2023-11-24T06:33:20.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 0x7f51e8159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:20.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 0x7f51e8159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38786/0 (socket says 172.21.15.143:38786) 2023-11-24T06:33:20.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 -- 172.21.15.143:0/112425942 learned_addr learned my addr 172.21.15.143:0/112425942 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51e659c640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e806c650 0x7f51e815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 -- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e806c650 msgr2=0x7f51e815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51e6d9d640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e8144030 0x7f51e80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e806c650 0x7f51e815a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 -- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e8144030 msgr2=0x7f51e80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e8144030 0x7f51e80af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:20.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 -- 172.21.15.143:0/112425942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0009420 con 0x7f51e80709c0 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51e659c640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e806c650 0x7f51e815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51e6d9d640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e8144030 0x7f51e80af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ddd9b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 0x7f51e8159b70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f51d00ae040 tx=0x7f51d0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00b4840 con 0x7f51e80709c0 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d00b49c0 con 0x7f51e80709c0 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00b4d70 con 0x7f51e80709c0 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e80cc910 con 0x7f51e80709c0 2023-11-24T06:33:20.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.460+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e80cd3f0 con 0x7f51e80709c0 2023-11-24T06:33:20.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.464+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e80cd110 con 0x7f51e80709c0 2023-11-24T06:33:20.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.464+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f51d00b2040 con 0x7f51e80709c0 2023-11-24T06:33:20.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.464+0000 7f51df7fe640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51c8066aa0 0x7f51c8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:20.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.464+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f51d011eed0 con 0x7f51e80709c0 2023-11-24T06:33:20.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.464+0000 7f51e659c640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51c8066aa0 0x7f51c8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:20.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.464+0000 7f51e659c640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51c8066aa0 0x7f51c8068f60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f51d8005c10 tx=0x7f51d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:20.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.468+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51e80cd110 con 0x7f51e80709c0 2023-11-24T06:33:20.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:20.620+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51e80cd110 con 0x7f51e80709c0 2023-11-24T06:33:21.253 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.252+0000 7f51df7fe640 1 -- 172.21.15.143:0/112425942 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f51e80cd110 con 0x7f51e80709c0 2023-11-24T06:33:21.254 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51c8066aa0 msgr2=0x7f51c8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51c8066aa0 0x7f51c8068f60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f51d8005c10 tx=0x7f51d8009040 comp rx=0 tx=0).stop 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 msgr2=0x7f51e8159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 0x7f51e8159b70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f51d00ae040 tx=0x7f51d0019220 comp rx=0 tx=0).stop 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 shutdown_connections 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f51c8066aa0 0x7f51c8068f60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.258 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e8144030 0x7f51e80af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51e80709c0 0x7f51e8159b70 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 --2- 172.21.15.143:0/112425942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51e806c650 0x7f51e815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 >> 172.21.15.143:0/112425942 conn(0x7f51e80b0bf0 msgr2=0x7f51e809a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:21.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 shutdown_connections 2023-11-24T06:33:21.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.256+0000 7f51ec86b640 1 -- 172.21.15.143:0/112425942 wait complete. 2023-11-24T06:33:21.285 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:33:21.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ded3640 1 Processor -- start 2023-11-24T06:33:21.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ded3640 1 -- start start 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ded3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f16180d0b00 0x7f1618160b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ded3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180b3610 con 0x7f1618099c40 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ded3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161806f020 con 0x7f161809a020 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ded3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1618070540 con 0x7f16180d0b00 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ced1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1618099c40 0x7f1618160450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37480/0 (socket says 172.21.15.143:37480) 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161ced1640 1 -- 172.21.15.143:0/1199763767 learned_addr learned my addr 172.21.15.143:0/1199763767 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161d6d2640 1 --2- 172.21.15.143:0/1199763767 >> v2:172.21.15.143:3300/0 conn(0x7f16180d0b00 0x7f1618160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f160f7fe640 1 -- 172.21.15.143:0/1199763767 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065979271 0 0) 0x7f16180b3610 con 0x7f1618099c40 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f160f7fe640 1 -- 172.21.15.143:0/1199763767 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1600003530 con 0x7f1618099c40 2023-11-24T06:33:21.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161d6d2640 1 -- 172.21.15.143:0/1199763767 >> v1:172.21.15.146:6789/0 conn(0x7f161809a020 legacy=0x7f161806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161d6d2640 1 -- 172.21.15.143:0/1199763767 >> v1:172.21.15.143:6789/0 conn(0x7f1618099c40 legacy=0x7f1618160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.428+0000 7f161d6d2640 1 -- 172.21.15.143:0/1199763767 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161806b760 con 0x7f16180d0b00 2023-11-24T06:33:21.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161d6d2640 1 --2- 172.21.15.143:0/1199763767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16180d0b00 0x7f1618160b60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7269eb4f46097116 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:21.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f160f7fe640 1 -- 172.21.15.143:0/1199763767 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100ab670 con 0x7f16180d0b00 2023-11-24T06:33:21.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f160f7fe640 1 -- 172.21.15.143:0/1199763767 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100ab7d0 con 0x7f16180d0b00 2023-11-24T06:33:21.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f160f7fe640 1 -- 172.21.15.143:0/1199763767 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100abb60 con 0x7f16180d0b00 2023-11-24T06:33:21.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 -- 172.21.15.143:0/1199763767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16180d0b00 msgr2=0x7f1618160b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 --2- 172.21.15.143:0/1199763767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16180d0b00 0x7f1618160b60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001c450 comp rx=0 tx=0).stop 2023-11-24T06:33:21.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 -- 172.21.15.143:0/1199763767 shutdown_connections 2023-11-24T06:33:21.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 --2- 172.21.15.143:0/1199763767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16180d0b00 0x7f1618160b60 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 -- 172.21.15.143:0/1199763767 >> 172.21.15.143:0/1199763767 conn(0x7f16180b2af0 msgr2=0x7f16180b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:21.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 -- 172.21.15.143:0/1199763767 shutdown_connections 2023-11-24T06:33:21.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.432+0000 7f161ded3640 1 -- 172.21.15.143:0/1199763767 wait complete. 2023-11-24T06:33:21.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 Processor -- start 2023-11-24T06:33:21.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- start start 2023-11-24T06:33:21.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 0x7f161809cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:21.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f161809a020 0x7f161809dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:21.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16180d0b00 0x7f161809b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:21.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161809e520 con 0x7f1618099c40 2023-11-24T06:33:21.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16181554a0 con 0x7f16180d0b00 2023-11-24T06:33:21.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161809e250 con 0x7f161809a020 2023-11-24T06:33:21.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 0x7f161809cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:21.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 0x7f161809cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38810/0 (socket says 172.21.15.143:38810) 2023-11-24T06:33:21.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 -- 172.21.15.143:0/4078270274 learned_addr learned my addr 172.21.15.143:0/4078270274 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:21.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161d6d2640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16180d0b00 0x7f161809b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:21.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f160ffff640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f161809a020 0x7f161809dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:21.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 -- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f161809a020 msgr2=0x7f161809dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f161809a020 0x7f161809dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 -- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16180d0b00 msgr2=0x7f161809b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16180d0b00 0x7f161809b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 -- 172.21.15.143:0/4078270274 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610009420 con 0x7f1618099c40 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f160ffff640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f161809a020 0x7f161809dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161d6d2640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16180d0b00 0x7f161809b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:21.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ced1640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 0x7f161809cd20 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f161400cbc0 tx=0x7f161400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:21.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400ad40 con 0x7f1618099c40 2023-11-24T06:33:21.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614012400 con 0x7f1618099c40 2023-11-24T06:33:21.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400aea0 con 0x7f1618099c40 2023-11-24T06:33:21.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16181593b0 con 0x7f1618099c40 2023-11-24T06:33:21.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618159970 con 0x7f1618099c40 2023-11-24T06:33:21.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.436+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1618067ce0 con 0x7f1618099c40 2023-11-24T06:33:21.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.440+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f1614007070 con 0x7f1618099c40 2023-11-24T06:33:21.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.440+0000 7f160d7fa640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1604066ad0 0x7f1604068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:21.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.440+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5385+0+0 (secure 0 0 0) 0x7f1614084950 con 0x7f1618099c40 2023-11-24T06:33:21.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.440+0000 7f160ffff640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1604066ad0 0x7f1604068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:21.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.440+0000 7f160ffff640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1604066ad0 0x7f1604068f90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1618155770 tx=0x7f1608009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:21.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.444+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1614051540 con 0x7f1618099c40 2023-11-24T06:33:21.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:21.596+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f161804e850 con 0x7f1618099c40 2023-11-24T06:33:22.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.256+0000 7f160d7fa640 1 -- 172.21.15.143:0/4078270274 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1614017070 con 0x7f1618099c40 2023-11-24T06:33:22.261 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.260+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1604066ad0 msgr2=0x7f1604068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.260+0000 7f161ded3640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1604066ad0 0x7f1604068f90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1618155770 tx=0x7f1608009040 comp rx=0 tx=0).stop 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.260+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 msgr2=0x7f161809cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.260+0000 7f161ded3640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 0x7f161809cd20 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f161400cbc0 tx=0x7f161400a430 comp rx=0 tx=0).stop 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 shutdown_connections 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f1604066ad0 0x7f1604068f90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.267 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16180d0b00 0x7f161809b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f161809a020 0x7f161809dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 --2- 172.21.15.143:0/4078270274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1618099c40 0x7f161809cd20 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 >> 172.21.15.143:0/4078270274 conn(0x7f16180b2af0 msgr2=0x7f16180b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:22.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 shutdown_connections 2023-11-24T06:33:22.268 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.264+0000 7f161ded3640 1 -- 172.21.15.143:0/4078270274 wait complete. 2023-11-24T06:33:22.298 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:33:22.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 Processor -- start 2023-11-24T06:33:22.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 -- start start 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ad80ce420 0x7f8ad815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80cd850 0x7f8ad806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80b3510 con 0x7f8ad80ae4a0 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80b37f0 con 0x7f8ad80ce420 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8adcb1d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80b3ad0 con 0x7f8ad80cd850 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.435+0000 7f8ad659c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8ad80ae4a0 0x7f8ad80cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37494/0 (socket says 172.21.15.143:37494) 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad659c640 1 -- 172.21.15.143:0/2068134790 learned_addr learned my addr 172.21.15.143:0/2068134790 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8acdd9b640 1 --2- 172.21.15.143:0/2068134790 >> v2:172.21.15.143:3300/0 conn(0x7f8ad80ce420 0x7f8ad815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad6d9d640 1 --2- 172.21.15.143:0/2068134790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80cd850 0x7f8ad806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad5d9b640 1 -- 172.21.15.143:0/2068134790 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186709384 0 0) 0x7f8ad80b3510 con 0x7f8ad80ae4a0 2023-11-24T06:33:22.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad5d9b640 1 -- 172.21.15.143:0/2068134790 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac4003530 con 0x7f8ad80ae4a0 2023-11-24T06:33:22.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8acdd9b640 1 -- 172.21.15.143:0/2068134790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80cd850 msgr2=0x7f8ad806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:22.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8acdd9b640 1 --2- 172.21.15.143:0/2068134790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80cd850 0x7f8ad806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8acdd9b640 1 -- 172.21.15.143:0/2068134790 >> v1:172.21.15.143:6789/0 conn(0x7f8ad80ae4a0 legacy=0x7f8ad80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8acdd9b640 1 -- 172.21.15.143:0/2068134790 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80b3db0 con 0x7f8ad80ce420 2023-11-24T06:33:22.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8acdd9b640 1 --2- 172.21.15.143:0/2068134790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815ba00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009d90 tx=0x7f8ac001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8704c1127667079 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:22.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad5d9b640 1 -- 172.21.15.143:0/2068134790 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00a5a00 con 0x7f8ad80ce420 2023-11-24T06:33:22.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad5d9b640 1 -- 172.21.15.143:0/2068134790 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac00a5b60 con 0x7f8ad80ce420 2023-11-24T06:33:22.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.439+0000 7f8ad5d9b640 1 -- 172.21.15.143:0/2068134790 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00ad440 con 0x7f8ad80ce420 2023-11-24T06:33:22.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- 172.21.15.143:0/2068134790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 msgr2=0x7f8ad815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/2068134790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815ba00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009d90 tx=0x7f8ac001c920 comp rx=0 tx=0).stop 2023-11-24T06:33:22.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- 172.21.15.143:0/2068134790 shutdown_connections 2023-11-24T06:33:22.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/2068134790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80cd850 0x7f8ad806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/2068134790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815ba00 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- 172.21.15.143:0/2068134790 >> 172.21.15.143:0/2068134790 conn(0x7f8ad80b0c80 msgr2=0x7f8ad80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:22.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- 172.21.15.143:0/2068134790 shutdown_connections 2023-11-24T06:33:22.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- 172.21.15.143:0/2068134790 wait complete. 2023-11-24T06:33:22.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 Processor -- start 2023-11-24T06:33:22.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- start start 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80ae4a0 0x7f8ad80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80cd850 0x7f8ad81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad815b190 con 0x7f8ad80ce420 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8152e10 con 0x7f8ad80cd850 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8adcb1d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad809a870 con 0x7f8ad80ae4a0 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8ad6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8ad6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38826/0 (socket says 172.21.15.143:38826) 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8ad6d9d640 1 -- 172.21.15.143:0/110531269 learned_addr learned my addr 172.21.15.143:0/110531269 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8ad659c640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80ae4a0 0x7f8ad80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8acdd9b640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80cd850 0x7f8ad81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8ad6d9d640 1 -- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80ae4a0 msgr2=0x7f8ad80705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.443+0000 7f8ad6d9d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80ae4a0 0x7f8ad80705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8ad6d9d640 1 -- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80cd850 msgr2=0x7f8ad81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8ad6d9d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80cd850 0x7f8ad81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8ad6d9d640 1 -- 172.21.15.143:0/110531269 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009a70 con 0x7f8ad80ce420 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8acdd9b640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80cd850 0x7f8ad81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8ad6d9d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815a4c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000e880 tx=0x7f8ad000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0009650 con 0x7f8ad80ce420 2023-11-24T06:33:22.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000c940 con 0x7f8ad80ce420 2023-11-24T06:33:22.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000ccd0 con 0x7f8ad80ce420 2023-11-24T06:33:22.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad809ab50 con 0x7f8ad80ce420 2023-11-24T06:33:22.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad815ae20 con 0x7f8ad80ce420 2023-11-24T06:33:22.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad804e8c0 con 0x7f8ad80ce420 2023-11-24T06:33:22.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f8ad0013470 con 0x7f8ad80ce420 2023-11-24T06:33:22.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.447+0000 7f8acf7fe640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ab8066aa0 0x7f8ab8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.451+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f8ad00848a0 con 0x7f8ad80ce420 2023-11-24T06:33:22.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.451+0000 7f8ad659c640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ab8066aa0 0x7f8ab8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.451+0000 7f8ad659c640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ab8066aa0 0x7f8ab8068f60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80011f0 tx=0x7f8ac8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:22.456 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.451+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ad0051750 con 0x7f8ad80ce420 2023-11-24T06:33:22.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.603+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8ad815b2d0 con 0x7f8ad80ce420 2023-11-24T06:33:22.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8acf7fe640 1 -- 172.21.15.143:0/110531269 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ad0054d70 con 0x7f8ad80ce420 2023-11-24T06:33:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ab8066aa0 msgr2=0x7f8ab8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ab8066aa0 0x7f8ab8068f60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80011f0 tx=0x7f8ac8009040 comp rx=0 tx=0).stop 2023-11-24T06:33:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 msgr2=0x7f8ad815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815a4c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000e880 tx=0x7f8ad000ed40 comp rx=0 tx=0).stop 2023-11-24T06:33:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 shutdown_connections 2023-11-24T06:33:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8ab8066aa0 0x7f8ab8068f60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad80ce420 0x7f8ad815a4c0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80cd850 0x7f8ad81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 --2- 172.21.15.143:0/110531269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad80ae4a0 0x7f8ad80705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 >> 172.21.15.143:0/110531269 conn(0x7f8ad80b0c80 msgr2=0x7f8ad815def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 shutdown_connections 2023-11-24T06:33:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.607+0000 7f8adcb1d640 1 -- 172.21.15.143:0/110531269 wait complete. 2023-11-24T06:33:22.632 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_ls' 2023-11-24T06:33:22.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf9851c640 1 Processor -- start 2023-11-24T06:33:22.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf9851c640 1 -- start start 2023-11-24T06:33:22.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf9851c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbf900b3670 0x7fbf9006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf9851c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf900ae950 con 0x7fbf90159a80 2023-11-24T06:33:22.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf9851c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf900b1ef0 con 0x7fbf9006d5f0 2023-11-24T06:33:22.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf9851c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf900adca0 con 0x7fbf900b3670 2023-11-24T06:33:22.773 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf962b8640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fbf90159a80 0x7fbf9006cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37500/0 (socket says 172.21.15.143:37500) 2023-11-24T06:33:22.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf962b8640 1 -- 172.21.15.143:0/314220536 learned_addr learned my addr 172.21.15.143:0/314220536 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:22.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf96ab9640 1 --2- 172.21.15.143:0/314220536 >> v2:172.21.15.143:3300/0 conn(0x7fbf900b3670 0x7fbf9006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf952b6640 1 -- 172.21.15.143:0/314220536 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880936542 0 0) 0x7fbf900ae950 con 0x7fbf90159a80 2023-11-24T06:33:22.774 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf952b6640 1 -- 172.21.15.143:0/314220536 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c003530 con 0x7fbf90159a80 2023-11-24T06:33:22.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf96ab9640 1 -- 172.21.15.143:0/314220536 >> v1:172.21.15.146:6789/0 conn(0x7fbf9006d5f0 legacy=0x7fbf900ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:22.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf96ab9640 1 -- 172.21.15.143:0/314220536 >> v1:172.21.15.143:6789/0 conn(0x7fbf90159a80 legacy=0x7fbf9006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.775 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.767+0000 7fbf96ab9640 1 -- 172.21.15.143:0/314220536 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900adf80 con 0x7fbf900b3670 2023-11-24T06:33:22.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf96ab9640 1 --2- 172.21.15.143:0/314220536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf900b3670 0x7fbf9006de50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009d90 tx=0x7fbf8801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab07089e0997fb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:22.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf952b6640 1 -- 172.21.15.143:0/314220536 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880a5910 con 0x7fbf900b3670 2023-11-24T06:33:22.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf952b6640 1 -- 172.21.15.143:0/314220536 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf880a5a70 con 0x7fbf900b3670 2023-11-24T06:33:22.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf952b6640 1 -- 172.21.15.143:0/314220536 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880a5e00 con 0x7fbf900b3670 2023-11-24T06:33:22.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 -- 172.21.15.143:0/314220536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf900b3670 msgr2=0x7fbf9006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.778 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 --2- 172.21.15.143:0/314220536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf900b3670 0x7fbf9006de50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009d90 tx=0x7fbf8801c850 comp rx=0 tx=0).stop 2023-11-24T06:33:22.779 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 -- 172.21.15.143:0/314220536 shutdown_connections 2023-11-24T06:33:22.779 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 --2- 172.21.15.143:0/314220536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf900b3670 0x7fbf9006de50 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.779 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 -- 172.21.15.143:0/314220536 >> 172.21.15.143:0/314220536 conn(0x7fbf900b0bf0 msgr2=0x7fbf900b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:22.779 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 -- 172.21.15.143:0/314220536 shutdown_connections 2023-11-24T06:33:22.780 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.771+0000 7fbf9851c640 1 -- 172.21.15.143:0/314220536 wait complete. 2023-11-24T06:33:22.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 Processor -- start 2023-11-24T06:33:22.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 -- start start 2023-11-24T06:33:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 0x7fbf900999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf900b3670 0x7fbf9009b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf90159a80 0x7fbf90164070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9009ae20 con 0x7fbf9006d5f0 2023-11-24T06:33:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9009a210 con 0x7fbf900b3670 2023-11-24T06:33:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9009a4f0 con 0x7fbf90159a80 2023-11-24T06:33:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 0x7fbf900999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 0x7fbf900999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38840/0 (socket says 172.21.15.143:38840) 2023-11-24T06:33:22.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 -- 172.21.15.143:0/1693339861 learned_addr learned my addr 172.21.15.143:0/1693339861 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:22.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 -- 172.21.15.143:0/1693339861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf90159a80 msgr2=0x7fbf90164070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.790 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf90159a80 0x7fbf90164070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 -- 172.21.15.143:0/1693339861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf900b3670 msgr2=0x7fbf9009b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:22.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf900b3670 0x7fbf9009b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:22.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 -- 172.21.15.143:0/1693339861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88009a70 con 0x7fbf9006d5f0 2023-11-24T06:33:22.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf962b8640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 0x7fbf900999e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c420 tx=0x7fbf8c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:22.791 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c005cf0 con 0x7fbf9006d5f0 2023-11-24T06:33:22.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c005e50 con 0x7fbf9006d5f0 2023-11-24T06:33:22.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0072d0 con 0x7fbf9006d5f0 2023-11-24T06:33:22.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9009a7d0 con 0x7fbf9006d5f0 2023-11-24T06:33:22.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.775+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf90099f20 con 0x7fbf9006d5f0 2023-11-24T06:33:22.792 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.779+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf90067520 con 0x7fbf9006d5f0 2023-11-24T06:33:22.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.779+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fbf8c007430 con 0x7fbf9006d5f0 2023-11-24T06:33:22.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.779+0000 7fbf86ffd640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbf74066aa0 0x7fbf74068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:22.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.779+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fbf8c083c20 con 0x7fbf9006d5f0 2023-11-24T06:33:22.793 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.779+0000 7fbf95ab7640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbf74066aa0 0x7fbf74068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:22.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.779+0000 7fbf95ab7640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbf74066aa0 0x7fbf74068f60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbf900cded0 tx=0x7fbf800079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:22.794 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.783+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf8c050af0 con 0x7fbf9006d5f0 2023-11-24T06:33:22.989 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:22.987+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_ls"]} v 0) v1 -- 0x7fbf900b3450 con 0x7fbf9006d5f0 2023-11-24T06:33:23.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf86ffd640 1 -- 172.21.15.143:0/1693339861 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_subvolume_inherited_snapshot_ls"]}]=0 v239) v1 ==== 164+0+0 (secure 0 0 0) 0x7fbf8c017020 con 0x7fbf9006d5f0 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbf74066aa0 msgr2=0x7fbf74068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbf74066aa0 0x7fbf74068f60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbf900cded0 tx=0x7fbf800079c0 comp rx=0 tx=0).stop 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 msgr2=0x7fbf900999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 0x7fbf900999e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c420 tx=0x7fbf8c00c8e0 comp rx=0 tx=0).stop 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 shutdown_connections 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbf74066aa0 0x7fbf74068f60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf90159a80 0x7fbf90164070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf900b3670 0x7fbf9009b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 --2- 172.21.15.143:0/1693339861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9006d5f0 0x7fbf900999e0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:23.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 >> 172.21.15.143:0/1693339861 conn(0x7fbf900b0bf0 msgr2=0x7fbf90158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:23.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 shutdown_connections 2023-11-24T06:33:23.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:23.259+0000 7fbf9851c640 1 -- 172.21.15.143:0/1693339861 wait complete. 2023-11-24T06:33:23.285 INFO:tasks.cephfs_test_runner:test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) ... ERROR 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner: 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner:ERROR: test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 4537, in test_subvolume_inherited_snapshot_ls 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner: snapshots = self._generate_random_snapshot_name(snap_count) 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner:AttributeError: 'TestSubvolumeSnapshots' object has no attribute '_generate_random_snapshot_name' 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner: 2023-11-24T06:33:23.286 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:Ran 10 tests in 195.415s 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner: 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:FAILED (errors=1, skipped=5) 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner: 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:ERROR: test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 4537, in test_subvolume_inherited_snapshot_ls 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner: snapshots = self._generate_random_snapshot_name(snap_count) 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner:AttributeError: 'TestSubvolumeSnapshots' object has no attribute '_generate_random_snapshot_name' 2023-11-24T06:33:23.287 INFO:tasks.cephfs_test_runner: 2023-11-24T06:33:23.288 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:33:23.355 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=04d178ee2afc47128db1d96d81ff10d2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-11-24T06:33:23.357 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T06:33:23.371 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-24T06:33:23.395 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T06:33:23.395 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:33:23.395 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:23.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:33:23.415 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-11-24T06:33:23.415 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:23.466 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:33:23.466 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:33:23.467 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:23.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:33:23.477 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-11-24T06:33:23.477 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:33:23.530 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7293 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:33:23.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.530 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:33:23.539 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:33:23.539 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:33:23.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:33:23.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.603 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:33:23.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.682 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-11-24T06:33:23.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.848 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-11-24T06:33:23.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.857 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-11-24T06:33:23.924 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2023-11-24T06:33:23.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:33:23.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.926 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:33:23.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:33:23.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:33:23.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:23.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:33:24.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:24.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:33:24.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:24.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-11-24T06:33:24.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:24.316 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-11-24T06:33:24.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:33:24.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-11-24T06:33:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-11-24T06:33:24.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:33:24.395 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T06:33:24.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:33:24.411 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:24.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 Processor -- start 2023-11-24T06:33:24.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 -- start start 2023-11-24T06:33:24.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 0x7fa78c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa78c0709c0 0x7fa78c070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c06d8b0 con 0x7fa78c09cc20 2023-11-24T06:33:24.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c145020 con 0x7fa78c0709c0 2023-11-24T06:33:24.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa790868640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c09d0a0 con 0x7fa78c144030 2023-11-24T06:33:24.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa789d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa78c09cc20 0x7fa78c06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37516/0 (socket says 172.21.15.143:37516) 2023-11-24T06:33:24.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa789d9b640 1 -- 172.21.15.143:0/3331568614 learned_addr learned my addr 172.21.15.143:0/3331568614 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:24.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78ad9d640 1 --2- 172.21.15.143:0/3331568614 >> v2:172.21.15.146:3300/0 conn(0x7fa78c0709c0 0x7fa78c070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 0x7fa78c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157091108 0 0) 0x7fa78c06d8b0 con 0x7fa78c09cc20 2023-11-24T06:33:24.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa774003530 con 0x7fa78c09cc20 2023-11-24T06:33:24.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482089889 0 0) 0x7fa774003530 con 0x7fa78c09cc20 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 msgr2=0x7fa78c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 0x7fa78c06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 >> v2:172.21.15.146:3300/0 conn(0x7fa78c0709c0 msgr2=0x7fa78c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 --2- 172.21.15.143:0/3331568614 >> v2:172.21.15.146:3300/0 conn(0x7fa78c0709c0 0x7fa78c070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c071390 con 0x7fa78c09cc20 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fa780001680 con 0x7fa78c09cc20 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 >> v1:172.21.15.143:6789/0 conn(0x7fa78c09cc20 legacy=0x7fa78c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa774003980 0x7fa774003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 0x7fa774005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c09d0a0 con 0x7fa774003980 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77400b990 con 0x7fa7740047d0 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77400bad0 con 0x7fa78c144030 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa774003980 0x7fa774003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa789d9b640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.555 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78ad9d640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 0x7fa774005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 -- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 msgr2=0x7fa774005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:24.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c144030 0x7fa774005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 -- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7740047d0 msgr2=0x7fa774004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:24.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.547+0000 7fa78a59c640 1 -- 172.21.15.143:0/3331568614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa774003530 con 0x7fa774003980 2023-11-24T06:33:24.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa78a59c640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa774003980 0x7fa774003da0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009ae0 tx=0x7fa77c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5da9c86ef4e2258 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:24.557 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0a6430 con 0x7fa774003980 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c0a6590 con 0x7fa774003980 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa78959a640 1 -- 172.21.15.143:0/3331568614 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0a6940 con 0x7fa774003980 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa790868640 1 -- 172.21.15.143:0/3331568614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa774003980 msgr2=0x7fa774003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa790868640 1 --2- 172.21.15.143:0/3331568614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa774003980 0x7fa774003da0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009ae0 tx=0x7fa77c01ca20 comp rx=0 tx=0).stop 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa78ad9d640 1 -- 172.21.15.143:0/3331568614 reap_dead start 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa790868640 1 -- 172.21.15.143:0/3331568614 shutdown_connections 2023-11-24T06:33:24.558 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa790868640 1 -- 172.21.15.143:0/3331568614 >> 172.21.15.143:0/3331568614 conn(0x7fa78c0b0bf0 msgr2=0x7fa78c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:24.559 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa790868640 1 -- 172.21.15.143:0/3331568614 shutdown_connections 2023-11-24T06:33:24.559 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.551+0000 7fa790868640 1 -- 172.21.15.143:0/3331568614 wait complete. 2023-11-24T06:33:24.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 Processor -- start 2023-11-24T06:33:24.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 -- start start 2023-11-24T06:33:24.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa774003980 0x7fa78c142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c13dfb0 0x7fa78c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 0x7fa78c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.561 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0ccb90 con 0x7fa78c15f3f0 2023-11-24T06:33:24.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0cc260 con 0x7fa78c13dfb0 2023-11-24T06:33:24.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0cc540 con 0x7fa774003980 2023-11-24T06:33:24.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 0x7fa78c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 0x7fa78c0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38858/0 (socket says 172.21.15.143:38858) 2023-11-24T06:33:24.562 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 -- 172.21.15.143:0/2729727100 learned_addr learned my addr 172.21.15.143:0/2729727100 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 -- 172.21.15.143:0/2729727100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa774003980 msgr2=0x7fa78c142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa774003980 0x7fa78c142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 -- 172.21.15.143:0/2729727100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c13dfb0 msgr2=0x7fa78c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c13dfb0 0x7fa78c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 -- 172.21.15.143:0/2729727100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0cc820 con 0x7fa78c15f3f0 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa78ad9d640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 0x7fa78c0cd660 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa78c070740 tx=0x7fa78400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400e040 con 0x7fa78c15f3f0 2023-11-24T06:33:24.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78400f040 con 0x7fa78c15f3f0 2023-11-24T06:33:24.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c142cc0 con 0x7fa78c15f3f0 2023-11-24T06:33:24.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784015670 con 0x7fa78c15f3f0 2023-11-24T06:33:24.564 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.555+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c1f4df0 con 0x7fa78c15f3f0 2023-11-24T06:33:24.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.559+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c0cc9b0 con 0x7fa78c15f3f0 2023-11-24T06:33:24.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.559+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fa7840157d0 con 0x7fa78c15f3f0 2023-11-24T06:33:24.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.559+0000 7fa77affd640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa76c066aa0 0x7fa76c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.559+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fa784084ff0 con 0x7fa78c15f3f0 2023-11-24T06:33:24.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.559+0000 7fa78a59c640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa76c066aa0 0x7fa76c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.559+0000 7fa78a59c640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa76c066aa0 0x7fa76c068f60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0ad000 tx=0x7fa77c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:24.567 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.563+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa784051cc0 con 0x7fa78c15f3f0 2023-11-24T06:33:24.715 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.711+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa78c0cc3d0 con 0x7fa76c066aa0 2023-11-24T06:33:24.717 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa77affd640 1 -- 172.21.15.143:0/2729727100 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50173 (secure 0 0 0) 0x7fa78c0cc3d0 con 0x7fa76c066aa0 2023-11-24T06:33:24.718 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:24.719 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:24.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa76c066aa0 msgr2=0x7fa76c068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa76c066aa0 0x7fa76c068f60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0ad000 tx=0x7fa77c004740 comp rx=0 tx=0).stop 2023-11-24T06:33:24.719 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 msgr2=0x7fa78c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 0x7fa78c0cd660 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa78c070740 tx=0x7fa78400f580 comp rx=0 tx=0).stop 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 shutdown_connections 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fa76c066aa0 0x7fa76c068f60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa78c15f3f0 0x7fa78c0cd660 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c13dfb0 0x7fa78c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 --2- 172.21.15.143:0/2729727100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa774003980 0x7fa78c142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 >> 172.21.15.143:0/2729727100 conn(0x7fa78c0b0bf0 msgr2=0x7fa78c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:24.720 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 shutdown_connections 2023-11-24T06:33:24.721 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.715+0000 7fa790868640 1 -- 172.21.15.143:0/2729727100 wait complete. 2023-11-24T06:33:24.738 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-24T06:33:24.248057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":259048,"kb_used_data":9600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715672,"statfs":{"total":773094113280,"available":772828848128,"internally_reserved":0,"allocated":9830400,"data_stored":4878835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23410,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000998"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-24T06:33:19.568849+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:33:19.568849+0000","last_peered":"2023-11-24T06:33:19.568849+0000","last_clean":"2023-11-24T06:33:19.568849+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:19.568849+0000","last_undegraded":"2023-11-24T06:33:19.568849+0000","last_fullsized":"2023-11-24T06:33:19.568849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1049367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.619,"15min":1.619},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99099999999999999,"5min":1.417,"15min":1.417},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.97699999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":1.7,"15min":1.7},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78400000000000003,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.92600000000000005,"5min":1.55,"15min":1.55},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92600000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":453662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":2.637,"15min":2.637},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96799999999999997,"5min":1.619,"15min":1.619},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85799999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.505},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99399999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.86899999999999999},"min":{"1min":0.504,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.72499999999999998,"15min":0.77500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":1.036,"15min":1.036},"last":0.65400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":480394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.278,"15min":1.278},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.294,"5min":1.919,"15min":1.919},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.3500000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.427,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5189999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4059999999999999,"5min":1.998,"15min":1.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.274,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.462,"15min":1.462},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":453103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.876},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.022},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.876,"5min":1.202,"15min":1.202},"last":0.91800000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94199999999999995,"5min":1.248,"15min":1.248},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.079,"15min":1.079},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.002,"5min":1.149,"15min":1.149},"last":1.056}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.629,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.625,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55500000000000005,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":1.095,"15min":1.095},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93300000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.264,"15min":1.264},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.286,"15min":1.286},"last":1.081}]},{"osd":7,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88100000000000001,"5min":1.409,"15min":1.409},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.78100000000000003,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94699999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.85299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.43099999999999999,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51300000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63900000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49199999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59399999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88900000000000001,"5min":1.075,"15min":1.075},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83699999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.27,"15min":1.27},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":1.389,"15min":1.389},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83499999999999996,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.874,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.93000000000000005,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.044,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.877,"5min":1.02,"15min":1.02},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81000000000000005,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":1.048,"15min":1.048},"last":0.625}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0940000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1048533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":1.393,"15min":1.393},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66100000000000003,"5min":1.319,"15min":1.319},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0049999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.499}]},{"osd":3,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71199999999999997,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.373},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.589,"15min":1.589},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.81200000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.778,"15min":1.778},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4099999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0089999999999999,"5min":1.496,"15min":1.496},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3740000000000001,"5min":1.454,"15min":1.454},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81100000000000005,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.829,"15min":1.829},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:24.742 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:24.879 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.875+0000 7f5c60416640 1 Processor -- start 2023-11-24T06:33:24.880 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.875+0000 7f5c60416640 1 -- start start 2023-11-24T06:33:24.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c60416640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c580b36c0 0x7f5c580b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c60416640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5815a700 con 0x7f5c58070da0 2023-11-24T06:33:24.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c60416640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c580b2620 con 0x7f5c5815a320 2023-11-24T06:33:24.881 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c60416640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c580b2430 con 0x7f5c580b36c0 2023-11-24T06:33:24.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5e9b3640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5c58070da0 0x7f5c5815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37532/0 (socket says 172.21.15.143:37532) 2023-11-24T06:33:24.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5e9b3640 1 -- 172.21.15.143:0/3186067871 learned_addr learned my addr 172.21.15.143:0/3186067871 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:24.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d9b1640 1 --2- 172.21.15.143:0/3186067871 >> v2:172.21.15.146:3300/0 conn(0x7f5c580b36c0 0x7f5c580b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755111642 0 0) 0x7f5c5815a700 con 0x7f5c58070da0 2023-11-24T06:33:24.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c44005740 con 0x7f5c58070da0 2023-11-24T06:33:24.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850493595 0 0) 0x7f5c580b2620 con 0x7f5c5815a320 2023-11-24T06:33:24.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c5815a700 con 0x7f5c5815a320 2023-11-24T06:33:24.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d9b1640 1 -- 172.21.15.143:0/3186067871 >> v1:172.21.15.146:6789/0 conn(0x7f5c5815a320 legacy=0x7f5c58070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d9b1640 1 -- 172.21.15.143:0/3186067871 >> v1:172.21.15.143:6789/0 conn(0x7f5c58070da0 legacy=0x7f5c5815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d9b1640 1 -- 172.21.15.143:0/3186067871 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c580b2900 con 0x7f5c580b36c0 2023-11-24T06:33:24.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.879+0000 7f5c5d9b1640 1 --2- 172.21.15.143:0/3186067871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c580b1ef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5c480097c0 tx=0x7f5c4801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f50c572fa6324fb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:24.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c480ad660 con 0x7f5c580b36c0 2023-11-24T06:33:24.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c480ad7c0 con 0x7f5c580b36c0 2023-11-24T06:33:24.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c5d1b0640 1 -- 172.21.15.143:0/3186067871 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c480adb50 con 0x7f5c580b36c0 2023-11-24T06:33:24.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 -- 172.21.15.143:0/3186067871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 msgr2=0x7f5c580b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 --2- 172.21.15.143:0/3186067871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c580b1ef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5c480097c0 tx=0x7f5c4801c450 comp rx=0 tx=0).stop 2023-11-24T06:33:24.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 -- 172.21.15.143:0/3186067871 shutdown_connections 2023-11-24T06:33:24.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 --2- 172.21.15.143:0/3186067871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c580b1ef0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 -- 172.21.15.143:0/3186067871 >> 172.21.15.143:0/3186067871 conn(0x7f5c580b0bf0 msgr2=0x7f5c580b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:24.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 -- 172.21.15.143:0/3186067871 shutdown_connections 2023-11-24T06:33:24.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 -- 172.21.15.143:0/3186067871 wait complete. 2023-11-24T06:33:24.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 Processor -- start 2023-11-24T06:33:24.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.883+0000 7f5c60416640 1 -- start start 2023-11-24T06:33:24.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c58070da0 0x7f5c58155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c581415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 0x7f5c58141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c58142020 con 0x7f5c5815a320 2023-11-24T06:33:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581fa6b0 con 0x7f5c580b36c0 2023-11-24T06:33:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581f9aa0 con 0x7f5c58070da0 2023-11-24T06:33:24.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 0x7f5c58141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e1b2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c58070da0 0x7f5c58155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 0x7f5c58141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38868/0 (socket says 172.21.15.143:38868) 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 -- 172.21.15.143:0/4156202476 learned_addr learned my addr 172.21.15.143:0/4156202476 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5d9b1640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c581415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 -- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c58070da0 msgr2=0x7f5c58155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c58070da0 0x7f5c58155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 -- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 msgr2=0x7f5c581415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c581415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:24.891 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 -- 172.21.15.143:0/4156202476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48009420 con 0x7f5c5815a320 2023-11-24T06:33:24.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c5e9b3640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 0x7f5c58141ae0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000cb40 tx=0x7f5c5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:24.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000aca0 con 0x7f5c5815a320 2023-11-24T06:33:24.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5000ae20 con 0x7f5c5815a320 2023-11-24T06:33:24.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50012640 con 0x7f5c5815a320 2023-11-24T06:33:24.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c581f9d80 con 0x7f5c5815a320 2023-11-24T06:33:24.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c581fa340 con 0x7f5c5815a320 2023-11-24T06:33:24.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c58067520 con 0x7f5c5815a320 2023-11-24T06:33:24.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.887+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f5c50007070 con 0x7f5c5815a320 2023-11-24T06:33:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.891+0000 7f5c4effd640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c3c066aa0 0x7f5c3c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.891+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f5c50084670 con 0x7f5c5815a320 2023-11-24T06:33:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.891+0000 7f5c5e1b2640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c3c066aa0 0x7f5c3c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:24.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.891+0000 7f5c5e1b2640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c3c066aa0 0x7f5c3c068f60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c54001720 tx=0x7f5c54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:24.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:24.895+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c50051540 con 0x7f5c5815a320 2023-11-24T06:33:25.043 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.039+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c581fa7f0 con 0x7f5c3c066aa0 2023-11-24T06:33:25.045 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c4effd640 1 -- 172.21.15.143:0/4156202476 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50173 (secure 0 0 0) 0x7f5c581fa7f0 con 0x7f5c3c066aa0 2023-11-24T06:33:25.046 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:25.046 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:25.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c3c066aa0 msgr2=0x7f5c3c068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c3c066aa0 0x7f5c3c068f60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c54001720 tx=0x7f5c54009040 comp rx=0 tx=0).stop 2023-11-24T06:33:25.047 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 msgr2=0x7f5c58141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 0x7f5c58141ae0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000cb40 tx=0x7f5c5000a060 comp rx=0 tx=0).stop 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 shutdown_connections 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5c3c066aa0 0x7f5c3c068f60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5815a320 0x7f5c58141ae0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c580b36c0 0x7f5c581415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 --2- 172.21.15.143:0/4156202476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c58070da0 0x7f5c58155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 >> 172.21.15.143:0/4156202476 conn(0x7f5c580b0bf0 msgr2=0x7f5c580b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:25.048 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 shutdown_connections 2023-11-24T06:33:25.049 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.043+0000 7f5c60416640 1 -- 172.21.15.143:0/4156202476 wait complete. 2023-11-24T06:33:25.068 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-24T06:33:24.248057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":259048,"kb_used_data":9600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715672,"statfs":{"total":773094113280,"available":772828848128,"internally_reserved":0,"allocated":9830400,"data_stored":4878835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23410,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000998"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-24T06:33:19.568849+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:33:19.568849+0000","last_peered":"2023-11-24T06:33:19.568849+0000","last_clean":"2023-11-24T06:33:19.568849+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:19.568849+0000","last_undegraded":"2023-11-24T06:33:19.568849+0000","last_fullsized":"2023-11-24T06:33:19.568849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1049367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.619,"15min":1.619},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99099999999999999,"5min":1.417,"15min":1.417},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.97699999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":1.7,"15min":1.7},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78400000000000003,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.92600000000000005,"5min":1.55,"15min":1.55},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92600000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":453662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":2.637,"15min":2.637},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96799999999999997,"5min":1.619,"15min":1.619},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85799999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.505},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99399999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.86899999999999999},"min":{"1min":0.504,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.72499999999999998,"15min":0.77500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":1.036,"15min":1.036},"last":0.65400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":480394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.278,"15min":1.278},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.294,"5min":1.919,"15min":1.919},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.3500000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.427,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5189999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4059999999999999,"5min":1.998,"15min":1.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.274,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.462,"15min":1.462},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":453103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.876},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.022},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.876,"5min":1.202,"15min":1.202},"last":0.91800000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94199999999999995,"5min":1.248,"15min":1.248},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.079,"15min":1.079},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.002,"5min":1.149,"15min":1.149},"last":1.056}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.629,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.625,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55500000000000005,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":1.095,"15min":1.095},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93300000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.264,"15min":1.264},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.286,"15min":1.286},"last":1.081}]},{"osd":7,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88100000000000001,"5min":1.409,"15min":1.409},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.78100000000000003,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94699999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.85299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.43099999999999999,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51300000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63900000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49199999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59399999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88900000000000001,"5min":1.075,"15min":1.075},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83699999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.27,"15min":1.27},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":1.389,"15min":1.389},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83499999999999996,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.874,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.93000000000000005,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.044,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.877,"5min":1.02,"15min":1.02},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81000000000000005,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":1.048,"15min":1.048},"last":0.625}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0940000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1048533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":1.393,"15min":1.393},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66100000000000003,"5min":1.319,"15min":1.319},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0049999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.499}]},{"osd":3,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71199999999999997,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.373},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.589,"15min":1.589},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.81200000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.778,"15min":1.778},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4099999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0089999999999999,"5min":1.496,"15min":1.496},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3740000000000001,"5min":1.454,"15min":1.454},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81100000000000005,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.829,"15min":1.829},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:25.070 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:33:25.070 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:25.208 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.203+0000 7f18ef091640 1 Processor -- start 2023-11-24T06:33:25.209 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.203+0000 7f18ef091640 1 -- start start 2023-11-24T06:33:25.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18ef091640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18e80b3ec0 0x7f18e815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18ef091640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e815e660 con 0x7f18e815db40 2023-11-24T06:33:25.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18ef091640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e815e900 con 0x7f18e8160be0 2023-11-24T06:33:25.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18ef091640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e806c650 con 0x7f18e80b3ec0 2023-11-24T06:33:25.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18ed62e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f18e815db40 0x7f18e815df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37542/0 (socket says 172.21.15.143:37542) 2023-11-24T06:33:25.210 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18ed62e640 1 -- 172.21.15.143:0/2721362452 learned_addr learned my addr 172.21.15.143:0/2721362452 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:25.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18dffff640 1 --2- 172.21.15.143:0/2721362452 >> v2:172.21.15.146:3300/0 conn(0x7f18e80b3ec0 0x7f18e815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612544386 0 0) 0x7f18e815e660 con 0x7f18e815db40 2023-11-24T06:33:25.211 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d0003530 con 0x7f18e815db40 2023-11-24T06:33:25.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490467955 0 0) 0x7f18e815e900 con 0x7f18e8160be0 2023-11-24T06:33:25.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e815e660 con 0x7f18e8160be0 2023-11-24T06:33:25.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18dffff640 1 -- 172.21.15.143:0/2721362452 >> v1:172.21.15.146:6789/0 conn(0x7f18e8160be0 legacy=0x7f18e80b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18dffff640 1 -- 172.21.15.143:0/2721362452 >> v1:172.21.15.143:6789/0 conn(0x7f18e815db40 legacy=0x7f18e815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.212 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.207+0000 7f18dffff640 1 -- 172.21.15.143:0/2721362452 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e806c830 con 0x7f18e80b3ec0 2023-11-24T06:33:25.213 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18dffff640 1 --2- 172.21.15.143:0/2721362452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80b3ec0 0x7f18e815ed00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f18d80097c0 tx=0x7f18d801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=662624d98be3a465 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:25.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80ab650 con 0x7f18e80b3ec0 2023-11-24T06:33:25.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d80ab7b0 con 0x7f18e80b3ec0 2023-11-24T06:33:25.214 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18df7fe640 1 -- 172.21.15.143:0/2721362452 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80abb40 con 0x7f18e80b3ec0 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 -- 172.21.15.143:0/2721362452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80b3ec0 msgr2=0x7f18e815ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 --2- 172.21.15.143:0/2721362452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80b3ec0 0x7f18e815ed00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f18d80097c0 tx=0x7f18d801c450 comp rx=0 tx=0).stop 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 -- 172.21.15.143:0/2721362452 shutdown_connections 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 --2- 172.21.15.143:0/2721362452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80b3ec0 0x7f18e815ed00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 -- 172.21.15.143:0/2721362452 >> 172.21.15.143:0/2721362452 conn(0x7f18e80b0bf0 msgr2=0x7f18e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 -- 172.21.15.143:0/2721362452 shutdown_connections 2023-11-24T06:33:25.215 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 -- 172.21.15.143:0/2721362452 wait complete. 2023-11-24T06:33:25.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 Processor -- start 2023-11-24T06:33:25.216 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.211+0000 7f18ef091640 1 -- start start 2023-11-24T06:33:25.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 0x7f18e81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e815db40 0x7f18e8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e8160be0 0x7f18e809b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.218 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8152d90 con 0x7f18e80b3ec0 2023-11-24T06:33:25.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8155620 con 0x7f18e8160be0 2023-11-24T06:33:25.219 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e809bdf0 con 0x7f18e815db40 2023-11-24T06:33:25.222 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 0x7f18e81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 0x7f18e81550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38876/0 (socket says 172.21.15.143:38876) 2023-11-24T06:33:25.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 -- 172.21.15.143:0/1807569210 learned_addr learned my addr 172.21.15.143:0/1807569210 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:25.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18dffff640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e815db40 0x7f18e8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ed62e640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e8160be0 0x7f18e809b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 -- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e815db40 msgr2=0x7f18e8153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e815db40 0x7f18e8153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 -- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e8160be0 msgr2=0x7f18e809b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e8160be0 0x7f18e809b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 -- 172.21.15.143:0/1807569210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009420 con 0x7f18e80b3ec0 2023-11-24T06:33:25.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ed62e640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e8160be0 0x7f18e809b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:25.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ece2d640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 0x7f18e81550e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c430 tx=0x7f18e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e40052d0 con 0x7f18e80b3ec0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4005450 con 0x7f18e80b3ec0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4003840 con 0x7f18e80b3ec0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e806e070 con 0x7f18e80b3ec0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e8154be0 con 0x7f18e80b3ec0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e8067520 con 0x7f18e80b3ec0 2023-11-24T06:33:25.226 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.215+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f18e40039a0 con 0x7f18e80b3ec0 2023-11-24T06:33:25.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.219+0000 7f18dd7fa640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18d4066aa0 0x7f18d4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.219+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f18e4083c00 con 0x7f18e80b3ec0 2023-11-24T06:33:25.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.219+0000 7f18dffff640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18d4066aa0 0x7f18d4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.219+0000 7f18dffff640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18d4066aa0 0x7f18d4068f60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f18d80af000 tx=0x7f18d80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:25.227 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.223+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18e4050b60 con 0x7f18e80b3ec0 2023-11-24T06:33:25.375 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.371+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18e80721d0 con 0x7f18d4066aa0 2023-11-24T06:33:25.378 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18dd7fa640 1 -- 172.21.15.143:0/1807569210 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50173 (secure 0 0 0) 0x7f18e80721d0 con 0x7f18d4066aa0 2023-11-24T06:33:25.378 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:25.379 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18d4066aa0 msgr2=0x7f18d4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18d4066aa0 0x7f18d4068f60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f18d80af000 tx=0x7f18d80a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 msgr2=0x7f18e81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 0x7f18e81550e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c430 tx=0x7f18e400c8f0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 shutdown_connections 2023-11-24T06:33:25.380 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f18d4066aa0 0x7f18d4068f60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e8160be0 0x7f18e809b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e815db40 0x7f18e8153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 --2- 172.21.15.143:0/1807569210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e80b3ec0 0x7f18e81550e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 >> 172.21.15.143:0/1807569210 conn(0x7f18e80b0bf0 msgr2=0x7f18e80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 shutdown_connections 2023-11-24T06:33:25.381 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.375+0000 7f18ef091640 1 -- 172.21.15.143:0/1807569210 wait complete. 2023-11-24T06:33:25.399 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-24T06:33:24.248057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":259048,"kb_used_data":9600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715672,"statfs":{"total":773094113280,"available":772828848128,"internally_reserved":0,"allocated":9830400,"data_stored":4878835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23410,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000998"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-24T06:33:19.568849+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:33:19.568849+0000","last_peered":"2023-11-24T06:33:19.568849+0000","last_clean":"2023-11-24T06:33:19.568849+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:19.568849+0000","last_undegraded":"2023-11-24T06:33:19.568849+0000","last_fullsized":"2023-11-24T06:33:19.568849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1049367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.619,"15min":1.619},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99099999999999999,"5min":1.417,"15min":1.417},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.97699999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":1.7,"15min":1.7},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78400000000000003,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.92600000000000005,"5min":1.55,"15min":1.55},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92600000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":453662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":2.637,"15min":2.637},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96799999999999997,"5min":1.619,"15min":1.619},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85799999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.505},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99399999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.86899999999999999},"min":{"1min":0.504,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.72499999999999998,"15min":0.77500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":1.036,"15min":1.036},"last":0.65400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":480394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.278,"15min":1.278},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.294,"5min":1.919,"15min":1.919},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.3500000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.427,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5189999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4059999999999999,"5min":1.998,"15min":1.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.274,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.462,"15min":1.462},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":453103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.876},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.022},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.876,"5min":1.202,"15min":1.202},"last":0.91800000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94199999999999995,"5min":1.248,"15min":1.248},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.079,"15min":1.079},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.002,"5min":1.149,"15min":1.149},"last":1.056}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.629,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.625,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55500000000000005,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":1.095,"15min":1.095},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93300000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.264,"15min":1.264},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.286,"15min":1.286},"last":1.081}]},{"osd":7,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88100000000000001,"5min":1.409,"15min":1.409},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.78100000000000003,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94699999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.85299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.43099999999999999,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51300000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63900000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49199999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59399999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88900000000000001,"5min":1.075,"15min":1.075},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83699999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.27,"15min":1.27},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":1.389,"15min":1.389},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83499999999999996,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.874,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.93000000000000005,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.044,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.877,"5min":1.02,"15min":1.02},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81000000000000005,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":1.048,"15min":1.048},"last":0.625}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0940000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1048533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":1.393,"15min":1.393},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66100000000000003,"5min":1.319,"15min":1.319},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0049999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.499}]},{"osd":3,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71199999999999997,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.373},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.589,"15min":1.589},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.81200000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.778,"15min":1.778},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4099999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0089999999999999,"5min":1.496,"15min":1.496},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3740000000000001,"5min":1.454,"15min":1.454},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81100000000000005,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.829,"15min":1.829},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:25.402 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:33:25.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.535+0000 7f515806b640 1 Processor -- start 2023-11-24T06:33:25.540 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.535+0000 7f515806b640 1 -- start start 2023-11-24T06:33:25.542 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f515806b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f515006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f515806b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f515009cc20 0x7f515006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f515806b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515006d8b0 con 0x7f515006e280 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f515806b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5150145020 con 0x7f515009cc20 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f515806b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515009d0a0 con 0x7f5150144030 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f515009cc20 0x7f515006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155e07640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f515006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.543 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f515009cc20 0x7f515006dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38886/0 (socket says 172.21.15.143:38886) 2023-11-24T06:33:25.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 -- 172.21.15.143:0/4092739940 learned_addr learned my addr 172.21.15.143:0/4092739940 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:25.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5156608640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f515006e280 0x7f51500709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:58928/0 (socket says 172.21.15.143:58928) 2023-11-24T06:33:25.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 -- 172.21.15.143:0/4092739940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 msgr2=0x7f515006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:25.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 --2- 172.21.15.143:0/4092739940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f515006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 -- 172.21.15.143:0/4092739940 >> v1:172.21.15.146:6789/0 conn(0x7f515006e280 legacy=0x7f51500709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.544 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.539+0000 7f5155606640 1 -- 172.21.15.143:0/4092739940 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515006cca0 con 0x7f515009cc20 2023-11-24T06:33:25.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5155606640 1 --2- 172.21.15.143:0/4092739940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f515006dd40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ab4ba30b39f6a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:25.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5154e05640 1 -- 172.21.15.143:0/4092739940 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400aa670 con 0x7f515009cc20 2023-11-24T06:33:25.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5154e05640 1 -- 172.21.15.143:0/4092739940 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51400aa7d0 con 0x7f515009cc20 2023-11-24T06:33:25.545 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5154e05640 1 -- 172.21.15.143:0/4092739940 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400aab60 con 0x7f515009cc20 2023-11-24T06:33:25.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- 172.21.15.143:0/4092739940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 msgr2=0x7f515006dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 --2- 172.21.15.143:0/4092739940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f515006dd40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001c510 comp rx=0 tx=0).stop 2023-11-24T06:33:25.546 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- 172.21.15.143:0/4092739940 shutdown_connections 2023-11-24T06:33:25.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 --2- 172.21.15.143:0/4092739940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f515006dd40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 --2- 172.21.15.143:0/4092739940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f515006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- 172.21.15.143:0/4092739940 >> 172.21.15.143:0/4092739940 conn(0x7f51500b0bf0 msgr2=0x7f51500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:25.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- 172.21.15.143:0/4092739940 shutdown_connections 2023-11-24T06:33:25.547 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- 172.21.15.143:0/4092739940 wait complete. 2023-11-24T06:33:25.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 Processor -- start 2023-11-24T06:33:25.548 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- start start 2023-11-24T06:33:25.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515006e280 0x7f51500b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f51501f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.549 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f5150142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b3250 con 0x7f515009cc20 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b3530 con 0x7f515006e280 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f515806b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b3810 con 0x7f5150144030 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5155606640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f51501f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5155606640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f51501f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38902/0 (socket says 172.21.15.143:38902) 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.543+0000 7f5155606640 1 -- 172.21.15.143:0/2151262520 learned_addr learned my addr 172.21.15.143:0/2151262520 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:25.550 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155e07640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515006e280 0x7f51500b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5156608640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f5150142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155606640 1 -- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 msgr2=0x7f5150142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155606640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f5150142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155606640 1 -- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515006e280 msgr2=0x7f51500b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155606640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515006e280 0x7f51500b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155606640 1 -- 172.21.15.143:0/2151262520 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400094d0 con 0x7f515009cc20 2023-11-24T06:33:25.551 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155606640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f51501f5410 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f51400ac040 tx=0x7f514001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400b3800 con 0x7f515009cc20 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51400b3980 con 0x7f515009cc20 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51500b3af0 con 0x7f515009cc20 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400b3d30 con 0x7f515009cc20 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51500b2f40 con 0x7f515009cc20 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150067520 con 0x7f515009cc20 2023-11-24T06:33:25.553 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f51400b2380 con 0x7f515009cc20 2023-11-24T06:33:25.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f51467fc640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5134066aa0 0x7f5134068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:25.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f514011f040 con 0x7f515009cc20 2023-11-24T06:33:25.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.547+0000 7f5155e07640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5134066aa0 0x7f5134068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:25.554 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.551+0000 7f5155e07640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5134066aa0 0x7f5134068f60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f514c009ac0 tx=0x7f514c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:25.556 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.551+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51400ebd70 con 0x7f515009cc20 2023-11-24T06:33:25.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.703+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f515006b670 con 0x7f515009cc20 2023-11-24T06:33:25.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.703+0000 7f51467fc640 1 -- 172.21.15.143:0/2151262520 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+13080 (secure 0 0 0) 0x7f51400c3020 con 0x7f515009cc20 2023-11-24T06:33:25.708 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:25.708 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":88,"fsid":"039ed6d4-b5c2-4e8e-a15f-05a601a78248","created":"2023-11-24T06:29:15.199007+0000","modified":"2023-11-24T06:33:22.253224+0000","last_up_change":"2023-11-24T06:29:27.674099+0000","last_in_change":"2023-11-24T06:29:17.756008+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:29:28.270057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfbd1a3a-5d81-4b00-be1e-bb30bde3c5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6801","nonce":1164316575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6803","nonce":1164316575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6807","nonce":1164316575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1164316575},{"type":"v1","addr":"172.21.15.143:6805","nonce":1164316575}]},"public_addr":"172.21.15.143:6801/1164316575","cluster_addr":"172.21.15.143:6803/1164316575","heartbeat_back_addr":"172.21.15.143:6807/1164316575","heartbeat_front_addr":"172.21.15.143:6805/1164316575","state":["exists","up"]},{"osd":1,"uuid":"40ba0a51-0cdd-49d8-927d-8d3e2ca80308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6809","nonce":3921027021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6811","nonce":3921027021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6815","nonce":3921027021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3921027021},{"type":"v1","addr":"172.21.15.143:6813","nonce":3921027021}]},"public_addr":"172.21.15.143:6809/3921027021","cluster_addr":"172.21.15.143:6811/3921027021","heartbeat_back_addr":"172.21.15.143:6815/3921027021","heartbeat_front_addr":"172.21.15.143:6813/3921027021","state":["exists","up"]},{"osd":2,"uuid":"95c33c83-6f16-4318-9c3a-d34703a027b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6825","nonce":1592203571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6827","nonce":1592203571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6831","nonce":1592203571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":1592203571},{"type":"v1","addr":"172.21.15.143:6829","nonce":1592203571}]},"public_addr":"172.21.15.143:6825/1592203571","cluster_addr":"172.21.15.143:6827/1592203571","heartbeat_back_addr":"172.21.15.143:6831/1592203571","heartbeat_front_addr":"172.21.15.143:6829/1592203571","state":["exists","up"]},{"osd":3,"uuid":"0688ff1a-fa2e-4024-b587-bfab84e913bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6817","nonce":2880360154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6819","nonce":2880360154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6823","nonce":2880360154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2880360154},{"type":"v1","addr":"172.21.15.143:6821","nonce":2880360154}]},"public_addr":"172.21.15.143:6817/2880360154","cluster_addr":"172.21.15.143:6819/2880360154","heartbeat_back_addr":"172.21.15.143:6823/2880360154","heartbeat_front_addr":"172.21.15.143:6821/2880360154","state":["exists","up"]},{"osd":4,"uuid":"08e4abf5-8b68-45b5-b039-e330f961ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6801","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6803","nonce":3450437685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6807","nonce":3450437685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6815","nonce":3450437685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":3450437685},{"type":"v1","addr":"172.21.15.146:6812","nonce":3450437685}]},"public_addr":"172.21.15.146:6803/3450437685","cluster_addr":"172.21.15.146:6807/3450437685","heartbeat_back_addr":"172.21.15.146:6815/3450437685","heartbeat_front_addr":"172.21.15.146:6812/3450437685","state":["exists","up"]},{"osd":5,"uuid":"76811fdd-ba5b-434d-a7e8-7367cc8470c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6817","nonce":714537045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6819","nonce":714537045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6823","nonce":714537045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":714537045},{"type":"v1","addr":"172.21.15.146:6821","nonce":714537045}]},"public_addr":"172.21.15.146:6817/714537045","cluster_addr":"172.21.15.146:6819/714537045","heartbeat_back_addr":"172.21.15.146:6823/714537045","heartbeat_front_addr":"172.21.15.146:6821/714537045","state":["exists","up"]},{"osd":6,"uuid":"74dfc999-5da9-4d97-8fea-35ba4387f8ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6825","nonce":2587602061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6827","nonce":2587602061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6831","nonce":2587602061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2587602061},{"type":"v1","addr":"172.21.15.146:6829","nonce":2587602061}]},"public_addr":"172.21.15.146:6825/2587602061","cluster_addr":"172.21.15.146:6827/2587602061","heartbeat_back_addr":"172.21.15.146:6831/2587602061","heartbeat_front_addr":"172.21.15.146:6829/2587602061","state":["exists","up"]},{"osd":7,"uuid":"cd65f1c5-f67f-43d8-aaff-2fa2e704308b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6802","nonce":2932726112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6806","nonce":2932726112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6813","nonce":2932726112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2932726112},{"type":"v1","addr":"172.21.15.146:6810","nonce":2932726112}]},"public_addr":"172.21.15.146:6802/2932726112","cluster_addr":"172.21.15.146:6806/2932726112","heartbeat_back_addr":"172.21.15.146:6813/2932726112","heartbeat_front_addr":"172.21.15.146:6810/2932726112","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.747310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.554620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.555178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.675539+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.465333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.356847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.544977+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:29:23.411363+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/1990915261":"2023-11-25T06:33:19.241260+0000","172.21.15.143:6836/1990915261":"2023-11-25T06:33:19.241260+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:33:25.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5134066aa0 msgr2=0x7f5134068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5134066aa0 0x7f5134068f60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f514c009ac0 tx=0x7f514c009190 comp rx=0 tx=0).stop 2023-11-24T06:33:25.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 msgr2=0x7f51501f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:25.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f51501f5410 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f51400ac040 tx=0x7f514001ad50 comp rx=0 tx=0).stop 2023-11-24T06:33:25.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 shutdown_connections 2023-11-24T06:33:25.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f5134066aa0 0x7f5134068f60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5150144030 0x7f5150142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f515009cc20 0x7f51501f5410 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 --2- 172.21.15.143:0/2151262520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515006e280 0x7f51500b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:25.711 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 >> 172.21.15.143:0/2151262520 conn(0x7f51500b0bf0 msgr2=0x7f515013c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:25.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 shutdown_connections 2023-11-24T06:33:25.712 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:25.707+0000 7f515806b640 1 -- 172.21.15.143:0/2151262520 wait complete. 2023-11-24T06:33:26.729 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T06:33:26.730 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:26.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 Processor -- start 2023-11-24T06:33:26.882 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 -- start start 2023-11-24T06:33:26.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.883 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdea806cd60 0x7fdea806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80ae950 con 0x7fdea806de50 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea8159fc0 con 0x7fdea806cd60 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeae780640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80b1ef0 con 0x7fdea80ad5e0 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdea7fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fdea806de50 0x7fdea806c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37558/0 (socket says 172.21.15.143:37558) 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdea7fff640 1 -- 172.21.15.143:0/164110257 learned_addr learned my addr 172.21.15.143:0/164110257 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeacd1d640 1 --2- 172.21.15.143:0/164110257 >> v2:172.21.15.143:3300/0 conn(0x7fdea806cd60 0x7fdea806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.884 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdea77fe640 1 --2- 172.21.15.143:0/164110257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdea6ffd640 1 -- 172.21.15.143:0/164110257 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448007009 0 0) 0x7fdea80ae950 con 0x7fdea806de50 2023-11-24T06:33:26.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdea6ffd640 1 -- 172.21.15.143:0/164110257 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde90005740 con 0x7fdea806de50 2023-11-24T06:33:26.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeacd1d640 1 -- 172.21.15.143:0/164110257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 msgr2=0x7fdea8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:26.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeacd1d640 1 --2- 172.21.15.143:0/164110257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:26.885 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeacd1d640 1 -- 172.21.15.143:0/164110257 >> v1:172.21.15.143:6789/0 conn(0x7fdea806de50 legacy=0x7fdea806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.886 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.879+0000 7fdeacd1d640 1 -- 172.21.15.143:0/164110257 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80ada40 con 0x7fdea806cd60 2023-11-24T06:33:26.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeacd1d640 1 --2- 172.21.15.143:0/164110257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea806d1f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009d90 tx=0x7fdea001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f71c2d84dcc51a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:26.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdea6ffd640 1 -- 172.21.15.143:0/164110257 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00a59f0 con 0x7fdea806cd60 2023-11-24T06:33:26.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdea6ffd640 1 -- 172.21.15.143:0/164110257 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea00a5b50 con 0x7fdea806cd60 2023-11-24T06:33:26.887 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdea6ffd640 1 -- 172.21.15.143:0/164110257 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00ad440 con 0x7fdea806cd60 2023-11-24T06:33:26.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 -- 172.21.15.143:0/164110257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 msgr2=0x7fdea806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 --2- 172.21.15.143:0/164110257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea806d1f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009d90 tx=0x7fdea001c930 comp rx=0 tx=0).stop 2023-11-24T06:33:26.888 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 -- 172.21.15.143:0/164110257 shutdown_connections 2023-11-24T06:33:26.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 --2- 172.21.15.143:0/164110257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea806d1f0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:26.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 --2- 172.21.15.143:0/164110257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:26.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 -- 172.21.15.143:0/164110257 >> 172.21.15.143:0/164110257 conn(0x7fdea80b0bf0 msgr2=0x7fdea80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:26.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 -- 172.21.15.143:0/164110257 shutdown_connections 2023-11-24T06:33:26.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.883+0000 7fdeae780640 1 -- 172.21.15.143:0/164110257 wait complete. 2023-11-24T06:33:26.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 Processor -- start 2023-11-24T06:33:26.890 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 -- start start 2023-11-24T06:33:26.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea806de50 0x7fdea80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.892 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81500c0 con 0x7fdea806cd60 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea809bd90 con 0x7fdea806de50 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea809c070 con 0x7fdea80ad5e0 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea814fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38928/0 (socket says 172.21.15.143:38928) 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 -- 172.21.15.143:0/3995155789 learned_addr learned my addr 172.21.15.143:0/3995155789 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeacd1d640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.893 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea77fe640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea806de50 0x7fdea80ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 -- 172.21.15.143:0/3995155789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 msgr2=0x7fdea8155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea80ad5e0 0x7fdea8155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 -- 172.21.15.143:0/3995155789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea806de50 msgr2=0x7fdea80ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea806de50 0x7fdea80ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 -- 172.21.15.143:0/3995155789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0009a70 con 0x7fdea806cd60 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea7fff640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea814fb80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fde9800c4d0 tx=0x7fde9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98005cf0 con 0x7fdea806cd60 2023-11-24T06:33:26.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98005e50 con 0x7fdea806cd60 2023-11-24T06:33:26.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98007270 con 0x7fdea806cd60 2023-11-24T06:33:26.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea809c350 con 0x7fdea806cd60 2023-11-24T06:33:26.895 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.887+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea809ba40 con 0x7fdea806cd60 2023-11-24T06:33:26.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdea80cc670 con 0x7fdea806cd60 2023-11-24T06:33:26.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fde980073d0 con 0x7fdea806cd60 2023-11-24T06:33:26.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea4ff9640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fde94066aa0 0x7fde94068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.896 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fde98083c00 con 0x7fdea806cd60 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea77fe640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fde94066aa0 0x7fde94068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea4ff9640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7fde9406c900 0x7fde9406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 --> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde9406f3f0 con 0x7fde9406c900 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde98088280 con 0x7fdea806cd60 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdeacd1d640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7fde9406c900 0x7fde9406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdea77fe640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fde94066aa0 0x7fde94068f60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdea80b23a0 tx=0x7fde9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:26.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.891+0000 7fdeacd1d640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7fde9406c900 0x7fde9406ed20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:26.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.895+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== osd.0 v2:172.21.15.143:6800/1164316575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fde9406f3f0 con 0x7fde9406c900 2023-11-24T06:33:26.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 --> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdea809c1e0 con 0x7fde9406c900 2023-11-24T06:33:26.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdea4ff9640 1 -- 172.21.15.143:0/3995155789 <== osd.0 v2:172.21.15.143:6800/1164316575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdea809c1e0 con 0x7fde9406c900 2023-11-24T06:33:26.911 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:26.911 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:26.911 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:26.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7fde9406c900 msgr2=0x7fde9406ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6800/1164316575,v1:172.21.15.143:6801/1164316575] conn(0x7fde9406c900 0x7fde9406ed20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:26.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fde94066aa0 msgr2=0x7fde94068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fde94066aa0 0x7fde94068f60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdea80b23a0 tx=0x7fde9c008040 comp rx=0 tx=0).stop 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 msgr2=0x7fdea814fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 --2- 172.21.15.143:0/3995155789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdea806cd60 0x7fdea814fb80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fde9800c4d0 tx=0x7fde9800c990 comp rx=0 tx=0).stop 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeacd1d640 1 -- 172.21.15.143:0/3995155789 reap_dead start 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 shutdown_connections 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 >> 172.21.15.143:0/3995155789 conn(0x7fdea80b0bf0 msgr2=0x7fdea806c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 shutdown_connections 2023-11-24T06:33:26.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:26.907+0000 7fdeae780640 1 -- 172.21.15.143:0/3995155789 wait complete. 2023-11-24T06:33:26.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T06:33:27.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b7209640 1 Processor -- start 2023-11-24T06:33:27.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b7209640 1 -- start start 2023-11-24T06:33:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b7209640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27b0154830 0x7f27b00cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b7209640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b015dc30 con 0x7f27b00d16d0 2023-11-24T06:33:27.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b7209640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b015df10 con 0x7f27b00cf3d0 2023-11-24T06:33:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b7209640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b015e1f0 con 0x7f27b0154830 2023-11-24T06:33:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b6a08640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f27b00d16d0 0x7f27b006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37572/0 (socket says 172.21.15.143:37572) 2023-11-24T06:33:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b6a08640 1 -- 172.21.15.143:0/455709037 learned_addr learned my addr 172.21.15.143:0/455709037 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b6207640 1 --2- 172.21.15.143:0/455709037 >> v2:172.21.15.146:3300/0 conn(0x7f27b0154830 0x7f27b00cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857044146 0 0) 0x7f27b015dc30 con 0x7f27b00d16d0 2023-11-24T06:33:27.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.063+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f279c003530 con 0x7f27b00d16d0 2023-11-24T06:33:27.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274586176 0 0) 0x7f27b015df10 con 0x7f27b00cf3d0 2023-11-24T06:33:27.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b015dc30 con 0x7f27b00cf3d0 2023-11-24T06:33:27.071 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 237213921 0 0) 0x7f279c003530 con 0x7f27b00d16d0 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 >> v2:172.21.15.146:3300/0 conn(0x7f27b0154830 msgr2=0x7f27b00cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 --2- 172.21.15.143:0/455709037 >> v2:172.21.15.146:3300/0 conn(0x7f27b0154830 0x7f27b00cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 >> v1:172.21.15.146:6789/0 conn(0x7f27b00cf3d0 legacy=0x7f27b00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b015e4d0 con 0x7f27b00d16d0 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7f27a8001a00 con 0x7f27b00d16d0 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 >> v1:172.21.15.143:6789/0 conn(0x7f27b00d16d0 legacy=0x7f27b006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c003b60 0x7f279c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0047d0 0x7f279c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f279c0051e0 0x7f279c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b015e1f0 con 0x7f279c0051e0 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c00c110 con 0x7f279c003b60 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c00c2d0 con 0x7f279c0047d0 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f279c0051e0 0x7f279c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6207640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c003b60 0x7f279c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b5a06640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0047d0 0x7f279c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.073 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 -- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0047d0 msgr2=0x7f279c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0047d0 0x7f279c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 -- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c003b60 msgr2=0x7f279c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c003b60 0x7f279c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.074 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 -- 172.21.15.143:0/455709037 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c003530 con 0x7f279c0051e0 2023-11-24T06:33:27.075 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 -- 172.21.15.143:0/455709037 reap_dead start 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.067+0000 7f27b6a08640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f279c0051e0 0x7f279c00b990 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f27a800a700 tx=0x7f27a801d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d096fb538e48a67 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a80ad630 con 0x7f279c0051e0 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a80a8070 con 0x7f279c0051e0 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b5205640 1 -- 172.21.15.143:0/455709037 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a80ad9d0 con 0x7f279c0051e0 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- 172.21.15.143:0/455709037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f279c0051e0 msgr2=0x7f279c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f279c0051e0 0x7f279c00b990 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f27a800a700 tx=0x7f27a801d1e0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.076 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- 172.21.15.143:0/455709037 shutdown_connections 2023-11-24T06:33:27.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 --2- 172.21.15.143:0/455709037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f279c0051e0 0x7f279c00b990 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- 172.21.15.143:0/455709037 >> 172.21.15.143:0/455709037 conn(0x7f27b0060fd0 msgr2=0x7f27b00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- 172.21.15.143:0/455709037 shutdown_connections 2023-11-24T06:33:27.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- 172.21.15.143:0/455709037 wait complete. 2023-11-24T06:33:27.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 Processor -- start 2023-11-24T06:33:27.077 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- start start 2023-11-24T06:33:27.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0051e0 0x7f27b00d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 0x7f27b01f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.079 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b01f3b20 0x7f27b01f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00d1450 con 0x7f27b00d0fd0 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00c9e10 con 0x7f27b01f3b20 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b7209640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00c85e0 con 0x7f279c0051e0 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b5a06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 0x7f27b01f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b5a06640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 0x7f27b01f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38952/0 (socket says 172.21.15.143:38952) 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b5a06640 1 -- 172.21.15.143:0/468930278 learned_addr learned my addr 172.21.15.143:0/468930278 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.071+0000 7f27b6207640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0051e0 0x7f27b00d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.080 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b6a08640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b01f3b20 0x7f27b01f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b5a06640 1 -- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0051e0 msgr2=0x7f27b00d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b5a06640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0051e0 0x7f27b00d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b5a06640 1 -- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b01f3b20 msgr2=0x7f27b01f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b5a06640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b01f3b20 0x7f27b01f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b5a06640 1 -- 172.21.15.143:0/468930278 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b015daa0 con 0x7f27b00d0fd0 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b5a06640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 0x7f27b01f35e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f27a00077e0 tx=0x7f27a000f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0015410 con 0x7f27b00d0fd0 2023-11-24T06:33:27.081 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a0015570 con 0x7f27b00d0fd0 2023-11-24T06:33:27.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0015920 con 0x7f27b00d0fd0 2023-11-24T06:33:27.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b00c88c0 con 0x7f27b00d0fd0 2023-11-24T06:33:27.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b00c8e80 con 0x7f27b00d0fd0 2023-11-24T06:33:27.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b004e850 con 0x7f27b00d0fd0 2023-11-24T06:33:27.082 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f27a0015a80 con 0x7f27b00d0fd0 2023-11-24T06:33:27.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27a6ffd640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2794066aa0 0x7f2794068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f27a0087df0 con 0x7f27b00d0fd0 2023-11-24T06:33:27.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.075+0000 7f27b6207640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2794066aa0 0x7f2794068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.083 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.079+0000 7f27b6207640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2794066aa0 0x7f2794068f60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27b0147040 tx=0x7f27ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.084 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.079+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27a0054c60 con 0x7f27b00d0fd0 2023-11-24T06:33:27.232 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.227+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f27b006f960 con 0x7f2794066aa0 2023-11-24T06:33:27.233 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27a6ffd640 1 -- 172.21.15.143:0/468930278 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27ac019070 con 0x7f2794066aa0 2023-11-24T06:33:27.233 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T06:33:27.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2794066aa0 msgr2=0x7f2794068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2794066aa0 0x7f2794068f60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27b0147040 tx=0x7f27ac009190 comp rx=0 tx=0).stop 2023-11-24T06:33:27.235 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 msgr2=0x7f27b01f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 0x7f27b01f35e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f27a00077e0 tx=0x7f27a000f540 comp rx=0 tx=0).stop 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 shutdown_connections 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f2794066aa0 0x7f2794068f60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b01f3b20 0x7f27b01f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27b00d0fd0 0x7f27b01f35e0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 --2- 172.21.15.143:0/468930278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c0051e0 0x7f27b00d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 >> 172.21.15.143:0/468930278 conn(0x7f27b0060fd0 msgr2=0x7f27b00cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.236 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 shutdown_connections 2023-11-24T06:33:27.237 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.231+0000 7f27b7209640 1 -- 172.21.15.143:0/468930278 wait complete. 2023-11-24T06:33:27.254 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T06:33:27.254 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:27.396 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.391+0000 7fcfdef8a640 1 Processor -- start 2023-11-24T06:33:27.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfdef8a640 1 -- start start 2023-11-24T06:33:27.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfdef8a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd8160900 0x7fcfd80b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfdef8a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcfd80b66e0 0x7fcfd80cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfdef8a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80d1980 con 0x7fcfd80b62a0 2023-11-24T06:33:27.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfdef8a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd80b6bf0 con 0x7fcfd80b66e0 2023-11-24T06:33:27.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfdef8a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80b6ed0 con 0x7fcfd8160900 2023-11-24T06:33:27.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcfd80b66e0 0x7fcfd80cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcfd80b66e0 0x7fcfd80cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52556/0 (socket says 172.21.15.143:52556) 2023-11-24T06:33:27.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 -- 172.21.15.143:0/2322990374 learned_addr learned my addr 172.21.15.143:0/2322990374 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:27.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfddf88640 1 --2- 172.21.15.143:0/2322990374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd8160900 0x7fcfd80b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 -- 172.21.15.143:0/2322990374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd8160900 msgr2=0x7fcfd80b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.400 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 --2- 172.21.15.143:0/2322990374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd8160900 0x7fcfd80b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.400 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 -- 172.21.15.143:0/2322990374 >> v1:172.21.15.146:6789/0 conn(0x7fcfd80b62a0 legacy=0x7fcfd80d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.400 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.395+0000 7fcfde789640 1 -- 172.21.15.143:0/2322990374 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80b71b0 con 0x7fcfd80b66e0 2023-11-24T06:33:27.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfde789640 1 --2- 172.21.15.143:0/2322990374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b66e0 0x7fcfd80cdf00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009e50 tx=0x7fcfd001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3628ca06872c743b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdcf86640 1 -- 172.21.15.143:0/2322990374 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00a58a0 con 0x7fcfd80b66e0 2023-11-24T06:33:27.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdcf86640 1 -- 172.21.15.143:0/2322990374 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00a5a00 con 0x7fcfd80b66e0 2023-11-24T06:33:27.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdcf86640 1 -- 172.21.15.143:0/2322990374 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00a5d90 con 0x7fcfd80b66e0 2023-11-24T06:33:27.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 -- 172.21.15.143:0/2322990374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b66e0 msgr2=0x7fcfd80cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 --2- 172.21.15.143:0/2322990374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b66e0 0x7fcfd80cdf00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009e50 tx=0x7fcfd001c9e0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 -- 172.21.15.143:0/2322990374 shutdown_connections 2023-11-24T06:33:27.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 --2- 172.21.15.143:0/2322990374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b66e0 0x7fcfd80cdf00 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 --2- 172.21.15.143:0/2322990374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd8160900 0x7fcfd80b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 -- 172.21.15.143:0/2322990374 >> 172.21.15.143:0/2322990374 conn(0x7fcfd80613d0 msgr2=0x7fcfd80617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 -- 172.21.15.143:0/2322990374 shutdown_connections 2023-11-24T06:33:27.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 -- 172.21.15.143:0/2322990374 wait complete. 2023-11-24T06:33:27.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 Processor -- start 2023-11-24T06:33:27.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.399+0000 7fcfdef8a640 1 -- start start 2023-11-24T06:33:27.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b62a0 0x7fcfd814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd80b66e0 0x7fcfd80c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfd8160900 0x7fcfd815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd814b5a0 con 0x7fcfd80b62a0 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd814b880 con 0x7fcfd8160900 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd814bb60 con 0x7fcfd80b66e0 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b62a0 0x7fcfd814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b62a0 0x7fcfd814c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52566/0 (socket says 172.21.15.143:52566) 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfde789640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfd8160900 0x7fcfd815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 -- 172.21.15.143:0/3678625506 learned_addr learned my addr 172.21.15.143:0/3678625506 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdd787640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd80b66e0 0x7fcfd80c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.407 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 -- 172.21.15.143:0/3678625506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd80b66e0 msgr2=0x7fcfd80c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd80b66e0 0x7fcfd80c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 -- 172.21.15.143:0/3678625506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfd8160900 msgr2=0x7fcfd815e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfd8160900 0x7fcfd815e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 -- 172.21.15.143:0/3678625506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0009b30 con 0x7fcfd80b62a0 2023-11-24T06:33:27.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdd787640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfd80b66e0 0x7fcfd80c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:27.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfddf88640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b62a0 0x7fcfd814c920 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400e870 tx=0x7fcfd400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4009510 con 0x7fcfd80b62a0 2023-11-24T06:33:27.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd400eec0 con 0x7fcfd80b62a0 2023-11-24T06:33:27.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd814be40 con 0x7fcfd80b62a0 2023-11-24T06:33:27.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400cb40 con 0x7fcfd80b62a0 2023-11-24T06:33:27.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd814c400 con 0x7fcfd80b62a0 2023-11-24T06:33:27.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.403+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfd804e850 con 0x7fcfd80b62a0 2023-11-24T06:33:27.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fcfd400cca0 con 0x7fcfd80b62a0 2023-11-24T06:33:27.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcfbc066aa0 0x7fcfbc068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fcfd40847e0 con 0x7fcfd80b62a0 2023-11-24T06:33:27.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfdd787640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcfbc066aa0 0x7fcfbc068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7fcfbc06c900 0x7fcfbc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 --> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfbc06f3f0 con 0x7fcfbc06c900 2023-11-24T06:33:27.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd4086d10 con 0x7fcfd80b62a0 2023-11-24T06:33:27.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfde789640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7fcfbc06c900 0x7fcfbc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfdd787640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcfbc066aa0 0x7fcfbc068f60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8061da0 tx=0x7fcfc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfde789640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7fcfbc06c900 0x7fcfbc06ed20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.407+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== osd.1 v2:172.21.15.143:6808/3921027021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcfbc06f3f0 con 0x7fcfbc06c900 2023-11-24T06:33:27.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.419+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 --> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcfd806a5b0 con 0x7fcfbc06c900 2023-11-24T06:33:27.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.419+0000 7fcfce7fc640 1 -- 172.21.15.143:0/3678625506 <== osd.1 v2:172.21.15.143:6808/3921027021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcfd806a5b0 con 0x7fcfbc06c900 2023-11-24T06:33:27.427 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:27.427 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:27.427 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7fcfbc06c900 msgr2=0x7fcfbc06ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6808/3921027021,v1:172.21.15.143:6809/3921027021] conn(0x7fcfbc06c900 0x7fcfbc06ed20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcfbc066aa0 msgr2=0x7fcfbc068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fcfbc066aa0 0x7fcfbc068f60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8061da0 tx=0x7fcfc8009040 comp rx=0 tx=0).stop 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b62a0 msgr2=0x7fcfd814c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 --2- 172.21.15.143:0/3678625506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfd80b62a0 0x7fcfd814c920 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400e870 tx=0x7fcfd400ec70 comp rx=0 tx=0).stop 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfde789640 1 -- 172.21.15.143:0/3678625506 reap_dead start 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 shutdown_connections 2023-11-24T06:33:27.429 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 >> 172.21.15.143:0/3678625506 conn(0x7fcfd80613d0 msgr2=0x7fcfd815fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 shutdown_connections 2023-11-24T06:33:27.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.423+0000 7fcfdef8a640 1 -- 172.21.15.143:0/3678625506 wait complete. 2023-11-24T06:33:27.443 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T06:33:27.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.575+0000 7f36c1555640 1 Processor -- start 2023-11-24T06:33:27.581 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.575+0000 7f36c1555640 1 -- start start 2023-11-24T06:33:27.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36c1555640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36bc15b600 0x7f36bc0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36c1555640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36bc0c9650 0x7f36bc0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36c1555640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0abed0 con 0x7f36bc15b220 2023-11-24T06:33:27.584 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36c1555640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc072710 con 0x7f36bc0c9650 2023-11-24T06:33:27.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36c1555640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0c9fa0 con 0x7f36bc15b600 2023-11-24T06:33:27.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36bc0c9650 0x7f36bc0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36bc0c9650 0x7f36bc0c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52576/0 (socket says 172.21.15.143:52576) 2023-11-24T06:33:27.585 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 -- 172.21.15.143:0/4044450981 learned_addr learned my addr 172.21.15.143:0/4044450981 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:27.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36b27fc640 1 --2- 172.21.15.143:0/4044450981 >> v2:172.21.15.146:3300/0 conn(0x7f36bc15b600 0x7f36bc0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 -- 172.21.15.143:0/4044450981 >> v2:172.21.15.146:3300/0 conn(0x7f36bc15b600 msgr2=0x7f36bc0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 --2- 172.21.15.143:0/4044450981 >> v2:172.21.15.146:3300/0 conn(0x7f36bc15b600 0x7f36bc0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.586 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 -- 172.21.15.143:0/4044450981 >> v1:172.21.15.146:6789/0 conn(0x7f36bc15b220 legacy=0x7f36bc06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.587 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.579+0000 7f36bb7fe640 1 -- 172.21.15.143:0/4044450981 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc072370 con 0x7f36bc0c9650 2023-11-24T06:33:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36bb7fe640 1 --2- 172.21.15.143:0/4044450981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c9a60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f36bc06e320 tx=0x7f36b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6636714267b375d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36ba7fc640 1 -- 172.21.15.143:0/4044450981 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b40aa430 con 0x7f36bc0c9650 2023-11-24T06:33:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36ba7fc640 1 -- 172.21.15.143:0/4044450981 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b40aa590 con 0x7f36bc0c9650 2023-11-24T06:33:27.592 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36ba7fc640 1 -- 172.21.15.143:0/4044450981 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b40aa920 con 0x7f36bc0c9650 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 -- 172.21.15.143:0/4044450981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 msgr2=0x7f36bc0c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 --2- 172.21.15.143:0/4044450981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c9a60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f36bc06e320 tx=0x7f36b401c4d0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 -- 172.21.15.143:0/4044450981 shutdown_connections 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 --2- 172.21.15.143:0/4044450981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c9a60 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 --2- 172.21.15.143:0/4044450981 >> v2:172.21.15.146:3300/0 conn(0x7f36bc15b600 0x7f36bc0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 -- 172.21.15.143:0/4044450981 >> 172.21.15.143:0/4044450981 conn(0x7f36bc0b0bf0 msgr2=0x7f36bc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 -- 172.21.15.143:0/4044450981 shutdown_connections 2023-11-24T06:33:27.593 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 -- 172.21.15.143:0/4044450981 wait complete. 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 Processor -- start 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.583+0000 7f36c1555640 1 -- start start 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36bc15b220 0x7f36bc0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36bc15b600 0x7f36bc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc09aa30 con 0x7f36bc0c9650 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c5120 con 0x7f36bc15b600 2023-11-24T06:33:27.594 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c5400 con 0x7f36bc15b220 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52590/0 (socket says 172.21.15.143:52590) 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 -- 172.21.15.143:0/1145165724 learned_addr learned my addr 172.21.15.143:0/1145165724 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36b27fc640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36bc15b220 0x7f36bc0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36bb7fe640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36bc15b600 0x7f36bc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 -- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36bc15b220 msgr2=0x7f36bc0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36bc15b220 0x7f36bc0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.595 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 -- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36bc15b600 msgr2=0x7f36bc15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36bc15b600 0x7f36bc15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 -- 172.21.15.143:0/1145165724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40094d0 con 0x7f36bc0c9650 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36baffd640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c2c50 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00c7f0 tx=0x7f36ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003b80 con 0x7f36bc0c9650 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac003ce0 con 0x7f36bc0c9650 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc0c56e0 con 0x7f36bc0c9650 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00aa90 con 0x7f36bc0c9650 2023-11-24T06:33:27.596 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc0c3190 con 0x7f36bc0c9650 2023-11-24T06:33:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.587+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc09d250 con 0x7f36bc0c9650 2023-11-24T06:33:27.597 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.591+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f36ac00abf0 con 0x7f36bc0c9650 2023-11-24T06:33:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.591+0000 7f36b3fff640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f369c066aa0 0x7f369c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.591+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f36ac084380 con 0x7f36bc0c9650 2023-11-24T06:33:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.591+0000 7f36b27fc640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f369c066aa0 0x7f369c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.591+0000 7f36b27fc640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f369c066aa0 0x7f369c068f60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f36bc164490 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.595+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36ac051360 con 0x7f36bc0c9650 2023-11-24T06:33:27.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f36bc0c58d0 con 0x7f369c066aa0 2023-11-24T06:33:27.746 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36b3fff640 1 -- 172.21.15.143:0/1145165724 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f36bc0c58d0 con 0x7f369c066aa0 2023-11-24T06:33:27.747 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T06:33:27.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f369c066aa0 msgr2=0x7f369c068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f369c066aa0 0x7f369c068f60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f36bc164490 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2023-11-24T06:33:27.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 msgr2=0x7f36bc0c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c2c50 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00c7f0 tx=0x7f36ac00ccb0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.749 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 shutdown_connections 2023-11-24T06:33:27.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f369c066aa0 0x7f369c068f60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36bc15b600 0x7f36bc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36bc15b220 0x7f36bc0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.750 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 --2- 172.21.15.143:0/1145165724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36bc0c9650 0x7f36bc0c2c50 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 >> 172.21.15.143:0/1145165724 conn(0x7f36bc0b0bf0 msgr2=0x7f36bc0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 shutdown_connections 2023-11-24T06:33:27.751 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.743+0000 7f36c1555640 1 -- 172.21.15.143:0/1145165724 wait complete. 2023-11-24T06:33:27.767 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T06:33:27.768 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:27.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.903+0000 7fd594a05640 1 Processor -- start 2023-11-24T06:33:27.909 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd594a05640 1 -- start start 2023-11-24T06:33:27.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd594a05640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 0x7fd5900702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd594a05640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd59006d750 0x7fd59006dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd594a05640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd590071700 con 0x7fd590143800 2023-11-24T06:33:27.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd594a05640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59006e120 con 0x7fd59006d750 2023-11-24T06:33:27.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd594a05640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590070af0 con 0x7fd59015e840 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd590143800 0x7fd590071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57694/0 (socket says 172.21.15.143:57694) 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 -- 172.21.15.143:0/306857214 learned_addr learned my addr 172.21.15.143:0/306857214 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58f59e640 1 --2- 172.21.15.143:0/306857214 >> v2:172.21.15.146:3300/0 conn(0x7fd59006d750 0x7fd59006dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd587fff640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 0x7fd5900702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508393025 0 0) 0x7fd590071700 con 0x7fd590143800 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd57c005740 con 0x7fd590143800 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2260441523 0 0) 0x7fd57c005740 con 0x7fd590143800 2023-11-24T06:33:27.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 msgr2=0x7fd5900702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 0x7fd5900702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 >> v2:172.21.15.146:3300/0 conn(0x7fd59006d750 msgr2=0x7fd59006dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 --2- 172.21.15.143:0/306857214 >> v2:172.21.15.146:3300/0 conn(0x7fd59006d750 0x7fd59006dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590070dd0 con 0x7fd590143800 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fd580001680 con 0x7fd590143800 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58f59e640 1 --2- 172.21.15.143:0/306857214 >> v2:172.21.15.146:3300/0 conn(0x7fd59006d750 0x7fd59006dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 >> v1:172.21.15.143:6789/0 conn(0x7fd590143800 legacy=0x7fd590071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.914 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c005b90 0x7fd57c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd57c0069e0 0x7fd57c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 0x7fd57c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59006e120 con 0x7fd57c005b90 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590070af0 con 0x7fd57c0069e0 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c00dba0 con 0x7fd59015e840 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c005b90 0x7fd57c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd587fff640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd57c0069e0 0x7fd57c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58f59e640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 0x7fd57c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 -- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 msgr2=0x7fd57c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59015e840 0x7fd57c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 -- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd57c0069e0 msgr2=0x7fd57c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:27.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd57c0069e0 0x7fd57c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.907+0000 7fd58ed9d640 1 -- 172.21.15.143:0/306857214 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c005740 con 0x7fd57c005b90 2023-11-24T06:33:27.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c005b90 0x7fd57c005fb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c240 tx=0x7fd58001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa098fb80b59a39 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800058e0 con 0x7fd57c005b90 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580005a40 con 0x7fd57c005b90 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd58e59c640 1 -- 172.21.15.143:0/306857214 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580005e10 con 0x7fd57c005b90 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd594a05640 1 -- 172.21.15.143:0/306857214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c005b90 msgr2=0x7fd57c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd594a05640 1 --2- 172.21.15.143:0/306857214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c005b90 0x7fd57c005fb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c240 tx=0x7fd58001cc30 comp rx=0 tx=0).stop 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd58f59e640 1 -- 172.21.15.143:0/306857214 reap_dead start 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd594a05640 1 -- 172.21.15.143:0/306857214 shutdown_connections 2023-11-24T06:33:27.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd594a05640 1 -- 172.21.15.143:0/306857214 >> 172.21.15.143:0/306857214 conn(0x7fd5900cb8b0 msgr2=0x7fd5900cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd594a05640 1 -- 172.21.15.143:0/306857214 shutdown_connections 2023-11-24T06:33:27.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.911+0000 7fd594a05640 1 -- 172.21.15.143:0/306857214 wait complete. 2023-11-24T06:33:27.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 Processor -- start 2023-11-24T06:33:27.919 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- start start 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd57c005b90 0x7fd59013db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd59015beb0 0x7fd59015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd590140420 0x7fd590140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900af3e0 con 0x7fd59015beb0 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900aead0 con 0x7fd590140420 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59015c930 con 0x7fd57c005b90 2023-11-24T06:33:27.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd59015beb0 0x7fd59015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd59015beb0 0x7fd59015c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52602/0 (socket says 172.21.15.143:52602) 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 -- 172.21.15.143:0/1162067016 learned_addr learned my addr 172.21.15.143:0/1162067016 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd58f59e640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd590140420 0x7fd590140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 -- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd57c005b90 msgr2=0x7fd59013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd57c005b90 0x7fd59013db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd57c005b90 0x7fd59013db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 -- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd590140420 msgr2=0x7fd590140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd590140420 0x7fd590140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 -- 172.21.15.143:0/1162067016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900aed90 con 0x7fd59015beb0 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd58f59e640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd590140420 0x7fd590140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd57c005b90 0x7fd59013db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd587fff640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd59015beb0 0x7fd59015c310 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd578011960 tx=0x7fd578011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800fa90 con 0x7fd59015beb0 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800fbf0 con 0x7fd59015beb0 2023-11-24T06:33:27.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578014440 con 0x7fd59015beb0 2023-11-24T06:33:27.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5900af070 con 0x7fd59015beb0 2023-11-24T06:33:27.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59013e070 con 0x7fd59015beb0 2023-11-24T06:33:27.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.915+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5900b3280 con 0x7fd59015beb0 2023-11-24T06:33:27.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fd5780145a0 con 0x7fd59015beb0 2023-11-24T06:33:27.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd570066ad0 0x7fd570068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fd578084fc0 con 0x7fd59015beb0 2023-11-24T06:33:27.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd570066ad0 0x7fd570068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7fd57006c930 0x7fd57006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 --> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd57006f420 con 0x7fd57006c930 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd578087420 con 0x7fd59015beb0 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd58f59e640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7fd57006c930 0x7fd57006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd58ed9d640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd570066ad0 0x7fd570068f90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd5800aa000 tx=0x7fd580001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd58f59e640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7fd57006c930 0x7fd57006ed50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:27.926 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.919+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== osd.2 v2:172.21.15.143:6824/1592203571 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd57006f420 con 0x7fd57006c930 2023-11-24T06:33:27.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 --> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd59004e850 con 0x7fd57006c930 2023-11-24T06:33:27.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd5877fe640 1 -- 172.21.15.143:0/1162067016 <== osd.2 v2:172.21.15.143:6824/1592203571 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd59004e850 con 0x7fd57006c930 2023-11-24T06:33:27.938 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:27.938 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:27.938 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:27.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7fd57006c930 msgr2=0x7fd57006ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6824/1592203571,v1:172.21.15.143:6825/1592203571] conn(0x7fd57006c930 0x7fd57006ed50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:27.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd570066ad0 msgr2=0x7fd570068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd570066ad0 0x7fd570068f90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd5800aa000 tx=0x7fd580001a80 comp rx=0 tx=0).stop 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd59015beb0 msgr2=0x7fd59015c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 --2- 172.21.15.143:0/1162067016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd59015beb0 0x7fd59015c310 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd578011960 tx=0x7fd578011e20 comp rx=0 tx=0).stop 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd58f59e640 1 -- 172.21.15.143:0/1162067016 reap_dead start 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 shutdown_connections 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 >> 172.21.15.143:0/1162067016 conn(0x7fd5900cb8b0 msgr2=0x7fd59015dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 shutdown_connections 2023-11-24T06:33:27.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:27.935+0000 7fd594a05640 1 -- 172.21.15.143:0/1162067016 wait complete. 2023-11-24T06:33:27.956 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T06:33:28.095 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 Processor -- start 2023-11-24T06:33:28.096 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 -- start start 2023-11-24T06:33:28.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e4815b220 0x7f4e480cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.097 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e480c9650 0x7f4e480c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480abed0 con 0x7f4e4815b600 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e48072710 con 0x7f4e480c9650 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.091+0000 7f4e4d31c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480ca000 con 0x7f4e4815b220 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e480c9650 0x7f4e480c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e480c9650 0x7f4e480c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52608/0 (socket says 172.21.15.143:52608) 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 -- 172.21.15.143:0/1076018117 learned_addr learned my addr 172.21.15.143:0/1076018117 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.098 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e46ffd640 1 --2- 172.21.15.143:0/1076018117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e4815b220 0x7f4e480cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 -- 172.21.15.143:0/1076018117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e4815b220 msgr2=0x7f4e480cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:28.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 --2- 172.21.15.143:0/1076018117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e4815b220 0x7f4e480cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 -- 172.21.15.143:0/1076018117 >> v1:172.21.15.146:6789/0 conn(0x7f4e4815b600 legacy=0x7f4e4806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.099 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 -- 172.21.15.143:0/1076018117 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48072370 con 0x7f4e480c9650 2023-11-24T06:33:28.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e477fe640 1 --2- 172.21.15.143:0/1076018117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e480c9650 0x7f4e480c9ac0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009e80 tx=0x7f4e4001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb511e28aa7aa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e467fc640 1 -- 172.21.15.143:0/1076018117 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400a5880 con 0x7f4e480c9650 2023-11-24T06:33:28.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e467fc640 1 -- 172.21.15.143:0/1076018117 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400a59e0 con 0x7f4e480c9650 2023-11-24T06:33:28.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.095+0000 7f4e467fc640 1 -- 172.21.15.143:0/1076018117 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400a5d70 con 0x7f4e480c9650 2023-11-24T06:33:28.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1076018117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e480c9650 msgr2=0x7f4e480c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1076018117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e480c9650 0x7f4e480c9ac0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009e80 tx=0x7f4e4001c9c0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1076018117 shutdown_connections 2023-11-24T06:33:28.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1076018117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e480c9650 0x7f4e480c9ac0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1076018117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e4815b220 0x7f4e480cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1076018117 >> 172.21.15.143:0/1076018117 conn(0x7f4e480b0bf0 msgr2=0x7f4e480b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1076018117 shutdown_connections 2023-11-24T06:33:28.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1076018117 wait complete. 2023-11-24T06:33:28.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 Processor -- start 2023-11-24T06:33:28.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- start start 2023-11-24T06:33:28.104 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e480c9650 0x7f4e480c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e4815b220 0x7f4e48150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 0x7f4e48151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c5640 con 0x7f4e4815b600 2023-11-24T06:33:28.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c4da0 con 0x7f4e4815b220 2023-11-24T06:33:28.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e4d31c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c5080 con 0x7f4e480c9650 2023-11-24T06:33:28.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 0x7f4e48151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e46ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e480c9650 0x7f4e480c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 0x7f4e48151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52620/0 (socket says 172.21.15.143:52620) 2023-11-24T06:33:28.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 -- 172.21.15.143:0/1490870569 learned_addr learned my addr 172.21.15.143:0/1490870569 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e3ffff640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e4815b220 0x7f4e48150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 -- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e480c9650 msgr2=0x7f4e480c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e480c9650 0x7f4e480c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 -- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e4815b220 msgr2=0x7f4e48150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e4815b220 0x7f4e48150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.099+0000 7f4e477fe640 1 -- 172.21.15.143:0/1490870569 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40009b30 con 0x7f4e4815b600 2023-11-24T06:33:28.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e477fe640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 0x7f4e48151430 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4e4001a5f0 tx=0x7f4e40019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b8670 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400b87f0 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e480c5360 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b8ba0 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e480c4a70 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4813d180 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f4e400b8d00 con 0x7f4e4815b600 2023-11-24T06:33:28.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e3f7fe640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e28066aa0 0x7f4e28068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f4e4011fbb0 con 0x7f4e4815b600 2023-11-24T06:33:28.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.103+0000 7f4e46ffd640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e28066aa0 0x7f4e28068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.107+0000 7f4e46ffd640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e28066aa0 0x7f4e28068f60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4e380045f0 tx=0x7f4e38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.107+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e400ecc30 con 0x7f4e4815b600 2023-11-24T06:33:28.269 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.263+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e4806cc10 con 0x7f4e28066aa0 2023-11-24T06:33:28.270 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.263+0000 7f4e3f7fe640 1 -- 172.21.15.143:0/1490870569 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4e4806cc10 con 0x7f4e28066aa0 2023-11-24T06:33:28.271 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T06:33:28.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e28066aa0 msgr2=0x7f4e28068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e28066aa0 0x7f4e28068f60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4e380045f0 tx=0x7f4e38008040 comp rx=0 tx=0).stop 2023-11-24T06:33:28.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 msgr2=0x7f4e48151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 0x7f4e48151430 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4e4001a5f0 tx=0x7f4e40019760 comp rx=0 tx=0).stop 2023-11-24T06:33:28.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 shutdown_connections 2023-11-24T06:33:28.272 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f4e28066aa0 0x7f4e28068f60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e4815b600 0x7f4e48151430 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e4815b220 0x7f4e48150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 --2- 172.21.15.143:0/1490870569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e480c9650 0x7f4e480c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 >> 172.21.15.143:0/1490870569 conn(0x7f4e480b0bf0 msgr2=0x7f4e480b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 shutdown_connections 2023-11-24T06:33:28.273 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.267+0000 7f4e4d31c640 1 -- 172.21.15.143:0/1490870569 wait complete. 2023-11-24T06:33:28.290 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T06:33:28.290 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:28.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.427+0000 7f7e7d1b4640 1 Processor -- start 2023-11-24T06:33:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.427+0000 7f7e7d1b4640 1 -- start start 2023-11-24T06:33:28.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e7d1b4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e7815d780 0x7f7e780d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e7d1b4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e780b21c0 0x7f7e780d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e7d1b4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780cdd80 con 0x7f7e780d1d00 2023-11-24T06:33:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e7d1b4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780d2170 con 0x7f7e780b21c0 2023-11-24T06:33:28.434 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e7d1b4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780ceb80 con 0x7f7e7815d780 2023-11-24T06:33:28.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e780b21c0 0x7f7e780d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e780b21c0 0x7f7e780d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52624/0 (socket says 172.21.15.143:52624) 2023-11-24T06:33:28.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 -- 172.21.15.143:0/918303170 learned_addr learned my addr 172.21.15.143:0/918303170 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e77fff640 1 --2- 172.21.15.143:0/918303170 >> v2:172.21.15.146:3300/0 conn(0x7f7e7815d780 0x7f7e780d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 -- 172.21.15.143:0/918303170 >> v2:172.21.15.146:3300/0 conn(0x7f7e7815d780 msgr2=0x7f7e780d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:28.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 --2- 172.21.15.143:0/918303170 >> v2:172.21.15.146:3300/0 conn(0x7f7e7815d780 0x7f7e780d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 -- 172.21.15.143:0/918303170 >> v1:172.21.15.146:6789/0 conn(0x7f7e780d1d00 legacy=0x7f7e78161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.437 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.431+0000 7f7e777fe640 1 -- 172.21.15.143:0/918303170 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780b0e20 con 0x7f7e780b21c0 2023-11-24T06:33:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e777fe640 1 --2- 172.21.15.143:0/918303170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e780d17c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7e7808d3b0 tx=0x7f7e6c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e9b43c60cc6c8a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e76ffd640 1 -- 172.21.15.143:0/918303170 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0ac640 con 0x7f7e780b21c0 2023-11-24T06:33:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e76ffd640 1 -- 172.21.15.143:0/918303170 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c0ac7a0 con 0x7f7e780b21c0 2023-11-24T06:33:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e76ffd640 1 -- 172.21.15.143:0/918303170 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0acb30 con 0x7f7e780b21c0 2023-11-24T06:33:28.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/918303170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 msgr2=0x7f7e780d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 --2- 172.21.15.143:0/918303170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e780d17c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7e7808d3b0 tx=0x7f7e6c01c500 comp rx=0 tx=0).stop 2023-11-24T06:33:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/918303170 shutdown_connections 2023-11-24T06:33:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 --2- 172.21.15.143:0/918303170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e780d17c0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 --2- 172.21.15.143:0/918303170 >> v2:172.21.15.146:3300/0 conn(0x7f7e7815d780 0x7f7e780d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/918303170 >> 172.21.15.143:0/918303170 conn(0x7f7e7809c520 msgr2=0x7f7e780d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/918303170 shutdown_connections 2023-11-24T06:33:28.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/918303170 wait complete. 2023-11-24T06:33:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 Processor -- start 2023-11-24T06:33:28.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 -- start start 2023-11-24T06:33:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e781559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.435+0000 7f7e7d1b4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e780d1d00 0x7f7e780c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7815d780 0x7f7e780b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780c9f70 con 0x7f7e780b21c0 2023-11-24T06:33:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780ca3e0 con 0x7f7e7815d780 2023-11-24T06:33:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78155fb0 con 0x7f7e780d1d00 2023-11-24T06:33:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e781559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.444 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e781559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52626/0 (socket says 172.21.15.143:52626) 2023-11-24T06:33:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 -- 172.21.15.143:0/1417479271 learned_addr learned my addr 172.21.15.143:0/1417479271 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e777fe640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e780d1d00 0x7f7e780c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7c9b3640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7815d780 0x7f7e780b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 -- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e780d1d00 msgr2=0x7f7e780c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.445 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e780d1d00 0x7f7e780c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 -- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7815d780 msgr2=0x7f7e780b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7815d780 0x7f7e780b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 -- 172.21.15.143:0/1417479271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0094d0 con 0x7f7e780b21c0 2023-11-24T06:33:28.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7c9b3640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7815d780 0x7f7e780b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:28.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e77fff640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e781559d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800d5f0 tx=0x7f7e6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680125f0 con 0x7f7e780b21c0 2023-11-24T06:33:28.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68012750 con 0x7f7e780b21c0 2023-11-24T06:33:28.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e780ccad0 con 0x7f7e780b21c0 2023-11-24T06:33:28.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012ae0 con 0x7f7e780b21c0 2023-11-24T06:33:28.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e780cd090 con 0x7f7e780b21c0 2023-11-24T06:33:28.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e780d4040 con 0x7f7e780b21c0 2023-11-24T06:33:28.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f7e68012c40 con 0x7f7e780b21c0 2023-11-24T06:33:28.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.439+0000 7f7e74ff9640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e64066aa0 0x7f7e64068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f7e68084b10 con 0x7f7e780b21c0 2023-11-24T06:33:28.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e777fe640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e64066aa0 0x7f7e64068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e74ff9640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f7e6406c900 0x7f7e6406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 --> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e6406f3f0 con 0x7f7e6406c900 2023-11-24T06:33:28.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e680892a0 con 0x7f7e780b21c0 2023-11-24T06:33:28.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e7c9b3640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f7e6406c900 0x7f7e6406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e777fe640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e64066aa0 0x7f7e64068f60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0ae000 tx=0x7f7e6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e7c9b3640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f7e6406c900 0x7f7e6406ed20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.443+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== osd.3 v2:172.21.15.143:6816/2880360154 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7e6406f3f0 con 0x7f7e6406c900 2023-11-24T06:33:28.459 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 --> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7e780ca520 con 0x7f7e6406c900 2023-11-24T06:33:28.460 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e74ff9640 1 -- 172.21.15.143:0/1417479271 <== osd.3 v2:172.21.15.143:6816/2880360154 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7e70001f40 con 0x7f7e6406c900 2023-11-24T06:33:28.460 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:28.460 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:28.460 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:28.461 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f7e6406c900 msgr2=0x7f7e6406ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6816/2880360154,v1:172.21.15.143:6817/2880360154] conn(0x7f7e6406c900 0x7f7e6406ed20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e64066aa0 msgr2=0x7f7e64068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f7e64066aa0 0x7f7e64068f60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0ae000 tx=0x7f7e6c008040 comp rx=0 tx=0).stop 2023-11-24T06:33:28.462 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 msgr2=0x7f7e781559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 --2- 172.21.15.143:0/1417479271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e780b21c0 0x7f7e781559d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800d5f0 tx=0x7f7e6800dab0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7c9b3640 1 -- 172.21.15.143:0/1417479271 reap_dead start 2023-11-24T06:33:28.463 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 shutdown_connections 2023-11-24T06:33:28.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 >> 172.21.15.143:0/1417479271 conn(0x7f7e7809c520 msgr2=0x7f7e7806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 shutdown_connections 2023-11-24T06:33:28.464 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.455+0000 7f7e7d1b4640 1 -- 172.21.15.143:0/1417479271 wait complete. 2023-11-24T06:33:28.479 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T06:33:28.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 Processor -- start 2023-11-24T06:33:28.618 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 -- start start 2023-11-24T06:33:28.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60b40cab60 0x7f60b40caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60b40cb480 0x7f60b406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b40ccbd0 con 0x7f60b406d480 2023-11-24T06:33:28.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b406dac0 con 0x7f60b40cb480 2023-11-24T06:33:28.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60bc06b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b406dda0 con 0x7f60b40cab60 2023-11-24T06:33:28.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60b40cb480 0x7f60b406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60b40cb480 0x7f60b406cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52642/0 (socket says 172.21.15.143:52642) 2023-11-24T06:33:28.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 -- 172.21.15.143:0/364505309 learned_addr learned my addr 172.21.15.143:0/364505309 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.620 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9e07640 1 --2- 172.21.15.143:0/364505309 >> v2:172.21.15.146:3300/0 conn(0x7f60b40cab60 0x7f60b40caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 -- 172.21.15.143:0/364505309 >> v2:172.21.15.146:3300/0 conn(0x7f60b40cab60 msgr2=0x7f60b40caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:28.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 --2- 172.21.15.143:0/364505309 >> v2:172.21.15.146:3300/0 conn(0x7f60b40cab60 0x7f60b40caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 -- 172.21.15.143:0/364505309 >> v1:172.21.15.146:6789/0 conn(0x7f60b406d480 legacy=0x7f60b40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.621 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.615+0000 7f60b9606640 1 -- 172.21.15.143:0/364505309 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b406e080 con 0x7f60b40cb480 2023-11-24T06:33:28.622 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60b9606640 1 --2- 172.21.15.143:0/364505309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b40cb480 0x7f60b406cf40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f60b406eb00 tx=0x7f60a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee697763629833f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60b8e05640 1 -- 172.21.15.143:0/364505309 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40ab600 con 0x7f60b40cb480 2023-11-24T06:33:28.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60b8e05640 1 -- 172.21.15.143:0/364505309 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a40a7050 con 0x7f60b40cb480 2023-11-24T06:33:28.623 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60b8e05640 1 -- 172.21.15.143:0/364505309 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40ab980 con 0x7f60b40cb480 2023-11-24T06:33:28.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 -- 172.21.15.143:0/364505309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b40cb480 msgr2=0x7f60b406cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 --2- 172.21.15.143:0/364505309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b40cb480 0x7f60b406cf40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f60b406eb00 tx=0x7f60a401c500 comp rx=0 tx=0).stop 2023-11-24T06:33:28.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 -- 172.21.15.143:0/364505309 shutdown_connections 2023-11-24T06:33:28.624 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 --2- 172.21.15.143:0/364505309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b40cb480 0x7f60b406cf40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 --2- 172.21.15.143:0/364505309 >> v2:172.21.15.146:3300/0 conn(0x7f60b40cab60 0x7f60b40caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 -- 172.21.15.143:0/364505309 >> 172.21.15.143:0/364505309 conn(0x7f60b40b0bf0 msgr2=0x7f60b40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 -- 172.21.15.143:0/364505309 shutdown_connections 2023-11-24T06:33:28.625 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.619+0000 7f60bc06b640 1 -- 172.21.15.143:0/364505309 wait complete. 2023-11-24T06:33:28.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 Processor -- start 2023-11-24T06:33:28.626 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 -- start start 2023-11-24T06:33:28.627 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 0x7f60b4158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b40cab60 0x7f60b415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b40cb480 0x7f60b40aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b41588c0 con 0x7f60b406d480 2023-11-24T06:33:28.628 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4159a70 con 0x7f60b40cab60 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4159d50 con 0x7f60b40cb480 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 0x7f60b4158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 0x7f60b4158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52650/0 (socket says 172.21.15.143:52650) 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 -- 172.21.15.143:0/3635990096 learned_addr learned my addr 172.21.15.143:0/3635990096 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60ba608640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b40cb480 0x7f60b40aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9606640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b40cab60 0x7f60b415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.629 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 -- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b40cb480 msgr2=0x7f60b40aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b40cb480 0x7f60b40aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 -- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b40cab60 msgr2=0x7f60b415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b40cab60 0x7f60b415bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 -- 172.21.15.143:0/3635990096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40094d0 con 0x7f60b406d480 2023-11-24T06:33:28.630 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60ba608640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b40cb480 0x7f60b40aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:28.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60b9e07640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 0x7f60b4158380 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f60b000d800 tx=0x7f60b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b000b6c0 con 0x7f60b406d480 2023-11-24T06:33:28.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b000b860 con 0x7f60b406d480 2023-11-24T06:33:28.631 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b000bc10 con 0x7f60b406d480 2023-11-24T06:33:28.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b41620e0 con 0x7f60b406d480 2023-11-24T06:33:28.632 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.623+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b41626a0 con 0x7f60b406d480 2023-11-24T06:33:28.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.627+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b409d250 con 0x7f60b406d480 2023-11-24T06:33:28.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.627+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f60b001e460 con 0x7f60b406d480 2023-11-24T06:33:28.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.627+0000 7f60aa7fc640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6098066ad0 0x7f6098068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.627+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f60b0084b20 con 0x7f60b406d480 2023-11-24T06:33:28.633 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.627+0000 7f60b9606640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6098066ad0 0x7f6098068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.627+0000 7f60b9606640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6098066ad0 0x7f6098068f90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ad000 tx=0x7f60a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.634 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.631+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60b0051a40 con 0x7f60b406d480 2023-11-24T06:33:28.783 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.779+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b416e5d0 con 0x7f6098066ad0 2023-11-24T06:33:28.783 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.779+0000 7f60aa7fc640 1 -- 172.21.15.143:0/3635990096 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60a40ab640 con 0x7f6098066ad0 2023-11-24T06:33:28.783 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T06:33:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6098066ad0 msgr2=0x7f6098068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6098066ad0 0x7f6098068f90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ad000 tx=0x7f60a4008040 comp rx=0 tx=0).stop 2023-11-24T06:33:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 msgr2=0x7f60b4158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 0x7f60b4158380 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f60b000d800 tx=0x7f60b000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 shutdown_connections 2023-11-24T06:33:28.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f6098066ad0 0x7f6098068f90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b40cb480 0x7f60b40aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b40cab60 0x7f60b415bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 --2- 172.21.15.143:0/3635990096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60b406d480 0x7f60b4158380 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.786 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 >> 172.21.15.143:0/3635990096 conn(0x7f60b40b0bf0 msgr2=0x7f60b40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 shutdown_connections 2023-11-24T06:33:28.787 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.783+0000 7f60bc06b640 1 -- 172.21.15.143:0/3635990096 wait complete. 2023-11-24T06:33:28.804 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T06:33:28.804 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:28.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98f6535640 1 Processor -- start 2023-11-24T06:33:28.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98f6535640 1 -- start start 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98f6535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98f6535640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f015a700 con 0x7f98f00b36c0 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98f6535640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f00b2620 con 0x7f98f0070da0 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98f6535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00b2430 con 0x7f98f015a320 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98ef7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f98f00b36c0 0x7f98f0070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57710/0 (socket says 172.21.15.143:57710) 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98ef7fe640 1 -- 172.21.15.143:0/1419354396 learned_addr learned my addr 172.21.15.143:0/1419354396 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98effff640 1 --2- 172.21.15.143:0/1419354396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065961793 0 0) 0x7f98f015a700 con 0x7f98f00b36c0 2023-11-24T06:33:28.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d8005740 con 0x7f98f00b36c0 2023-11-24T06:33:28.949 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520992889 0 0) 0x7f98f00b2620 con 0x7f98f0070da0 2023-11-24T06:33:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f015a700 con 0x7f98f0070da0 2023-11-24T06:33:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98effff640 1 -- 172.21.15.143:0/1419354396 >> v1:172.21.15.146:6789/0 conn(0x7f98f0070da0 legacy=0x7f98f015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98effff640 1 -- 172.21.15.143:0/1419354396 >> v1:172.21.15.143:6789/0 conn(0x7f98f00b36c0 legacy=0x7f98f0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770526813 0 0) 0x7f98d8005740 con 0x7f98f00b36c0 2023-11-24T06:33:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.943+0000 7f98effff640 1 -- 172.21.15.143:0/1419354396 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00b2900 con 0x7f98f015a320 2023-11-24T06:33:28.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98effff640 1 --2- 172.21.15.143:0/1419354396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f00b1ef0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097f0 tx=0x7f98e001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ea3156d8f48de3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.951 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4001680 con 0x7f98f015a320 2023-11-24T06:33:28.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00a7050 con 0x7f98f015a320 2023-11-24T06:33:28.952 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98eeffd640 1 -- 172.21.15.143:0/1419354396 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00ab600 con 0x7f98f015a320 2023-11-24T06:33:28.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 -- 172.21.15.143:0/1419354396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 msgr2=0x7f98f00b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.953 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 --2- 172.21.15.143:0/1419354396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f00b1ef0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097f0 tx=0x7f98e001c3b0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 -- 172.21.15.143:0/1419354396 shutdown_connections 2023-11-24T06:33:28.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 --2- 172.21.15.143:0/1419354396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f00b1ef0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 -- 172.21.15.143:0/1419354396 >> 172.21.15.143:0/1419354396 conn(0x7f98f00b0bf0 msgr2=0x7f98f00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 -- 172.21.15.143:0/1419354396 shutdown_connections 2023-11-24T06:33:28.954 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.947+0000 7f98f6535640 1 -- 172.21.15.143:0/1419354396 wait complete. 2023-11-24T06:33:28.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 Processor -- start 2023-11-24T06:33:28.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 -- start start 2023-11-24T06:33:28.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f0070da0 0x7f98f01516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f00b36c0 0x7f98f009b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f0159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.957 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f009b470 con 0x7f98f0070da0 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f009a860 con 0x7f98f00b36c0 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f009ab40 con 0x7f98f015a320 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f0070da0 0x7f98f01516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f0070da0 0x7f98f01516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52662/0 (socket says 172.21.15.143:52662) 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 -- 172.21.15.143:0/4172370591 learned_addr learned my addr 172.21.15.143:0/4172370591 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98ef7fe640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f00b36c0 0x7f98f009b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f4ad2640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.958 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 -- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 msgr2=0x7f98f0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f015a320 0x7f98f0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 -- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f00b36c0 msgr2=0x7f98f009b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f00b36c0 0x7f98f009b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 -- 172.21.15.143:0/4172370591 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009420 con 0x7f98f0070da0 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98ef7fe640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f00b36c0 0x7f98f009b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98effff640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f0070da0 0x7f98f01516e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097f0 tx=0x7f98e0019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00be070 con 0x7f98f0070da0 2023-11-24T06:33:28.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0006e20 con 0x7f98f0070da0 2023-11-24T06:33:28.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00abce0 con 0x7f98f0070da0 2023-11-24T06:33:28.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f009ae20 con 0x7f98f0070da0 2023-11-24T06:33:28.960 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.951+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f0151df0 con 0x7f98f0070da0 2023-11-24T06:33:28.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98f0067520 con 0x7f98f0070da0 2023-11-24T06:33:28.961 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f98e00b2040 con 0x7f98f0070da0 2023-11-24T06:33:28.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ecff9640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98dc066aa0 0x7f98dc068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f98e011edf0 con 0x7f98f0070da0 2023-11-24T06:33:28.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ef7fe640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98dc066aa0 0x7f98dc068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ecff9640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f98dc06c900 0x7f98dc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:28.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 --> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98dc06f3f0 con 0x7f98dc06c900 2023-11-24T06:33:28.962 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e011f050 con 0x7f98f0070da0 2023-11-24T06:33:28.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98f4ad2640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f98dc06c900 0x7f98dc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:28.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98ef7fe640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98dc066aa0 0x7f98dc068f60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98f015dce0 tx=0x7f98e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.955+0000 7f98f4ad2640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f98dc06c900 0x7f98dc06ed20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:28.963 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.959+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== osd.4 v2:172.21.15.146:6801/3450437685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f98dc06f3f0 con 0x7f98dc06c900 2023-11-24T06:33:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 --> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98f009b2d0 con 0x7f98dc06c900 2023-11-24T06:33:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98ecff9640 1 -- 172.21.15.143:0/4172370591 <== osd.4 v2:172.21.15.146:6801/3450437685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f98e8001a80 con 0x7f98dc06c900 2023-11-24T06:33:28.976 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:28.976 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:28.976 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f98dc06c900 msgr2=0x7f98dc06ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.146:6801/3450437685,v1:172.21.15.146:6803/3450437685] conn(0x7f98dc06c900 0x7f98dc06ed20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98dc066aa0 msgr2=0x7f98dc068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f98dc066aa0 0x7f98dc068f60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98f015dce0 tx=0x7f98e4009040 comp rx=0 tx=0).stop 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f0070da0 msgr2=0x7f98f01516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 --2- 172.21.15.143:0/4172370591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f0070da0 0x7f98f01516e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097f0 tx=0x7f98e0019150 comp rx=0 tx=0).stop 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f4ad2640 1 -- 172.21.15.143:0/4172370591 reap_dead start 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 shutdown_connections 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 >> 172.21.15.143:0/4172370591 conn(0x7f98f00b0bf0 msgr2=0x7f98f00aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 shutdown_connections 2023-11-24T06:33:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:28.971+0000 7f98f6535640 1 -- 172.21.15.143:0/4172370591 wait complete. 2023-11-24T06:33:28.994 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T06:33:29.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.127+0000 7f11dc8aa640 1 Processor -- start 2023-11-24T06:33:29.133 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.127+0000 7f11dc8aa640 1 -- start start 2023-11-24T06:33:29.135 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11dc8aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f11d80ce8b0 0x7f11d80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.137 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11dc8aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d806c0e0 con 0x7f11d80d3020 2023-11-24T06:33:29.139 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11dc8aa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d80d1cc0 con 0x7f11d815d570 2023-11-24T06:33:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11dc8aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80d1fa0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f11d80ce8b0 0x7f11d80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f11d80ce8b0 0x7f11d80ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52674/0 (socket says 172.21.15.143:52674) 2023-11-24T06:33:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d6d9d640 1 -- 172.21.15.143:0/4281659127 learned_addr learned my addr 172.21.15.143:0/4281659127 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d5d9b640 1 --1- 172.21.15.143:0/4281659127 >> v1:172.21.15.143:6789/0 conn(0x7f11d80d3020 0x7f11d80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57722/0 (socket says 172.21.15.143:57722) 2023-11-24T06:33:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d6d9d640 1 -- 172.21.15.143:0/4281659127 >> v1:172.21.15.146:6789/0 conn(0x7f11d815d570 legacy=0x7f11d806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:29.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d6d9d640 1 -- 172.21.15.143:0/4281659127 >> v1:172.21.15.143:6789/0 conn(0x7f11d80d3020 legacy=0x7f11d80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d6d9d640 1 -- 172.21.15.143:0/4281659127 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80ce0b0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.142 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.131+0000 7f11d559a640 1 -- 172.21.15.143:0/4281659127 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177989685 0 0) 0x7f11d806c0e0 con 0x7f11d80d3020 2023-11-24T06:33:29.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11d6d9d640 1 --2- 172.21.15.143:0/4281659127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d80ced60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009e50 tx=0x7f11d001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d37574303b07fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.144 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11d559a640 1 -- 172.21.15.143:0/4281659127 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d00a58a0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11d559a640 1 -- 172.21.15.143:0/4281659127 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d00a5a00 con 0x7f11d80ce8b0 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11d559a640 1 -- 172.21.15.143:0/4281659127 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d00a5d90 con 0x7f11d80ce8b0 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 -- 172.21.15.143:0/4281659127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 msgr2=0x7f11d80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/4281659127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d80ced60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009e50 tx=0x7f11d001c9e0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 -- 172.21.15.143:0/4281659127 shutdown_connections 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/4281659127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d80ced60 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 -- 172.21.15.143:0/4281659127 >> 172.21.15.143:0/4281659127 conn(0x7f11d808ceb0 msgr2=0x7f11d809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.145 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 -- 172.21.15.143:0/4281659127 shutdown_connections 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 -- 172.21.15.143:0/4281659127 wait complete. 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 Processor -- start 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.135+0000 7f11dc8aa640 1 -- start start 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d80d3020 0x7f11d8160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d815d570 0x7f11d8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c88a0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.146 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d815de90 con 0x7f11d80d3020 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c8410 con 0x7f11d815d570 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d815fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52682/0 (socket says 172.21.15.143:52682) 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 -- 172.21.15.143:0/1376282863 learned_addr learned my addr 172.21.15.143:0/1376282863 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 -- 172.21.15.143:0/1376282863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d815d570 msgr2=0x7f11d8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d815d570 0x7f11d8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 -- 172.21.15.143:0/1376282863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d80d3020 msgr2=0x7f11d8160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d80d3020 0x7f11d8160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.147 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 -- 172.21.15.143:0/1376282863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0009b30 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11d659c640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d815fee0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f11c800c3f0 tx=0x7f11c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80052d0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8005430 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8003840 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d80c7ae0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d80c80a0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d804e930 con 0x7f11d80ce8b0 2023-11-24T06:33:29.148 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.139+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f11c80039a0 con 0x7f11d80ce8b0 2023-11-24T06:33:29.149 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.143+0000 7f11c6ffd640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11b8066aa0 0x7f11b8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.143+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f11c8083c00 con 0x7f11d80ce8b0 2023-11-24T06:33:29.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.143+0000 7f11d5d9b640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11b8066aa0 0x7f11b8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.143+0000 7f11d5d9b640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11b8066aa0 0x7f11b8068f60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000c10 tx=0x7f11cc007910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.154 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.147+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11c8050a20 con 0x7f11d80ce8b0 2023-11-24T06:33:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.295+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d809c940 con 0x7f11b8066aa0 2023-11-24T06:33:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.295+0000 7f11c6ffd640 1 -- 172.21.15.143:0/1376282863 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f11d809c940 con 0x7f11b8066aa0 2023-11-24T06:33:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T06:33:29.302 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11b8066aa0 msgr2=0x7f11b8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11b8066aa0 0x7f11b8068f60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000c10 tx=0x7f11cc007910 comp rx=0 tx=0).stop 2023-11-24T06:33:29.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 msgr2=0x7f11d815fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d815fee0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f11c800c3f0 tx=0x7f11c800c8b0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 shutdown_connections 2023-11-24T06:33:29.303 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f11b8066aa0 0x7f11b8068f60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d815d570 0x7f11d8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d80d3020 0x7f11d8160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 --2- 172.21.15.143:0/1376282863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11d80ce8b0 0x7f11d815fee0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 >> 172.21.15.143:0/1376282863 conn(0x7f11d808ceb0 msgr2=0x7f11d80cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 shutdown_connections 2023-11-24T06:33:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.299+0000 7f11dc8aa640 1 -- 172.21.15.143:0/1376282863 wait complete. 2023-11-24T06:33:29.321 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T06:33:29.322 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.459+0000 7f8acaed3640 1 Processor -- start 2023-11-24T06:33:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8acaed3640 1 -- start start 2023-11-24T06:33:29.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8acaed3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158aa0 0x7f8ac415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8acaed3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ac40ce910 0x7f8ac40b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.466 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8acaed3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac406c6e0 con 0x7f8ac4158e80 2023-11-24T06:33:29.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8acaed3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac406d580 con 0x7f8ac40ce910 2023-11-24T06:33:29.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8acaed3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac415c010 con 0x7f8ac4158aa0 2023-11-24T06:33:29.467 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac9ed1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158aa0 0x7f8ac415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac96d0640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ac4158e80 0x7f8ac406ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:52934/0 (socket says 172.21.15.143:52934) 2023-11-24T06:33:29.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac96d0640 1 -- 172.21.15.143:0/1596189830 learned_addr learned my addr 172.21.15.143:0/1596189830 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:29.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8aca6d2640 1 --2- 172.21.15.143:0/1596189830 >> v2:172.21.15.146:3300/0 conn(0x7f8ac40ce910 0x7f8ac40b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac9ed1640 1 -- 172.21.15.143:0/1596189830 >> v2:172.21.15.146:3300/0 conn(0x7f8ac40ce910 msgr2=0x7f8ac40b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:29.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac9ed1640 1 --2- 172.21.15.143:0/1596189830 >> v2:172.21.15.146:3300/0 conn(0x7f8ac40ce910 0x7f8ac40b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.468 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac9ed1640 1 -- 172.21.15.143:0/1596189830 >> v1:172.21.15.146:6789/0 conn(0x7f8ac4158e80 legacy=0x7f8ac406ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac9ed1640 1 -- 172.21.15.143:0/1596189830 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac415c2f0 con 0x7f8ac4158aa0 2023-11-24T06:33:29.469 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.463+0000 7f8ac8ecf640 1 -- 172.21.15.143:0/1596189830 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980932256 0 0) 0x7f8ac406c6e0 con 0x7f8ac4158e80 2023-11-24T06:33:29.470 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8ac9ed1640 1 --2- 172.21.15.143:0/1596189830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158aa0 0x7f8ac415b720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00097c0 tx=0x7f8ac001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3042ac26915e2b6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8ac8ecf640 1 -- 172.21.15.143:0/1596189830 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00ad660 con 0x7f8ac4158aa0 2023-11-24T06:33:29.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8ac8ecf640 1 -- 172.21.15.143:0/1596189830 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac00ad7c0 con 0x7f8ac4158aa0 2023-11-24T06:33:29.471 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8ac8ecf640 1 -- 172.21.15.143:0/1596189830 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00adb50 con 0x7f8ac4158aa0 2023-11-24T06:33:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 -- 172.21.15.143:0/1596189830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158aa0 msgr2=0x7f8ac415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 --2- 172.21.15.143:0/1596189830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158aa0 0x7f8ac415b720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00097c0 tx=0x7f8ac001c450 comp rx=0 tx=0).stop 2023-11-24T06:33:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 -- 172.21.15.143:0/1596189830 shutdown_connections 2023-11-24T06:33:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 --2- 172.21.15.143:0/1596189830 >> v2:172.21.15.146:3300/0 conn(0x7f8ac40ce910 0x7f8ac40b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 --2- 172.21.15.143:0/1596189830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158aa0 0x7f8ac415b720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 -- 172.21.15.143:0/1596189830 >> 172.21.15.143:0/1596189830 conn(0x7f8ac40cb8b0 msgr2=0x7f8ac40cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 -- 172.21.15.143:0/1596189830 shutdown_connections 2023-11-24T06:33:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.467+0000 7f8acaed3640 1 -- 172.21.15.143:0/1596189830 wait complete. 2023-11-24T06:33:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 Processor -- start 2023-11-24T06:33:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- start start 2023-11-24T06:33:29.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac40ce910 0x7f8ac415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ac4158aa0 0x7f8ac4151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.475 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158e80 0x7f8ac4152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4151980 con 0x7f8ac4158aa0 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4150d70 con 0x7f8ac40ce910 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4151330 con 0x7f8ac4158e80 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ac4158aa0 0x7f8ac4151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ac4158aa0 0x7f8ac4151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52696/0 (socket says 172.21.15.143:52696) 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 -- 172.21.15.143:0/3156643716 learned_addr learned my addr 172.21.15.143:0/3156643716 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8aca6d2640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158e80 0x7f8ac4152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac9ed1640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac40ce910 0x7f8ac415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 -- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158e80 msgr2=0x7f8ac4152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac4158e80 0x7f8ac4152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 -- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac40ce910 msgr2=0x7f8ac415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac40ce910 0x7f8ac415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 -- 172.21.15.143:0/3156643716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009420 con 0x7f8ac4158aa0 2023-11-24T06:33:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8ac96d0640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ac4158aa0 0x7f8ac4151e10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c4e0 tx=0x7f8ab400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40074e0 con 0x7f8ac4158aa0 2023-11-24T06:33:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4007660 con 0x7f8ac4158aa0 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4004a80 con 0x7f8ac4158aa0 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac4151610 con 0x7f8ac4158aa0 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac415d1e0 con 0x7f8ac4158aa0 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.471+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ac4151190 con 0x7f8ac4158aa0 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f8ab4012400 con 0x7f8ac4158aa0 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aba7fc640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8aa8066aa0 0x7f8aa8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f8ab4083ff0 con 0x7f8ac4158aa0 2023-11-24T06:33:29.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8ac9ed1640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8aa8066aa0 0x7f8aa8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aba7fc640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f8aa806c900 0x7f8aa806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 --> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8aa806f3f0 con 0x7f8aa806c900 2023-11-24T06:33:29.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab4084250 con 0x7f8ac4158aa0 2023-11-24T06:33:29.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aca6d2640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f8aa806c900 0x7f8aa806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.481 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8ac9ed1640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8aa8066aa0 0x7f8aa8068f60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00af000 tx=0x7f8ac0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.475+0000 7f8aca6d2640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f8aa806c900 0x7f8aa806ed20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.482 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.479+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== osd.5 v2:172.21.15.146:6816/714537045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8aa806f3f0 con 0x7f8aa806c900 2023-11-24T06:33:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 --> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ac404e850 con 0x7f8aa806c900 2023-11-24T06:33:29.494 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8aba7fc640 1 -- 172.21.15.143:0/3156643716 <== osd.5 v2:172.21.15.146:6816/714537045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8ac404e850 con 0x7f8aa806c900 2023-11-24T06:33:29.495 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:29.495 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:29.495 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f8aa806c900 msgr2=0x7f8aa806ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.146:6816/714537045,v1:172.21.15.146:6817/714537045] conn(0x7f8aa806c900 0x7f8aa806ed20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8aa8066aa0 msgr2=0x7f8aa8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8aa8066aa0 0x7f8aa8068f60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00af000 tx=0x7f8ac0008040 comp rx=0 tx=0).stop 2023-11-24T06:33:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ac4158aa0 msgr2=0x7f8ac4151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 --2- 172.21.15.143:0/3156643716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ac4158aa0 0x7f8ac4151e10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c4e0 tx=0x7f8ab400c9a0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8aca6d2640 1 -- 172.21.15.143:0/3156643716 reap_dead start 2023-11-24T06:33:29.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 shutdown_connections 2023-11-24T06:33:29.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 >> 172.21.15.143:0/3156643716 conn(0x7f8ac40cb8b0 msgr2=0x7f8ac40b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 shutdown_connections 2023-11-24T06:33:29.497 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.491+0000 7f8acaed3640 1 -- 172.21.15.143:0/3156643716 wait complete. 2023-11-24T06:33:29.513 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T06:33:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 Processor -- start 2023-11-24T06:33:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 -- start start 2023-11-24T06:33:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3380cb390 0x7fd338072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd338070600 0x7fd3380b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380b1490 con 0x7fd3380b1090 2023-11-24T06:33:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33806d5f0 con 0x7fd338070600 2023-11-24T06:33:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33e7b4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33815bb80 con 0x7fd3380cb390 2023-11-24T06:33:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.647+0000 7fd33cfb1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd338070600 0x7fd3380b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd338070600 0x7fd3380b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52702/0 (socket says 172.21.15.143:52702) 2023-11-24T06:33:29.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 -- 172.21.15.143:0/773446409 learned_addr learned my addr 172.21.15.143:0/773446409 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:29.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33d7b2640 1 --2- 172.21.15.143:0/773446409 >> v2:172.21.15.146:3300/0 conn(0x7fd3380cb390 0x7fd338072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.654 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 -- 172.21.15.143:0/773446409 >> v2:172.21.15.146:3300/0 conn(0x7fd3380cb390 msgr2=0x7fd338072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 --2- 172.21.15.143:0/773446409 >> v2:172.21.15.146:3300/0 conn(0x7fd3380cb390 0x7fd338072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 -- 172.21.15.143:0/773446409 >> v1:172.21.15.143:6789/0 conn(0x7fd3380b1090 legacy=0x7fd3380c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 -- 172.21.15.143:0/773446409 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33815be60 con 0x7fd338070600 2023-11-24T06:33:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33d7b2640 1 --2- 172.21.15.143:0/773446409 >> v2:172.21.15.146:3300/0 conn(0x7fd3380cb390 0x7fd338072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd33cfb1640 1 --2- 172.21.15.143:0/773446409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd3380b0b50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd338072ab0 tx=0x7fd32801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614ab4f45a32d692 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd32ffff640 1 -- 172.21.15.143:0/773446409 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a8050 con 0x7fd338070600 2023-11-24T06:33:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd32ffff640 1 -- 172.21.15.143:0/773446409 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3280ac5f0 con 0x7fd338070600 2023-11-24T06:33:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.651+0000 7fd32ffff640 1 -- 172.21.15.143:0/773446409 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280ac980 con 0x7fd338070600 2023-11-24T06:33:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- 172.21.15.143:0/773446409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 msgr2=0x7fd3380b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/773446409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd3380b0b50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd338072ab0 tx=0x7fd32801c470 comp rx=0 tx=0).stop 2023-11-24T06:33:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- 172.21.15.143:0/773446409 shutdown_connections 2023-11-24T06:33:29.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/773446409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd3380b0b50 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/773446409 >> v2:172.21.15.146:3300/0 conn(0x7fd3380cb390 0x7fd338072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- 172.21.15.143:0/773446409 >> 172.21.15.143:0/773446409 conn(0x7fd3380cbb50 msgr2=0x7fd3380cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.659 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- 172.21.15.143:0/773446409 shutdown_connections 2023-11-24T06:33:29.660 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- 172.21.15.143:0/773446409 wait complete. 2023-11-24T06:33:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 Processor -- start 2023-11-24T06:33:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- start start 2023-11-24T06:33:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd33815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3380b1090 0x7fd3380ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3380cb390 0x7fd338155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338099a80 con 0x7fd338070600 2023-11-24T06:33:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338099d60 con 0x7fd3380b1090 2023-11-24T06:33:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33e7b4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33809a040 con 0x7fd3380cb390 2023-11-24T06:33:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd33815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd33815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52708/0 (socket says 172.21.15.143:52708) 2023-11-24T06:33:29.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 -- 172.21.15.143:0/1062063682 learned_addr learned my addr 172.21.15.143:0/1062063682 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:29.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 -- 172.21.15.143:0/1062063682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3380cb390 msgr2=0x7fd338155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.664 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3380cb390 0x7fd338155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 -- 172.21.15.143:0/1062063682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3380b1090 msgr2=0x7fd3380ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3380b1090 0x7fd3380ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 -- 172.21.15.143:0/1062063682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280094d0 con 0x7fd338070600 2023-11-24T06:33:29.665 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.655+0000 7fd33d7b2640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd33815a4f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd33400e810 tx=0x7fd33400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400c8d0 con 0x7fd338070600 2023-11-24T06:33:29.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400ca30 con 0x7fd338070600 2023-11-24T06:33:29.666 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400cdc0 con 0x7fd338070600 2023-11-24T06:33:29.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33809a320 con 0x7fd338070600 2023-11-24T06:33:29.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33809c370 con 0x7fd338070600 2023-11-24T06:33:29.667 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33804e850 con 0x7fd338070600 2023-11-24T06:33:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fd334013410 con 0x7fd338070600 2023-11-24T06:33:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd32dffb640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd31c066aa0 0x7fd31c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fd334084660 con 0x7fd338070600 2023-11-24T06:33:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd33cfb1640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd31c066aa0 0x7fd31c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.659+0000 7fd33cfb1640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd31c066aa0 0x7fd31c068f60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd3280ae000 tx=0x7fd328004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.663+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd334051330 con 0x7fd338070600 2023-11-24T06:33:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3380725c0 con 0x7fd31c066aa0 2023-11-24T06:33:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd32dffb640 1 -- 172.21.15.143:0/1062063682 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3280ac760 con 0x7fd31c066aa0 2023-11-24T06:33:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T06:33:29.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd31c066aa0 msgr2=0x7fd31c068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.819 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd31c066aa0 0x7fd31c068f60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd3280ae000 tx=0x7fd328004740 comp rx=0 tx=0).stop 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 msgr2=0x7fd33815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd33815a4f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd33400e810 tx=0x7fd33400ecd0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 shutdown_connections 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fd31c066aa0 0x7fd31c068f60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3380cb390 0x7fd338155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3380b1090 0x7fd3380ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 --2- 172.21.15.143:0/1062063682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd338070600 0x7fd33815a4f0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 >> 172.21.15.143:0/1062063682 conn(0x7fd3380cbb50 msgr2=0x7fd33815d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 shutdown_connections 2023-11-24T06:33:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.815+0000 7fd33e7b4640 1 -- 172.21.15.143:0/1062063682 wait complete. 2023-11-24T06:33:29.838 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T06:33:29.839 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.975+0000 7fe4a19c1640 1 Processor -- start 2023-11-24T06:33:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.975+0000 7fe4a19c1640 1 -- start start 2023-11-24T06:33:29.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe4a19c1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe49c0d1d30 0x7fe49c0b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe4a19c1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0cf4f0 con 0x7fe49c0d18d0 2023-11-24T06:33:29.981 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe4a19c1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0b0540 con 0x7fe49c160cb0 2023-11-24T06:33:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe4a19c1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0cef30 con 0x7fe49c0d1d30 2023-11-24T06:33:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe493fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe49c0d18d0 0x7fe49c0b09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:57730/0 (socket says 172.21.15.143:57730) 2023-11-24T06:33:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe493fff640 1 -- 172.21.15.143:0/967083872 learned_addr learned my addr 172.21.15.143:0/967083872 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/967083872 >> v2:172.21.15.146:3300/0 conn(0x7fe49c0d1d30 0x7fe49c0b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212345873 0 0) 0x7fe49c0cf4f0 con 0x7fe49c0d18d0 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe488003530 con 0x7fe49c0d18d0 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501483029 0 0) 0x7fe49c0b0540 con 0x7fe49c160cb0 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe49c0cf4f0 con 0x7fe49c160cb0 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386176907 0 0) 0x7fe488003530 con 0x7fe49c0d18d0 2023-11-24T06:33:29.985 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 >> v2:172.21.15.146:3300/0 conn(0x7fe49c0d1d30 msgr2=0x7fe49c0b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 --2- 172.21.15.143:0/967083872 >> v2:172.21.15.146:3300/0 conn(0x7fe49c0d1d30 0x7fe49c0b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 >> v1:172.21.15.146:6789/0 conn(0x7fe49c160cb0 legacy=0x7fe49c0d3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0cf210 con 0x7fe49c0d18d0 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fe484001680 con 0x7fe49c0d18d0 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 >> v1:172.21.15.143:6789/0 conn(0x7fe49c0d18d0 legacy=0x7fe49c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488003b10 0x7fe488003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4880047d0 0x7fe488004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe48800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cef30 con 0x7fe488005190 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48800c010 con 0x7fe4880047d0 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48800c1d0 con 0x7fe488003b10 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe48800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49affd640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488003b10 0x7fe488003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe493fff640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4880047d0 0x7fe488004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 -- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488003b10 msgr2=0x7fe488003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488003b10 0x7fe488003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 -- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4880047d0 msgr2=0x7fe488004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4880047d0 0x7fe488004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.979+0000 7fe49b7fe640 1 -- 172.21.15.143:0/967083872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488003530 con 0x7fe488005190 2023-11-24T06:33:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe49b7fe640 1 -- 172.21.15.143:0/967083872 reap_dead start 2023-11-24T06:33:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe48800b990 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe494009fc0 tx=0x7fe49401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9a27111cc62a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484007ea0 con 0x7fe488005190 2023-11-24T06:33:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400f040 con 0x7fe488005190 2023-11-24T06:33:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe49a7fc640 1 -- 172.21.15.143:0/967083872 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494003e20 con 0x7fe488005190 2023-11-24T06:33:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 -- 172.21.15.143:0/967083872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 msgr2=0x7fe48800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe48800b990 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe494009fc0 tx=0x7fe49401cca0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 -- 172.21.15.143:0/967083872 shutdown_connections 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 --2- 172.21.15.143:0/967083872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe48800b990 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 -- 172.21.15.143:0/967083872 >> 172.21.15.143:0/967083872 conn(0x7fe49c08af70 msgr2=0x7fe49c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 -- 172.21.15.143:0/967083872 shutdown_connections 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 -- 172.21.15.143:0/967083872 wait complete. 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.983+0000 7fe4a19c1640 1 Processor -- start 2023-11-24T06:33:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- start start 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe49c0cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe49c0cc7d0 0x7fe49c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe49c0b8940 0x7fe49c0b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cb730 con 0x7fe488005190 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cba10 con 0x7fe49c0b8940 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cbcf0 con 0x7fe49c0cc7d0 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe49c0cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe49c0cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52730/0 (socket says 172.21.15.143:52730) 2023-11-24T06:33:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 -- 172.21.15.143:0/292330621 learned_addr learned my addr 172.21.15.143:0/292330621 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe493fff640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe49c0cc7d0 0x7fe49c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe49c0b8940 0x7fe49c0b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 -- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe49c0cc7d0 msgr2=0x7fe49c146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe49c0cc7d0 0x7fe49c146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 -- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe49c0b8940 msgr2=0x7fe49c0b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe49c0b8940 0x7fe49c0b8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 -- 172.21.15.143:0/292330621 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0cbfd0 con 0x7fe488005190 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe493fff640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe49c0cc7d0 0x7fe49c146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe49affd640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe49c0cb090 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00f770 tx=0x7fe48c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c005110 con 0x7fe488005190 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c005270 con 0x7fe488005190 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c007030 con 0x7fe488005190 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c0cc2b0 con 0x7fe488005190 2023-11-24T06:33:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c146790 con 0x7fe488005190 2023-11-24T06:33:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.987+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe49c0b26e0 con 0x7fe488005190 2023-11-24T06:33:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fe48c007190 con 0x7fe488005190 2023-11-24T06:33:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe47c066ad0 0x7fe47c068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fe48c083e90 con 0x7fe488005190 2023-11-24T06:33:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe493fff640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe47c066ad0 0x7fe47c068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7fe47c06c930 0x7fe47c06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 --> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe47c06f420 con 0x7fe47c06c930 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe48c089370 con 0x7fe488005190 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7fe47c06c930 0x7fe47c06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe493fff640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe47c066ad0 0x7fe47c068f90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe484001060 tx=0x7fe484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe49b7fe640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7fe47c06c930 0x7fe47c06ed50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:29.998 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:29.991+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== osd.6 v2:172.21.15.146:6824/2587602061 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe47c06f420 con 0x7fe47c06c930 2023-11-24T06:33:30.008 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.003+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 --> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe49c0d21c0 con 0x7fe47c06c930 2023-11-24T06:33:30.009 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe498ff9640 1 -- 172.21.15.143:0/292330621 <== osd.6 v2:172.21.15.146:6824/2587602061 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe4940a5ac0 con 0x7fe47c06c930 2023-11-24T06:33:30.009 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:30.009 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:30.010 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:30.010 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7fe47c06c930 msgr2=0x7fe47c06ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.146:6824/2587602061,v1:172.21.15.146:6825/2587602061] conn(0x7fe47c06c930 0x7fe47c06ed50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe47c066ad0 msgr2=0x7fe47c068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fe47c066ad0 0x7fe47c068f90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe484001060 tx=0x7fe484009040 comp rx=0 tx=0).stop 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 msgr2=0x7fe49c0cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 --2- 172.21.15.143:0/292330621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe488005190 0x7fe49c0cb090 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00f770 tx=0x7fe48c00fc30 comp rx=0 tx=0).stop 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe49b7fe640 1 -- 172.21.15.143:0/292330621 reap_dead start 2023-11-24T06:33:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 shutdown_connections 2023-11-24T06:33:30.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 >> 172.21.15.143:0/292330621 conn(0x7fe49c08af70 msgr2=0x7fe49c06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 shutdown_connections 2023-11-24T06:33:30.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.007+0000 7fe4a19c1640 1 -- 172.21.15.143:0/292330621 wait complete. 2023-11-24T06:33:30.028 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T06:33:30.167 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.163+0000 7f8f73f72640 1 Processor -- start 2023-11-24T06:33:30.168 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.163+0000 7f8f73f72640 1 -- start start 2023-11-24T06:33:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f73f72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c15a4d0 0x7f8f6c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f73f72640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f6c0cad20 0x7f8f6c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f73f72640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c15a8b0 con 0x7f8f6c06d740 2023-11-24T06:33:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f73f72640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c9c30 con 0x7f8f6c0cad20 2023-11-24T06:33:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f73f72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c15ee80 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f71d0e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c15a4d0 0x7f8f6c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f7250f640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8f6c06d740 0x7f8f6c0cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.143:52948/0 (socket says 172.21.15.143:52948) 2023-11-24T06:33:30.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f7250f640 1 -- 172.21.15.143:0/2127869608 learned_addr learned my addr 172.21.15.143:0/2127869608 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:30.170 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f7150d640 1 --2- 172.21.15.143:0/2127869608 >> v2:172.21.15.146:3300/0 conn(0x7f8f6c0cad20 0x7f8f6c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f70d0c640 1 -- 172.21.15.143:0/2127869608 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720679727 0 0) 0x7f8f6c15a8b0 con 0x7f8f6c06d740 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f70d0c640 1 -- 172.21.15.143:0/2127869608 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f58005740 con 0x7f8f6c06d740 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f71d0e640 1 -- 172.21.15.143:0/2127869608 >> v2:172.21.15.146:3300/0 conn(0x7f8f6c0cad20 msgr2=0x7f8f6c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f71d0e640 1 --2- 172.21.15.143:0/2127869608 >> v2:172.21.15.146:3300/0 conn(0x7f8f6c0cad20 0x7f8f6c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f71d0e640 1 -- 172.21.15.143:0/2127869608 >> v1:172.21.15.146:6789/0 conn(0x7f8f6c06d740 legacy=0x7f8f6c0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f71d0e640 1 -- 172.21.15.143:0/2127869608 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0c9f60 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.171 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.167+0000 7f8f7150d640 1 --2- 172.21.15.143:0/2127869608 >> v2:172.21.15.146:3300/0 conn(0x7f8f6c0cad20 0x7f8f6c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:33:30.172 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f71d0e640 1 --2- 172.21.15.143:0/2127869608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c15a4d0 0x7f8f6c0c9650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f680097c0 tx=0x7f8f6801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42a669ba6c6f7a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f70d0c640 1 -- 172.21.15.143:0/2127869608 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680ac620 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f70d0c640 1 -- 172.21.15.143:0/2127869608 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680ac780 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f70d0c640 1 -- 172.21.15.143:0/2127869608 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680acb10 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- 172.21.15.143:0/2127869608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c15a4d0 msgr2=0x7f8f6c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 --2- 172.21.15.143:0/2127869608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c15a4d0 0x7f8f6c0c9650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f680097c0 tx=0x7f8f6801c3c0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- 172.21.15.143:0/2127869608 shutdown_connections 2023-11-24T06:33:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 --2- 172.21.15.143:0/2127869608 >> v2:172.21.15.146:3300/0 conn(0x7f8f6c0cad20 0x7f8f6c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 --2- 172.21.15.143:0/2127869608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c15a4d0 0x7f8f6c0c9650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- 172.21.15.143:0/2127869608 >> 172.21.15.143:0/2127869608 conn(0x7f8f6c0b0bf0 msgr2=0x7f8f6c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- 172.21.15.143:0/2127869608 shutdown_connections 2023-11-24T06:33:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- 172.21.15.143:0/2127869608 wait complete. 2023-11-24T06:33:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 Processor -- start 2023-11-24T06:33:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- start start 2023-11-24T06:33:30.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06d740 0x7f8f6c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c0cad20 0x7f8f6c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 0x7f8f6c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c14fc60 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c163460 con 0x7f8f6c06d740 2023-11-24T06:33:30.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.171+0000 7f8f73f72640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1511f0 con 0x7f8f6c0cad20 2023-11-24T06:33:30.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 0x7f8f6c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 0x7f8f6c152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52746/0 (socket says 172.21.15.143:52746) 2023-11-24T06:33:30.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 -- 172.21.15.143:0/350865635 learned_addr learned my addr 172.21.15.143:0/350865635 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:30.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7150d640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c0cad20 0x7f8f6c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f71d0e640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06d740 0x7f8f6c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 -- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c0cad20 msgr2=0x7f8f6c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c0cad20 0x7f8f6c1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 -- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06d740 msgr2=0x7f8f6c14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06d740 0x7f8f6c14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 -- 172.21.15.143:0/350865635 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009420 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f7250f640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 0x7f8f6c152860 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400cb40 tx=0x7f8f6400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400aca0 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6400ae00 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f68009420 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012620 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c06e0e0 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c09d250 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.175+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f8f64007070 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.179+0000 7f8f627fc640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066aa0 0x7f8f50068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.179+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f8f640846e0 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.179+0000 7f8f71d0e640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066aa0 0x7f8f50068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.179+0000 7f8f71d0e640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066aa0 0x7f8f50068f60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8f680ae000 tx=0x7f8f680a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.183+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f64051570 con 0x7f8f6c15a4d0 2023-11-24T06:33:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f6c06df60 con 0x7f8f50066aa0 2023-11-24T06:33:30.338 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f627fc640 1 -- 172.21.15.143:0/350865635 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f680ba070 con 0x7f8f50066aa0 2023-11-24T06:33:30.338 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T06:33:30.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066aa0 msgr2=0x7f8f50068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066aa0 0x7f8f50068f60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8f680ae000 tx=0x7f8f680a7000 comp rx=0 tx=0).stop 2023-11-24T06:33:30.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 msgr2=0x7f8f6c152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.340 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 0x7f8f6c152860 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400cb40 tx=0x7f8f6400a060 comp rx=0 tx=0).stop 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 shutdown_connections 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f8f50066aa0 0x7f8f50068f60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f6c15a4d0 0x7f8f6c152860 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c0cad20 0x7f8f6c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 --2- 172.21.15.143:0/350865635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06d740 0x7f8f6c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 >> 172.21.15.143:0/350865635 conn(0x7f8f6c0b0bf0 msgr2=0x7f8f6c0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 shutdown_connections 2023-11-24T06:33:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.335+0000 7f8f73f72640 1 -- 172.21.15.143:0/350865635 wait complete. 2023-11-24T06:33:30.359 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T06:33:30.359 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:33:30.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.495+0000 7fbd93c9a640 1 Processor -- start 2023-11-24T06:33:30.500 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.495+0000 7fbd93c9a640 1 -- start start 2023-11-24T06:33:30.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd93c9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd8c15a320 0x7fbd8c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd93c9a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd8c070da0 0x7fbd8c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.502 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd93c9a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c15a700 con 0x7fbd8c0b36c0 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd93c9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b2430 con 0x7fbd8c15a320 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd93c9a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b2620 con 0x7fbd8c070da0 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd8c15a320 0x7fbd8c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd8c15a320 0x7fbd8c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52758/0 (socket says 172.21.15.143:52758) 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 -- 172.21.15.143:0/3348259024 learned_addr learned my addr 172.21.15.143:0/3348259024 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd92237640 1 --2- 172.21.15.143:0/3348259024 >> v2:172.21.15.146:3300/0 conn(0x7fbd8c070da0 0x7fbd8c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 -- 172.21.15.143:0/3348259024 >> v2:172.21.15.146:3300/0 conn(0x7fbd8c070da0 msgr2=0x7fbd8c0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:30.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 --2- 172.21.15.143:0/3348259024 >> v2:172.21.15.146:3300/0 conn(0x7fbd8c070da0 0x7fbd8c0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 -- 172.21.15.143:0/3348259024 >> v1:172.21.15.146:6789/0 conn(0x7fbd8c0b36c0 legacy=0x7fbd8c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd91a36640 1 -- 172.21.15.143:0/3348259024 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0b2900 con 0x7fbd8c15a320 2023-11-24T06:33:30.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.499+0000 7fbd92237640 1 --2- 172.21.15.143:0/3348259024 >> v2:172.21.15.146:3300/0 conn(0x7fbd8c070da0 0x7fbd8c0711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:30.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd91a36640 1 --2- 172.21.15.143:0/3348259024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c15a320 0x7fbd8c0b1ef0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c06c2d0 tx=0x7fbd8801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef407ed5298f701e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.505 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd90a34640 1 -- 172.21.15.143:0/3348259024 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880a7b70 con 0x7fbd8c15a320 2023-11-24T06:33:30.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd90a34640 1 -- 172.21.15.143:0/3348259024 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880a7cd0 con 0x7fbd8c15a320 2023-11-24T06:33:30.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd90a34640 1 -- 172.21.15.143:0/3348259024 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880af660 con 0x7fbd8c15a320 2023-11-24T06:33:30.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 -- 172.21.15.143:0/3348259024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c15a320 msgr2=0x7fbd8c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 --2- 172.21.15.143:0/3348259024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c15a320 0x7fbd8c0b1ef0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c06c2d0 tx=0x7fbd8801eba0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 -- 172.21.15.143:0/3348259024 shutdown_connections 2023-11-24T06:33:30.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 --2- 172.21.15.143:0/3348259024 >> v2:172.21.15.146:3300/0 conn(0x7fbd8c070da0 0x7fbd8c0711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 --2- 172.21.15.143:0/3348259024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c15a320 0x7fbd8c0b1ef0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.507 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 -- 172.21.15.143:0/3348259024 >> 172.21.15.143:0/3348259024 conn(0x7fbd8c0b0bf0 msgr2=0x7fbd8c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 -- 172.21.15.143:0/3348259024 shutdown_connections 2023-11-24T06:33:30.508 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 -- 172.21.15.143:0/3348259024 wait complete. 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 Processor -- start 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.503+0000 7fbd93c9a640 1 -- start start 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c070da0 0x7fbd8c14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b36c0 0x7fbd8c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd8c15a320 0x7fbd8c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c14fc00 con 0x7fbd8c070da0 2023-11-24T06:33:30.510 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c1567e0 con 0x7fbd8c0b36c0 2023-11-24T06:33:30.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c14f540 con 0x7fbd8c15a320 2023-11-24T06:33:30.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c070da0 0x7fbd8c14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c070da0 0x7fbd8c14dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52772/0 (socket says 172.21.15.143:52772) 2023-11-24T06:33:30.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 -- 172.21.15.143:0/2773070399 learned_addr learned my addr 172.21.15.143:0/2773070399 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:30.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91235640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b36c0 0x7fbd8c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.511 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd92237640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd8c15a320 0x7fbd8c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 -- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd8c15a320 msgr2=0x7fbd8c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd8c15a320 0x7fbd8c15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 -- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b36c0 msgr2=0x7fbd8c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b36c0 0x7fbd8c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 -- 172.21.15.143:0/2773070399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8800b770 con 0x7fbd8c070da0 2023-11-24T06:33:30.513 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd91a36640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c070da0 0x7fbd8c14dd80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbd8801b7b0 tx=0x7fbd8801b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880ba660 con 0x7fbd8c070da0 2023-11-24T06:33:30.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880ba7e0 con 0x7fbd8c070da0 2023-11-24T06:33:30.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c14f820 con 0x7fbd8c070da0 2023-11-24T06:33:30.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880bab90 con 0x7fbd8c070da0 2023-11-24T06:33:30.514 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c156580 con 0x7fbd8c070da0 2023-11-24T06:33:30.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd8c067520 con 0x7fbd8c070da0 2023-11-24T06:33:30.515 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.507+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fbd880c2360 con 0x7fbd8c070da0 2023-11-24T06:33:30.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd827fc640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbd70066aa0 0x7fbd70068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fbd880a7e40 con 0x7fbd8c070da0 2023-11-24T06:33:30.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd91235640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbd70066aa0 0x7fbd70068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.516 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd827fc640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fbd7006c900 0x7fbd7006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 --> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd7006f3f0 con 0x7fbd7006c900 2023-11-24T06:33:30.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd8811fb00 con 0x7fbd8c070da0 2023-11-24T06:33:30.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd92237640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fbd7006c900 0x7fbd7006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd91235640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbd70066aa0 0x7fbd70068f60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c072590 tx=0x7fbd7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd92237640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fbd7006c900 0x7fbd7006ed20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.517 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.511+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== osd.7 v2:172.21.15.146:6800/2932726112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd7006f3f0 con 0x7fbd7006c900 2023-11-24T06:33:30.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.523+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 --> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbd8c15add0 con 0x7fbd7006c900 2023-11-24T06:33:30.529 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd827fc640 1 -- 172.21.15.143:0/2773070399 <== osd.7 v2:172.21.15.146:6800/2932726112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbd8c15add0 con 0x7fbd7006c900 2023-11-24T06:33:30.529 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-11-24T06:33:30.529 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:33:30.529 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-11-24T06:33:30.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fbd7006c900 msgr2=0x7fbd7006ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.530 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.146:6800/2932726112,v1:172.21.15.146:6802/2932726112] conn(0x7fbd7006c900 0x7fbd7006ed20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbd70066aa0 msgr2=0x7fbd70068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fbd70066aa0 0x7fbd70068f60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c072590 tx=0x7fbd7c009040 comp rx=0 tx=0).stop 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c070da0 msgr2=0x7fbd8c14dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 --2- 172.21.15.143:0/2773070399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c070da0 0x7fbd8c14dd80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbd8801b7b0 tx=0x7fbd8801b940 comp rx=0 tx=0).stop 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd92237640 1 -- 172.21.15.143:0/2773070399 reap_dead start 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 shutdown_connections 2023-11-24T06:33:30.531 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 >> 172.21.15.143:0/2773070399 conn(0x7fbd8c0b0bf0 msgr2=0x7fbd8c071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 shutdown_connections 2023-11-24T06:33:30.532 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.527+0000 7fbd93c9a640 1 -- 172.21.15.143:0/2773070399 wait complete. 2023-11-24T06:33:30.547 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T06:33:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 Processor -- start 2023-11-24T06:33:30.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 -- start start 2023-11-24T06:33:30.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d00cad20 0x7f91d00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91d006d740 0x7f91d006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d006e0d0 con 0x7f91d015a4d0 2023-11-24T06:33:30.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d015a8b0 con 0x7f91d006d740 2023-11-24T06:33:30.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91d5e6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00c9c30 con 0x7f91d00cad20 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91d006d740 0x7f91d006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91d006d740 0x7f91d006db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52786/0 (socket says 172.21.15.143:52786) 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 -- 172.21.15.143:0/2334670451 learned_addr learned my addr 172.21.15.143:0/2334670451 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91ceffd640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d00cad20 0x7f91d00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 -- 172.21.15.143:0/2334670451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d00cad20 msgr2=0x7f91d00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d00cad20 0x7f91d00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 -- 172.21.15.143:0/2334670451 >> v1:172.21.15.146:6789/0 conn(0x7f91d015a4d0 legacy=0x7f91d015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91cffff640 1 -- 172.21.15.143:0/2334670451 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00c9f60 con 0x7f91d006d740 2023-11-24T06:33:30.689 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.683+0000 7f91ceffd640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d00cad20 0x7f91d00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:33:30.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91cffff640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d006d740 0x7f91d006db90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009e50 tx=0x7f91c801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93ce79af622b320 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91ce7fc640 1 -- 172.21.15.143:0/2334670451 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80a5810 con 0x7f91d006d740 2023-11-24T06:33:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91ce7fc640 1 -- 172.21.15.143:0/2334670451 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c80a5970 con 0x7f91d006d740 2023-11-24T06:33:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91ce7fc640 1 -- 172.21.15.143:0/2334670451 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80a5d00 con 0x7f91d006d740 2023-11-24T06:33:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 -- 172.21.15.143:0/2334670451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d006d740 msgr2=0x7f91d006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d006d740 0x7f91d006db90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009e50 tx=0x7f91c801c950 comp rx=0 tx=0).stop 2023-11-24T06:33:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 -- 172.21.15.143:0/2334670451 shutdown_connections 2023-11-24T06:33:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d006d740 0x7f91d006db90 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/2334670451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d00cad20 0x7f91d00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 -- 172.21.15.143:0/2334670451 >> 172.21.15.143:0/2334670451 conn(0x7f91d00b0bf0 msgr2=0x7f91d00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 -- 172.21.15.143:0/2334670451 shutdown_connections 2023-11-24T06:33:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 -- 172.21.15.143:0/2334670451 wait complete. 2023-11-24T06:33:30.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.687+0000 7f91d5e6b640 1 Processor -- start 2023-11-24T06:33:30.693 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- start start 2023-11-24T06:33:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d006d740 0x7f91d00c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 0x7f91d00c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91d015a4d0 0x7f91d014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00c5a40 con 0x7f91d00cad20 2023-11-24T06:33:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0154010 con 0x7f91d015a4d0 2023-11-24T06:33:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d014f8a0 con 0x7f91d006d740 2023-11-24T06:33:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 0x7f91d00c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 0x7f91d00c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52792/0 (socket says 172.21.15.143:52792) 2023-11-24T06:33:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 -- 172.21.15.143:0/3541043760 learned_addr learned my addr 172.21.15.143:0/3541043760 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91cffff640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91d015a4d0 0x7f91d014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91cf7fe640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d006d740 0x7f91d00c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 -- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d006d740 msgr2=0x7f91d00c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d006d740 0x7f91d00c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 -- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91d015a4d0 msgr2=0x7f91d014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91d015a4d0 0x7f91d014f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 -- 172.21.15.143:0/3541043760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009b30 con 0x7f91d00cad20 2023-11-24T06:33:30.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91ceffd640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 0x7f91d00c5500 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f91c400e840 tx=0x7f91c400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400c6d0 con 0x7f91d00cad20 2023-11-24T06:33:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c400c830 con 0x7f91d00cad20 2023-11-24T06:33:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400cbe0 con 0x7f91d00cad20 2023-11-24T06:33:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d00c31c0 con 0x7f91d00cad20 2023-11-24T06:33:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d00c38c0 con 0x7f91d00cad20 2023-11-24T06:33:30.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.691+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d009d250 con 0x7f91d00cad20 2023-11-24T06:33:30.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.695+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f91c400cd40 con 0x7f91d00cad20 2023-11-24T06:33:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.695+0000 7f91b7fff640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91bc066ad0 0x7f91bc068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.695+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f91c40843e0 con 0x7f91d00cad20 2023-11-24T06:33:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.695+0000 7f91cf7fe640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91bc066ad0 0x7f91bc068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:30.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.695+0000 7f91cf7fe640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91bc066ad0 0x7f91bc068f90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f91d00cc060 tx=0x7f91c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:30.703 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.699+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91c4051280 con 0x7f91d00cad20 2023-11-24T06:33:30.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.847+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f91d009c920 con 0x7f91bc066ad0 2023-11-24T06:33:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.847+0000 7f91b7fff640 1 -- 172.21.15.143:0/3541043760 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91d009c920 con 0x7f91bc066ad0 2023-11-24T06:33:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T06:33:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91bc066ad0 msgr2=0x7f91bc068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91bc066ad0 0x7f91bc068f90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f91d00cc060 tx=0x7f91c0009040 comp rx=0 tx=0).stop 2023-11-24T06:33:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 msgr2=0x7f91d00c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 0x7f91d00c5500 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f91c400e840 tx=0x7f91c400ed00 comp rx=0 tx=0).stop 2023-11-24T06:33:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 shutdown_connections 2023-11-24T06:33:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f91bc066ad0 0x7f91bc068f90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91d015a4d0 0x7f91d014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91d00cad20 0x7f91d00c5500 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 --2- 172.21.15.143:0/3541043760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91d006d740 0x7f91d00c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:30.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 >> 172.21.15.143:0/3541043760 conn(0x7f91d00b0bf0 msgr2=0x7f91d0073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:30.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 shutdown_connections 2023-11-24T06:33:30.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:30.851+0000 7f91d5e6b640 1 -- 172.21.15.143:0/3541043760 wait complete. 2023-11-24T06:33:30.874 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:31.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 Processor -- start 2023-11-24T06:33:31.012 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 -- start start 2023-11-24T06:33:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c0b36c0 0x7fb46c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb46c070da0 0x7fb46c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c15a700 con 0x7fb46c15a320 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0b2430 con 0x7fb46c070da0 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.007+0000 7fb471b57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0b2620 con 0x7fb46c0b36c0 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb46c070da0 0x7fb46c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb46c070da0 0x7fb46c15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52796/0 (socket says 172.21.15.143:52796) 2023-11-24T06:33:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 -- 172.21.15.143:0/2007542505 learned_addr learned my addr 172.21.15.143:0/2007542505 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:31.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46affd640 1 --2- 172.21.15.143:0/2007542505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c0b36c0 0x7fb46c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:31.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 -- 172.21.15.143:0/2007542505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c0b36c0 msgr2=0x7fb46c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:31.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 --2- 172.21.15.143:0/2007542505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c0b36c0 0x7fb46c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 -- 172.21.15.143:0/2007542505 >> v1:172.21.15.146:6789/0 conn(0x7fb46c15a320 legacy=0x7fb46c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:31.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 -- 172.21.15.143:0/2007542505 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0b2900 con 0x7fb46c070da0 2023-11-24T06:33:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46bfff640 1 --2- 172.21.15.143:0/2007542505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c070da0 0x7fb46c15ddd0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fb46400d150 tx=0x7fb46401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2801cea8fd46e430 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46a7fc640 1 -- 172.21.15.143:0/2007542505 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640a7cd0 con 0x7fb46c070da0 2023-11-24T06:33:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46a7fc640 1 -- 172.21.15.143:0/2007542505 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640a7e30 con 0x7fb46c070da0 2023-11-24T06:33:31.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.011+0000 7fb46a7fc640 1 -- 172.21.15.143:0/2007542505 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400b2f0 con 0x7fb46c070da0 2023-11-24T06:33:31.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- 172.21.15.143:0/2007542505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c070da0 msgr2=0x7fb46c15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:31.017 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 --2- 172.21.15.143:0/2007542505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c070da0 0x7fb46c15ddd0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fb46400d150 tx=0x7fb46401ebe0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- 172.21.15.143:0/2007542505 shutdown_connections 2023-11-24T06:33:31.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 --2- 172.21.15.143:0/2007542505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c070da0 0x7fb46c15ddd0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 --2- 172.21.15.143:0/2007542505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c0b36c0 0x7fb46c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- 172.21.15.143:0/2007542505 >> 172.21.15.143:0/2007542505 conn(0x7fb46c0b0bf0 msgr2=0x7fb46c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:31.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- 172.21.15.143:0/2007542505 shutdown_connections 2023-11-24T06:33:31.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- 172.21.15.143:0/2007542505 wait complete. 2023-11-24T06:33:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 Processor -- start 2023-11-24T06:33:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- start start 2023-11-24T06:33:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb46c070da0 0x7fb46c09a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 0x7fb46c1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c15a320 0x7fb46c143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c09c7a0 con 0x7fb46c0b36c0 2023-11-24T06:33:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c140b10 con 0x7fb46c070da0 2023-11-24T06:33:31.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb471b57640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c09b8f0 con 0x7fb46c15a320 2023-11-24T06:33:31.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 0x7fb46c1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:31.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 0x7fb46c1405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:52808/0 (socket says 172.21.15.143:52808) 2023-11-24T06:33:31.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 -- 172.21.15.143:0/94345702 learned_addr learned my addr 172.21.15.143:0/94345702 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:31.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46b7fe640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb46c070da0 0x7fb46c09a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:31.023 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46bfff640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c15a320 0x7fb46c143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:31.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 -- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c15a320 msgr2=0x7fb46c143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:31.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c15a320 0x7fb46c143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 -- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb46c070da0 msgr2=0x7fb46c09a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:31.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb46c070da0 0x7fb46c09a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.024 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.015+0000 7fb46affd640 1 -- 172.21.15.143:0/94345702 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46400bd40 con 0x7fb46c0b36c0 2023-11-24T06:33:31.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb46affd640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 0x7fb46c1405d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e900 tx=0x7fb46000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:31.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460009690 con 0x7fb46c0b36c0 2023-11-24T06:33:31.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000ca00 con 0x7fb46c0b36c0 2023-11-24T06:33:31.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000cdb0 con 0x7fb46c0b36c0 2023-11-24T06:33:31.025 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c09bb90 con 0x7fb46c0b36c0 2023-11-24T06:33:31.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c09c150 con 0x7fb46c0b36c0 2023-11-24T06:33:31.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c09c950 con 0x7fb46c0b36c0 2023-11-24T06:33:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fb460013470 con 0x7fb46c0b36c0 2023-11-24T06:33:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb453fff640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb458066aa0 0x7fb458068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fb460084850 con 0x7fb46c0b36c0 2023-11-24T06:33:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.019+0000 7fb46b7fe640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb458066aa0 0x7fb458068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.023+0000 7fb46b7fe640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb458066aa0 0x7fb458068f60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb45c007fd0 tx=0x7fb45c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.023+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb46c09c950 con 0x7fb46c0b36c0 2023-11-24T06:33:31.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.175+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb46c067520 con 0x7fb458066aa0 2023-11-24T06:33:31.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb453fff640 1 -- 172.21.15.143:0/94345702 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50105 (secure 0 0 0) 0x7fb46c067520 con 0x7fb458066aa0 2023-11-24T06:33:31.182 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:31.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb458066aa0 msgr2=0x7fb458068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb458066aa0 0x7fb458068f60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb45c007fd0 tx=0x7fb45c009040 comp rx=0 tx=0).stop 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 msgr2=0x7fb46c1405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 0x7fb46c1405d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e900 tx=0x7fb46000edc0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 shutdown_connections 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb458066aa0 0x7fb458068f60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb46c15a320 0x7fb46c143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb46c0b36c0 0x7fb46c1405d0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 --2- 172.21.15.143:0/94345702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb46c070da0 0x7fb46c09a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:31.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 >> 172.21.15.143:0/94345702 conn(0x7fb46c0b0bf0 msgr2=0x7fb46c0ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:31.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 shutdown_connections 2023-11-24T06:33:31.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:31.179+0000 7fb471b57640 1 -- 172.21.15.143:0/94345702 wait complete. 2023-11-24T06:33:31.202 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2023-11-24T06:33:30.249182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259112,"kb_used_data":9668,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715608,"statfs":{"total":773094113280,"available":772828782592,"internally_reserved":0,"allocated":9900032,"data_stored":4896503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-135,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.995950"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":221,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-11-24T06:33:21.260627+0000","last_change":"2023-11-24T06:29:29.753845+0000","last_active":"2023-11-24T06:33:21.260627+0000","last_peered":"2023-11-24T06:33:21.260627+0000","last_clean":"2023-11-24T06:33:21.260627+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:21.260627+0000","last_undegraded":"2023-11-24T06:33:21.260627+0000","last_fullsized":"2023-11-24T06:33:21.260627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:29:28.676476+0000","last_clean_scrub_stamp":"2023-11-24T06:29:28.676476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:32.347776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1683456,"data_stored":1054960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.619,"15min":1.619},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99099999999999999,"5min":1.417,"15min":1.417},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.97699999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.754},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96799999999999997,"5min":1.7,"15min":1.7},"last":0.91800000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78400000000000003,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.92600000000000005,"5min":1.55,"15min":1.55},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.438,"15min":0.438},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92600000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":2.637,"15min":2.637},"last":0.625}]},{"osd":1,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96799999999999997,"5min":1.619,"15min":1.619},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85799999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99399999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.86899999999999999},"min":{"1min":0.504,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.72499999999999998,"15min":0.77500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.495},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":1.036,"15min":1.036},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.278,"15min":1.278},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.294,"5min":1.919,"15min":1.919},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.3500000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.427,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5189999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.629},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4059999999999999,"5min":1.998,"15min":1.998},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.274,"5min":1.343,"15min":1.343},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.501}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80500000000000005,"15min":0.81699999999999995},"min":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.462,"15min":1.462},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.022},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.876,"5min":1.202,"15min":1.202},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94199999999999995,"5min":1.248,"15min":1.248},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.079,"15min":1.079},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.002,"5min":1.149,"15min":1.149},"last":0.94999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.376},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.629,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.625,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55500000000000005,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":1.095,"15min":1.095},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93300000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.264,"15min":1.264},"last":0.626},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.286,"15min":1.286},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88100000000000001,"5min":1.409,"15min":1.409},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.78100000000000003,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94699999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.43099999999999999,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51300000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63900000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49199999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59399999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88900000000000001,"5min":1.075,"15min":1.075},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83699999999999997,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.623},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.27,"15min":1.27},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":1.389,"15min":1.389},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83499999999999996,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.874,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.93000000000000005,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.378}]},{"osd":3,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.044,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.626}]},{"osd":5,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.55200000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.877,"5min":1.02,"15min":1.02},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81000000000000005,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":1.048,"15min":1.048},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0940000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1679360,"data_stored":1053991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":1.393,"15min":1.393},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66100000000000003,"5min":1.319,"15min":1.319},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0049999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71199999999999997,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":1.589,"15min":1.589},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.81200000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.778,"15min":1.778},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4099999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0089999999999999,"5min":1.496,"15min":1.496},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3740000000000001,"5min":1.454,"15min":1.454},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81100000000000005,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.829,"15min":1.829},"last":0.749}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:31.246 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T06:29:28.676476+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=29, tm_sec=28, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=33, tm_sec=25, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T06:33:31.246 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T06:33:38.606 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:33:38.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:33:51.247 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:33:51.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.391+0000 7fb4c692a640 1 Processor -- start 2023-11-24T06:33:51.397 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.391+0000 7fb4c692a640 1 -- start start 2023-11-24T06:33:51.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c692a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 0x7fb4c006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c692a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c006d8b0 con 0x7fb4c009cc20 2023-11-24T06:33:51.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c692a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c009d0a0 con 0x7fb4c00709c0 2023-11-24T06:33:51.398 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c692a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0145020 con 0x7fb4c0144030 2023-11-24T06:33:51.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4bf7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb4c009cc20 0x7fb4c006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33266/0 (socket says 172.21.15.143:33266) 2023-11-24T06:33:51.399 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4bf7fe640 1 -- 172.21.15.143:0/3989138737 learned_addr learned my addr 172.21.15.143:0/3989138737 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4bffff640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 0x7fb4c006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997323828 0 0) 0x7fb4c006d8b0 con 0x7fb4c009cc20 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a8003530 con 0x7fb4c009cc20 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1663407925 0 0) 0x7fb4a8003530 con 0x7fb4c009cc20 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 msgr2=0x7fb4c006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 0x7fb4c006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 >> v1:172.21.15.146:6789/0 conn(0x7fb4c00709c0 legacy=0x7fb4c0070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c006cca0 con 0x7fb4c009cc20 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3452958352 0 0) 0x7fb4b4001680 con 0x7fb4c009cc20 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 >> v1:172.21.15.143:6789/0 conn(0x7fb4c009cc20 legacy=0x7fb4c006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80039b0 0x7fb4a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 0x7fb4a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a800ba40 con 0x7fb4a8004d10 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a800bb80 con 0x7fb4a80039b0 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a800bcf0 con 0x7fb4c0144030 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c4ec7640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4bffff640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80039b0 0x7fb4a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4bf7fe640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 0x7fb4a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c4ec7640 1 -- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 msgr2=0x7fb4a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c4ec7640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c0144030 0x7fb4a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.403 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c4ec7640 1 -- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80039b0 msgr2=0x7fb4a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:51.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c4ec7640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80039b0 0x7fb4a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.404 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.395+0000 7fb4c4ec7640 1 -- 172.21.15.143:0/3989138737 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8003530 con 0x7fb4a8004d10 2023-11-24T06:33:51.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c4ec7640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4a8005190 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8001f60 tx=0x7fb4b801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc064b40d26e071 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:51.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80a5750 con 0x7fb4a8004d10 2023-11-24T06:33:51.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b80a58b0 con 0x7fb4a8004d10 2023-11-24T06:33:51.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4beffd640 1 -- 172.21.15.143:0/3989138737 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80a5c60 con 0x7fb4a8004d10 2023-11-24T06:33:51.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c692a640 1 -- 172.21.15.143:0/3989138737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 msgr2=0x7fb4a8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.405 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c692a640 1 --2- 172.21.15.143:0/3989138737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4a8005190 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8001f60 tx=0x7fb4b801c860 comp rx=0 tx=0).stop 2023-11-24T06:33:51.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c4ec7640 1 -- 172.21.15.143:0/3989138737 reap_dead start 2023-11-24T06:33:51.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c692a640 1 -- 172.21.15.143:0/3989138737 shutdown_connections 2023-11-24T06:33:51.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c692a640 1 -- 172.21.15.143:0/3989138737 >> 172.21.15.143:0/3989138737 conn(0x7fb4c00b0bf0 msgr2=0x7fb4c00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:51.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c692a640 1 -- 172.21.15.143:0/3989138737 shutdown_connections 2023-11-24T06:33:51.406 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.399+0000 7fb4c692a640 1 -- 172.21.15.143:0/3989138737 wait complete. 2023-11-24T06:33:51.408 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 Processor -- start 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 -- start start 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4c013e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c013ebc0 0x7fb4c013cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4c013d1c0 0x7fb4c0140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c013f040 con 0x7fb4a8004d10 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c013d9f0 con 0x7fb4c013d1c0 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0140450 con 0x7fb4c013ebc0 2023-11-24T06:33:51.409 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4c013e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4c013e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38040/0 (socket says 172.21.15.143:38040) 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 -- 172.21.15.143:0/2877444208 learned_addr learned my addr 172.21.15.143:0/2877444208 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bf7fe640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c013ebc0 0x7fb4c013cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c4ec7640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4c013d1c0 0x7fb4c0140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 -- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c013ebc0 msgr2=0x7fb4c013cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c013ebc0 0x7fb4c013cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.410 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 -- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4c013d1c0 msgr2=0x7fb4c0140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4c013d1c0 0x7fb4c0140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 -- 172.21.15.143:0/2877444208 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0140730 con 0x7fb4a8004d10 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bffff640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4c013e680 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00119d0 tx=0x7fb4b0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000faf0 con 0x7fb4a8004d10 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000fc50 con 0x7fb4a8004d10 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c0140a10 con 0x7fb4a8004d10 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0014440 con 0x7fb4a8004d10 2023-11-24T06:33:51.411 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.403+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c0141470 con 0x7fb4a8004d10 2023-11-24T06:33:51.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.407+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0067520 con 0x7fb4a8004d10 2023-11-24T06:33:51.412 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.407+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fb4b00145a0 con 0x7fb4a8004d10 2023-11-24T06:33:51.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.407+0000 7fb4bcff9640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ac066ad0 0x7fb4ac068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.407+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fb4b0084dc0 con 0x7fb4a8004d10 2023-11-24T06:33:51.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.407+0000 7fb4bf7fe640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ac066ad0 0x7fb4ac068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.413 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.407+0000 7fb4bf7fe640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ac066ad0 0x7fb4ac068f90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4001060 tx=0x7fb4b4000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:51.415 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.411+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4b0051d30 con 0x7fb4a8004d10 2023-11-24T06:33:51.563 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.559+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 --> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4c0140bf0 con 0x7fb4ac066ad0 2023-11-24T06:33:51.565 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4bcff9640 1 -- 172.21.15.143:0/2877444208 <== mgr.4107 v2:172.21.15.143:6832/1816026817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50058 (secure 0 0 0) 0x7fb4c0140bf0 con 0x7fb4ac066ad0 2023-11-24T06:33:51.566 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:51.567 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2023-11-24T06:33:51.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ac066ad0 msgr2=0x7fb4ac068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ac066ad0 0x7fb4ac068f90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4001060 tx=0x7fb4b4000f80 comp rx=0 tx=0).stop 2023-11-24T06:33:51.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 msgr2=0x7fb4c013e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.568 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4c013e680 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00119d0 tx=0x7fb4b0011dd0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 shutdown_connections 2023-11-24T06:33:51.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7fb4ac066ad0 0x7fb4ac068f90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4c013d1c0 0x7fb4c0140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4c013ebc0 0x7fb4c013cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.569 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 --2- 172.21.15.143:0/2877444208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4a8004d10 0x7fb4c013e680 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 >> 172.21.15.143:0/2877444208 conn(0x7fb4c00b0bf0 msgr2=0x7fb4c01e49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:51.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 shutdown_connections 2023-11-24T06:33:51.570 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.563+0000 7fb4c692a640 1 -- 172.21.15.143:0/2877444208 wait complete. 2023-11-24T06:33:51.586 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2023-11-24T06:33:50.252980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259108,"kb_used_data":9668,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715612,"statfs":{"total":773094113280,"available":772828786688,"internally_reserved":0,"allocated":9900032,"data_stored":4896503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002337"},"pg_stats":[{"pgid":"1.0","version":"88'119","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-24T06:33:31.145563+0000","last_change":"2023-11-24T06:33:31.145563+0000","last_active":"2023-11-24T06:33:31.145563+0000","last_peered":"2023-11-24T06:33:31.145563+0000","last_clean":"2023-11-24T06:33:31.145563+0000","last_became_active":"2023-11-24T06:29:29.752608+0000","last_became_peered":"2023-11-24T06:29:29.752608+0000","last_unstale":"2023-11-24T06:33:31.145563+0000","last_undegraded":"2023-11-24T06:33:31.145563+0000","last_fullsized":"2023-11-24T06:33:31.145563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'119","last_scrub_stamp":"2023-11-24T06:33:31.145442+0000","last_deep_scrub":"88'119","last_deep_scrub_stamp":"2023-11-24T06:33:31.145442+0000","last_clean_scrub_stamp":"2023-11-24T06:33:31.145442+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:23.668244+0000","scrub_duration":0.0087325409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1683456,"data_stored":1054960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.995,"5min":1.619,"15min":1.619},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69599999999999995,"15min":0.72599999999999998},"min":{"1min":0.503,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.417,"15min":1.417},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72299999999999998,"15min":0.79100000000000004},"min":{"1min":0.44700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.94699999999999995,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.996},{"interface":"front","average":{"1min":0.747,"5min":0.75900000000000001,"15min":0.80900000000000005},"min":{"1min":0.56499999999999995,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91800000000000004,"5min":1.7,"15min":1.7},"last":0.83999999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.749,"15min":0.81799999999999995},"min":{"1min":0.44500000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.014,"5min":1.96,"15min":1.96},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.54000000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.876,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.95399999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.78300000000000003},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93100000000000005,"5min":1.55,"15min":1.55},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76800000000000002,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.91800000000000004,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65000000000000002,"15min":0.68500000000000005},"min":{"1min":0.40400000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.82799999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":1,"15min":1},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.75},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0269999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.876}]},{"osd":6,"last update":"Fri Nov 24 06:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84099999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69699999999999995,"15min":0.72399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92500000000000004,"5min":2.637,"15min":2.637},"last":0.749}]},{"osd":1,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91500000000000004,"5min":1.619,"15min":1.619},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":0.78500000000000003},"min":{"1min":0.495,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97599999999999998,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.505,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81100000000000005,"5min":0.873,"15min":0.873},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":0.76200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78100000000000003,"15min":0.85899999999999999},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92600000000000005,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95899999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70199999999999996,"15min":0.76700000000000002},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.86899999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92000000000000004,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64500000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89400000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77800000000000002,"15min":0.81100000000000005},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80000000000000004,"15min":0.86199999999999999},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94399999999999995,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.96999999999999997,"5min":1.036,"15min":1.036},"last":0.72799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65800000000000003,"15min":0.68000000000000005},"min":{"1min":0.54000000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97699999999999998,"5min":1.278,"15min":1.278},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89500000000000002,"5min":1.919,"15min":1.919},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.72099999999999997},"min":{"1min":0.499,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.874,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.878}]},{"osd":2,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.77500000000000002},"min":{"1min":0.55700000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.02,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.54100000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0469999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.90100000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.57699999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0629999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":1.998,"15min":1.998},"last":0.83699999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64200000000000002,"15min":0.65700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79500000000000004,"5min":1.125,"15min":1.125},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.42599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88400000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71499999999999997,"15min":0.74099999999999999},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92600000000000005,"5min":1.343,"15min":1.343},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.72599999999999998,"15min":0.751},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":1.327,"15min":1.327},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Nov 24 06:33:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77900000000000003,"15min":0.83099999999999996},"min":{"1min":0.47499999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91400000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95599999999999996,"5min":1.462,"15min":1.462},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.141,"5min":1.165,"15min":1.165},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.173,"5min":1.202,"15min":1.202},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.56699999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.77300000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65000000000000002,"15min":0.67200000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.67200000000000004,"15min":0.71899999999999997},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.77900000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.42799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":1.248,"15min":1.248},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73099999999999998,"15min":0.75900000000000001},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.504}]},{"osd":7,"last update":"Fri Nov 24 06:33:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.78200000000000003},"min":{"1min":0.45800000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86199999999999999,"5min":1.002,"15min":1.002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.51000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.056,"5min":1.149,"15min":1.149},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45400000000000001,"15min":0.47199999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.435},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59499999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65300000000000002,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68500000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.628},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":1.095,"15min":1.095},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.52600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.052,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72499999999999998,"15min":0.76100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1539999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.753,"15min":0.77700000000000002},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73899999999999999,"15min":0.76700000000000002},"min":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.018,"5min":1.264,"15min":1.264},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2410000000000001,"5min":1.286,"15min":1.286},"last":0.751}]},{"osd":7,"last update":"Fri Nov 24 06:33:32 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0880000000000001,"5min":1.409,"15min":1.409},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77100000000000002,"15min":0.80400000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1839999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42299999999999999,"15min":0.45600000000000002},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57899999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.443},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66100000000000003,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.747,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51800000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76100000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.55600000000000005},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.0589999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.54200000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89800000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97699999999999998,"5min":1.27,"15min":1.27},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.996,"5min":1.389,"15min":1.389},"last":0.628},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.58499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94199999999999995,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.60699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":464592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65300000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.443},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68000000000000005,"5min":1.01,"15min":1.01},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.436,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.57699999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69299999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55300000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64500000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71299999999999997,"15min":0.72199999999999998},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86799999999999999,"5min":1.075,"15min":1.075},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72799999999999998,"15min":0.73699999999999999},"min":{"1min":0.58299999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82999999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.54100000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.91700000000000004,"5min":1.02,"15min":1.02},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72799999999999998,"15min":0.747},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98099999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.623}]},{"osd":6,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.58899999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93400000000000005,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96599999999999997,"5min":1.048,"15min":1.048},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1679360,"data_stored":1053991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45600000000000002,"15min":0.48799999999999999},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65400000000000003,"5min":1.393,"15min":1.393},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48099999999999998,"15min":0.503},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65200000000000002,"5min":1.319,"15min":1.319},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.502,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.58399999999999996,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.377,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59499999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63500000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55500000000000005,"15min":0.58099999999999996},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71999999999999997,"5min":1.589,"15min":1.589},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73999999999999999,"15min":0.76800000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95199999999999996,"5min":1.462,"15min":1.462},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.80600000000000005},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0580000000000001,"5min":1.778,"15min":1.778},"last":0.747}]},{"osd":5,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.80000000000000004},"min":{"1min":0.52200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.127,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76600000000000001,"15min":0.82399999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96299999999999997,"5min":1.496,"15min":1.496},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78500000000000003,"15min":0.82499999999999996},"min":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.159,"5min":1.454,"15min":1.454},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76800000000000002,"15min":0.81599999999999995},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97399999999999998,"5min":1.514,"15min":1.514},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.83099999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.087,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.83899999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2010000000000001,"5min":1.829,"15min":1.829},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:33:51.589 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T06:33:51.723 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 Processor -- start 2023-11-24T06:33:51.724 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 -- start start 2023-11-24T06:33:51.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f060c1624f0 0x7f060c1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f060c0cd380 0x7f060c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0723c0 con 0x7f060c0ccef0 2023-11-24T06:33:51.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c072980 con 0x7f060c1624f0 2023-11-24T06:33:51.725 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.719+0000 7f0614157640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c0726a0 con 0x7f060c0cd380 2023-11-24T06:33:51.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0611ef3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f060c1624f0 0x7f060c1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f06116f2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f060c0ccef0 0x7f060c071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33282/0 (socket says 172.21.15.143:33282) 2023-11-24T06:33:51.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f06116f2640 1 -- 172.21.15.143:0/2436177712 learned_addr learned my addr 172.21.15.143:0/2436177712 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-11-24T06:33:51.726 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f06126f4640 1 --2- 172.21.15.143:0/2436177712 >> v2:172.21.15.146:3300/0 conn(0x7f060c0cd380 0x7f060c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0611ef3640 1 -- 172.21.15.143:0/2436177712 >> v2:172.21.15.146:3300/0 conn(0x7f060c0cd380 msgr2=0x7f060c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:51.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0611ef3640 1 --2- 172.21.15.143:0/2436177712 >> v2:172.21.15.146:3300/0 conn(0x7f060c0cd380 0x7f060c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0611ef3640 1 -- 172.21.15.143:0/2436177712 >> v1:172.21.15.143:6789/0 conn(0x7f060c0ccef0 legacy=0x7f060c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0610ef1640 1 -- 172.21.15.143:0/2436177712 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392953171 0 0) 0x7f060c0723c0 con 0x7f060c0ccef0 2023-11-24T06:33:51.727 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0611ef3640 1 -- 172.21.15.143:0/2436177712 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c06c7e0 con 0x7f060c1624f0 2023-11-24T06:33:51.728 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0611ef3640 1 --2- 172.21.15.143:0/2436177712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c1628d0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f060c070610 tx=0x7f060801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beae043c2a7affc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:51.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0610ef1640 1 -- 172.21.15.143:0/2436177712 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080ab600 con 0x7f060c1624f0 2023-11-24T06:33:51.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0610ef1640 1 -- 172.21.15.143:0/2436177712 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06080a7050 con 0x7f060c1624f0 2023-11-24T06:33:51.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.723+0000 7f0610ef1640 1 -- 172.21.15.143:0/2436177712 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080ab980 con 0x7f060c1624f0 2023-11-24T06:33:51.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- 172.21.15.143:0/2436177712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 msgr2=0x7f060c1628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.729 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 --2- 172.21.15.143:0/2436177712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c1628d0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f060c070610 tx=0x7f060801c3a0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- 172.21.15.143:0/2436177712 shutdown_connections 2023-11-24T06:33:51.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 --2- 172.21.15.143:0/2436177712 >> v2:172.21.15.146:3300/0 conn(0x7f060c0cd380 0x7f060c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 --2- 172.21.15.143:0/2436177712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c1628d0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- 172.21.15.143:0/2436177712 >> 172.21.15.143:0/2436177712 conn(0x7f060c0b0c80 msgr2=0x7f060c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:51.730 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- 172.21.15.143:0/2436177712 shutdown_connections 2023-11-24T06:33:51.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- 172.21.15.143:0/2436177712 wait complete. 2023-11-24T06:33:51.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 Processor -- start 2023-11-24T06:33:51.731 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- start start 2023-11-24T06:33:51.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f060c0ccef0 0x7f060c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f060c0cd380 0x7f060c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c099530 con 0x7f060c1624f0 2023-11-24T06:33:51.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c099810 con 0x7f060c0cd380 2023-11-24T06:33:51.733 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0614157640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c099af0 con 0x7f060c0ccef0 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f06126f4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f06126f4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c0b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38066/0 (socket says 172.21.15.143:38066) 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f06126f4640 1 -- 172.21.15.143:0/3722239641 learned_addr learned my addr 172.21.15.143:0/3722239641 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f06116f2640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f060c0cd380 0x7f060c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f0611ef3640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f060c0ccef0 0x7f060c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.727+0000 7f06126f4640 1 -- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f060c0ccef0 msgr2=0x7f060c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.734 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06126f4640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f060c0ccef0 0x7f060c14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06126f4640 1 -- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f060c0cd380 msgr2=0x7f060c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06126f4640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f060c0cd380 0x7f060c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06126f4640 1 -- 172.21.15.143:0/3722239641 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009420 con 0x7f060c1624f0 2023-11-24T06:33:51.735 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06126f4640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c0b2ff0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f060400efc0 tx=0x7f060400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:51.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604009ca0 con 0x7f060c1624f0 2023-11-24T06:33:51.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060400f040 con 0x7f060c1624f0 2023-11-24T06:33:51.736 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040146c0 con 0x7f060c1624f0 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c099dd0 con 0x7f060c1624f0 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c099150 con 0x7f060c1624f0 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c04e8c0 con 0x7f060c1624f0 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f0604014820 con 0x7f060c1624f0 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06027fc640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f05f0066aa0 0x7f05f0068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f0604085600 con 0x7f060c1624f0 2023-11-24T06:33:51.737 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.731+0000 7f0611ef3640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f05f0066aa0 0x7f05f0068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:51.738 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.735+0000 7f0611ef3640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f05f0066aa0 0x7f05f0068f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f06080ad000 tx=0x7f06080a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:51.740 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.735+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0604052380 con 0x7f060c1624f0 2023-11-24T06:33:51.889 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.887+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f060c09a280 con 0x7f060c1624f0 2023-11-24T06:33:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v20)=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7f06040559a0 con 0x7f060c1624f0 2023-11-24T06:33:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f06027fc640 1 -- 172.21.15.143:0/3722239641 <== mon.0 v2:172.21.15.143:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0604083250 con 0x7f060c1624f0 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f05f0066aa0 msgr2=0x7f05f0068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f05f0066aa0 0x7f05f0068f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f06080ad000 tx=0x7f06080a6000 comp rx=0 tx=0).stop 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 msgr2=0x7f060c0b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c0b2ff0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f060400efc0 tx=0x7f060400c490 comp rx=0 tx=0).stop 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 shutdown_connections 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7f05f0066aa0 0x7f05f0068f60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f060c1624f0 0x7f060c0b2ff0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f060c0cd380 0x7f060c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 --2- 172.21.15.143:0/3722239641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f060c0ccef0 0x7f060c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:51.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 >> 172.21.15.143:0/3722239641 conn(0x7f060c0b0c80 msgr2=0x7f060c0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:51.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 shutdown_connections 2023-11-24T06:33:51.898 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:51.891+0000 7f0614157640 1 -- 172.21.15.143:0/3722239641 wait complete. 2023-11-24T06:33:51.917 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:33:51.917 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:33:52.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 Processor -- start 2023-11-24T06:33:52.055 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 -- start start 2023-11-24T06:33:52.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa6015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffa6015a6b0 0x7ffa6006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa6015ab30 0x7ffa6006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6015b100 con 0x7ffa6015ab30 2023-11-24T06:33:52.057 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6015b3e0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa6491b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6015ddb0 con 0x7ffa60143a90 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa5f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa6015ab30 0x7ffa6006dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa5f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa6015ab30 0x7ffa6006dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38072/0 (socket says 172.21.15.143:38072) 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.051+0000 7ffa5f59e640 1 -- 172.21.15.143:0/2063148663 learned_addr learned my addr 172.21.15.143:0/2063148663 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5ed9d640 1 --2- 172.21.15.143:0/2063148663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa6015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa57fff640 1 --2- 172.21.15.143:0/2063148663 >> v2:172.21.15.146:3300/0 conn(0x7ffa6015a6b0 0x7ffa6006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5f59e640 1 -- 172.21.15.143:0/2063148663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 msgr2=0x7ffa6015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:52.058 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5f59e640 1 --2- 172.21.15.143:0/2063148663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa6015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5f59e640 1 -- 172.21.15.143:0/2063148663 >> v2:172.21.15.146:3300/0 conn(0x7ffa6015a6b0 msgr2=0x7ffa6006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:33:52.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5f59e640 1 --2- 172.21.15.143:0/2063148663 >> v2:172.21.15.146:3300/0 conn(0x7ffa6015a6b0 0x7ffa6006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.059 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5f59e640 1 -- 172.21.15.143:0/2063148663 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6015e090 con 0x7ffa6015ab30 2023-11-24T06:33:52.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5f59e640 1 --2- 172.21.15.143:0/2063148663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015ab30 0x7ffa6006dcb0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b1bb0 tx=0x7ffa5801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea72d744895e09ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:52.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5e59c640 1 -- 172.21.15.143:0/2063148663 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580a57e0 con 0x7ffa6015ab30 2023-11-24T06:33:52.060 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5e59c640 1 -- 172.21.15.143:0/2063148663 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffa580a5940 con 0x7ffa6015ab30 2023-11-24T06:33:52.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.055+0000 7ffa5e59c640 1 -- 172.21.15.143:0/2063148663 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580a5cf0 con 0x7ffa6015ab30 2023-11-24T06:33:52.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- 172.21.15.143:0/2063148663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015ab30 msgr2=0x7ffa6006dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:52.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- 172.21.15.143:0/2063148663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015ab30 0x7ffa6006dcb0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b1bb0 tx=0x7ffa5801c940 comp rx=0 tx=0).stop 2023-11-24T06:33:52.061 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- 172.21.15.143:0/2063148663 shutdown_connections 2023-11-24T06:33:52.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- 172.21.15.143:0/2063148663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015ab30 0x7ffa6006dcb0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- 172.21.15.143:0/2063148663 >> v2:172.21.15.146:3300/0 conn(0x7ffa6015a6b0 0x7ffa6006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- 172.21.15.143:0/2063148663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa6015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- 172.21.15.143:0/2063148663 >> 172.21.15.143:0/2063148663 conn(0x7ffa600cb840 msgr2=0x7ffa600cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:52.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- 172.21.15.143:0/2063148663 shutdown_connections 2023-11-24T06:33:52.062 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- 172.21.15.143:0/2063148663 wait complete. 2023-11-24T06:33:52.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 Processor -- start 2023-11-24T06:33:52.063 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- start start 2023-11-24T06:33:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa60142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 0x7ffa60136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6015ab30 0x7ffa6015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60168cc0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.064 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60168fa0 con 0x7ffa6015ab30 2023-11-24T06:33:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa6491b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60141130 con 0x7ffa60143a90 2023-11-24T06:33:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 0x7ffa60136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 0x7ffa60136ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38078/0 (socket says 172.21.15.143:38078) 2023-11-24T06:33:52.065 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 -- 172.21.15.143:0/4098015560 learned_addr learned my addr 172.21.15.143:0/4098015560 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-11-24T06:33:52.066 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa5ed9d640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa60142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa5f59e640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6015ab30 0x7ffa6015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 -- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 msgr2=0x7ffa60142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:52.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa60142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 -- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6015ab30 msgr2=0x7ffa6015bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:52.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6015ab30 0x7ffa6015bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.067 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.059+0000 7ffa57fff640 1 -- 172.21.15.143:0/4098015560 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58009b30 con 0x7ffa6015a6b0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa57fff640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 0x7ffa60136ce0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800d800 tx=0x7ffa4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800b6c0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffa4800b820 con 0x7ffa6015a6b0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa60070e60 con 0x7ffa6015a6b0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800bbb0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa601416f0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.068 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6004e850 con 0x7ffa6015a6b0 2023-11-24T06:33:52.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7ffa4800bd10 con 0x7ffa6015a6b0 2023-11-24T06:33:52.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa577fe640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa40066aa0 0x7ffa40068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:33:52.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4971+0+0 (secure 0 0 0) 0x7ffa48084da0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.063+0000 7ffa5ed9d640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa40066aa0 0x7ffa40068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:33:52.069 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.067+0000 7ffa5ed9d640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa40066aa0 0x7ffa40068f60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffa6015c9b0 tx=0x7ffa50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:33:52.072 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.067+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa48051af0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa600b4ea0 con 0x7ffa6015a6b0 2023-11-24T06:33:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa577fe640 1 -- 172.21.15.143:0/4098015560 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3699 (secure 0 0 0) 0x7ffa48055110 con 0x7ffa6015a6b0 2023-11-24T06:33:52.256 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-11-24T06:33:52.256 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/55201871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":55201871},{"type":"v1","addr":"172.21.15.146:6835","nonce":55201871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6562,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4172901263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4172901263},{"type":"v1","addr":"172.21.15.146:6834","nonce":4172901263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/460775449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":460775449},{"type":"v1","addr":"172.21.15.143:6835","nonce":460775449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/719885552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":719885552},{"type":"v1","addr":"172.21.15.143:6837","nonce":719885552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[]} 2023-11-24T06:33:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 57 2023-11-24T06:33:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa40066aa0 msgr2=0x7ffa40068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa40066aa0 0x7ffa40068f60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffa6015c9b0 tx=0x7ffa50008040 comp rx=0 tx=0).stop 2023-11-24T06:33:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 msgr2=0x7ffa60136ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:33:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 0x7ffa60136ce0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800d800 tx=0x7ffa4800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 shutdown_connections 2023-11-24T06:33:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:6832/1816026817,v1:172.21.15.143:6833/1816026817] conn(0x7ffa40066aa0 0x7ffa40068f60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6015ab30 0x7ffa6015bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa6015a6b0 0x7ffa60136ce0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 --2- 172.21.15.143:0/4098015560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa60143a90 0x7ffa60142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:33:52.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 >> 172.21.15.143:0/4098015560 conn(0x7ffa600cb840 msgr2=0x7ffa600aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:33:52.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 shutdown_connections 2023-11-24T06:33:52.261 INFO:teuthology.orchestra.run.smithi143.stderr:2023-11-24T06:33:52.251+0000 7ffa6491b640 1 -- 172.21.15.143:0/4098015560 wait complete. 2023-11-24T06:33:52.276 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T06:33:52.276 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T06:33:52.276 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:33:52.277 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.290 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:33:52.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:33:52.291 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.350 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:33:52.351 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:33:52.351 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.367 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:33:52.367 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:33:52.367 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.428 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:33:52.428 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T06:33:52.429 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T06:33:52.429 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.528 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T06:33:52.529 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T06:33:52.529 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.608 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T06:33:52.608 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T06:33:52.608 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-24T06:33:52.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-24T06:33:52.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-24T06:33:52.707 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T06:33:52.708 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T06:33:52.708 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:52.764 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T06:33:52.764 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T06:33:52.765 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-24T06:33:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-24T06:33:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-24T06:33:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-24T06:33:58.867 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T06:33:58.867 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T06:33:58.867 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:33:58.942 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T06:33:58.942 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T06:33:58.942 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:04.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-24T06:34:04.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-24T06:34:05.044 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T06:34:05.045 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T06:34:05.045 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:05.122 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T06:34:05.123 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T06:34:05.123 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T06:34:05.123 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:05.180 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T06:34:05.180 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T06:34:05.181 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:05.232 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T06:34:05.232 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T06:34:05.233 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T06:34:05.233 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:05.253 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T06:34:05.253 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T06:34:05.253 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:05.270 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T06:34:05.270 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T06:34:05.270 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:34:05.330 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T06:34:05.331 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T06:34:05.332 DEBUG:teuthology.orchestra.run.smithi143:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T06:34:05.368 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:34:05.368 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T06:34:05.653 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:34:05.653 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T06:34:05.866 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:34:05.867 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T06:34:06.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:34:06.057 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T06:34:06.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:34:06.283 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T06:34:06.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:34:06.455 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T06:34:06.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:34:06.638 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T06:34:06.820 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:34:06.821 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T06:34:07.002 INFO:tasks.ceph:Archiving mon data... 2023-11-24T06:34:07.004 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/data/mon.a.tgz 2023-11-24T06:34:07.004 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-11-24T06:34:07.014 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.m3u7JQB1Yh 2023-11-24T06:34:07.014 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.m3u7JQB1Yh 2023-11-24T06:34:07.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.m3u7JQB1Yh 2023-11-24T06:34:07.281 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.m3u7JQB1Yh is 678KB 2023-11-24T06:34:07.347 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.m3u7JQB1Yh 2023-11-24T06:34:07.356 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/data/mon.b.tgz 2023-11-24T06:34:07.356 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-11-24T06:34:07.365 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.Do27jWQiaF 2023-11-24T06:34:07.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Do27jWQiaF 2023-11-24T06:34:07.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.Do27jWQiaF 2023-11-24T06:34:07.674 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.Do27jWQiaF is 923KB 2023-11-24T06:34:07.748 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.Do27jWQiaF 2023-11-24T06:34:07.756 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/data/mon.c.tgz 2023-11-24T06:34:07.757 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-11-24T06:34:07.809 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.BKrMCdzTxV 2023-11-24T06:34:07.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BKrMCdzTxV 2023-11-24T06:34:08.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.BKrMCdzTxV 2023-11-24T06:34:08.117 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.BKrMCdzTxV is 922KB 2023-11-24T06:34:08.191 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.BKrMCdzTxV 2023-11-24T06:34:08.200 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T06:34:08.200 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:34:08.204 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:34:08.261 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T06:34:08.261 DEBUG:teuthology.orchestra.run.smithi143:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:34:08.268 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:34:08.307 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:34:08.335 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:34:08.342 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T06:34:08.344 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/remote/smithi143/crash 2023-11-24T06:34:08.345 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:34:08.377 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/remote/smithi146/crash 2023-11-24T06:34:08.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:34:08.410 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T06:34:08.410 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:34:08.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:34:08.500 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:34:08.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:34:08.564 INFO:tasks.ceph:Compressing logs... 2023-11-24T06:34:08.564 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:34:08.568 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:34:08.592 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2023-11-24T06:34:08.593 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53004.log 2023-11-24T06:34:08.594 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49960.log 2023-11-24T06:34:08.594 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2023-11-24T06:34:08.595 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2023-11-24T06:34:08.595 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53004.log.gz 2023-11-24T06:34:08.596 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46530.log 2023-11-24T06:34:08.596 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49960.log.gz 2023-11-24T06:34:08.597 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2023-11-24T06:34:08.597 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2023-11-24T06:34:08.598 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48242.log 2023-11-24T06:34:08.598 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46530.log.gz 2023-11-24T06:34:08.599 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56243.log 2023-11-24T06:34:08.599 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2023-11-24T06:34:08.600 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54259.log 2023-11-24T06:34:08.600 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48242.log.gz 2023-11-24T06:34:08.601 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55570.log 2023-11-24T06:34:08.601 INFO:teuthology.orchestra.run.smithi143.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56243.log.gz 2023-11-24T06:34:08.601 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55784.log 2023-11-24T06:34:08.602 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54259.log.gz 2023-11-24T06:34:08.602 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52429.log 2023-11-24T06:34:08.603 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55570.log.gz 2023-11-24T06:34:08.605 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55679.log 2023-11-24T06:34:08.606 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55784.log.gz 2023-11-24T06:34:08.606 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52429.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52429.log.gz 2023-11-24T06:34:08.606 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2023-11-24T06:34:08.607 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2023-11-24T06:34:08.607 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55679.log.gz 2023-11-24T06:34:08.614 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47868.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2023-11-24T06:34:08.614 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55459.log 2023-11-24T06:34:08.615 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48527.log 2023-11-24T06:34:08.615 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2023-11-24T06:34:08.615 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46959.log 2023-11-24T06:34:08.615 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55459.log.gz 2023-11-24T06:34:08.616 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56115.log 2023-11-24T06:34:08.616 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48527.log.gz 2023-11-24T06:34:08.616 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46959.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46959.log.gz 2023-11-24T06:34:08.616 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53722.log 2023-11-24T06:34:08.617 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49049.log 2023-11-24T06:34:08.617 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56115.log.gz 2023-11-24T06:34:08.617 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53722.log: gzip 85.5% -- replaced with /var/log/ceph/ceph-client.admin.53722.log.gz -5 2023-11-24T06:34:08.618 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.2.45848.log 2023-11-24T06:34:08.618 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45277.log 2023-11-24T06:34:08.618 INFO:teuthology.orchestra.run.smithi143.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49049.log.gz 2023-11-24T06:34:08.618 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.2.45848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45848.log.gz 2023-11-24T06:34:08.619 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50064.log 2023-11-24T06:34:08.632 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T06:34:08.633 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45277.log.gz 2023-11-24T06:34:08.633 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52978.log 2023-11-24T06:34:08.633 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50064.log.gz 2023-11-24T06:34:08.633 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51381.log 2023-11-24T06:34:08.633 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55836.log 2023-11-24T06:34:08.634 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52978.log.gz 2023-11-24T06:34:08.634 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52189.log 2023-11-24T06:34:08.634 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51381.log.gz 2023-11-24T06:34:08.634 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55836.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.45563.log -- replaced with /var/log/ceph/ceph-client.admin.55836.log.gz 2023-11-24T06:34:08.634 INFO:teuthology.orchestra.run.smithi143.stderr: 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46691.log 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52189.log.gz 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54311.log 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47011.log 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46691.log.gz 2023-11-24T06:34:08.635 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47063.log 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54311.log.gz 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47011.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47011.log.gz 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55125.log 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44315.log 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47063.log.gz 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55888.log 2023-11-24T06:34:08.636 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55125.log.gz 2023-11-24T06:34:08.637 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51151.log 2023-11-24T06:34:08.637 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44315.log.gz 2023-11-24T06:34:08.637 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55151.log 2023-11-24T06:34:08.637 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55888.log.gz 2023-11-24T06:34:08.638 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51151.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51151.log.gz 2023-11-24T06:34:08.638 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44785.log 2023-11-24T06:34:08.638 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2023-11-24T06:34:08.638 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55151.log.gz 2023-11-24T06:34:08.639 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49692.log 2023-11-24T06:34:08.639 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2023-11-24T06:34:08.639 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2023-11-24T06:34:08.639 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2023-11-24T06:34:08.645 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38385.log 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38289.log 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38385.log.gz 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44621.log 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44969.log 2023-11-24T06:34:08.646 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38289.log.gz 2023-11-24T06:34:08.647 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.44621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44621.log.gz 2023-11-24T06:34:08.647 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T06:34:08.647 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.44969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44969.log.gz 2023-11-24T06:34:08.647 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T06:34:08.647 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38337.log 2023-11-24T06:34:08.647 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44863.log 2023-11-24T06:34:08.652 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38265.log 2023-11-24T06:34:08.653 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38337.log.gz 2023-11-24T06:34:08.653 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.44863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44863.log.gz 2023-11-24T06:34:08.653 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T06:34:08.653 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38265.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38265.log.gz 2023-11-24T06:34:08.653 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T06:34:08.653 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:34:08.654 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38217.log 2023-11-24T06:34:08.654 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T06:34:08.658 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44270.log 2023-11-24T06:34:08.658 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38217.log.gz 2023-11-24T06:34:08.658 INFO:teuthology.orchestra.run.smithi146.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:34:08.658 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.c.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T06:34:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44739.log 2023-11-24T06:34:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.44270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44270.log.gz 2023-11-24T06:34:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:34:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.44739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44739.log.gz 2023-11-24T06:34:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T06:34:08.670 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44498.log 2023-11-24T06:34:08.670 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38361.log 2023-11-24T06:34:08.670 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.44498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44498.log.gz 2023-11-24T06:34:08.670 INFO:teuthology.orchestra.run.smithi146.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44355.log 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38361.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38361.log.gz 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.3.44355.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.3.44355.log.gz --verbose 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-mon.b.log 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T06:34:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38241.log 2023-11-24T06:34:08.672 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38241.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38241.log.gz 2023-11-24T06:34:08.675 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49692.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2023-11-24T06:34:08.676 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49770.log 2023-11-24T06:34:08.676 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51669.log 2023-11-24T06:34:08.676 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2023-11-24T06:34:08.676 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47524.log 2023-11-24T06:34:08.676 INFO:teuthology.orchestra.run.smithi143.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49770.log.gz 2023-11-24T06:34:08.676 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48996.log 2023-11-24T06:34:08.677 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51669.log.gz 2023-11-24T06:34:08.677 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51301.log 2023-11-24T06:34:08.677 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47524.log.gz 2023-11-24T06:34:08.677 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48996.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48996.log.gz -- 2023-11-24T06:34:08.677 INFO:teuthology.orchestra.run.smithi143.stderr: /var/log/ceph/ceph-client.admin.48294.log 2023-11-24T06:34:08.677 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51301.log.gz 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49612.log 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54564.log 88.3% 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2023-11-24T06:34:08.678 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49612.log.gz 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54564.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.54564.log.gz 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46876.log 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44127.log 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53547.log 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46876.log.gz 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2023-11-24T06:34:08.679 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44127.log.gz 2023-11-24T06:34:08.680 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53547.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53547.log.gz 2023-11-24T06:34:08.680 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T06:34:08.680 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54363.log 2023-11-24T06:34:08.680 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2023-11-24T06:34:08.680 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2023-11-24T06:34:08.680 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56765.log 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54363.log.gz 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48944.log 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56765.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56765.log.gz 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51565.log 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51118.log 2023-11-24T06:34:08.681 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48944.log.gz 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51565.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51565.log.gz 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54207.log 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51118.log.gz 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47245.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54879.log 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44263.log 2023-11-24T06:34:08.682 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54207.log.gz 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54879.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54879.log.gz 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46418.log 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44263.log.gz 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44992.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50629.log 2023-11-24T06:34:08.683 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49075.log 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46418.log.gz 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50629.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50629.log.gz 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46366.log 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47734.log 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49075.log.gz 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46366.log: gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.46366.log.gz 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr: /var/log/ceph/ceph-client.admin.53409.log 2023-11-24T06:34:08.684 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47734.log.gz 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53409.log.gz 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50986.log 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50986.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50986.log.gz 2023-11-24T06:34:08.685 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46182.log 2023-11-24T06:34:08.686 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44471.log 2023-11-24T06:34:08.686 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2023-11-24T06:34:08.686 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46182.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46182.log.gz 2023-11-24T06:34:08.686 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2023-11-24T06:34:08.686 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49944.log 2023-11-24T06:34:08.686 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz 2023-11-24T06:34:08.687 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44237.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2023-11-24T06:34:08.687 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56815.log 2023-11-24T06:34:08.687 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.49944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49944.log.gz 2023-11-24T06:34:08.687 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45623.log 2023-11-24T06:34:08.696 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2023-11-24T06:34:08.697 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56815.log.gz 2023-11-24T06:34:08.697 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2023-11-24T06:34:08.697 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45623.log.gz 2023-11-24T06:34:08.697 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45407.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2023-11-24T06:34:08.697 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2023-11-24T06:34:08.697 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46000.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52163.log 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45199.log 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52163.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52163.log.gz 2023-11-24T06:34:08.698 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45251.log 2023-11-24T06:34:08.699 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56789.log 2023-11-24T06:34:08.699 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45199.log.gz 2023-11-24T06:34:08.699 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45251.log.gz 2023-11-24T06:34:08.699 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52847.log 2023-11-24T06:34:08.699 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55992.log 2023-11-24T06:34:08.699 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56789.log.gz 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52847.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52847.log.gz 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46286.log 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45225.log 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55992.log.gz 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46286.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46286.log.gz 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52639.log 2023-11-24T06:34:08.700 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49744.log 2023-11-24T06:34:08.701 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45225.log.gz 2023-11-24T06:34:08.701 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52639.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52639.log.gz 2023-11-24T06:34:08.701 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45511.log 2023-11-24T06:34:08.701 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51911.log 2023-11-24T06:34:08.701 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49744.log.gz 2023-11-24T06:34:08.701 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45511.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45511.log.gz 2023-11-24T06:34:08.702 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2023-11-24T06:34:08.702 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46104.log 2023-11-24T06:34:08.702 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51911.log.gz 2023-11-24T06:34:08.702 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46933.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2023-11-24T06:34:08.702 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49390.log 2023-11-24T06:34:08.707 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46104.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46104.log.gz 2023-11-24T06:34:08.707 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53887.log 2023-11-24T06:34:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54649.log 2023-11-24T06:34:08.708 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49390.log.gz 2023-11-24T06:34:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45737.log 2023-11-24T06:34:08.708 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53887.log.gz 2023-11-24T06:34:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54649.log.gz 2023-11-24T06:34:08.708 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51591.log 2023-11-24T06:34:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.45737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45737.log.gz 2023-11-24T06:34:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45381.log 2023-11-24T06:34:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51591.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51591.log.gz 2023-11-24T06:34:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51949.log 2023-11-24T06:34:08.709 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2023-11-24T06:34:08.710 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45381.log.gz 2023-11-24T06:34:08.710 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2023-11-24T06:34:08.710 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51949.log.gz 2023-11-24T06:34:08.710 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48579.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2023-11-24T06:34:08.711 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50785.log 2023-11-24T06:34:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53861.log 2023-11-24T06:34:08.713 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2023-11-24T06:34:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50785.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50785.log.gz 2023-11-24T06:34:08.713 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55596.log 2023-11-24T06:34:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49718.log 2023-11-24T06:34:08.714 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53861.log.gz 2023-11-24T06:34:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55596.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55596.log.gz 2023-11-24T06:34:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46665.log 2023-11-24T06:34:08.714 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52769.log 2023-11-24T06:34:08.715 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49718.log.gz 2023-11-24T06:34:08.716 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46665.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46665.log.gz 2023-11-24T06:34:08.716 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44990.log 2023-11-24T06:34:08.716 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56607.log 2023-11-24T06:34:08.717 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52769.log.gz 2023-11-24T06:34:08.717 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44990.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44990.log.gz 2023-11-24T06:34:08.717 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51745.log 2023-11-24T06:34:08.718 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56607.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56607.log.gz 2023-11-24T06:34:08.718 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50811.log 2023-11-24T06:34:08.718 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51745.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51745.log.gz 2023-11-24T06:34:08.719 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53599.log 2023-11-24T06:34:08.719 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50811.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T06:34:08.720 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50811.log.gz 2023-11-24T06:34:08.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53599.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53599.log.gz 2023-11-24T06:34:08.721 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2023-11-24T06:34:08.721 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2023-11-24T06:34:08.723 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45433.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2023-11-24T06:34:08.723 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2023-11-24T06:34:08.724 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46772.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2023-11-24T06:34:08.725 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46504.log 2023-11-24T06:34:08.726 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53331.log 2023-11-24T06:34:08.726 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2023-11-24T06:34:08.727 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46504.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46504.log.gz 2023-11-24T06:34:08.727 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43857.log 2023-11-24T06:34:08.728 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53331.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53331.log.gz 2023-11-24T06:34:08.729 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2023-11-24T06:34:08.730 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 2023-11-24T06:34:08.730 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43857.log.gz 2023-11-24T06:34:08.731 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48050.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2023-11-24T06:34:08.731 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2023-11-24T06:34:08.732 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50187.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2023-11-24T06:34:08.733 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55653.log 2023-11-24T06:34:08.734 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54590.log 2023-11-24T06:34:08.734 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2023-11-24T06:34:08.735 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55653.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55653.log.gz 2023-11-24T06:34:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46052.log 2023-11-24T06:34:08.736 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54590.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54590.log.gz 2023-11-24T06:34:08.738 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48174.log 2023-11-24T06:34:08.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2023-11-24T06:34:08.739 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46052.log.gz 2023-11-24T06:34:08.739 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.48174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48174.log.gz 2023-11-24T06:34:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T06:34:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54907.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gz 2023-11-24T06:34:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46743.log 2023-11-24T06:34:08.742 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52795.log 2023-11-24T06:34:08.743 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54101.log 2023-11-24T06:34:08.744 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46743.log.gz 2023-11-24T06:34:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56141.log 2023-11-24T06:34:08.745 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52795.log.gz 2023-11-24T06:34:08.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48418.log 2023-11-24T06:34:08.746 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54101.log.gz 2023-11-24T06:34:08.748 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46026.log 2023-11-24T06:34:08.748 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56141.log.gz 2023-11-24T06:34:08.749 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48418.log.gz 2023-11-24T06:34:08.749 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53573.log 2023-11-24T06:34:08.751 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2023-11-24T06:34:08.751 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46026.log.gz 2023-11-24T06:34:08.752 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53573.log.gz 2023-11-24T06:34:08.752 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48128.log 2023-11-24T06:34:08.753 INFO:teuthology.orchestra.run.smithi143.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T06:34:08.753 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47998.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2023-11-24T06:34:08.754 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49338.log 2023-11-24T06:34:08.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48128.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2023-11-24T06:34:08.755 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2023-11-24T06:34:08.756 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2023-11-24T06:34:08.757 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47349.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49338.log.gz 2023-11-24T06:34:08.757 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2023-11-24T06:34:08.758 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53357.log 2023-11-24T06:34:08.759 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50363.log 2023-11-24T06:34:08.759 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2023-11-24T06:34:08.760 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53357.log.gz 2023-11-24T06:34:08.760 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2023-11-24T06:34:08.761 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55343.log 2023-11-24T06:34:08.762 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50363.log.gz 2023-11-24T06:34:08.763 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46208.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2023-11-24T06:34:08.763 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54967.log 2023-11-24T06:34:08.764 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55343.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55343.log.gz 2023-11-24T06:34:08.764 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52821.log 2023-11-24T06:34:08.765 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2023-11-24T06:34:08.766 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54967.log.gz 2023-11-24T06:34:08.766 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52821.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52821.log.gz 2023-11-24T06:34:08.767 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52246.log 2023-11-24T06:34:08.768 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49534.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2023-11-24T06:34:08.768 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45922.log 2023-11-24T06:34:08.770 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52246.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52246.log.gz 2023-11-24T06:34:08.770 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2023-11-24T06:34:08.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56633.log 2023-11-24T06:34:08.772 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45922.log.gz 2023-11-24T06:34:08.773 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2023-11-24T06:34:08.773 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2023-11-24T06:34:08.774 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56633.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56633.log.gz 2023-11-24T06:34:08.774 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55966.log 2023-11-24T06:34:08.776 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55758.log 2023-11-24T06:34:08.776 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2023-11-24T06:34:08.777 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55966.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55966.log.gz 2023-11-24T06:34:08.777 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52880.log 2023-11-24T06:34:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55758.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55758.log.gz 2023-11-24T06:34:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2023-11-24T06:34:08.780 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52880.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52880.log.gz 2023-11-24T06:34:08.780 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49822.log 2023-11-24T06:34:08.781 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2023-11-24T06:34:08.781 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2023-11-24T06:34:08.783 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56529.log 2023-11-24T06:34:08.783 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49822.log.gz 2023-11-24T06:34:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56737.log 2023-11-24T06:34:08.784 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2023-11-24T06:34:08.786 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52665.log 2023-11-24T06:34:08.786 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56529.log.gz 2023-11-24T06:34:08.787 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50655.log 2023-11-24T06:34:08.787 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56737.log.gz 2023-11-24T06:34:08.789 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44075.log 2023-11-24T06:34:08.789 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52665.log.gz 2023-11-24T06:34:08.790 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50655.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50655.log.gz 2023-11-24T06:34:08.790 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2023-11-24T06:34:08.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53030.log 2023-11-24T06:34:08.792 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44075.log.gz 2023-11-24T06:34:08.792 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53485.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2023-11-24T06:34:08.793 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53996.log 2023-11-24T06:34:08.794 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53030.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 2023-11-24T06:34:08.794 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52507.log 2023-11-24T06:34:08.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53996.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53996.log.gz 2023-11-24T06:34:08.796 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2023-11-24T06:34:08.797 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51513.log 2023-11-24T06:34:08.797 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52507.log.gz 2023-11-24T06:34:08.798 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46392.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2023-11-24T06:34:08.798 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54337.log 2023-11-24T06:34:08.799 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51513.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51513.log.gz 2023-11-24T06:34:08.800 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46582.log 2023-11-24T06:34:08.801 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54337.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54337.log.gz 2023-11-24T06:34:08.801 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51183.log 2023-11-24T06:34:08.803 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46582.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46582.log.gz 2023-11-24T06:34:08.803 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53651.log 2023-11-24T06:34:08.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51183.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51183.log.gz 2023-11-24T06:34:08.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50889.log 2023-11-24T06:34:08.806 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53651.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53651.log.gz -5 2023-11-24T06:34:08.806 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48658.log 2023-11-24T06:34:08.807 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46444.log 2023-11-24T06:34:08.807 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50889.log.gz 2023-11-24T06:34:08.809 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51791.log 2023-11-24T06:34:08.809 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48658.log.gz 2023-11-24T06:34:08.810 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44048.log 2023-11-24T06:34:08.810 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46444.log.gz 2023-11-24T06:34:08.811 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.51791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51791.log.gz 2023-11-24T06:34:08.812 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48334.log 2023-11-24T06:34:08.813 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44048.log.gz 2023-11-24T06:34:08.813 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56321.log 2023-11-24T06:34:08.815 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48334.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.48334.log.gz 2023-11-24T06:34:08.815 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2023-11-24T06:34:08.816 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56321.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56321.log.gz 2023-11-24T06:34:08.817 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2023-11-24T06:34:08.818 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48762.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2023-11-24T06:34:08.818 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2023-11-24T06:34:08.819 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48866.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2023-11-24T06:34:08.819 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49446.log 2023-11-24T06:34:08.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2023-11-24T06:34:08.821 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49446.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2023-11-24T06:34:08.822 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2023-11-24T06:34:08.822 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44393.log 2023-11-24T06:34:08.823 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47323.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2023-11-24T06:34:08.824 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53939.log 2023-11-24T06:34:08.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44393.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44393.log.gz 2023-11-24T06:34:08.825 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47708.log 2023-11-24T06:34:08.826 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44341.log 2023-11-24T06:34:08.826 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53939.log.gz 2023-11-24T06:34:08.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47708.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47708.log.gz 2023-11-24T06:34:08.828 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2023-11-24T06:34:08.828 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T06:34:08.830 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44341.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44341.log.gz 2023-11-24T06:34:08.830 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48631.log 2023-11-24T06:34:08.831 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2023-11-24T06:34:08.831 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47682.log 2023-11-24T06:34:08.832 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48631.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48631.log.gz 2023-11-24T06:34:08.832 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50472.log 2023-11-24T06:34:08.834 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47682.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47682.log.gz 2023-11-24T06:34:08.834 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47037.log 2023-11-24T06:34:08.835 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51807.log 2023-11-24T06:34:08.835 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50472.log.gz 2023-11-24T06:34:08.836 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2023-11-24T06:34:08.837 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47037.log.gz 2023-11-24T06:34:08.838 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51807.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51807.log.gz 2023-11-24T06:34:08.838 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47762.log 2023-11-24T06:34:08.839 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2023-11-24T06:34:08.840 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2023-11-24T06:34:08.841 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47762.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47762.log.gz 2023-11-24T06:34:08.841 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2023-11-24T06:34:08.842 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52220.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2023-11-24T06:34:08.842 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2023-11-24T06:34:08.844 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44289.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T06:34:08.844 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2023-11-24T06:34:08.845 INFO:teuthology.orchestra.run.smithi146.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T06:34:08.846 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43924.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2023-11-24T06:34:08.847 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51461.log 2023-11-24T06:34:08.847 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48024.log 2023-11-24T06:34:08.848 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47408.log 2023-11-24T06:34:08.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51461.log.gz 2023-11-24T06:34:08.849 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2023-11-24T06:34:08.850 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48024.log.gz 2023-11-24T06:34:08.851 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56018.log 2023-11-24T06:34:08.851 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47408.log.gz 2023-11-24T06:34:08.852 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48684.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz -5 2023-11-24T06:34:08.852 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53383.log 2023-11-24T06:34:08.853 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44780.log 2023-11-24T06:34:08.854 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56018.log.gz 2023-11-24T06:34:08.855 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52481.log 2023-11-24T06:34:08.855 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53383.log.gz 2023-11-24T06:34:08.857 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53279.log 2023-11-24T06:34:08.857 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44780.log.gz 2023-11-24T06:34:08.858 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52481.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52481.log.gz 2023-11-24T06:34:08.858 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2023-11-24T06:34:08.859 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53279.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.53279.log.gz --verbose 2023-11-24T06:34:08.859 INFO:teuthology.orchestra.run.smithi143.stderr: -- /var/log/ceph/ceph-client.admin.56089.log 2023-11-24T06:34:08.861 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55315.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2023-11-24T06:34:08.861 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52613.log 2023-11-24T06:34:08.862 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56089.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56089.log.gz 2023-11-24T06:34:08.863 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54233.log 2023-11-24T06:34:08.864 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55705.log 2023-11-24T06:34:08.864 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52613.log.gz 2023-11-24T06:34:08.865 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48918.log 2023-11-24T06:34:08.866 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54233.log.gz 2023-11-24T06:34:08.867 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55705.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55705.log.gz -5 2023-11-24T06:34:08.867 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48359.log 2023-11-24T06:34:08.868 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48918.log: gzip -5 --verbose 87.7% -- /var/log/ceph/ceph-client.admin.48788.log -- replaced with /var/log/ceph/ceph-client.admin.48918.log.gz 2023-11-24T06:34:08.868 INFO:teuthology.orchestra.run.smithi143.stderr: 2023-11-24T06:34:08.870 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48359.log.gz 2023-11-24T06:34:08.871 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48078.log 2023-11-24T06:34:08.872 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53531.log 2023-11-24T06:34:08.872 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48788.log.gz 2023-11-24T06:34:08.873 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2023-11-24T06:34:08.874 INFO:teuthology.orchestra.run.smithi143.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48078.log.gz 2023-11-24T06:34:08.874 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.53531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53531.log.gz 2023-11-24T06:34:08.875 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55627.log 2023-11-24T06:34:08.876 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2023-11-24T06:34:08.876 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2023-11-24T06:34:08.878 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55627.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.55627.log.gz 2023-11-24T06:34:08.878 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2023-11-24T06:34:08.879 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50863.log 2023-11-24T06:34:08.879 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2023-11-24T06:34:08.881 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45766.log 2023-11-24T06:34:08.881 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2023-11-24T06:34:08.882 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50863.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50863.log.gz 2023-11-24T06:34:08.882 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56216.log 2023-11-24T06:34:08.884 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54129.log 2023-11-24T06:34:08.884 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45766.log.gz 2023-11-24T06:34:08.885 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56216.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56216.log.gz 2023-11-24T06:34:08.885 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53970.log 2023-11-24T06:34:08.886 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54129.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.54129.log.gz 2023-11-24T06:34:08.887 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53913.log 2023-11-24T06:34:08.888 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45537.log 2023-11-24T06:34:08.888 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53970.log.gz 2023-11-24T06:34:08.890 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50498.log 2023-11-24T06:34:08.890 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53913.log.gz 2023-11-24T06:34:08.891 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2023-11-24T06:34:08.891 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45537.log.gz 2023-11-24T06:34:08.892 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50498.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50498.log.gz 2023-11-24T06:34:08.893 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2023-11-24T06:34:08.894 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51695.log 2023-11-24T06:34:08.894 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2023-11-24T06:34:08.898 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54048.log 2023-11-24T06:34:08.898 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2023-11-24T06:34:08.898 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53835.log 2023-11-24T06:34:08.898 INFO:teuthology.orchestra.run.smithi143.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51695.log.gz 2023-11-24T06:34:08.899 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2023-11-24T06:34:08.899 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54048.log.gz 2023-11-24T06:34:08.900 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53835.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53835.log.gz -5 2023-11-24T06:34:08.900 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50934.log 2023-11-24T06:34:08.901 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T06:34:08.901 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49220.log 2023-11-24T06:34:08.901 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2023-11-24T06:34:08.903 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44153.log 2023-11-24T06:34:08.903 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50934.log.gz 2023-11-24T06:34:08.904 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52001.log 2023-11-24T06:34:08.904 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49220.log.gz 2023-11-24T06:34:08.906 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44153.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T06:34:08.906 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44153.log.gz 2023-11-24T06:34:08.907 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52001.log: 85.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.52001.log.gz 2023-11-24T06:34:08.907 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56685.log 2023-11-24T06:34:08.909 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44560.log 2023-11-24T06:34:08.910 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2023-11-24T06:34:08.910 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56685.log.gz 2023-11-24T06:34:08.911 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T06:34:08.912 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45974.log 2023-11-24T06:34:08.912 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44560.log.gz 2023-11-24T06:34:08.913 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46798.log 2023-11-24T06:34:08.913 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2023-11-24T06:34:08.914 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46850.log 2023-11-24T06:34:08.915 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45974.log.gz 2023-11-24T06:34:08.916 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46798.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46798.log.gz 2023-11-24T06:34:08.917 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2023-11-24T06:34:08.917 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46850.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46850.log.gz 2023-11-24T06:34:08.918 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2023-11-24T06:34:08.919 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44523.log 2023-11-24T06:34:08.920 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2023-11-24T06:34:08.920 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44775.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T06:34:08.921 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2023-11-24T06:34:08.921 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2023-11-24T06:34:08.922 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53224.log 2023-11-24T06:34:08.922 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44523.log.gz 2023-11-24T06:34:08.923 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48392.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz -5 2023-11-24T06:34:08.924 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2023-11-24T06:34:08.925 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54825.log 2023-11-24T06:34:08.925 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53224.log.gz 2023-11-24T06:34:08.927 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44179.log 2023-11-24T06:34:08.927 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2023-11-24T06:34:08.928 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2023-11-24T06:34:08.928 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54825.log.gz 2023-11-24T06:34:08.930 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51833.log 2023-11-24T06:34:08.930 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44179.log.gz 2023-11-24T06:34:08.931 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45173.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz -5 2023-11-24T06:34:08.931 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45870.log 2023-11-24T06:34:08.932 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44974.log 2023-11-24T06:34:08.933 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51833.log.gz 2023-11-24T06:34:08.934 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2023-11-24T06:34:08.935 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45870.log.gz 2023-11-24T06:34:08.935 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38341.log 2023-11-24T06:34:08.936 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44974.log.gz 2023-11-24T06:34:08.937 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50389.log 2023-11-24T06:34:08.937 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2023-11-24T06:34:08.938 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38341.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38341.log.gz 2023-11-24T06:34:08.938 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54434.log 2023-11-24T06:34:08.940 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2023-11-24T06:34:08.940 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50389.log.gz 2023-11-24T06:34:08.941 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48444.log 2023-11-24T06:34:08.941 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54434.log.gz 2023-11-24T06:34:08.942 INFO:teuthology.orchestra.run.smithi146.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T06:34:08.942 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45329.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2023-11-24T06:34:08.943 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52912.log 2023-11-24T06:34:08.944 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51409.log 2023-11-24T06:34:08.944 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48444.log.gz 2023-11-24T06:34:08.945 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48190.log 2023-11-24T06:34:08.945 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52912.log.gz 2023-11-24T06:34:08.947 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52137.log 2023-11-24T06:34:08.947 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51409.log.gz 2023-11-24T06:34:08.948 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55862.log 2023-11-24T06:34:08.948 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48190.log.gz 2023-11-24T06:34:08.950 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2023-11-24T06:34:08.950 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52137.log.gz 2023-11-24T06:34:08.951 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56451.log 2023-11-24T06:34:08.951 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55862.log.gz 2023-11-24T06:34:08.953 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2023-11-24T06:34:08.953 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2023-11-24T06:34:08.954 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56451.log.gz 2023-11-24T06:34:08.954 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55544.log 2023-11-24T06:34:08.956 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46556.log 2023-11-24T06:34:08.956 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2023-11-24T06:34:08.957 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53750.log 2023-11-24T06:34:08.957 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55544.log.gz 2023-11-24T06:34:08.958 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48216.log 2023-11-24T06:34:08.959 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46556.log.gz 2023-11-24T06:34:08.960 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2023-11-24T06:34:08.960 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53750.log.gz 2023-11-24T06:34:08.960 INFO:teuthology.orchestra.run.smithi143.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T06:34:08.961 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2023-11-24T06:34:08.962 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48216.log.gz 2023-11-24T06:34:08.962 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51249.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2023-11-24T06:34:08.963 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56167.log 2023-11-24T06:34:08.964 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49155.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2023-11-24T06:34:08.964 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51643.log 2023-11-24T06:34:08.965 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56167.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56167.log.gz 2023-11-24T06:34:08.966 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2023-11-24T06:34:08.967 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51643.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51643.log.gz 2023-11-24T06:34:08.967 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52272.log 2023-11-24T06:34:08.968 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48892.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2023-11-24T06:34:08.968 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55073.log 2023-11-24T06:34:08.970 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2023-11-24T06:34:08.970 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52272.log.gz 2023-11-24T06:34:08.971 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55073.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55073.log.gz 2023-11-24T06:34:08.971 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51327.log 2023-11-24T06:34:08.972 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44577.log 2023-11-24T06:34:08.973 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gz 2023-11-24T06:34:08.974 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51327.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51327.log.gz 2023-11-24T06:34:08.974 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49640.log 2023-11-24T06:34:08.974 INFO:teuthology.orchestra.run.smithi146.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T06:34:08.976 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44577.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44577.log.gz 2023-11-24T06:34:08.976 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56399.log 2023-11-24T06:34:08.977 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49640.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49640.log.gz 2023-11-24T06:34:08.977 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56269.log 2023-11-24T06:34:08.978 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56399.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:34:08.978 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56399.log.gz 2023-11-24T06:34:08.980 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2023-11-24T06:34:08.980 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56269.log.gz 2023-11-24T06:34:08.981 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52298.log 2023-11-24T06:34:08.983 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49188.log: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:34:08.983 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2023-11-24T06:34:08.983 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2023-11-24T06:34:08.984 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50299.log 2023-11-24T06:34:08.984 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52298.log.gz 2023-11-24T06:34:08.985 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53172.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz 2023-11-24T06:34:08.985 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54022.log 2023-11-24T06:34:08.987 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50299.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50299.log.gzgzip 2023-11-24T06:34:08.987 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56503.log 2023-11-24T06:34:08.989 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47790.log 2023-11-24T06:34:08.989 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54022.log.gz 2023-11-24T06:34:08.990 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56503.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56503.log.gz 2023-11-24T06:34:08.990 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54993.log 2023-11-24T06:34:08.992 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47790.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47790.log.gz 2023-11-24T06:34:08.992 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2023-11-24T06:34:08.993 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T06:34:08.993 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54074.log 2023-11-24T06:34:08.993 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54993.log.gz 2023-11-24T06:34:08.994 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54538.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2023-11-24T06:34:08.995 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50759.log 2023-11-24T06:34:08.995 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-11-24T06:34:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m0.381s 2023-11-24T06:34:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m1.723s 2023-11-24T06:34:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.176s 2023-11-24T06:34:08.997 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53305.log 2023-11-24T06:34:08.997 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54074.log.gz 2023-11-24T06:34:08.997 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50759.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50759.log.gz 2023-11-24T06:34:08.997 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53802.log 2023-11-24T06:34:08.998 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53305.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53305.log.gz 2023-11-24T06:34:08.999 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2023-11-24T06:34:09.000 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53802.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53802.log.gz 2023-11-24T06:34:09.000 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2023-11-24T06:34:09.001 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44562.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz --verbose 2023-11-24T06:34:09.002 INFO:teuthology.orchestra.run.smithi143.stderr: -- /var/log/ceph/ceph-client.admin.52587.log 2023-11-24T06:34:09.003 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2023-11-24T06:34:09.003 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2023-11-24T06:34:09.005 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55299.log 2023-11-24T06:34:09.005 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52587.log.gz 2023-11-24T06:34:09.006 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2023-11-24T06:34:09.006 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2023-11-24T06:34:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.55299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55299.log.gz 2023-11-24T06:34:09.007 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2023-11-24T06:34:09.008 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49101.log 2023-11-24T06:34:09.009 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2023-11-24T06:34:09.010 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50441.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2023-11-24T06:34:09.010 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51012.log 2023-11-24T06:34:09.012 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50960.log 2023-11-24T06:34:09.012 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gz 2023-11-24T06:34:09.013 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52111.log 2023-11-24T06:34:09.013 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51012.log.gz 2023-11-24T06:34:09.015 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56373.log 2023-11-24T06:34:09.015 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50960.log.gz 2023-11-24T06:34:09.016 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52111.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52111.log.gzgzip 2023-11-24T06:34:09.016 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2023-11-24T06:34:09.018 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56373.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56373.log.gz 2023-11-24T06:34:09.018 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44573.log 2023-11-24T06:34:09.019 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log 2023-11-24T06:34:09.019 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2023-11-24T06:34:09.020 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44573.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44573.log.gz 2023-11-24T06:34:09.020 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50733.log 2023-11-24T06:34:09.021 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2023-11-24T06:34:09.022 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48496.log 2023-11-24T06:34:09.024 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50733.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50733.log.gz 2023-11-24T06:34:09.024 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55203.log 2023-11-24T06:34:09.025 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48496.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48496.log.gz 2023-11-24T06:34:09.025 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45948.log 2023-11-24T06:34:09.026 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54486.log 2023-11-24T06:34:09.027 INFO:teuthology.orchestra.run.smithi143.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55203.log.gz 2023-11-24T06:34:09.028 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45948.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45948.log.gz 2023-11-24T06:34:09.028 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50219.log 2023-11-24T06:34:09.029 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54616.log 2023-11-24T06:34:09.029 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54486.log.gz 2023-11-24T06:34:09.030 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50219.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50219.log.gz 2023-11-24T06:34:09.031 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55253.log 2023-11-24T06:34:09.032 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54616.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54616.log.gz 2023-11-24T06:34:09.032 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55395.log 2023-11-24T06:34:09.034 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55253.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55253.log.gz 2023-11-24T06:34:09.034 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-11-24T06:34:09.035 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55395.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.55395.log.gz 2023-11-24T06:34:09.035 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50707.log 2023-11-24T06:34:09.037 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47219.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2023-11-24T06:34:09.037 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50337.log 2023-11-24T06:34:09.038 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55731.log 2023-11-24T06:34:09.038 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50707.log.gz 2023-11-24T06:34:09.040 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48553.log 2023-11-24T06:34:09.040 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50337.log.gz 2023-11-24T06:34:09.041 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52403.log 2023-11-24T06:34:09.042 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55731.log.gz 2023-11-24T06:34:09.043 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48553.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48553.log.gz 2023-11-24T06:34:09.043 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52691.log 2023-11-24T06:34:09.044 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2023-11-24T06:34:09.044 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52403.log.gz 2023-11-24T06:34:09.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-24T06:34:09.045 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52691.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52691.log.gz 2023-11-24T06:34:09.046 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54460.log 2023-11-24T06:34:09.047 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2023-11-24T06:34:09.047 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2023-11-24T06:34:09.048 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54460.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54460.log.gz 2023-11-24T06:34:09.048 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46312.log 2023-11-24T06:34:09.049 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46130.log 2023-11-24T06:34:09.050 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz 2023-11-24T06:34:09.050 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46312.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46312.log.gz 2023-11-24T06:34:09.051 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2023-11-24T06:34:09.052 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46130.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46130.log.gz 2023-11-24T06:34:09.052 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48840.log 2023-11-24T06:34:09.054 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56659.log 2023-11-24T06:34:09.054 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2023-11-24T06:34:09.055 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48840.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48840.log.gz 2023-11-24T06:34:09.055 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48970.log 2023-11-24T06:34:09.056 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47630.log 2023-11-24T06:34:09.056 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56659.log.gz 2023-11-24T06:34:09.058 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47816.log 2023-11-24T06:34:09.058 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48970.log.gz 2023-11-24T06:34:09.059 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50158.log 88.0% 2023-11-24T06:34:09.059 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47630.log.gz 2023-11-24T06:34:09.061 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47816.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:34:09.061 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47816.log.gz 2023-11-24T06:34:09.062 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50158.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50158.log.gz 2023-11-24T06:34:09.062 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55047.log 2023-11-24T06:34:09.063 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46608.log 2023-11-24T06:34:09.064 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55047.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55047.log.gz 2023-11-24T06:34:09.065 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2023-11-24T06:34:09.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46608.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:34:09.066 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46608.log.gz 2023-11-24T06:34:09.066 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T06:34:09.068 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47297.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2023-11-24T06:34:09.068 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53689.log 2023-11-24T06:34:09.069 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54799.log 2023-11-24T06:34:09.071 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55421.log 2023-11-24T06:34:09.071 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53689.log.gz 2023-11-24T06:34:09.072 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54799.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T06:34:09.072 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54799.log.gz 2023-11-24T06:34:09.074 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54747.log 2023-11-24T06:34:09.074 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55421.log.gz 2023-11-24T06:34:09.075 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47604.log 2023-11-24T06:34:09.077 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2023-11-24T06:34:09.077 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54747.log.gz 2023-11-24T06:34:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47604.log.gz 2023-11-24T06:34:09.078 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2023-11-24T06:34:09.079 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52717.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2023-11-24T06:34:09.080 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56347.log 2023-11-24T06:34:09.081 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2023-11-24T06:34:09.082 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2023-11-24T06:34:09.083 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51859.log 2023-11-24T06:34:09.083 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56347.log.gz 2023-11-24T06:34:09.084 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47894.log 2023-11-24T06:34:09.084 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2023-11-24T06:34:09.086 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49986.log 2023-11-24T06:34:09.086 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51859.log.gz 2023-11-24T06:34:09.087 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2023-11-24T06:34:09.087 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47894.log.gz 2023-11-24T06:34:09.088 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2023-11-24T06:34:09.089 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49986.log.gz 2023-11-24T06:34:09.090 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52533.log 2023-11-24T06:34:09.090 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2023-11-24T06:34:09.091 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2023-11-24T06:34:09.091 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2023-11-24T06:34:09.093 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46156.log 2023-11-24T06:34:09.093 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52533.log.gz 2023-11-24T06:34:09.094 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51975.log 2023-11-24T06:34:09.094 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2023-11-24T06:34:09.096 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47498.log 2023-11-24T06:34:09.096 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46156.log.gz 2023-11-24T06:34:09.097 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47089.log 2023-11-24T06:34:09.097 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51975.log.gz 2023-11-24T06:34:09.098 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2023-11-24T06:34:09.099 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47498.log.gz 2023-11-24T06:34:09.100 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56581.log 2023-11-24T06:34:09.100 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47089.log.gz 2023-11-24T06:34:09.101 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52026.log 2023-11-24T06:34:09.101 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2023-11-24T06:34:09.103 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49508.log 2023-11-24T06:34:09.103 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56581.log.gz 2023-11-24T06:34:09.104 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46234.log 2023-11-24T06:34:09.104 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52026.log.gz 2023-11-24T06:34:09.106 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49508.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49508.log.gz 2023-11-24T06:34:09.106 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49586.log 2023-11-24T06:34:09.107 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46234.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.46234.log.gz 2023-11-24T06:34:09.107 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54285.log 2023-11-24T06:34:09.109 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53253.log 2023-11-24T06:34:09.109 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2023-11-24T06:34:09.110 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55177.log 2023-11-24T06:34:09.110 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54285.log.gz 2023-11-24T06:34:09.111 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53253.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53253.log.gz 2023-11-24T06:34:09.112 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2023-11-24T06:34:09.113 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55177.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55177.log.gz 2023-11-24T06:34:09.113 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50249.log 2023-11-24T06:34:09.115 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50576.log 2023-11-24T06:34:09.115 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2023-11-24T06:34:09.116 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44978.log 2023-11-24T06:34:09.116 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50249.log.gz 2023-11-24T06:34:09.118 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2023-11-24T06:34:09.118 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50576.log.gz 2023-11-24T06:34:09.119 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44978.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44978.log.gz /var/log/ceph/ceph-client.admin.52351.log 2023-11-24T06:34:09.120 INFO:teuthology.orchestra.run.smithi143.stderr: 2023-11-24T06:34:09.120 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50132.log 2023-11-24T06:34:09.121 INFO:teuthology.orchestra.run.smithi143.stderr: 91.2%/var/log/ceph/ceph-client.admin.52351.log: -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2023-11-24T06:34:09.122 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52351.log.gz 2023-11-24T06:34:09.123 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50132.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50132.log.gz 2023-11-24T06:34:09.124 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2023-11-24T06:34:09.125 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51539.log 2023-11-24T06:34:09.125 INFO:teuthology.orchestra.run.smithi143.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T06:34:09.127 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2023-11-24T06:34:09.127 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2023-11-24T06:34:09.128 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45303.log 2023-11-24T06:34:09.128 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51539.log.gz 2023-11-24T06:34:09.130 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2023-11-24T06:34:09.130 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2023-11-24T06:34:09.131 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38106.log 2023-11-24T06:34:09.131 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45303.log.gz 2023-11-24T06:34:09.132 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49480.log 2023-11-24T06:34:09.133 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2023-11-24T06:34:09.134 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2023-11-24T06:34:09.134 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38106.log.gz 2023-11-24T06:34:09.135 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54512.log 2023-11-24T06:34:09.136 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49480.log.gz 2023-11-24T06:34:09.137 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44781.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2023-11-24T06:34:09.137 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2023-11-24T06:34:09.138 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54512.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54512.log.gz 2023-11-24T06:34:09.139 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53056.log 2023-11-24T06:34:09.140 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56555.log 2023-11-24T06:34:09.140 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2023-11-24T06:34:09.141 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53435.log 2023-11-24T06:34:09.142 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53056.log.gz 2023-11-24T06:34:09.142 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T06:34:09.143 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2023-11-24T06:34:09.143 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56555.log.gz 2023-11-24T06:34:09.144 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53625.log 2023-11-24T06:34:09.145 INFO:teuthology.orchestra.run.smithi143.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53435.log.gz 2023-11-24T06:34:09.145 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50104.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2023-11-24T06:34:09.146 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50837.log 2023-11-24T06:34:09.147 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55810.log 2023-11-24T06:34:09.147 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53625.log.gz 2023-11-24T06:34:09.148 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50837.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50837.log.gz 2023-11-24T06:34:09.148 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2023-11-24T06:34:09.150 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55810.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55810.log.gz 2023-11-24T06:34:09.150 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55021.log 2023-11-24T06:34:09.151 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54773.log 2023-11-24T06:34:09.151 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2023-11-24T06:34:09.152 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55021.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55021.log.gz 2023-11-24T06:34:09.153 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2023-11-24T06:34:09.154 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54773.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54773.log.gz 2023-11-24T06:34:09.154 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53110.log 2023-11-24T06:34:09.155 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44977.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz 2023-11-24T06:34:09.155 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56711.log 2023-11-24T06:34:09.156 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47920.log 2023-11-24T06:34:09.157 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53110.log.gz 2023-11-24T06:34:09.158 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56711.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56711.log.gz 2023-11-24T06:34:09.158 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51038.log 2023-11-24T06:34:09.159 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47920.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47920.log.gz 2023-11-24T06:34:09.160 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46985.log 2023-11-24T06:34:09.161 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51038.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51038.log.gz 2023-11-24T06:34:09.161 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46824.log 2023-11-24T06:34:09.162 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46985.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46985.log.gz 2023-11-24T06:34:09.163 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2023-11-24T06:34:09.164 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46824.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46824.log.gz 2023-11-24T06:34:09.164 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55369.log 2023-11-24T06:34:09.165 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55940.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2023-11-24T06:34:09.166 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51885.log 2023-11-24T06:34:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55369.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55369.log.gz 2023-11-24T06:34:09.167 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2023-11-24T06:34:09.169 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51885.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51885.log.gz 2023-11-24T06:34:09.169 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2023-11-24T06:34:09.170 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46078.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz 2023-11-24T06:34:09.170 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2023-11-24T06:34:09.171 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2023-11-24T06:34:09.172 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2023-11-24T06:34:09.172 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52324.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2023-11-24T06:34:09.173 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47842.log 2023-11-24T06:34:09.174 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2023-11-24T06:34:09.175 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55492.log 2023-11-24T06:34:09.176 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47842.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47842.log.gz 2023-11-24T06:34:09.176 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49364.log 2023-11-24T06:34:09.177 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55492.log: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T06:34:09.177 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55492.log.gz 2023-11-24T06:34:09.178 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2023-11-24T06:34:09.179 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53138.log 2023-11-24T06:34:09.179 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49364.log.gz 2023-11-24T06:34:09.180 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55099.log 2023-11-24T06:34:09.180 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2023-11-24T06:34:09.181 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53138.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53138.log.gz 2023-11-24T06:34:09.181 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44419.log 2023-11-24T06:34:09.182 INFO:teuthology.orchestra.run.smithi143.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T06:34:09.182 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47656.log 2023-11-24T06:34:09.183 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55099.log.gz 2023-11-24T06:34:09.183 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44419.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44419.log.gz 2023-11-24T06:34:09.184 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2023-11-24T06:34:09.184 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2023-11-24T06:34:09.184 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47656.log.gz 2023-11-24T06:34:09.185 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46470.log 2023-11-24T06:34:09.185 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2023-11-24T06:34:09.186 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2023-11-24T06:34:09.186 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2023-11-24T06:34:09.187 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46470.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46470.log.gz 2023-11-24T06:34:09.188 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44497.log 2023-11-24T06:34:09.188 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2023-11-24T06:34:09.188 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2023-11-24T06:34:09.189 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44497.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44497.log.gz 2023-11-24T06:34:09.190 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56477.log 2023-11-24T06:34:09.190 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47946.log 2023-11-24T06:34:09.190 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2023-11-24T06:34:09.191 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2023-11-24T06:34:09.191 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56477.log.gz 2023-11-24T06:34:09.192 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44101.log 2023-11-24T06:34:09.192 INFO:teuthology.orchestra.run.smithi143.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47946.log.gz 2023-11-24T06:34:09.193 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47375.log 2023-11-24T06:34:09.193 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2023-11-24T06:34:09.194 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44101.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44101.log.gz 2023-11-24T06:34:09.194 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45355.log 2023-11-24T06:34:09.195 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52085.log 2023-11-24T06:34:09.195 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47375.log.gz 2023-11-24T06:34:09.196 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52743.log 2023-11-24T06:34:09.196 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45355.log.gz 2023-11-24T06:34:09.197 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52085.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52085.log.gz 2023-11-24T06:34:09.197 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46338.log 2023-11-24T06:34:09.198 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51435.log 2023-11-24T06:34:09.198 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52743.log.gz 2023-11-24T06:34:09.199 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46338.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33254.log 2023-11-24T06:34:09.199 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46338.log.gz 2023-11-24T06:34:09.200 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54851.log 2023-11-24T06:34:09.200 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51435.log.gz 2023-11-24T06:34:09.201 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.tmp-client.admin.33254.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33254.log.gz 2023-11-24T06:34:09.201 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55914.log 2023-11-24T06:34:09.202 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54851.log: gzip -5 --verbose 88.6% -- /var/log/ceph/ceph-client.admin.54701.log -- replaced with /var/log/ceph/ceph-client.admin.54851.log.gz 2023-11-24T06:34:09.202 INFO:teuthology.orchestra.run.smithi143.stderr: 2023-11-24T06:34:09.203 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54941.log 2023-11-24T06:34:09.203 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55914.log.gz 2023-11-24T06:34:09.203 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2023-11-24T06:34:09.204 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2023-11-24T06:34:09.204 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44981.log 2023-11-24T06:34:09.204 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54941.log.gz 2023-11-24T06:34:09.205 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49312.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2023-11-24T06:34:09.205 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50524.log 2023-11-24T06:34:09.206 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55518.log 2023-11-24T06:34:09.207 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44981.log.gz 2023-11-24T06:34:09.207 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50524.log.gz 2023-11-24T06:34:09.208 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56044.log 2023-11-24T06:34:09.208 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.55518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46907.log 2023-11-24T06:34:09.209 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55518.log.gz 2023-11-24T06:34:09.210 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44367.log 2023-11-24T06:34:09.210 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56044.log.gz 2023-11-24T06:34:09.210 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46907.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46907.log.gz 2023-11-24T06:34:09.211 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44367.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44367.log.gz 2023-11-24T06:34:09.255 INFO:teuthology.orchestra.run.smithi143.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T06:34:09.259 INFO:teuthology.orchestra.run.smithi143.stderr: 2023-11-24T06:34:09.259 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m0.687s 2023-11-24T06:34:09.259 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m2.250s 2023-11-24T06:34:09.259 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m1.036s 2023-11-24T06:34:09.259 INFO:tasks.ceph:Archiving logs... 2023-11-24T06:34:09.260 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/remote/smithi143/log 2023-11-24T06:34:09.261 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:34:09.877 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/remote/smithi146/log 2023-11-24T06:34:09.878 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:34:10.087 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T06:34:10.097 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T06:34:10.097 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:34:10.101 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:34:10.191 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T06:34:10.203 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T06:34:10.204 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:34:10.207 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:34:10.218 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T06:34:10.219 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2023-11-24T06:34:10.219 INFO:teuthology.orchestra.run.smithi143.stdout:+hv01.front.sepi 67.205.162.81 3 u 33 64 377 0.134 -2.853 1.321 2023-11-24T06:34:10.219 INFO:teuthology.orchestra.run.smithi143.stdout:+hv02.front.sepi 63.231.80.2 3 u 26 64 377 0.163 +1.089 1.298 2023-11-24T06:34:10.219 INFO:teuthology.orchestra.run.smithi143.stdout:*hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.127 -0.544 1.393 2023-11-24T06:34:10.219 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:34:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T06:34:10.223 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-11-24T06:34:10.224 INFO:teuthology.orchestra.run.smithi146.stdout:+hv01.front.sepi 67.205.162.81 3 u 32 64 377 0.074 -4.699 1.429 2023-11-24T06:34:10.224 INFO:teuthology.orchestra.run.smithi146.stdout:*hv02.front.sepi 63.231.80.2 3 u 34 64 377 0.092 +0.881 1.175 2023-11-24T06:34:10.224 INFO:teuthology.orchestra.run.smithi146.stdout:+hv03.front.sepi 74.6.168.72 3 u 32 64 377 0.072 -0.292 1.502 2023-11-24T06:34:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T06:34:10.225 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T06:34:10.237 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T06:34:10.237 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T06:34:10.265 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T06:34:10.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T06:34:10.332 INFO:teuthology.task.internal:Duration was 1018.189878 seconds 2023-11-24T06:34:10.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T06:34:10.364 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T06:34:10.365 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:34:10.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:34:10.458 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T06:34:10.458 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2023-11-24T06:34:10.458 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:34:10.480 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-11-24T06:34:10.480 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:34:10.503 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T06:34:10.503 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:34:10.528 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:34:10.583 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T06:34:10.583 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:34:10.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:34:10.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T06:34:10.701 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T06:34:10.702 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:34:10.722 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:34:10.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T06:34:10.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:34:10.767 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:34:10.782 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2023-11-24T06:34:10.802 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-11-24T06:34:10.821 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:34:10.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:34:10.852 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:34:10.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:34:10.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T06:34:10.883 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T06:34:10.884 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/remote/smithi143 2023-11-24T06:34:10.884 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:34:10.922 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560/remote/smithi146 2023-11-24T06:34:10.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:34:10.951 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T06:34:10.952 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:34:10.967 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:34:10.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T06:34:11.008 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T06:34:11.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T06:34:11.032 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T06:34:11.032 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:34:11.036 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:34:11.041 INFO:teuthology.orchestra.run.smithi143.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:34 /home/ubuntu/cephtest 2023-11-24T06:34:11.049 INFO:teuthology.orchestra.run.smithi146.stdout: 658044 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:34 /home/ubuntu/cephtest 2023-11-24T06:34:11.051 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T06:34:11.066 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T06:34:11.133 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T06:34:11.159 DEBUG:teuthology.nuke:shortname: smithi143 2023-11-24T06:34:11.159 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:34:11.185 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 06:06:24.045567', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK571X5v8ybfW5xaL+9/jOldn0g12dbfgwdijBi196/sFnv87ZXK97WAtjgWmgzjyeqIfimHl2sjI2RS/LUwCEw='} 2023-11-24T06:34:11.189 DEBUG:teuthology.nuke:shortname: smithi146 2023-11-24T06:34:11.190 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:34:11.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 06:06:24.046853', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN9RtF/LioMP8wF1Nn2EjNcSH9NOw6hdoWdwoIe+zgllor3fduKAXMcHtderaomSnjMpfFLiTZIei5/RJwWCvk8='} 2023-11-24T06:34:11.238 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-24T06:34:11.238 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:34:11.265 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-24T06:34:11.265 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:11.282 INFO:teuthology.orchestra.console.smithi146:Power off 2023-11-24T06:34:11.282 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:34:11.292 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-24T06:34:11.304 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-11-24T06:34:11.305 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:11.326 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-11-24T06:34:15.293 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:15.327 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:15.403 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-24T06:34:15.437 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-11-24T06:34:19.405 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:19.438 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:19.516 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-24T06:34:19.548 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-11-24T06:34:23.518 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:23.550 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:34:23.628 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-24T06:34:23.660 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-11-24T06:34:23.730 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-24T06:34:23.761 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-11-24T06:34:23.866 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} duration: 1018.1898782253265 failure_reason: 'Test failure: test_subvolume_inherited_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeSnapshots)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=04d178ee2afc47128db1d96d81ff10d2 status: fail success: false 2023-11-24T06:34:23.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T06:34:23.984 INFO:teuthology.run:FAIL